FinReportBench: New benchmark evaluates LLM quality for institutional financi...

New benchmark tests LLMs on financial statement verification accuracy

HQ arXiv: AI + Accounting arXiv · 2mo ago · 1 min read

FinVerBench evaluates 15 LLMs on numerical consistency checks in SEC 10-K filings, introducing error taxonomy across arithmetic, linkage, and magnitude categories to measure AI readiness for financ...

Researchers propose LEDGER framework to audit LLM agent workflows

HQ arXiv: AI + Accounting arXiv · 5d ago · 1 min read

LEDGER introduces claim-to-evidence trace graphs to make LLM agent outputs auditable, addressing the challenge of verifying correctness in autonomous workflows that execute code, edit files, and ge...

LLMs lower audit standards when primed with repair context, study finds

HQ arXiv: AI + Accounting arXiv · 7d ago · 1 min read

Research on ProcessBench traces reveals LLMs soften audit verification thresholds by 2.8–11.5 percentage points when prior repair episodes are in context, reducing false alarms across 15 model vari...

Open-weight LLM fine-tuned with reinforcement learning beats commercial model...

HQ arXiv: AI + Accounting arXiv · 11d ago · 1 min read

Researchers develop GRPO-fine-tuned language model that outperforms GPT-4 and Claude on financial advice generation from business records, using reinforcement learning to improve numerical reasonin...

Study proposes verification-cost metric to evaluate AI reliability in accounting

HQ arXiv: AI + Accounting arXiv · 14d ago · 1 min read

Researchers argue AI model evaluation for accounting must measure verification effort, not just correctness—identifying a new failure mode where auditors miss errors within budget constraints.