New research introduces FinRank, a benchmark for evaluating AI systems on financial question answering over SEC filings, focusing on evidence provenance rather than answer correctness alone.
Researchers introduce A²E (Agent Auditing Engine), an end-to-end evaluation framework for assessing LLM agent capabilities across domains, addressing the gap in systematic auditing of complex agent...
Research on role-differentiated LLM agents for audit resource allocation shows that distributing triage decisions across multiple agents can paradoxically worsen demographic bias outcomes compared ...
Research paper introduces trace-grounded parametric profiling to expose video language model failures in event counting tasks—a core requirement for automated audit and bookkeeping workflows.
arXiv paper argues top-k embedding retrieval fails on financial statements and audit reports; proposes interpretable agentic operations for structured financial document analysis.
Researchers propose interpretable agentic operations over traditional embedding-based retrieval for financial documents, showing top-k methods fail on 780-page government reports where 86.8% of con...
Academic paper proposes methods to detect errors in autonomous data analysis agents used in audits, addressing reliability gaps in unsupervised error detection systems.
Academic scoping review of 4,259 documents reveals AI audits focused on individual models miss integration risks—drawing lessons from aerospace safety-critical auditing for accounting and complianc...
Researchers introduce FinReportBench, an expert-grounded benchmark measuring LLM-generated financial report quality for institutional use, identifying gaps in identity, compliance, sourcing, and vi...
FRAMES framework helps LLM agents improve at policy-bound tasks like document auditing by evolving skills from existing assets while preserving auditability and rule consistency—addressing the chal...
Research reveals systematic validity problems in automated benchmarks evaluating agentic AI systems, with audits finding flaws in 7 of 10 popular benchmarks—raising questions about safety certifica...
Academic paper proposes optimal allocation strategy for auditing LLM agent fleets with limited human budget, identifying miscalibration thresholds where confidence-based auditing underperforms rand...
Aprio, a $681M accounting firm, expands collaboration with Fieldguide to develop role-specific AI agents for financial audits across planning, fieldwork, and reporting phases.
Deloitte debuts ControlCatalyst.AI, an AI tool designed to automate risk identification and enhance audit quality through smarter insights and resource optimization.
Aprio partners with Fieldguide to integrate agentic AI into audit processes, expanding a pilot program that began in 2023 into a full platform agreement.
Former Deloitte auditor releases open-source SOC 2 methodology, enabling AI companies to self-audit and streamline compliance — bridging audit expertise with AI accessibility.
Researcher proposes adapting food safety's HACCP methodology to create an auditable self-control standard for AI, bridging compliance gaps in automated systems used by auditors and accountants.
Luca IQ debuts tax software with IRS e-file approval while Workday and Cherry Hill Advisory roll out AI agents for audit and tax work.
AccountingWeb/DataSnipper showcase 8 concrete examples of AI systems performing live accounting and audit work, moving beyond pilots to production deployment.
PwC's AI systems are producing hallucinated leadership reports with fabricated details and false information, exposing risks in deploying large language models for audit and compliance work without...