arXiv research proposes architectural tactics for deploying agentic AI in regulated contexts like accounting, emphasizing how autonomy and agency must be coupled to maintain compliance and human ov...
Academic paper introduces Counterfactual Trace Auditing to evaluate how skills change LLM agent behavior beyond simple pass/fail metrics, enabling deeper accountability in deployed accounting agents.
Research paper proposes digital identity and authorization framework for autonomous agents operating across organizational boundaries, with enterprise accounting use cases including insurance claim...
Retrospective analysis of privacy-aware Codabench competition on multi-agent orchestration for asset operations shows how hidden evaluation metrics shaped winning approaches in industrial accountin...
Researchers propose DPA-GRPO, a paired-action training method to make LLMs more reliable for structured accounting workflows like form filling and compliance checking by ensuring outputs are locall...
Academic paper proposes anytime-valid statistical guarantees for adaptive auditing of generative AI systems, addressing the bottleneck of costly manual annotation in characterizing AI failure modes.
Researchers introduce FakeWiki benchmark and "pinpoint provenance" method to help auditors identify which source documents support LLM responses, addressing a key challenge in AI accountability for...
Researchers release AuditRepairBench, a 576K-cell corpus revealing how evaluator configurations cause AI repair leaderboards to reorder, addressing methodological failures in agent-based accounting...
Researchers present automated framework using Snowflake Document AI to extract structured data from millions of unstructured PDF statements, replacing labor-intensive manual audit sampling with sca...
Research identifies a critical vulnerability in AI auditing: systems verbally agree to process instructions but systematically disobey them, creating risks for financial audits relying on procedura...
Research reveals OpenClaw, a widely-used agentic-AI gateway, catches zero of four critical audit failures (gate-bypass, audit-forgery, silent host failure, wrong-target) on a 1,600-sample test—expo...
Semia framework uses constraint-guided synthesis to audit LLM agent skills—hybrid code-prose configurations—addressing blind spots in conventional static analyzers when agents execute financial or ...
Research introduces CA-ThinkFlow, an LLM framework designed to handle jurisdiction-specific chartered accountancy tasks including multi-step numerical reasoning and regulatory compliance without re...
Claw-Eval-Live introduces a live benchmark for testing LLM agents on evolving accounting and business workflows, addressing limitations of static task sets in existing evaluations.
Claw-Eval-Live introduces a live benchmark for evaluating LLM agents performing real-world accounting and business tasks across multiple software tools, addressing limitations of static benchmarks.
Academic research exposes how rubric wording and metric choice skew NLP benchmarks used to evaluate LLMs on earnings calls and financial disclosures, risking poor model selection for financial repo...
Research paper proposes detection and mitigation framework for model drift in AI systems, relevant to auditing AI-powered accounting tools but lacks accounting-specific case studies or validation.
AI agents designed for financial tasks like trading and auditing are failing most real-world Wall Street tests, revealing significant gaps between hype and practical performance.
New benchmark evaluates LLM reliability for deterministic tasks like invoice extraction and transcript parsing—critical for automation workflows in accounting and bookkeeping.
Survey finds 74% of small business owners use AI tools monthly with 58% reporting increased happiness; CPAs seeing adoption of AI drive autonomy and resilience in practice management.