Researchers develop auditing framework to measure LLM agent skill impact

Study reveals LLM agent credit signals fail to identify causally important steps

HQ arXiv: AI + Accounting arXiv · 3d ago · 1 min read

Research auditing step-level credit assignment in LLM agents finds that LLM-judge scores, logprob ratios, and confidence signals fail to identify which steps actually matter better than chance when...

Researchers propose LEDGER framework to audit LLM agent workflows

HQ arXiv: AI + Accounting arXiv · 5d ago · 1 min read

LEDGER introduces claim-to-evidence trace graphs to make LLM agent outputs auditable, addressing the challenge of verifying correctness in autonomous workflows that execute code, edit files, and ge...

LLMs lower audit standards when primed with repair context, study finds

HQ arXiv: AI + Accounting arXiv · 7d ago · 1 min read

Research on ProcessBench traces reveals LLMs soften audit verification thresholds by 2.8–11.5 percentage points when prior repair episodes are in context, reducing false alarms across 15 model vari...

New XAI method aids auditing of opaque AI systems in accounting

HQ arXiv: AI + Accounting arXiv · 12d ago · 1 min read

Researchers propose 'Rule of Thumb' explainability framework to interpret AI decisions using partial information, with applications to LLM classification and AI system audits—relevant for accountan...

Large Language Models Automate IT Audit Control Evaluation

HQ arXiv: AI + Accounting arXiv · 16d ago · 1 min read

IntelliAudit uses retrieval-grounded multi-agent LLMs to automate IT audit evidence evaluation by synthesizing heterogeneous organizational data across policies and records—addressing the semantic ...