Researchers audit LLM consistency on real venture-financing documents
Probity benchmark reveals LLMs give inconsistent answers on identical accounting queries 60+ times; researchers identify systematic defect where evidence is hidden from model's visible context window.