DELEGATE-52 Shows LLMs Corrupt Documents
DELEGATE-52 is a new benchmark for long-horizon delegated document editing across 52 professional domains. Testing 19 models in 310 real work environments, the paper finds even frontier LLMs silently corrupt about 25% of document content by the end of extended workflows.
This is a sharp reminder that “agentic” doesn’t mean trustworthy, especially when the task is editing rather than generating. The failure mode is not dramatic hallucination; it’s quiet accumulation of small errors that compounds over time.
- –The benchmark’s breadth matters: 52 domains makes this a delegation test, not a niche doc-cleanup demo
- –Tool use alone did not fix the problem, so more actions without better verification just create faster corruption
- –Sparse, silent errors are the dangerous part because they are hard for users to notice until damage has spread
- –For real workflows, guardrails like diff checks, validation, and rollback matter more than extra autonomy
- –The result should push teams to treat LLMs as assistive editors, not trusted delegates
DISCOVERED
95d ago
2026-04-29
PUBLISHED
95d ago
2026-04-29
RELEVANCE
AUTHOR
AlphaSignalAI