Chroma drops Context Rot long-context benchmark

This is a useful correction to the “just buy more context window” narrative, because it isolates input length as the variable and still shows degradation.

• –The benchmark goes beyond vanilla Needle-in-a-Haystack by testing semantic similarity, distractors, and haystack structure.
• –Results suggest long-context quality failures are model-family specific, not a single universal error mode.
• –Reproducible code and experiment folders make it practical for dev teams to run pre-deployment reliability checks.
• –The biggest takeaway for builders: long context is a systems problem (retrieval quality, prompt structure, eval discipline), not just a model spec-sheet number.