Appen Research validates SubQ 1.1 12M-token retrieval
Appen Research has conducted an independent evaluation of Subquadratic's SubQ 1.1 Small Preview model on Needle In A Haystack (NIAH) benchmarks spanning 1 million to 12 million tokens, as well as on LiveCodeBench. SubQ 1.1 Small Preview is built on a subquadratic sparse attention architecture, which is designed to process massive context windows with significantly lower compute requirements and higher inference speeds compared to standard transformer models.
Third-party validation from Appen is a significant milestone for Subquadratic AI, helping to dispel skepticism around the real-world viability of their non-transformer architecture.
- –Independent benchmarks are crucial for validating claims of linear scaling and near-perfect retrieval across multi-million token contexts.
- –Demonstrating high-fidelity retrieval up to 12 million tokens positions SubQ as a highly competitive alternative to frontier transformers for large-scale codebase analysis.
- –The model's success on LiveCodeBench indicates that efficiency gains do not immediately come at the cost of coding capabilities.
DISCOVERED
50d ago
2026-06-16
PUBLISHED
50d ago
2026-06-16
RELEVANCE
AUTHOR
subquadratic