
mdlARC Scores 44% on ARC-AGI for 67 Cents
Mithil Vakde’s open-source mdlARC reaches 44% on ARC-AGI-1 using a 75M-parameter transformer trained from scratch on a single RTX 5090. The benchmark result matches more complex systems while costing roughly 67 cents and also reaches 7% on ARC-AGI-2.
mdlARC is a compelling sample-efficiency result, but its benchmark specialization should not be confused with general reasoning.
- –Uses 3D RoPE, per-task embeddings, data augmentation, and test-time training to improve ARC performance.
- –The standard transformer architecture challenges the assumption that ARC requires elaborate recursive designs.
- –Ablations suggest representation choices matter more than raw scale, with several removals dropping performance sharply.
- –Its low compute cost makes rapid experimentation accessible to individual researchers.
- –The result remains limited by public-benchmark optimization and does not establish broad generalization.
DISCOVERED
12d ago
2026-09-01
PUBLISHED
12d ago
2026-09-01
RELEVANCE
AUTHOR
porridgeraisin