Reddit crowdsources human-vs-AI intelligence benchmark

The broader effort reflects frustration with benchmarks like MMLU, which are increasingly vulnerable to contamination and over-optimization. Crowdsourcing essential questions turns the idea into a more resilient live benchmark by forcing synthesis rather than retrieval. Theory of Mind is treated as the key separator, while novel constraints like lipograms and metacognition probes are meant to surface model blind spots.