OpenAI Introduces BioBasicsBench for Wet-Lab Agents
OpenAI and enzyme-design biotech Ligo introduced BioBasicsBench, a 100-task benchmark built from real wet-lab experiments. It tests whether AI agents can interpret raw data, spot errors, and recognize when evidence does not support a conclusion; GPT-6 Astra scored 66.7% at xhigh reasoning.
BioBasicsBench is a meaningful shift from clean academic questions toward the messy evidence scientists actually handle, though a 66.7% score still leaves agents far from dependable lab assistance.
- –Covers gels, microscopy, sequencing, instrument exports, colony plates, protocols, and bench videos across five wet-lab domains
- –Uses expert-reviewed rubrics with partial credit for conclusions, measurements, reasoning, and recognizing insufficient evidence
- –GPT-6 Astra’s 22.9-point lead over GPT-5.6 Sol suggests multimodal capability matters more than simply generating longer answers
- –The benchmark exposes practical failure modes around controls, image interpretation, calibration, and experimental context
- –Its real-world task construction makes it a useful complement to knowledge-heavy biology benchmarks
DISCOVERED
13m ago
2026-11-06
PUBLISHED
1h ago
2026-11-06
RELEVANCE
AUTHOR
OpenAI