Trace launches live benchmark for scraping APIs
Trace is an open-source benchmark that compares web scraping APIs on fresh pages, measuring useful-content rate, latency, cost, quality, and failure reasons. In its November 6 sample, Context.dev led with 87.0% useful content across 2,527 pages.
Trace focuses on the metric that matters for AI agents: whether the returned page is actually useful, not merely whether an HTTP request succeeded.
- –Fresh samples, disabled caching, provider-blind grading, confidence intervals, and paired tests make comparisons more credible.
- –Context.dev ranked ahead of Keenable, Firecrawl, and Exa, while also posting the shortest p95 latency at 8.91 seconds.
- –Page-level records, scoring code, and methodology make the benchmark reproducible and auditable.
- –Curated sources, automated judging, and Context.dev’s role as both benchmark operator and participant remain important limitations.
- –AI and RAG developers can use the results to inform scraping-provider selection, routing, fallback, and cost decisions.
DISCOVERED
48m ago
2026-11-07
PUBLISHED
5h ago
2026-11-07
RELEVANCE
AUTHOR
[REDACTED]