Priors adopts MIT open-source license
Adam Holter's custom AI model benchmark index, Priors, is now officially licensed under the MIT open-source license. The platform lets developers fit evaluation benchmark weights to their own model rankings and evaluate Pareto-optimal cost-performance tradeoffs.
Static leaderboards impose arbitrary evaluation weights that rarely reflect specific engineering workloads. Open-sourcing Priors turns benchmark personalization into a transparent, self-hostable developer primitive.
- –Inverts standard leaderboards by allowing teams to order models by preference and solve for matching benchmark weights
- –Fully self-hostable Next.js and Convex architecture runs out of the box with offline snapshot data
- –Calculates Pareto frontiers to help engineers balance model quality against latency and token costs
- –Modular scraper pipeline and TypeScript codebase make it straightforward to integrate private internal evals
DISCOVERED
6h ago
2026-11-19
PUBLISHED
6h ago
2026-11-19
RELEVANCE
AUTHOR
AdamHoltererer