Instructor proposes typed decision models
Instructor is considering adding decision-model support powered by TypeSafe’s Jev through OpenRouter. The proposal would let developers define Pydantic-based choices, boolean judgments, and scores, then receive typed answers with probabilities.
This is a smart move from merely parsing LLM output to exposing bounded, probabilistic judgments—but it remains an RFC, not a shipped feature.
- –Pydantic schemas keep classification, moderation, and routing logic inside the application’s type system.
- –Probability distributions enable threshold-based escalation and human review instead of brittle yes/no parsing.
- –Shared context and parallel questions could consolidate multiple evaluation checks into one request.
- –The initial TypeSafe/Jev dependency limits provider flexibility compared with Instructor’s broader ecosystem.
- –API naming, confidence semantics, and calibration will need community scrutiny before production adoption.
DISCOVERED
1h ago
2026-09-26
PUBLISHED
1h ago
2026-09-26
RELEVANCE
AUTHOR
jxnlco