ConvAI Innovations drops Laya decision engine
ConvAI Innovations has released Laya, an open-source non-autoregressive decision engine designed to replace slow generative LLMs for reflex tasks such as text classification, routing, and guardrails. Running in a single ~33ms forward pass under Apache 2.0, it outputs mathematically calibrated probabilities across structured primitives with a sub-millisecond script router supporting over 100 languages.
Using generative text models for simple triage and classification is wasteful overkill; non-autoregressive architectures with honest calibration represent the optimal blueprint for production AI reflex layers.
- –Latency and cost breakthrough: Operating in under 35ms on commodity hardware, Laya runs 6 to 8 times faster than proprietary closed APIs like TypeSafe Jev while remaining completely free and self-hostable.
- –Eliminates generative failure modes: Restricting outputs to numerical probabilities over defined schemas physically prevents hallucinations, regex parsing headaches, and malformed JSON errors.
- –Critical multi-script awareness: Highlighting that English models report ~95% confidence even when completely failing on non-Latin scripts, Laya's sub-millisecond pre-inference router solves a critical blind spot in multilingual pipelines.
- –Schema scaling constraints: Performance drops notably when evaluating schemas with more than 20 candidate options due to fixed token budgets, necessitating hierarchical decision trees for larger label spaces.
DISCOVERED
1h ago
2026-09-20
PUBLISHED
1h ago
2026-09-20
RELEVANCE
AUTHOR
AI Search
