SmolLM2 hits 7 tok/s on Roblox Native

// 45d agoOPENSOURCE RELEASE

SmolLM2 hits 7 tok/s on Roblox Native

Developer u/antwon_dev has successfully implemented Hugging Face’s SmolLM2-135M-Q8 running natively within Roblox’s Luau engine. The implementation achieves 7 tokens per second, enabling zero-latency, on-platform AI inference for game developers without the cost or privacy concerns of external API calls.

// ANALYSIS

Running a transformer natively in Roblox’s Luau is a significant technical milestone that unlocks persistent, zero-cost AI for the platform's creator ecosystem. By bypassing costly external API calls, this implementation proves that small, high-quality models like SmolLM2 can provide real-time NPC interactions. Future optimizations like better parallelization could push performance beyond the current 7 tok/s benchmark, especially if weights are serialized directly within the game to remove GitHub dependencies. This paves the way for truly autonomous agents and complex procedural generation within the Roblox environment.

// TAGS

smollm2-roblox-nativesmollm2robloxluaullmedge-aigame-dev

DISCOVERED

45d ago

2026-04-18

PUBLISHED

45d ago

2026-04-17

RELEVANCE

8/ 10

AUTHOR

antwon_dev

// KEEP READING

More AI developer news from the feed

EXPLORE FULL FEED

NEWS1h ago

Pencil is an infinite design canvas that integrates directly into your code editor, empowering AI coding assistants with Figma-like UI design capabilities.

Pencil (pencil.dev) is a developer-centric, infinite design canvas designed to integrate seamlessly inside code editors like VS Code and Cursor. Rather than separating design from code, Pencil allows design files to live within the Git repository as version-controlled `.pen` files. It bridges the gap between visual layout and production-ready code by serving as an interface that AI coding agents (such as Claude Code or Cursor) can read, write, and drive. The user reports being highly impressed by Pencil's current state and notes that the tool continues to be available for free.

NEWS2h ago

Developers debate Claude Code and Codex flat-rate pricing

A viral post from DROID (@droidbuilds) sparked a developer debate comparing Anthropic's Claude Code and OpenAI's Codex under a hypothetical $50 monthly flat-rate plan. The discussion highlights the tradeoff between Claude Code's superior reasoning and Codex's deep ecosystem integration when subscription pricing is standardized.

OPEN SOURCE2h ago

Lavish Editor is an open-source, local-first interactive editor designed to streamline human-AI collaboration on HTML artifacts directly in the browser.

Lavish Editor (lavish-axi) is a free and open-source, local-first tool designed to enhance human-AI collaboration on interactive HTML artifacts. Recognizing that AI agents are proficient at generating rich visual and interactive HTML content, Lavish Editor provides a command-line interface (using `npx lavish-axi`) to open these files in a local web browser. Users can select text ranges or pinpoint specific visual elements to leave inline feedback, which can then be read and addressed by the AI agent. Operating entirely locally with zero cloud dependencies, it functions as an Agent Experience Interface (AXI), optimizing token efficiency and human-in-the-loop interactions for complex technical plans, visual designs, and interactive documentation.

SmolLM2 hits 7 tok/s on Roblox Native