SmolLM2 hits 7 tok/s on Roblox Native

Running a transformer natively in Roblox’s Luau is a significant technical milestone that unlocks persistent, zero-cost AI for the platform's creator ecosystem. By bypassing costly external API calls, this implementation proves that small, high-quality models like SmolLM2 can provide real-time NPC interactions. Future optimizations like better parallelization could push performance beyond the current 7 tok/s benchmark, especially if weights are serialized directly within the game to remove GitHub dependencies. This paves the way for truly autonomous agents and complex procedural generation within the Roblox environment.