Cactus adds hybrid cloud fallback and Needle model

// 2h agoINFRASTRUCTURE

Cactus adds hybrid cloud fallback and Needle model

Cactus Compute updated its low-latency mobile NPU engine with a hybrid architecture that combines zero-copy memory mapping with smart cloud fallback. The release includes "Needle," a 26M parameter model optimized for fast, local tool-calling.

// ANALYSIS

Cactus is the "Ollama for mobile" developers have been waiting for, finally unlocking the dedicated NPU silicon in modern smartphones. Zero-copy memory mapping and a proprietary .cact format reduce RAM overhead by 10x, making 1B+ models viable on mid-range hardware. Native SDKs for Flutter and React Native bypass the complex C++ boilerplate typically required for mobile ML. The hybrid router dynamically switches between local NPU execution and cloud APIs based on battery, latency, and task complexity. The recent release of the "Needle" 26M parameter model optimizes for fast, local tool-calling, turning phones into autonomous agents.

// TAGS

cactusinferenceedge-aimobile-npuquantizationllmlocal-firstinfrastructure

DISCOVERED

2h ago

2026-05-17

PUBLISHED

2h ago

2026-05-17

RELEVANCE

9/ 10

AUTHOR

Better Stack

// KEEP READING

More AI developer news from the feed

EXPLORE FULL FEED

OPEN SOURCE48m ago

Zero v0.1.1 sharpens agent-first CLI

Zero is Vercel Labs’ experimental systems language for AI agents, aimed at making effects, memory, and tooling more explicit for both humans and agents. The release highlighted in the video leans into a JSON-first CLI workflow with machine-readable diagnostics, graph output, size reports, and repair metadata, alongside tiny native binaries and capability-based APIs. It also still reads as early-stage: current docs show a limited target/capability matrix, host-only filesystem support, and no published package registry or semantic version solver yet.

POLICY5h ago

Mozilla: VPNs are infrastructure, not loopholes

Mozilla formally challenged UK proposals to age-gate VPNs, arguing they are essential privacy infrastructure. The filing warns that restricting these tools undermines digital safety for all users and sets a dangerous precedent for network surveillance.

OPEN SOURCE6h ago

OpenUI open-sources generative UI stack

OpenUI is Thesys’s open-source generative UI stack, centered on OpenUI Lang, a streaming-first language plus React runtime, built-in component libraries, and a CLI for scaffolded apps. It’s built to render structured UI as models stream, rather than forcing everything through JSON.