OxTorch hits legacy hardware with Vulkan, SIMD

// 66d agoOPENSOURCE RELEASE

OxTorch hits legacy hardware with Vulkan, SIMD

OxTorch is a lightweight AI library engineered to run modern LLMs on "legacy" hardware like Intel Ivy Bridge CPUs and AMD GCN 1.1 GPUs. It bypasses modern RAM and CUDA requirements using custom SIMD and Vulkan kernels, transforming decade-old systems into functional AI nodes.

// ANALYSIS

OxTorch is a masterclass in low-level optimization that successfully repurposes aging hardware for the AI era. It leverages hand-tuned SIMD kernels, the lock-free Mera Style Tiling System, and SSD-as-RAM streaming via io_uring to enable large model inference on legacy systems with limited memory and non-CUDA GPUs.

// TAGS

oxtorchedge-aiopen-sourcellminferencegpucpuvulkan

DISCOVERED

66d ago

2026-03-23

PUBLISHED

66d ago

2026-03-22

RELEVANCE

8/ 10

AUTHOR

slavek_is_hyperreal

// KEEP READING

More AI developer news from the feed

EXPLORE FULL FEED

UPDATE31m ago

Grok Build widens access, adds subagents

xAI’s Grok Build is an early-beta terminal coding agent with plan-review-approve flows, parallel subagents, worktree isolation, and support for plugins, hooks, skills, and MCP. The latest improvements make it feel less like a demo and more like xAI’s bid to compete seriously in the AI coding CLI race.

MODEL38m ago

Krea 2 lands on Replicate

Krea 2 is now available on Replicate, giving developers access to Krea's style-first image model outside the Krea app. It emphasizes aesthetic diversity, style control, and reference-driven creative workflows.

MODEL1h ago

ElevenLabs launches Music v2 for creators

ElevenLabs has released Music v2, a new music generation model that improves vocals, instrumentation, arrangement, and multilingual output. The model supports longer, section-by-section composition, inpainting to regenerate specific parts of a track, and more complex shifts within a song without losing coherence. It powers ElevenMusic and ElevenCreative now, with ElevenAPI access coming soon, and is trained on licensed data for commercial use.