GMKtec EVO-X2 runs Llama 70B at 5 t/s

// 45d agoBENCHMARK RESULT

GMKtec EVO-X2 runs Llama 70B at 5 t/s

User testing of the GMKtec EVO-X2 confirms that AMD's Strix Halo architecture handles 70B models locally at usable speeds. The 256GB/s unified memory bandwidth enables roughly 5.25 tokens per second for Llama-3.3-70B, though performance drops as context grows toward 16k tokens.

// ANALYSIS

The GMKtec EVO-X2 marks a shift in local AI hardware, proving that high-bandwidth unified memory can finally replace expensive dual-GPU setups for 70B-class models.

–5.25 t/s is a 3-4x performance leap over previous generation iGPUs (RDNA 3) which typically hit ~1.5 t/s on 70B models
–128GB of LPDDR5X-8000 is the critical enabler, allowing 70B models to reside entirely in VRAM with room for large KV caches
–Performance degradation at high context (dropping to 2.5 t/s at 16k) reveals the compute-to-bandwidth bottleneck inherent in current integrated solutions
–Linux with ROCm 6.4.4 remains the optimal software stack for maximizing Strix Halo's gfx1151 architecture
–The necessity of GRUB tweaks (ttm.pages_limit) highlights that "AI PCs" still require significant manual tuning for enthusiast-level local inference

// TAGS

llmgpuinferenceself-hostedllama-3-3gmktec-evo-x2-ai-mini-pc

DISCOVERED

45d ago

2026-04-28

PUBLISHED

45d ago

2026-04-28

RELEVANCE

8/ 10

AUTHOR

Non-Technical

// KEEP READING

More AI developer news from the feed

EXPLORE FULL FEED

VIDEO6m ago

Gemma Showcases Reachy Mini Running Gemma 4

Google Gemma shared a demonstration of Reachy Mini, an open-source desktop robot developed by Pollen Robotics and Hugging Face, showcasing real-time voice conversation powered by Gemini Live. The demo highlights the robot's physical responsiveness and concludes with a preview of it running entirely locally on the upcoming Gemma 4 model.

MODEL57m ago

ByteDance's Seedance 2.0 multimodal video generation model showcases highly expressive AI-generated human emotions.

Seedance 2.0 is an advanced, multimodal AI video generation model developed by ByteDance that has gained significant attention in the creator community for its realistic portrayal of human emotions. Unlike older generation pipelines, Seedance 2.0 allows creators to combine text, image, video, and audio inputs in a single unified architecture. The model is capable of outputting synchronized video and audio with precise narrative control, allowing creators to prompt specific emotional intensities (e.g., joy, sadness, hesitation) to achieve highly nuanced facial expressions and body language in generated characters.

OPEN SOURCE58m ago

Ponytail cuts AI agent over-engineering

Ponytail is an open-source skill and configuration tool for Claude Code, Cursor, Cline, and other AI agents designed to promote a "lazy senior developer" mindset. By establishing a strict hierarchy of checks—prioritizing native platform features, standard libraries, and existing dependencies—it prevents AI tools from generating unnecessary boilerplate, resulting in cleaner codebases, lower token costs, and faster output generation.

GMKtec EVO-X2 runs Llama 70B at 5 t/s