Mac Pro 2019 RAM Trails M3 Ultra

// 71d agoINFRASTRUCTURE

Mac Pro 2019 RAM Trails M3 Ultra

A Reddit user is considering a 1.5TB RAM upgrade for their 2019 Intel Mac Pro to run Llama 3.1 405B locally. The community consensus highlights the significant bottleneck of DDR4 memory bandwidth compared to the unified memory architecture of newer Apple Silicon machines.

// ANALYSIS

–Memory bandwidth, not just capacity, is the critical factor for usable LLM inference; the M3 Ultra's over 800GB/s is about 5.7x the Mac Pro's peak theoretical 6-channel DDR4 bandwidth.
–Running an unquantized Llama 3.1 405B (820GB) on a Xeon CPU will likely yield less than 1 token per second, making it a "batch" processor rather than an interactive assistant.
–Quantizing the 405B model to 4-bit allows it to fit within 512GB of M3 Ultra unified memory, providing a "snappy" performance that is far more practical for most use cases.
–Transitioning to Apple Silicon is the definitive recommendation for high-end local AI work, as it consolidates memory and compute into a much more efficient package.

// TAGS

mac-pro-2019llmgpuapple-siliconmac-studioself-hostedinfrastructure

DISCOVERED

71d ago

2026-03-18

PUBLISHED

71d ago

2026-03-18

RELEVANCE

7/ 10

AUTHOR

Artifiko

// KEEP READING

More AI developer news from the feed

EXPLORE FULL FEED

VIDEO1h ago

Mistral Vibe wires connectors into CLI workflows

Mistral Vibe’s connector layer lets the terminal agent reach into external services from one workflow. The demo shows it reading requirements, editing code, opening a GitHub PR, and updating Linear without leaving the CLI.

NEWS3h ago

Dev lets Claude trade BTC overnight, nets $95 profit

A developer gave Claude a $20 budget to autonomously script and execute Bitcoin trades overnight, waking up to a functional trading bot and a $95 profit across five trades.

OPEN SOURCE3h ago

Plannotator 0.19.24 adds Amp support and configurable storage

Plannotator 0.19.24 is a substantial release that expands the tool beyond Claude Code with native Amp support, adds a `PLANNOTATOR_DATA_DIR` override so users can move the default `~/.plannotator` data directory, introduces Auto Mode in the permission selector for newer Claude Code versions, and fixes a Pi approval crash after plan acceptance. The update folds multiple stacked PRs into one release and pushes the project further toward a multi-agent review layer rather than a single-agent hook utility.