Reddit debates local LLM hardware choices

Hot take: for most people, the best local LLM box is the one that balances VRAM, RAM, and model size rather than the most expensive one on paper.

• –Macs with lots of unified memory are attractive for large models and simple setup, especially if you value quiet operation and macOS tooling.
• –Nvidia GPUs on Windows still win on raw throughput and ecosystem support, but VRAM is the real constraint; once you run out, performance drops off fast.
• –Small workstation-style systems can be convenient, but they are usually a compromise between portability and performance, not a universal best pick.
• –The key decision is what you want to run: small coding models, mid-sized chat models, or larger quantized models each push you toward different hardware.