OPEN_SOURCE ↗
REDDIT · REDDIT// 5h agoOPENSOURCE RELEASE
asmi brings nvidia-smi to Apple Silicon
asmi is an open-source Rust daemon for Apple Silicon Macs that exposes hardware telemetry, model inventory, process control, MLX server lifecycle management, RDMA topology, and MCP tools over a JSON API. It aims to be the missing `nvidia-smi` plus `systemctl` layer for local LLM rigs, from one Mac to multi-node clusters.
// ANALYSIS
This is the right abstraction for Apple Silicon inference: a lightweight control plane instead of another opinionated runtime. The useful part is not just visibility, but orchestration across the messy stack people already run.
- –The daemon collapses a bunch of ad hoc macOS commands into one API surface, which matters once you move from a single laptop to a cluster.
- –RDMA and Thunderbolt topology support is the differentiator here; that is the painful part most tooling ignores.
- –MLX server lifecycle management makes it more than monitoring, since it can recover, reload, and manage serving state.
- –The MCP server is a smart distribution play: it turns infrastructure state into agent-accessible tools.
- –The product is strongest for local-LLM operators, not general Mac users, which keeps the scope coherent.
// TAGS
asmiopen-sourceinferencegpuapimcpautomation
DISCOVERED
5h ago
2026-04-24
PUBLISHED
6h ago
2026-04-24
RELEVANCE
9/ 10
AUTHOR
Street-Buyer-2428