BACK_TO_FEEDAICRIER_2
asmi brings nvidia-smi to Apple Silicon
OPEN_SOURCE ↗
REDDIT · REDDIT// 5h agoOPENSOURCE RELEASE

asmi brings nvidia-smi to Apple Silicon

asmi is an open-source Rust daemon for Apple Silicon Macs that exposes hardware telemetry, model inventory, process control, MLX server lifecycle management, RDMA topology, and MCP tools over a JSON API. It aims to be the missing `nvidia-smi` plus `systemctl` layer for local LLM rigs, from one Mac to multi-node clusters.

// ANALYSIS

This is the right abstraction for Apple Silicon inference: a lightweight control plane instead of another opinionated runtime. The useful part is not just visibility, but orchestration across the messy stack people already run.

  • The daemon collapses a bunch of ad hoc macOS commands into one API surface, which matters once you move from a single laptop to a cluster.
  • RDMA and Thunderbolt topology support is the differentiator here; that is the painful part most tooling ignores.
  • MLX server lifecycle management makes it more than monitoring, since it can recover, reload, and manage serving state.
  • The MCP server is a smart distribution play: it turns infrastructure state into agent-accessible tools.
  • The product is strongest for local-LLM operators, not general Mac users, which keeps the scope coherent.
// TAGS
asmiopen-sourceinferencegpuapimcpautomation

DISCOVERED

5h ago

2026-04-24

PUBLISHED

6h ago

2026-04-24

RELEVANCE

9/ 10

AUTHOR

Street-Buyer-2428