REDDIT · REDDIT// 4h agoOPENSOURCE RELEASE

fm CLI taps on-device Apple foundation models

Developed by kosminus, fm is a lightweight CLI and REPL for interacting directly with native, on-device foundation models on macOS. The tool supports the built-in 4k context window and can be installed via Homebrew or integrated into Python workflows using the apple-fm-sdk.

// ANALYSIS

This is a power user bridge into Apple's walled garden of on-device AI, offering Llama-like local access without the overhead of Ollama. By leveraging the Apple Neural Engine for optimized inference and requiring no external weights, fm provides a zero-latency, privacy-first solution for integrating system-native models into developer workflows and Python-based automation.

// TAGS

fmapplemacosllmclion-devicelocal-aipythonopensource

DISCOVERED

4h ago

2026-04-12

PUBLISHED

5h ago

2026-04-12

RELEVANCE

8/ 10

AUTHOR

claykos