SparkNest 0.7.1 adds multi-disk hosts
SparkNest 0.7.1 adds dynamic multi-NVMe support, letting hosts add or remove disks while exposing each disk separately for placement. It also removes repeated SQLite metadata lookups from remote reads, dramatically improving high-IOPS model-serving workloads.
This is a deceptively important storage update: the remote-read optimization may matter more for LLM infrastructure than the headline capacity feature.
- –Each disk becomes a managed placement target without forcing a single oversized filesystem.
- –Cached file-source selection lifts reported remote random reads from 181K to 1.84M reads per second.
- –System CPU usage reportedly falls from 52 cores to roughly one-fifth of a core during the benchmark.
- –RDMA-powered whole-file placement fits shared Hugging Face model caches and distributed inference clusters.
- –The promised 39GB/s per-host throughput remains unverified, and adding or removing disks requires every host to run SparkNest 0.7.x.
DISCOVERED
1h ago
2026-10-31
PUBLISHED
1h ago
2026-10-31
RELEVANCE
AUTHOR
wrldsuksgo2mars