Zerodha unveils Blobasaur SQLite blob store
Zerodha open-sourced Blobasaur, a Rust-based distributed blob storage server using sharded SQLite files and Redis protocol compatibility. Built to replace SSDB on its Kite platform, the engine sustains tens of thousands of requests per second with sub-2ms p99 latency on commodity hardware.
Building distributed blob storage on sharded SQLite instances is a masterclass in defying microservice bloat with simple, battle-tested primitives. While many teams default to heavy object stores or complex distributed key-value databases, wrapping SQLite with consistent hashing and Tokio delivers remarkable operational simplicity.
- –Solves SQLite's single-writer bottleneck by partitioning keys across disk shards via multi-probe consistent hashing and group commits, achieving over 25,000 writes per second per node
- –Implements the RESP2 protocol and Redis Cluster slot routing, allowing existing client libraries to interact with SQLite without custom drivers or CGo overhead
- –Trades strict fsync durability for sub-2ms p99 latencies via WAL mode and async memory queues, a sensible compromise for transient UI layouts and metadata
- –Tackles WAL checkpoint stalls, background TTL lock contention, and freelist growth by pairing incremental vacuuming with chunked writer-shared deletions
DISCOVERED
6h ago
2026-11-19
PUBLISHED
10h ago
2026-11-19
RELEVANCE
AUTHOR
ghostfoxgod