Bulk debuts BulkSketch for set reconciliation
BULK released BulkSketch, a dependency-free pure-Rust implementation of PinSketch for 64-bit set reconciliation with bounded decode budgets and AVX-512 acceleration. The library enables distributed systems and peer-to-peer nodes to reconcile disparate state sets up to 20x faster than existing reference implementations.
While set reconciliation rarely makes mainstream headlines, BulkSketch solves critical tail-latency and DoS attack vectors that have plagued distributed peer-to-peer sync protocols. By combining strict operation budgets and Lean 4 formal proofs with SIMD optimizations, it sets a high bar for mission-critical systems engineering.
- –Bounded decode budgets: Every decode runs under an enforced operation budget (`DecodeLimits::max_work`) and pre-allocated scratch arena, preventing algorithmic complexity DoS attacks from hostile inputs.
- –High-performance arithmetic: Up to 20x faster than minisketch's portable baseline and over 2x faster than CLMUL using runtime-detected VPCLMUL and AVX-512 backends on x86-64.
- –Zero dependencies: Operates as a pure-Rust crate with no external dependencies and unsafe code strictly confined to hardware acceleration backends.
- –Formal verification: Core portable decoding algorithms include machine-checked mathematical proofs written in Lean 4.
DISCOVERED
7h ago
2026-11-20
PUBLISHED
7h ago
2026-11-20
RELEVANCE
AUTHOR
frankdecodes