Reddit proposal seeks volunteers for decentralized 20-40B model training

Decentralized training is moving from academic curiosity to a viable alternative for the open-source community as commercial providers "close the floodgates."

• –Success hinges on SparseLoCo-style optimizers that reduce communication overhead by ~150x, making home broadband a viable interconnect
• –Consumer hardware (12-16GB VRAM) remains the target, potentially democratizing the training of mid-sized models previously reserved for H100 clusters
• –The project follows Covenant AI's proof-of-concept (ArXiv:2603.08163) but seeks to operate without the centralized overhead or crypto-incentive volatility of networks like Bittensor
• –Key technical challenges include trustless peer coordination and ensuring gradient integrity across heterogeneous consumer nodes
• –If successful, this creates a blueprint for "sovereign" community models that are resistant to corporate API restrictions