OPEN_SOURCE ↗
REDDIT · REDDIT// 34d agoRESEARCH PAPER
SymGPT flags 5,783 ERC violations
SymGPT is a research system that uses an LLM to translate Ethereum ERC rules into a constrained intermediate form, then uses symbolic execution to verify smart contract compliance. In a 4,000-contract evaluation, the authors report 5,783 rule violations, including 1,375 with clear paths to financial theft, and the work is listed for OOPSLA 2026.
// ANALYSIS
This is a stronger LLM security paper than most because the model is not doing freeform auditing; it is being used as a narrow translator inside a formal analysis pipeline. That hybrid design makes the results far more interesting to developers than another “GPT found bugs” claim.
- –The core idea is to use LLMs for natural-language rule extraction while leaving actual violation detection to symbolic execution
- –The paper focuses on ERC20, ERC721, and ERC1155, where compliance bugs can break interoperability or expose direct asset-theft paths
- –The authors claim SymGPT outperforms six automated baselines plus a human auditing service on their labeled dataset
- –The most credible part is the constrained grammar layer, which is explicitly meant to reduce hallucinations and make rule translation auditable
- –It still reads as research infrastructure, not a turnkey product, so adoption will depend on code availability, false-positive tolerance, and support for more standards
// TAGS
symgptllmresearchtestingautomation
DISCOVERED
34d ago
2026-03-08
PUBLISHED
34d ago
2026-03-08
RELEVANCE
7/ 10
AUTHOR
songlinhai