OPEN_SOURCE ↗
GH · GITHUB// 22h agoOPENSOURCE RELEASE
Scrapling adds adaptive crawling, AI-safe scraping
Scrapling is a Python web-scraping framework that combines adaptive parsing, stealth fetchers, a spider system, CLI tooling, and MCP support. It is built to move from one-off requests to large crawls without constantly rewriting selectors when sites change.
// ANALYSIS
This is a strong “agent-era scraping” package: it treats DOM drift, anti-bot friction, and crawl orchestration as core problems instead of edge cases.
- –Adaptive element tracking is the standout feature; it can relocate targets after layout changes, which cuts down on brittle selector maintenance
- –The fetcher stack covers plain HTTP, stealth browsing, and proxy rotation, so teams can choose the least expensive path that still works
- –The spider framework plus pause/resume makes it more than a parser library; it looks like a real crawl orchestration layer
- –MCP and the `--ai-targeted` mode are the tell that Scrapling is aiming at AI workflows, not just classic scraping
- –The MCP path is a good sign, because scraping for agents is quickly becoming a security problem as much as a data problem
// TAGS
scraplingmcpautomationdevtoolframeworkopen-sourceself-hosted
DISCOVERED
22h ago
2026-05-02
PUBLISHED
22h ago
2026-05-02
RELEVANCE
8/ 10