BACK_TO_FEEDAICRIER_2
Scrapling adds adaptive crawling, AI-safe scraping
OPEN_SOURCE ↗
GH · GITHUB// 22h agoOPENSOURCE RELEASE

Scrapling adds adaptive crawling, AI-safe scraping

Scrapling is a Python web-scraping framework that combines adaptive parsing, stealth fetchers, a spider system, CLI tooling, and MCP support. It is built to move from one-off requests to large crawls without constantly rewriting selectors when sites change.

// ANALYSIS

This is a strong “agent-era scraping” package: it treats DOM drift, anti-bot friction, and crawl orchestration as core problems instead of edge cases.

  • Adaptive element tracking is the standout feature; it can relocate targets after layout changes, which cuts down on brittle selector maintenance
  • The fetcher stack covers plain HTTP, stealth browsing, and proxy rotation, so teams can choose the least expensive path that still works
  • The spider framework plus pause/resume makes it more than a parser library; it looks like a real crawl orchestration layer
  • MCP and the `--ai-targeted` mode are the tell that Scrapling is aiming at AI workflows, not just classic scraping
  • The MCP path is a good sign, because scraping for agents is quickly becoming a security problem as much as a data problem
// TAGS
scraplingmcpautomationdevtoolframeworkopen-sourceself-hosted

DISCOVERED

22h ago

2026-05-02

PUBLISHED

22h ago

2026-05-02

RELEVANCE

8/ 10