aiagent.club
中文
GitHub

Scrapling

#43 of 971 in the AI Agent Index↓ Download poster

54 Score
Real usage
Momentum
97
Attention
98

About

Selection methods · Fetchers · Spiders · Proxy Rotation · CLI · MCP

Scrapling is an adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl.

Its parser learns from website changes and automatically relocates your elements when pages update. Its fetchers bypass anti-bot systems like Cloudflare Turnstile out of the box. And its spider framework lets you scale up to concurrent, multi-session crawls with pause/resume and automatic proxy rotation - all in a few lines of Python. One library, zero compromises.

Blazing fast crawls with real-time stats and streaming. Built by Web Scrapers for Web Scrapers and regular…

Across sources

72.2k Stars
  • Stars 72.2k
  • Forks 7.2k
  • Commits 1.6k
  • Releases 50