What is different?
- Built to reliably scrape Cloudflare-protected and anti-bot websites using stealth Chromium automation via Nodriver.
- Supports dual scraping modes: full stealth browser for protected targets and lightweight HTTP parsing for simple pages.
- Includes background polling with APScheduler, so data stays continuously updated without manual triggers.
- Provides a secure FastAPI REST API with API-key authentication and automatic Swagger documentation.
- Designed for production deployment with Docker, persistent storage, retry logic, and structured JSON outputs.
- Fully config-driven architecture — targets, selectors, retries, proxies, and timing are controlled from a single YAML file.
Core Capabilities
Cloudflare Bypass
Smart Extraction System
- CSS, XPath, ID, and class selectors
- Text or attribute extraction
- Multiple element arrays
- Default fallbacks for missing data
Autonomous Scraping
- Exponential retry backoff
- Failure tracking
- Performance timing metrics
Secure Data API
- Health monitoring
- Target statistics
- Latest structured scrape results























