Back to rankings
lorien/awesome-web-scraping
MakefileList of libraries, tools and APIs for web scraping and data processing.
web-scrapingcaptcha-bypasscaptcha-recaptchacrawlingcrawling-frameworkcrawling-pythoncrawling-toolscrapingscraping-frameworkscraping-pythonscraping-toolwebscraping
Key Metrics
Star Growth
Stars
8k
Forks
918
Weekly Growth
—
Issues
0
2k4k6k
Aug 2015May 2017Mar 2019Jan 2021Nov 2022Sep 2024Jul 2026
README
Awesome Web Scraping
List of packages, services, and manuals related to web scraping.
Topics
- Python - Python packages
- PHP - PHP packages
- Ruby - Ruby packages
- JavaScript - JavaScript packages
- Go - Go packages
- Command Line Tools - tools with a command line interface
- Web Scraping Manuals - list of articles and books teaching web scraping
- dhamaniasad / HeadlessBrowsers - list of (almost) all headless web browsers in existence
- DNS over HTTPS providers - list of DNS over HTTPS providers
- Awesome Pastebins - list of pastebin sites
Captcha Solving Services
Proxy Server Marketplaces
Telegram Discussion Groups
- @grablab - talks in English
- @grablab_ru - talks in Russian
How to Contribute to This List
Please see the CONTRIBUTING.md document.
Credits
The list is initially based on partial data from these sources awesome-python, awesome-php, awesome-ruby, ruby-nlp, awesome-javascript
Related repositories