List of libraries, tools and APIs for web scraping and data processing.

SpideyX a multipurpose Web Penetration Testing tool with asynchronous concurrent performance with multiple mode and configurations.

📱 A utility for downloading Android apps from the Google Play Store and Xiaomi App Store (the Chinese App Store).

An declarative and easy to use web crawler and scraper in C#

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

Web crawling & scraping framework for Node.js on top of headless Chrome browser

🕷️ Easily scrap the web for torrent and media files.

🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖

Firetastic - a tool for automating interaction with FireTV apps

A Website Spider/Crawler, Python 3.x

This python script crawls course title, ratings, description and instructors from coursera.org

A web Crowler design , basic setup c++

By scraping leads from Google Maps, you can build a database of potential customers who have shown interest in products or services related to your business. This data can be used for targeted marketing campaigns, email outreach, or sales prospecting.

Firetastic - a tool for automating interaction with FireTV apps

The DirFinder tool is user for bruteforce directory with dedicated Wordlist is very simple user-friendly to use

A spam spider which is targeting 'Untitled' spam pages from the Google search results.

The DirFinder tool is user for bruteforce directory with dedicated Wordlist is very simple user-friendly to use

Selenium automatic test that visits every article on WordPress site.

Tourist is a simple tool that allows you to collect console messages, errors, unsuccessful requests of all your pages after the DOM loading with authentication support.