A web scraping tool designed to fetch the latest prices of products from various e-commerce websites.
- Multi-Platform Support: Scrapes prices from multiple e-commerce platforms.
- Real-time Updates: Fetches the most recent price data.
- Customizable: Allows users to add or remove e-commerce sites.
- Export Data: Supports exporting scraped data in multiple formats (CSV, JSON, etc.).
Ensure you have the following installed:
- Python 3.x
- Pip
- Virtual Environment (Optional but recommended)
-
Clone the repository:
git clone https://github.com/abhinav26966/EcommercePriceScraper.git cd EcommercePriceScraper
-
Set up a virtual environment (optional but recommended):
python3 -m venv venv
source venv/bin/activate # On Windows use `venv\Scripts\activate`
- Install dependencies:
pip install -r requirements.txt
- Configure the scraper:
- Edit the config.json file to specify the e-commerce websites, products, and other settings.
-
Run the scraper:
python scraper.py
-
View results:
- The scraped data will be available in the output/ directory by default.
Here's a basic example of how to run the scraper:
python scraper.py --site amazon --product "Samsung Galaxy S21"
- Amazon
- eBay
- Walmart
- Flipkart
- Abhinav Nagar