From project root in a virtualenv or similar:
pip install -e .
Useful for VS Code and other IDEs.
pip install mypy flake8 pylint rope django-stubs pylint-django pep257 pyflakes
Main app is in the vad
directory.
The Django project is in the voxsnapvad
directory.
From project root:
scrapy crawl amazon_alexa_skills
Code for this scraper is in scraping/alexa.py
. Settings are in scraping/scrapy_settings.py
.
python scraping/google_assistant.py
You must pass a cookies.txt file that contains .google.com
cookies HSID, SID, and SSID if you want to scrape reviews:
python scraping/google_assistant.py cookies.txt
Run with PDB:
python -m pdb -c 'continue' scraping/google_assistant.py cookies.txt