Skip to content
This repository has been archived by the owner on Dec 23, 2018. It is now read-only.

Problem with InsecureRequest #39

Open
MihirUpasani opened this issue Dec 5, 2017 · 1 comment
Open

Problem with InsecureRequest #39

MihirUpasani opened this issue Dec 5, 2017 · 1 comment

Comments

@MihirUpasani
Copy link

/home/####/.local/lib/python2.7/site-packages/urllib3/connectionpool.py:858: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecureRequestWarning)

This is the warning i get on trying this :

from amazon_scraper import AmazonScraper amzn = AmazonScraper(I've passed correct arguments) rs = amzn.reviews(ItemId='B0734X8GW5') for r in rs.ids: rvn = amzn.review(Id=r) print (rvn.id) print (rvn.text)

@adamlwgriffiths
Copy link
Owner

adamlwgriffiths commented Dec 7, 2017

I disabled certificate verification as it was failing in a number of cases.
There was no point having my scrapes fail because of some poorly configured SSL certificate or similar error.

The scraper uses HTTP instead of HTTPS anyway.
Doing full SSL of the scraper would require you to:

  • change the amazon_base url.
  • change all request.get's to not use verify=False

Again, I don't see this as an issue as no user information is passed.
The Amazon API is a separate module to the scraper.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants