Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update scraper.py #34

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Update scraper.py #34

wants to merge 1 commit into from

Conversation

oscarm417
Copy link

added a user agent to the python request.get(url), since it appears yahoo has banned the python standard get request.

added a user agent to the python  request.get(url), since it appears yahoo has banned the python standard get request.
@ZhibaiLuo
Copy link

Hi oscarm. My code still does not working when I use your modification. The bug is still the same. Should I paste your user data directly or shoudl I do some change?
headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36'}

@tsherknus
Copy link

This works awesome! Thank you!

@mikylucky
Copy link

Works perfectly! @wenboyu2 please merge it so the library gets back working :)

@kfmfe04
Copy link

kfmfe04 commented Apr 20, 2022

Yes, please merge - I can confirm the patch fixes the broken lib.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants