Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can't login to Yahoo! for scraping #72

Open
haz-q opened this issue Dec 30, 2018 · 0 comments
Open

Can't login to Yahoo! for scraping #72

haz-q opened this issue Dec 30, 2018 · 0 comments

Comments

@haz-q
Copy link

haz-q commented Dec 30, 2018

I'm going through the 2nd ed. of the book now and it's great. I've spent hours upon hours trying to log into Yahoo! with a POST request but I'm being thwarted. First, the program throws a TooManyRedirects error. When I add the keyword arg of allow_redirects=False, apparently I am being redirected anyway to a site with no content:

Output of response_obj.text:
'<p>Found. Redirecting to <a href="https://guce.yahoo.com/consent?gcrumb=F12tPO4&amp;trapType=login&amp;done=https%3A%2F%2Fwww.yahoo.com%2F&amp;src=">https://guce.yahoo.com/consent?gcrumb=F12tPO4&amp;trapType=login&amp;done=https%3A%2F%2Fwww.yahoo.com%2F&amp;src=</a></p>'

I am passing my browser headers and just about every other data I can identify under normal login circumstances with the request.
If anyone can successfully log into Yahoo, please spread the knowledge!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant