You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, i am currently use ghost.py to write a mini crawler on facebook.
The problem is that the page doesn't execute any of it's script
Python 2.7
Ghost.py latest
Homepage:
Friend:
This is my cmd log: I have tried install TimeSlice and BigPipe, no change.
The code:
fromghostimportGhost, Sessionfrombs4importBeautifulSoupghost=Ghost()
withghost.start():
session=Session(ghost, user_agent='Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/535.2 (KHTML, like Gecko) Chrome/15.0.874.121 Safari/535.2',
wait_timeout=8, wait_callback=None, display=True, viewport_size=(800, 600),
ignore_ssl_errors=True, plugins_enabled=True, java_enabled=True, javascript_enabled=True,
download_images=True, show_scrollbars=True)
session.wait_timeout=999# This a a cookie i generated from my login_facebook scriptsession.load_cookies('fbookie')
# Some random facebook idpage, extra_resources=session.open("https://www.facebook.com/100017894403983")
# Just some test with beautifulsoupresult, extra=session.evaluate('document.title;')
print('The title is: {}'.format(result))
ifpage.http_status==200:
soup=BeautifulSoup(session.content, 'lxml')
soup.find_all("p", "title")
forainsoup.findAll('a'):
printa['href']
I am still unsure whether this is Ghost.py's fault or something else.
The text was updated successfully, but these errors were encountered:
Hi, i am currently use ghost.py to write a mini crawler on facebook.
The problem is that the page doesn't execute any of it's script
Homepage:
Friend:
This is my cmd log: I have tried install TimeSlice and BigPipe, no change.
The code:
I am still unsure whether this is Ghost.py's fault or something else.
The text was updated successfully, but these errors were encountered: