Kudos! Can I do this for another institute?

[SoxFace]

Hi there,

I love this tool - it's amazing, thanks for sharing.

Can you offer any advice on how to update the scapergui.py urls to suit another institute?

Cheers
Sox

[jasongi]

Hi Sox

I would try a replace all on "lms.curtin.edu.au" with your institution's
blackboard url, then troubleshoot it from there. It also really depends on
what version of blackboard it is, as they have slightly different front
ends that break these types of scrapers.

Jason

On Tue, May 12, 2015 at 12:36 PM, Sonya Corcoran [email protected]
wrote:

Hi there,

I love this tool - it's amazing, thanks for sharing.

Can you offer any advice on how to update the scapergui.py urls to suit
another institute?

Cheers
Sox

—
Reply to this email directly or view it on GitHub
#4.

[jasongi]

Hey SoxFace,

Did you have any luck?

[thedonmckenzie]

I'm attempting to adapt the blackboard scraper for course content from QUT.

I've replaced each of the Curtin references with the appropriate URLs for their blackboard, although the login to this particular blackboard uses a SAML-based SSO, so I'm passing that URL to requests.session, expecting that to login, and then requesting a protected blackboard page as normal. But no dice.
Perhaps its something wrong with my payload for the SSO login? or something else?

Any assistance would be greatly, greatly appreciated.

#starts the login session def login(user, password): unitlist = [] ileclist = [] password = base64.b64encode(password) payload = { 'username': user, 'password': password, } url = 'https://esoe.qut.edu.au/qut-login/' with requests.Session() as s: s.post(url, data=payload) r = \ s.get('https://blackboard.qut.edu.au/webapps/portal/execute/tabs/tabAction?tab_tab_group_id=_3_1' ) data = r.text soup = BeautifulSoup(data, "html.parser")