Skip to content

Scrapes UGA's Bulletin website for all course info into a nice JSON file.

License

Notifications You must be signed in to change notification settings

dsluo/bulletin-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Bulletin Scraper

Scrape's UGA's Bulletin website for all course info and puts it into a nice JSON formatted file.

To Run

  • Install dependencies (preferably in a virtual environment).
    pip install -r requirements.txt
    
  • Change directory into the Bulletin directory (the one with scrapy.cfg, not the project directory).
    cd bulletin
    
  • Run
    scrapy crawl bulletin -o courses.json
    

Note about the data

Courses are listed multiple times if they are transdisciplinary (once for each discipline). E.g. for Introduction to Quantum Computation, listed as CSCI(MATH)(PHYS) 4612/6612, it will be listed once under CSCI, once under MATH, and once under PHYS.

About

Scrapes UGA's Bulletin website for all course info into a nice JSON file.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published