(New Office) Budget Office (Phase 1): create scraper for this office

[higorspinto]

Description

The Budget Office is among the list of new offices whose datasets need to be ingested into the data portal. For this to happen, we need to create a new scraper to crawl/parse the available webpages of the office.

https://www2.ed.gov/about/overview/budget/index.html

Acceptance Criteria

• We have a functional crawler that crawls through the webpages of the offices
• We have a functional parser that understands the page structures and generates structured data
• Datasets are produced when the scraper is run

Tasks

• Identify the possible page structures in the target site
• Write one or multiple parsers that cover as many cases as possible
• Test if it runs well within the pipeline

Jira Card