Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

London assembly scraper #167

Open
wants to merge 12 commits into
base: master
Choose a base branch
from
Open

London assembly scraper #167

wants to merge 12 commits into from

Commits on Apr 13, 2023

  1. Update to newer version for python 3.9 compat

    @ajparsons
    ajparsons committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    2a9927a View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2023

  1. Add python dev config settings

    @ajparsons
    ajparsons committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    51df5fe View commit details
    Browse the repository at this point in the history

  2. Black format pass

    @ajparsons
    ajparsons committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    66a4b2f View commit details
    Browse the repository at this point in the history

  3. Update to resolve 'HTMLParseError' error

    @ajparsons
    ajparsons committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    5d0acdf View commit details
    Browse the repository at this point in the history

  4. Update code for new click version

    @ajparsons
    ajparsons committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    b9a538b View commit details
    Browse the repository at this point in the history

  5. Auto-lint imports and fixable issues

    @ajparsons
    ajparsons committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    8ceed8d View commit details
    Browse the repository at this point in the history

  6. Switch out click for rich_click

    @ajparsons
    ajparsons committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    2364e0e View commit details
    Browse the repository at this point in the history

  7. Switch to pathlib for file operations

    @ajparsons
    ajparsons committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    a77abc3 View commit details
    Browse the repository at this point in the history

  8. Set docker and packages for python 3.7

    @ajparsons
    ajparsons committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    edf95c9 View commit details
    Browse the repository at this point in the history

  9. Tiered config for ruff 

    - only apply to london mayors config
    @ajparsons
    ajparsons committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    98b6b59 View commit details
    Browse the repository at this point in the history

  10. Replace London Assembly scraper 

    - They've updated their website, needed to update
- Have reused some of the old code, but used a dataclass
  based approach to make it easier to follow.
    @ajparsons
    ajparsons committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    1ae4d4d View commit details
    Browse the repository at this point in the history

  11. Add action to mirror back to git.mysociety.org

    @ajparsons
    ajparsons committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    c09785d View commit details
    Browse the repository at this point in the history