Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Code clean-up: create functions and error handling #93

Closed
1 of 5 tasks
nicolassaw opened this issue Jul 8, 2024 · 3 comments
Closed
1 of 5 tasks

Code clean-up: create functions and error handling #93

nicolassaw opened this issue Jul 8, 2024 · 3 comments
Assignees
Labels
architecture big picture how all the code and data fit together

Comments

@nicolassaw
Copy link
Contributor

nicolassaw commented Jul 8, 2024

Problem
The code currently does not have very many functions that can provide more modularity and clarity to the code. It also has some error handling but not a bunch. It tends to fail and shut down, but if dealing with large jobs (multiple modules for multiple counties), the code should be written to keep going. These seemed like intertwined tasks so I put them in the same ticket.

Goal
Update the different submodules of the program to use functions. Implement error handling so that the code will continue the larger orchestration regardless of where it hits the error.

Modules Completed

  • orchestrator
  • scraper
  • parser
  • cleaner
  • updater
@nicolassaw nicolassaw added the architecture big picture how all the code and data fit together label Jul 8, 2024
@nicolassaw nicolassaw self-assigned this Jul 8, 2024
@nicolassaw nicolassaw moved this from 🔖 To-do to 🏗 In progress in Product - Indigent Defense Stats Jul 28, 2024
@nicolassaw
Copy link
Contributor Author

Scraper has been re-written to have more modular functions in this pull request.

Next is parser.

@nicolassaw
Copy link
Contributor Author

This ticket is going to be broken down into smaller tickets and assigned to different folks. Tickets here:
#103
#115
#118
#122
#124
#128

@nicolassaw
Copy link
Contributor Author

Accordingly, this ticket can be closed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
architecture big picture how all the code and data fit together
Projects
Status: ✅ Done
Development

No branches or pull requests

1 participant