Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Compare realtime schedule #69

Open
wants to merge 63 commits into
base: main
Choose a base branch
from
Open

Compare realtime schedule #69

wants to merge 63 commits into from

Conversation

dcjohnson24
Copy link
Collaborator

Description

Please describe your changes, why you're making them, and any other context that someone would need to review this pull request.
Create and save data.json and schedule_vs_realtime_all_day_types_routes.json to s3.

Resolves #

Type of change

  • Bug fix
  • New functionality
  • Documentation

How has this been tested?

Locally

@dcjohnson24
add date range option for downloads.
ae0cb03
@dcjohnson24
Add branch for GitHub actions
68a55bd
@dcjohnson24
Fix typing error with List[str, str]
640b30a
@dcjohnson24
Add bucket name argument to download_fileobj
26169ad
@dcjohnson24
Change Zipfile to ZipFile
9c2a93d
@dcjohnson24
Add case for nothing to check in transitfeeds
48a1d53
@dcjohnson24
Test with date range
ec95194
@dcjohnson24
Add 2022 data from transitfeeds to s3
98cac8e
@dcjohnson24
Shorten date range for testing
3ea9630
@dcjohnson24
Create data.json
0e6ceb9
@dcjohnson24
add dependency
4eb490f
@dcjohnson24
Add date_range argument
984de27
@dcjohnson24
Remove date formatting. Handled by React
c671d61
@dcjohnson24
Add cta_download argument to create_GTFS_data_list
fd7a87d
@dcjohnson24
Turn of fail-fast
14c8756
@dcjohnson24
save transitfeeds zipfiles to s3
e6b4d53
@dcjohnson24
Fix syntax error
2ce5458
@dcjohnson24
confirm files exist
43e3945
@dcjohnson24
call seek on BytesIO
0a9a706
@dcjohnson24
Convert list of lists to list
68f425b
@dcjohnson24
download from s3 instead of transitfeeds
0f67748
@dcjohnson24
test saving data.json
ce6251a
@dcjohnson24
Search for transitfeeds files after cta files
e8e5c7c
@dcjohnson24
Change filter date range for transitfeeds zipfiles
1d8c481
@dcjohnson24
Correct the filename on transitfeeds zip
625a510
@dcjohnson24
Add manual workflow to backfill transitfeeds data
b550387
@dcjohnson24
Add data artifacts
c4049b2
@dcjohnson24
add logger messages for s3 downloads
d9498c3
@dcjohnson24
add more logging
0023be6
@dcjohnson24
Change to ubuntu 20.04. Return to commit b550387
fc20b83
@dcjohnson24
Change loop
e629cb0
@dcjohnson24
Fix dictionary syntax
8c5d79d
@dcjohnson24
remove tmate
de38990
@dcjohnson24
Add cta_download argument to GTFSFeed.extract_data
acb7d4d
@dcjohnson24
More print statements for start and end date
d563c04
@dcjohnson24
change save path of output JSON
fe6f522
@dcjohnson24
Make sure the save paths are the same
b3dc77f
@dcjohnson24
Merge branch 'main' into compare-realtime-schedule
5f9a09d
@dcjohnson24
Use main function from compare_scheduled_and_rt.py
bddb22c
@dcjohnson24
Remove cta_download arg
9f646ce
@dcjohnson24
fix key error
ef11107
@dcjohnson24
Add save_path argument
dc4d3d9
@dcjohnson24
change path name
c84fc8c
@dcjohnson24
Add .json extension. Create scratch folder
cc02a8f
@dcjohnson24
Add lineplot json data
3f89030
@dcjohnson24
create schedule_feeds if None
87eddee
@dcjohnson24
move Path.mkdir to cta_data_downloads.py
81d0669
@dcjohnson24
Check the save path in update_data.py
4db28f0
@dcjohnson24
create GeoJSON files. Fix save paths
f89f9f8
@dcjohnson24
create 'ratio' column
2e4e28e
@dcjohnson24
fix path name
31139ba
@dcjohnson24
Fix path name
675bb00
@dcjohnson24
Add .json to file path
0134f35
@dcjohnson24
remove datetime in JSON
bc85e5f
@dcjohnson24
convert lineplot_json to bytes
80fac25
@lauriemerrell lauriemerrell mentioned this pull request Oct 25, 2023
Closed
3 tasks
@dcjohnson24 dcjohnson24 mentioned this pull request Oct 30, 2023
Draft
5 tasks
@KyleDolezal KyleDolezal mentioned this pull request Jan 6, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@dcjohnson24