Skip to content

Commit

Permalink
moved counter for total records written
Browse files Browse the repository at this point in the history
  • Loading branch information
m-p-esser committed Oct 3, 2023
1 parent f5eec00 commit 9d0a254
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion src/prefect/ingest_photos_expanded_napi_gcs.py
Original file line number Diff line number Diff line change
Expand Up @@ -165,9 +165,10 @@ def ingest_photos_expanded_napi_gcs(
f"All ({total_record_size}) metadata (and log) records written to Bigquery"
)

total_records_written = 0

while len(remaining_photo_ids) > 0 and total_records_written < total_record_size:
# Request and write data
total_records_written = 0

for batch in batches:
useragent_string = create_random_ua_string()
Expand Down

0 comments on commit 9d0a254

Please sign in to comment.