Skip to content

Commit

Permalink
update ReadMe with parallel parsing description
Browse files Browse the repository at this point in the history
  • Loading branch information
chance-on-brink authored Nov 28, 2024
1 parent 8ceaa0b commit 7903686
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions automated_updates/Automated Updates README.md
Original file line number Diff line number Diff line change
Expand Up @@ -79,6 +79,7 @@ To quickly set up and ensure all code paths are functioning, a pre-defined test
**parse_asset_names_llm.py**
* Sends images to OpenAI's API with specific prompts, extracting asset names and saving them to `./all_processed_data`.
* Use the `--new-only` flag to parse only new disclosures since last run.
* To parallelize this step, Use parse_asset_names_llm_parallel.py instead (8 workers by default). Requires OpenAI API Usage Tier 2 or higher.
**summarize_results.py**
* Summarizes files in `./all_processed_data` into `final_datasets/final_asset_data.csv` and `final_datasets/final_summary_data.csv`.
Expand Down

0 comments on commit 7903686

Please sign in to comment.