Skip to content

Commit

Permalink
make download_gt work
Browse files Browse the repository at this point in the history
  • Loading branch information
harsha-simhadri committed Oct 16, 2023
1 parent 2ac3168 commit 771930e
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 3 deletions.
6 changes: 3 additions & 3 deletions neurips23/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -119,9 +119,9 @@ python run.py --neurips23track streaming --algorithm diskann --dataset msturing-

For streaming track, runbook specifies the order of operations to be executed by the algorithms. To download the ground truth for every search operation: (needs azcopy tool in your binary path):
```
python benchmark/streaming/download_gt.py --runbook_file neurips23/streaming/simple_runbook.yaml --dataset msspacev-10M
python benchmark/streaming/download_gt.py --runbook_file neurips23/streaming/delete_runbook.yaml --dataset msturing-10M-clustered
python benchmark/streaming/download_gt.py --runbook_file neurips23/streaming/final_runbook.yaml --dataset msturing-30M-clustered
python -m benchmark.streaming.download_gt --runbook_file neurips23/streaming/simple_runbook.yaml --dataset msspacev-10M
python -m benchmark.streaming.download_gt --runbook_file neurips23/streaming/delete_runbook.yaml --dataset msturing-10M-clustered
python -m benchmark.streaming.download_gt --runbook_file neurips23/streaming/final_runbook.yaml --dataset msturing-30M-clustered
```
Alternately, to compute ground truth for an arbitrary runbook, [clone and build DiskANN repo](https://github.com/Microsoft/DiskANN) and use the command line tool to compute ground truth at various search checkpoints. The `--gt_cmdline_tool` points to the directory with DiskANN commandline tools.
```
Expand Down
1 change: 1 addition & 0 deletions neurips23/streaming/final_runbook.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -3840,3 +3840,4 @@ msturing-30M-clustered:
end: 29991665
1280:
operation: 'search'
gt_url: "https://comp21storage.blob.core.windows.net/publiccontainer/comp23/clustered_data/msturing-30M-clustered/final_runbook.yaml"

0 comments on commit 771930e

Please sign in to comment.