Skip to content

Commit

Permalink
Merge pull request #173 from harsha-simhadri/harshasi/azure-plots
Browse files Browse the repository at this point in the history
Added prelim plots on azure VM
  • Loading branch information
maumueller authored Oct 3, 2023
2 parents f3a474b + 09f0139 commit f5bb90b
Showing 1 changed file with 15 additions and 4 deletions.
19 changes: 15 additions & 4 deletions neurips23/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -130,18 +130,29 @@ To make the results available for post-processing, change permissions of the res
sudo chmod 777 -R results/
```

The following command will summarize all results files into a single csv file `res.csv` suitable for further processing.

```
python data_export.py --out res.csv
```

To plot QPS vs recall, you can use `plot.py` as follows:
```
python plot.py --dataset yfcc-10M --neurips23track filter
```
This will place a plot into the *results/* directory.
Please note that you have to provide the correct competition track to the script.
The following are plots generated on Azure Standard D8lds v5 (8 vCPUs and 16GB DRAM) VM.

The following command will summarize all results files into a single csv file `res.csv` suitable for further processing.
**Sparse track**
![sparse-full](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/2009131b-c5fb-4ae3-a3bd-4b647672caef)

**Filter track**
![yfcc-10M](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/09439f77-f1b1-49e4-a90d-05b5d6848375)

**OOD track**
![text2image-10M](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/79850d1f-be61-4c2b-81ea-3b7b80179d1c)

```
python data_export.py --out res.csv
```

### Starting_Your_Development

Expand Down

0 comments on commit f5bb90b

Please sign in to comment.