diff --git a/neurips23/README.md b/neurips23/README.md index f97d0464..f15c2fae 100644 --- a/neurips23/README.md +++ b/neurips23/README.md @@ -130,18 +130,29 @@ To make the results available for post-processing, change permissions of the res sudo chmod 777 -R results/ ``` +The following command will summarize all results files into a single csv file `res.csv` suitable for further processing. + +``` +python data_export.py --out res.csv +``` + To plot QPS vs recall, you can use `plot.py` as follows: ``` python plot.py --dataset yfcc-10M --neurips23track filter ``` This will place a plot into the *results/* directory. Please note that you have to provide the correct competition track to the script. +The following are plots generated on Azure Standard D8lds v5 (8 vCPUs and 16GB DRAM) VM. -The following command will summarize all results files into a single csv file `res.csv` suitable for further processing. +**Sparse track** +![sparse-full](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/2009131b-c5fb-4ae3-a3bd-4b647672caef) + +**Filter track** +![yfcc-10M](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/09439f77-f1b1-49e4-a90d-05b5d6848375) + +**OOD track** +![text2image-10M](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/79850d1f-be61-4c2b-81ea-3b7b80179d1c) -``` -python data_export.py --out res.csv -``` ### Starting_Your_Development