diff --git a/neurips23.html b/neurips23.html index d6b70333..1ef329cc 100644 --- a/neurips23.html +++ b/neurips23.html @@ -71,17 +71,68 @@
+ New: the latest ongoing leaderboard has been released (Feb 1st, 2024).
Top entries:
+
Filter track | +OOD track | +Sparse track | + +||||||
---|---|---|---|---|---|---|---|---|
Rank | +Algorithm | +QPS@90% recall | +Rank | +Algorithm | +QPS@90% recall | +Rank | +Algorithm | +QPS@90% recall | +
1 | +Pinecone-filter | +85,491 | +1 | +Pinecone-ood | +31,643 | +1 | +Zilliz | +9,933 | +
2 | +Zilliz | +84,596 | +2 | +Zilliz | +27,585 | +2 | +PyANNS | +8,732 | +
3 | +ParlayANN IVF2 | +37,902 | +3 | +RoarANN | +22,555 | +3 | +Pinecone_smips | +8,078 | +
- Update: we will maintain a new ongoing leaderboard to include
- existing and new submissions to the big-ann repository,
- that will be published periodically. The first updates are planned for 2/1/2024 and 3/1/2024.
- Same rules apply as in the original competition, except:
- (1) Open source is encouraged but not enforced. Closed-source entries will be marked as such.
- In any case, a short description of the algorithm is required.
- (2) We will only evaluate the public query sets in the new leaderboard
- (on the same VM type: Azure Standard D8lds v5 with 8 vcpus, 16 GiB memory)
- (3) To participate, simply send a PR with the new algorithm (no need for a CMT entry).
+ See here for the full ongoing leaderboard and rules. Next update: March 1st, 2024.
+
+ Note: entries by pinecone and zilliz are not open source.
This challenge is to encourage the development of indexing data @@ -104,10 +155,10 @@