Skip to content

Commit

Permalink
ongoing leaderboard (#271)
Browse files Browse the repository at this point in the history
* ongoing leaderboard

* comments

* VM
  • Loading branch information
ingberam authored Jan 23, 2024
1 parent 492690a commit 25f528d
Showing 1 changed file with 13 additions and 2 deletions.
15 changes: 13 additions & 2 deletions neurips23.html
Original file line number Diff line number Diff line change
Expand Up @@ -71,6 +71,18 @@ <h1>
<img src="assets/zilliz-logo.png" class="zilliz-logo" alt="Zilliz" />
</p>

<p class="hero-text">
<b> Update:</b> we will maintain a new <i>ongoing leaderboard</i> to include
existing and new submissions to the big-ann repository,
that will be published periodically. The first updates are planned for 2/1/2024 and 3/1/2024.
Same rules apply as in the original competition, except:
(1) Open source is encouraged but not enforced. Closed-source entries will be marked as such.
In any case, a short description of the algorithm is required.
(2) We will only evaluate the public query sets in the new leaderboard
(on the same VM type: Azure Standard D8lds v5 with 8 vcpus, 16 GiB memory)
(3) To participate, simply send a PR with the new algorithm (no need for a CMT entry).
</p>

<p class="hero-text">
This challenge is to encourage the development of indexing data
structures and search algorithms for practical variants of
Expand All @@ -83,7 +95,6 @@ <h1>
submit new algorithms that improve on the baselines for these
variants. This competition aims at being accessible to participants
by limiting the scale of the datasets to about 10 million points.
You may request cloud compute credits ($1000) for development by July 31st.
</p>

<div class="buttons">
Expand Down Expand Up @@ -303,7 +314,7 @@ <h4>Streaming Search</h4>
<span class="authors"><span>Authors</span>: Jie Yin, Ben Huang, Baidu.</span>
</li>
</ul>
<p></p>^M
<p></p>
<sup>*</sup> Zihao Wang is also an employee of Zilliz. However, he declares that the PyANNs entry was created on his time off, without any involvement from Zilliz or any of the other organizers. This entry did not declare conflict with organizers before participating.

<h4>Organizer Presentations</h4>
Expand Down

0 comments on commit 25f528d

Please sign in to comment.