Billion-Scale ANN Benchmarks, NeurIPS 2023

Add support for pgvector's hnsw (0.7.4) and generic support for Postgres (16) indexes #820

Triggered via pull request September 9, 2024 13:24

onurctirtir

opened #309

onurctirtir:upstream-pgvector-hnsw

Status Failure

Total duration 34m 32s

Artifacts –

neurips23.yml

on: pull_request

Matrix: build

Annotations

28 errors and 70 warnings

build (hwtl_sdu_anns_filter, random-filter-s, filter): benchmark/main.py#L257

Nothing to run

build (hwtl_sdu_anns_filter, random-filter-s, filter)

Process completed with exit code 1.

build (fdufilterdiskann, random-filter-s, filter): benchmark/main.py#L257

Nothing to run

build (fdufilterdiskann, random-filter-s, filter)

Process completed with exit code 1.

build (mysteryann, random-xs, ood): plot.py#L208

Nothing to plot

build (mysteryann, random-xs, ood)

Process completed with exit code 1.

build (mysteryann-dif, random-xs, ood): plot.py#L208

Nothing to plot

build (mysteryann-dif, random-xs, ood)

Process completed with exit code 1.

build (dhq, random-filter-s, filter): benchmark/main.py#L257

Nothing to run

build (dhq, random-filter-s, filter)

Process completed with exit code 1.

build (pinecone, random-filter-s, filter): plot.py#L208

Nothing to plot

build (pinecone, random-filter-s, filter)

Process completed with exit code 1.

build (pyanns, sparse-small, sparse): benchmark/main.py#L257

Nothing to run

build (pyanns, sparse-small, sparse)

Process completed with exit code 1.

build (sustech-whu, sparse-small, sparse): benchmark/main.py#L257

Nothing to run

build (sustech-whu, sparse-small, sparse)

Process completed with exit code 1.

build (zilliz, random-filter-s, filter): plot.py#L208

Nothing to plot

build (zilliz, random-filter-s, filter)

Process completed with exit code 1.

build (pyanns, random-xs, ood): benchmark/main.py#L257

Nothing to run

build (pyanns, random-xs, ood)

Process completed with exit code 1.

build (zilliz, sparse-small, sparse): plot.py#L208

Nothing to plot

build (zilliz, sparse-small, sparse)

Process completed with exit code 1.

build (zilliz, random-xs, ood): plot.py#L208

Nothing to plot

build (zilliz, random-xs, ood)

Process completed with exit code 1.

build (pyanns, random-filter-s, filter): benchmark/main.py#L257

Nothing to run

build (pyanns, random-filter-s, filter)

Process completed with exit code 1.

build (sustech-ood, random-xs, ood): benchmark/main.py#L257

Nothing to run

build (sustech-ood, random-xs, ood)

Process completed with exit code 1.

build (hwtl_sdu_anns_filter, random-filter-s, filter)

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

build (hwtl_sdu_anns_filter, random-filter-s, filter)

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

build (fdufilterdiskann, random-filter-s, filter)

build (mysteryann, random-xs, ood)

build (mysteryann-dif, random-xs, ood)

build (dhq, random-filter-s, filter)

build (hwtl_sdu_anns_stream, random-xs, streaming)

build (cufe, sparse-small, sparse)

build (linscan, sparse-small, sparse)

build (pinecone, random-filter-s, filter)

build (cufe, random-xs, streaming)

build (diskann, random-xs, ood)

build (cufe, random-xs, ood)

build (diskann, random-xs, streaming)

build (pyanns, sparse-small, sparse)

build (ngt, random-xs, ood)

build (sustech-whu, sparse-small, sparse)

build (parlayivf, random-filter-s, filter)

build (zilliz, random-filter-s, filter)

build (pyanns, random-xs, ood)

build (faissplus, random-filter-s, filter)

build (cufe, random-s, filter)

build (epsearch, random-xs, ood)

build (faiss, random-filter-s, filter)

build (zilliz, sparse-small, sparse)

build (vamana, random-xs, ood)

build (zilliz, random-xs, ood)

build (pyanns, random-filter-s, filter)

build (pyanns, random-xs, streaming)

build (puck, random-xs, ood)

build (shnsw, sparse-small, sparse)

build (puck, random-xs, streaming)

build (nle, sparse-small, sparse)

build (puck, random-filter-s, filter)

build (sustech-ood, random-xs, ood)

build (wm_filter, random-filter-s, filter)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add support for pgvector's hnsw (0.7.4) and generic support for Postgres (16) indexes #820

Summary