Skip to content

Commit

Permalink
Refactor DenseVectorDocumentGenerator -> JsonDenseVectorDocumentGener…
Browse files Browse the repository at this point in the history 
…ator (#2650)

+ InvertedDenseVectorDocumentGenerator -> JsonInvertedDenseVectorDocumentGenerator
+ Updated docs, regressions, etc.
  • Loading branch information
@lintool
lintool authored Dec 14, 2024
1 parent 7fbc146 commit c7dff5f
Show file tree
Hide file tree
Showing 636 changed files with 1,266 additions and 1,142 deletions.
679 changes: 383 additions & 296 deletions docs/regressions.md
View file

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion ...egressions/regressions-beir-v1.0.0-arguana.bge-base-en-v1.5.flat-int8.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-arguana.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat-int8.beir-v1.0.0-arguana.bge-base-en-v1.5/ \
-quantize.int8 \
>& logs/log.beir-v1.0.0-arguana.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion .../regressions/regressions-beir-v1.0.0-arguana.bge-base-en-v1.5.flat-int8.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-arguana.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat-int8.beir-v1.0.0-arguana.bge-base-en-v1.5/ \
-quantize.int8 \
>& logs/log.beir-v1.0.0-arguana.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-arguana.bge-base-en-v1.5.flat.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-arguana.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat.beir-v1.0.0-arguana.bge-base-en-v1.5/ \
>& logs/log.beir-v1.0.0-arguana.bge-base-en-v1.5 &
```
Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-arguana.bge-base-en-v1.5.flat.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-arguana.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat.beir-v1.0.0-arguana.bge-base-en-v1.5/ \
>& logs/log.beir-v1.0.0-arguana.bge-base-en-v1.5 &
```
Expand Down
2 changes: 1 addition & 1 deletion ...egressions/regressions-beir-v1.0.0-arguana.bge-base-en-v1.5.hnsw-int8.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-arguana.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-arguana.bge-base-en-v1.5/ \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-arguana.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion .../regressions/regressions-beir-v1.0.0-arguana.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-arguana.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-arguana.bge-base-en-v1.5/ \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-arguana.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-arguana.bge-base-en-v1.5.hnsw.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-arguana.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-arguana.bge-base-en-v1.5/ \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-arguana.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-arguana.bge-base-en-v1.5.hnsw.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-arguana.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-arguana.bge-base-en-v1.5/ \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-arguana.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...regressions/regressions-beir-v1.0.0-bioasq.bge-base-en-v1.5.flat-int8.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-bioasq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat-int8.beir-v1.0.0-bioasq.bge-base-en-v1.5/ \
-quantize.int8 \
>& logs/log.beir-v1.0.0-bioasq.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-bioasq.bge-base-en-v1.5.flat-int8.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-bioasq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat-int8.beir-v1.0.0-bioasq.bge-base-en-v1.5/ \
-quantize.int8 \
>& logs/log.beir-v1.0.0-bioasq.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-bioasq.bge-base-en-v1.5.flat.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-bioasq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat.beir-v1.0.0-bioasq.bge-base-en-v1.5/ \
>& logs/log.beir-v1.0.0-bioasq.bge-base-en-v1.5 &
```
Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-bioasq.bge-base-en-v1.5.flat.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-bioasq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat.beir-v1.0.0-bioasq.bge-base-en-v1.5/ \
>& logs/log.beir-v1.0.0-bioasq.bge-base-en-v1.5 &
```
Expand Down
2 changes: 1 addition & 1 deletion ...regressions/regressions-beir-v1.0.0-bioasq.bge-base-en-v1.5.hnsw-int8.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-bioasq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-bioasq.bge-base-en-v1.5/ \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-bioasq.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-bioasq.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-bioasq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-bioasq.bge-base-en-v1.5/ \
-M 16 -efC 500 -quantize.int8 \
>& logs/log.beir-v1.0.0-bioasq.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-bioasq.bge-base-en-v1.5.hnsw.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-bioasq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-bioasq.bge-base-en-v1.5/ \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-bioasq.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-bioasq.bge-base-en-v1.5.hnsw.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-bioasq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-bioasq.bge-base-en-v1.5/ \
-M 16 -efC 500 \
>& logs/log.beir-v1.0.0-bioasq.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...ions/regressions-beir-v1.0.0-climate-fever.bge-base-en-v1.5.flat-int8.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-climate-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat-int8.beir-v1.0.0-climate-fever.bge-base-en-v1.5/ \
-quantize.int8 \
>& logs/log.beir-v1.0.0-climate-fever.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...ssions/regressions-beir-v1.0.0-climate-fever.bge-base-en-v1.5.flat-int8.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-climate-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat-int8.beir-v1.0.0-climate-fever.bge-base-en-v1.5/ \
-quantize.int8 \
>& logs/log.beir-v1.0.0-climate-fever.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...gressions/regressions-beir-v1.0.0-climate-fever.bge-base-en-v1.5.flat.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-climate-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat.beir-v1.0.0-climate-fever.bge-base-en-v1.5/ \
>& logs/log.beir-v1.0.0-climate-fever.bge-base-en-v1.5 &
```
Expand Down
2 changes: 1 addition & 1 deletion ...regressions/regressions-beir-v1.0.0-climate-fever.bge-base-en-v1.5.flat.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-climate-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat.beir-v1.0.0-climate-fever.bge-base-en-v1.5/ \
>& logs/log.beir-v1.0.0-climate-fever.bge-base-en-v1.5 &
```
Expand Down
2 changes: 1 addition & 1 deletion ...ions/regressions-beir-v1.0.0-climate-fever.bge-base-en-v1.5.hnsw-int8.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-climate-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-climate-fever.bge-base-en-v1.5/ \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-climate-fever.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...ssions/regressions-beir-v1.0.0-climate-fever.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-climate-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-climate-fever.bge-base-en-v1.5/ \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-climate-fever.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...gressions/regressions-beir-v1.0.0-climate-fever.bge-base-en-v1.5.hnsw.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-climate-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-climate-fever.bge-base-en-v1.5/ \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-climate-fever.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...regressions/regressions-beir-v1.0.0-climate-fever.bge-base-en-v1.5.hnsw.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-climate-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-climate-fever.bge-base-en-v1.5/ \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-climate-fever.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...egressions-beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5.flat-int8.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat-int8.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5/ \
-quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion .../regressions-beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5.flat-int8.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat-int8.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5/ \
-quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...ons/regressions-beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5.flat.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5/ \
>& logs/log.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 &
```
Expand Down
2 changes: 1 addition & 1 deletion ...sions/regressions-beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5.flat.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5/ \
>& logs/log.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 &
```
Expand Down
2 changes: 1 addition & 1 deletion ...egressions-beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5.hnsw-int8.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5/ \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion .../regressions-beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5/ \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...ons/regressions-beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5.hnsw.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5/ \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...sions/regressions-beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5.hnsw.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5/ \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...egressions-beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5.flat-int8.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat-int8.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5/ \
-quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion .../regressions-beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5.flat-int8.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat-int8.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5/ \
-quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...ons/regressions-beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5.flat.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5/ \
>& logs/log.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 &
```
Expand Down
2 changes: 1 addition & 1 deletion ...sions/regressions-beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5.flat.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5/ \
>& logs/log.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 &
```
Expand Down
2 changes: 1 addition & 1 deletion ...egressions-beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5.hnsw-int8.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5/ \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion .../regressions-beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5/ \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...ons/regressions-beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5.hnsw.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5/ \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...sions/regressions-beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5.hnsw.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5/ \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...regressions-beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5.flat-int8.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat-int8.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5/ \
-quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...s/regressions-beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5.flat-int8.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat-int8.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5/ \
-quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 &
Expand Down
2 changes: 1 addition & 1 deletion ...ions/regressions-beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5.flat.cached.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5/ \
>& logs/log.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 &
```
Expand Down
2 changes: 1 addition & 1 deletion ...ssions/regressions-beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5.flat.onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ bin/run.sh io.anserini.index.IndexFlatDenseVectors \
-threads 16 \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-generator JsonDenseVectorDocumentGenerator \
-index indexes/lucene-flat.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5/ \
>& logs/log.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 &
```
Expand Down
Loading

0 comments on commit c7dff5f

Please sign in to comment.