How to search with many files of queries

[Wenze7]

I have too many queries to search, and I want to use multi threads, how should i do?

[lintool]

Use:

python -m pyserini.search.lucene \
  --threads xxx --batch-size yyy
...

See https://castorini.github.io/pyserini/2cr/msmarco-v1-passage.html for sample invocations.

[Wenze7]

Thanks!

[Hannibal046]

Hi, what would you suggest to set the number of thread and batch size?

[lintool]

Suggestion: set the number to threads to the number of cores you want to use; set the batch size to something like 8 * number of threads.