New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

gather and manysearch benchmarks for branchwater plugin v0.9.11 #525

Open

ctb opened this issue Nov 16, 2024 · 0 comments

Collaborator

ctb commented Nov 16, 2024 •

edited

Loading

CURRENT: v0.9.11 (link)

prefix	s	max_rss
fastmultigather_rocksdb	120.462	476.09
fastgather	146.704	13121.3
fastmultigather	476.358	12867.1
pygather	2783.36	13755.1

Cost of RocksDB indexing: 4:46:17 / 17178s / 14.3 GB

Previous v0.9.8 (link)

prefix	s	max_rss
fastmultigather_rocksdb	94.9313	482.69
fastgather	121.758	7676.93
fastmultigather	408.682	22902.7
pygather	1902.84	13743

Cost of RocksDB indexing: 2:40:31 / 9632s / 14.4 GB.

manysearch benchmarks

plugin version	time	memory
v0.8.6	814s	18.3 GB
v0.9.0	1332s	27.1 GB
v0.9.1	1361s	22.4 GB
v0.9.5	1534s	21.1 GB
v0.9.6	1752s	27.2 GB
v0.9.8	1520s	19.9 GB
v0.9.8 (csv)*	686s	42.8 GB
v0.9.11	2190s	18.3 GB
v0.9.11 (csv*)	630s	24.2 GB

* these runs used sig.zip files and manifest CSVs in the benchmarking.

ctb mentioned this issue

write up rationale for .sig.zip files over JSON files sourmash-bio/sourmash#3400

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment