Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimizations to KMeans and IVFBuilder #252

Merged
merged 1 commit into from
Jan 1, 2025
Merged

Conversation

hicder
Copy link
Owner

@hicder hicder commented Jan 1, 2025

Summary

This adds 2 main implementation

  • Parallelize posting list & kmeans builder, since they are independent and can be done in parallel
  • SIMD the centroid computation

Result

Before this change, for query-optimized configs (max posting list size = 2000)

  • Index time: 96s
  • Query latency: 3ms

After this change, for the same config:

  • Index time: 61s
  • Query latency: 800 us (<-- no this is not a typo)

@hicder hicder requested review from tyb0807 and thinh2 January 1, 2025 03:22
@hicder hicder merged commit 39b827d into master Jan 1, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant