Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EXP: implement some intermediate APIs on top of Rust using pyo3 #428

Closed
wants to merge 38 commits into from

Conversation

ctb
Copy link
Collaborator

@ctb ctb commented Aug 18, 2024

Note: PR into #424
Includes #430

Playing around with some pyo3 stuff.


This PR -

  • provides an initial wrapping of Collection, Manifest, and Record;
  • adds a load_from hook to support loading files via new wrapping;

Next steps:

  • adjust Record to provide getters for private elements ksize, scaled, num, with_abundance, and n_hashes;
  • think about how to support more of the Index protocol - in particular, providing sketches that are compatible with the FFI layer, and supporting find, prefetch, and peek;

Other notes:

pyo3-ffi - might this let us work directly with FFI interface in sourmash?

Limit to rocksdb loading? And/or provide env variable switch to turn loading on and off?

ctb added 8 commits August 20, 2024 10:32
#434)

* preliminary victory

* compiles and mostly runs

* cleanup, split to new module

* cleanup and comment

* more cleanup of diff

* cargo fmt

* fix fmt

* restore n_failed

* comment failing test

* cleanup and de-vec

* create module/submodule structure

* comment for later

* get rid of vec

* beg for help

* cleanup and doc
Base automatically changed from ctb_misc_cleanup to main August 26, 2024 18:54
@ctb
Copy link
Collaborator Author

ctb commented Dec 21, 2024

copying the useful bits over to #552

@ctb ctb closed this Dec 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant