Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add example python udaf #53

Merged
merged 11 commits into from
Nov 13, 2024
Merged

Add example python udaf #53

merged 11 commits into from
Nov 13, 2024

Conversation

emgeee
Copy link
Contributor

@emgeee emgeee commented Nov 1, 2024

Here's an attempted implementation of the count() method as a udaf in python. It currently does not work:

 ◰.venv  ~/c/p/denormalized   *…  py-denormalized  python python/examples/udaf_example.py
thread '<unnamed>' panicked at /Users/matt/.cargo/registry/src/index.crates.io-6f17d22bba15001f/slatedb-0.2.0/src/compactor.rs:159:46:
fatal error loading manifest: ObjectStoreError(JoinError { source: JoinError::Cancelled(Id(130)) })
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

@emgeee emgeee requested a review from ameyc November 1, 2024 21:43
ameyc and others added 10 commits November 12, 2024 16:14
@ameyc @emgeee
Fixing the streaming join example (#54)
0a84261 
* Fixing the streaming join example

* format

* add drop_columns

* update python internal package name

---------

Co-authored-by: Matt Green <[email protected]>
@emgeee @ameyc
Implement stream join in python (#51)
26695f0 
* Implement stream join in python

* update

* fmt

* clippy fmt

* example works

* fmt
@ameyc @emgeee
Adding config option for checkpointing (#50)
b6d7a6b 
* Adding config option for checkpointing

* Add maturin build step for ci (#52)

* fix: correct python module name

* Fixing the streaming join example (#54)

* Fixing the streaming join example

* format

* add drop_columns

* update python internal package name

---------

Co-authored-by: Matt Green <[email protected]>

* merge with main

* Adding config option for checkpointing

* merge with main

* Cargo fmt

---------

Co-authored-by: Matt Green <[email protected]>
@ameyc
Rm hardcoded checkpoint (#55)
3df33e2
@ameyc
Add dockerfile to run emit_measurements and kafka (#56)
d292927 
* Add dockerfile to run emit_measurements and kafka
@emgeee @ameyc
Add ability to specify timestamp_column on kafka stream (#57)
695f086
@ameyc
Add example python udaf
dc82a10
@ameyc
Fixing the UDAF example
733e4c9
@ameyc
merge main
fcef54e
@ameyc
Merge branch 'main' into matt/sample-udaf
e1fe512
@ameyc ameyc merged commit c9f4760 into main Nov 13, 2024
11 checks passed
@ameyc ameyc deleted the matt/sample-udaf branch November 13, 2024 01:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ameyc ameyc ameyc approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@emgeee @ameyc