Add hudi feature
#189
Add hudi feature
#189
Conversation
| datafusion-functions-json = { version = "0.41.0", optional = true } | ||
| deltalake = { version = "0.19.0", features = ["datafusion"], optional = true } | ||
| directories = "5.0.1" | ||
| env_logger = "0.11.5" | ||
| futures = "0.3.30" | ||
| http = "0.2.9" | ||
| http-body = {version = "0.4.5" } | ||
| hudi = { features = ["datafusion"], optional = true, git = "https://github.com/apache/hudi-rs", rev = "abb3e635a28af229ba1e872fd6005c381e2b7ded" } |
There was a problem hiding this comment.
you can use https://crates.io/crates/hudi/0.2.0-rc.1 now, and soon use 0.2.0 once the release is out.
There was a problem hiding this comment.
@matthewmturner thanks for the work - any plan to move this forward?
There was a problem hiding this comment.
Yes! I'm really looking forward to getting this merged. Unfortunately, it was held back back because we already have a deltalake feature but they werent able to upgrade datafusion for an extended period of time which prevented this from moving forward. It seems to finally be resolved and I hope to get this merged shortly.
Some other context:
- I dont plan on releasing next version until this and iceberg are added as features (those are basically the only blockers at this point)
- Because of how unfortunate this was i am considering a switch to the new FFI interface. The community has expressed interest in this as well, but i wouldnt expect that to come until after a release
There was a problem hiding this comment.
@xushiyan do you think apache/hudi-rs#196 could be included in the 0.2.0 release?
There was a problem hiding this comment.
@matthewmturner 0.2.0 was already in voting stage. we can get this in 0.3.0 which shouldn't be too far away
No description provided.