-
Notifications
You must be signed in to change notification settings - Fork 131
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature]: Support Iceberg optimization tool #9313
Comments
@nqvuong1998: Nessie GC handles expire snapshots and orphan files together. So, we don't need expire snapshots implementation again. But due to Nessie's feature of catalog level tags, we cannot update the table metadata on the tags after running expire snapshots functionality. Hence, Nessie GC is not updating the table metadata files. Other operations like compactions (including sort), can work with Engine's existing implementation. Line 716 in 4d3d53e
|
Description
Currently, the Nessie catalog has a GC tool to clean up orphaned files. Additionally, Nessie can support an optimization tool to compact, sort, and expire snapshots for Iceberg tables.
Expected Use Cases
GC and optimization tools are useful for keeping Iceberg tables optimized.
Requested Changes in public API
No response
The text was updated successfully, but these errors were encountered: