Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When distribution-mode = RANGE, Flink Stop-with-savepoint operation will definitely fail #11556

Open
1 of 3 tasks
huyuanfeng2018 opened this issue Nov 15, 2024 · 0 comments
Open
1 of 3 tasks
Labels
bug Something isn't working

Comments

@huyuanfeng2018
Copy link
Contributor

Apache Iceberg version

1.7.0 (latest release)

Query engine

Flink

Please describe the bug 🐞

When my job turns on distribution-mode = RANGE, and I try to stop the task and generate Savepoint at the same time, an exception will occur.

The key case is:

The vertex Source:xxx[10] -> Calc[11] -> range-shuffle (id = xxxxx) has used UnionListState, but part of its tasks has called operators' finish method.

Willingness to contribute

  • I can contribute a fix for this bug independently
  • I would be willing to contribute a fix for this bug with guidance from the Iceberg community
  • I cannot contribute a fix for this bug at this time
@huyuanfeng2018 huyuanfeng2018 added the bug Something isn't working label Nov 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant