Does Repartition rule works in balista #7178
Answered
by
thinkharderdev
mustafasrepo
asked this question in
Q&A
-
In the comment for repartition rule. There is a comment saying that this rule doesn't work in balista. I have examined balista code a bit, However it seems that this is not valid comment. Is this so, or am I missing something? @waynexia . Are you familiar with current balista side. |
Beta Was this translation helpful? Give feedback.
Answered by
thinkharderdev
Aug 3, 2023
Replies: 1 comment 2 replies
-
Maybe @thinkharderdev or @yahoNanJing have ideas as well |
Beta Was this translation helpful? Give feedback.
2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I don't think this is a valid comment. AFAICT ballista does use this optimizer rule (or rather doesn't disable it). Maybe the comment was originally added since the cost of adding another repartition in the distributed plan is much higher since it adds another shuffle stage.