We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
by
What is the bug? When group by a high cardinality field, such as clientip, the spark writing job will fail "Request size exceeded 10485760 bytes" .
clientip
How can one reproduce the bug? Steps to reproduce the behavior:
source = myglue_test.default.http_logs | stats avg(size) by clientip
What is the expected behavior? A clear and concise description of what you expected to happen.
What is your host/environment?
Do you have any screenshots? If applicable, add screenshots to help explain your problem.
Do you have any additional context? Add any other context about the problem.
The text was updated successfully, but these errors were encountered:
@LantaoJin what do you suggest here ? should we rewrite the query in such high carnality cases ?
Sorry, something went wrong.
fieldsummary should provide statistical info about fields and assisting the cost estimation of the query including cardinality
tablesample
sample
top
rare
YANG-DB
No branches or pull requests
What is the bug?
When group by a high cardinality field, such as
clientip
, the spark writing job will fail "Request size exceeded 10485760 bytes" .How can one reproduce the bug?
Steps to reproduce the behavior:
source = myglue_test.default.http_logs | stats avg(size) by clientip
What is the expected behavior?
A clear and concise description of what you expected to happen.
What is your host/environment?
Do you have any screenshots?
If applicable, add screenshots to help explain your problem.
Do you have any additional context?
Add any other context about the problem.
The text was updated successfully, but these errors were encountered: