Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

handle MetaException with glue AccessDeniedException #410

Merged
merged 2 commits into from
Jul 4, 2024

Conversation

noCharger
Copy link
Collaborator

Description

handleGeneralException should handle MetaException with AccessDeniedException properly

24/07/03 21:34:42 INFO FlintREPL: Original exception class name: org.apache.spark.SparkException
24/07/03 21:34:42 INFO FlintREPL: Root cause exception class name: org.apache.hadoop.hive.metastore.api.MetaException

Screenshot 2024-07-03 at 15 43 16

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Comment on lines 492 to 493
if (rootCauseClassName == "org.apache.hadoop.hive.metastore.api.MetaException" &&
errMsg.contains("com.amazonaws.services.glue.model.AccessDeniedException")) {
Copy link
Collaborator Author

@noCharger noCharger Jul 3, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use class name string here since hadoop.hive.metastore is not imported as a dependency of spark-hive jar

@vamsimanohar
Copy link
Member

LGTM. but check the build failure.

@noCharger noCharger force-pushed the handle-metaexception branch from 5c9144f to 21afd04 Compare July 3, 2024 22:54
Signed-off-by: Louis Chu <[email protected]>
@noCharger
Copy link
Collaborator Author

LGTM. but check the build failure.

Fixed. Failed due to flint-commons refactor, will need a manual backport

@noCharger noCharger requested a review from dai-chen July 3, 2024 23:02
@noCharger noCharger merged commit b5715f6 into opensearch-project:main Jul 4, 2024
4 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Jul 4, 2024
* handleGeneralException should handle MetaException with AccessDeniedException properly

Signed-off-by: Louis Chu <[email protected]>

* Revise comments

Signed-off-by: Louis Chu <[email protected]>

---------

Signed-off-by: Louis Chu <[email protected]>
(cherry picked from commit b5715f6)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
noCharger added a commit that referenced this pull request Jul 4, 2024
…412)

* handle MetaException with glue AccessDeniedException (#410)

* handleGeneralException should handle MetaException with AccessDeniedException properly

Signed-off-by: Louis Chu <[email protected]>

* Revise comments

Signed-off-by: Louis Chu <[email protected]>

---------

Signed-off-by: Louis Chu <[email protected]>
(cherry picked from commit b5715f6)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Resolve cherry-pick confict

Signed-off-by: Louis Chu <[email protected]>

---------

Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Louis Chu <[email protected]>
noCharger added a commit to noCharger/opensearch-spark that referenced this pull request Aug 3, 2024
…ect#410)

* handleGeneralException should handle MetaException with AccessDeniedException properly

Signed-off-by: Louis Chu <[email protected]>

* Revise comments

Signed-off-by: Louis Chu <[email protected]>

---------

Signed-off-by: Louis Chu <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants