[SPARK-50338][CORE] Make LazyTry exceptions less verbose

[juliuszsompolski]

What changes were proposed in this pull request?

For LazyTry, we want two stack traces:

1. the one from the original execution when the exception happened
2. the one from the current execution, that retrieved the exception.

The first one is added as suppressed exception. The second one is stitched into the stack trace of the rethrown exception.

The third one (TRY_WITH_CALLER_STACKTRACE_TRY_STACKTRACE) doesn't need to be visible to users as a suppressed exception. We only need the depth of the stacktrace until doTryWithCallerStacktrace. Use a custom exception OriginalTryStackTraceException to store it together with the suppressed first one.

Why are the changes needed?

The suppressed Exception was too verbose.

Does this PR introduce any user-facing change?

Yes. Stacktraces of Exceptions coming from a LazyTry (e.g. QueryExecution plans) should be more readable.

How was this patch tested?

Unit tests were adapted.

Was this patch authored or co-authored using generative AI tooling?

No.

[juliuszsompolski]

@yaooqinn @cloud-fan
Hmm... So I see that it happens in a pattern:
The LazyTry of executedPlan triggers the LazyTry of sparkPlan triggers the LazyTry of optimizedPlan triggers the LazyTry of analyzedPlan...
So if you get an AnalysisError and then trigger the executedPlan, the stitched together stack trace of exception will be the full stack trace going down into where the error originally happened in the analyzer, stitched with the stack trace of where it got called now... but then each LazyTry layer adds it's own suppressed exception of the full stack trace of where it was called from where it originally happened.
I guess I could still do something to see that if an exception already has a OriginalTryStackTraceException I could compare if we are within the same recursive call, and don't add it again if so...

But I will have to think about it. I won't have time for it this week, let's not merge it until I have a chance to think about it.