Change emr job names based on the query type

[vamsimanohar]

Description

• Change EMR job names to following.
  * Batch Query: clustername:batch
  * Interactive Query: clustername:interactive:sessionId
  * Index Streaming Query: clustername:streaming:flint_my_glue_default_http_logs_elb_and_requesturi_index
• Truncating jobname if length of it is greater than 255 characters.
• SparkQueryDispatcherTest.java and CreateAsyncQueryRequestTest.java refactoring.

Issues Resolved

[List any issues this PR will resolve]

Check List

• New functionality includes testing.
  • All tests pass, including unit test, integration test and doctest
• New functionality has been documented.
  • New functionality has javadoc added
  • New functionality has user manual doc added
• Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.42%. Comparing base (f57d686) to head (71333b3).
Report is 1 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff            @@
##               main    #2543   +/-   ##
=========================================
  Coverage     95.41%   95.42%           
  Complexity     5027     5027           
=========================================
  Files           483      483           
  Lines         14016    14020    +4     
  Branches        944      944           
=========================================
+ Hits          13374    13378    +4     
  Misses          621      621           
  Partials         21       21           

Flag	Coverage Δ
sql-engine	95.42% <100.00%> (+<0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[penghuo]

could we also add index name in batch query.

Batch Query: clustername:flint_my_glue_default_http_logs_elb_and_requesturi_index:batch
Streaming Query: clustername:flint_my_glue_default_http_logs_elb_and_requesturi_index:streaming

[dai-chen]

Just wonder any max length limit in EMR job name?

[vamsimanohar]

Just wonder any max length limit in EMR job name?

Yes addressing that even suresh raised this concern. 255 is the limit.

[vamsimanohar]

Cluster name is between 3-28 chars, but index name can go beyond 255 characters.
Will truncate the job name beyond 255 characters before making the emr job call.

[noCharger]

What is the benefit of transferring the jobname formatting to the callee side? I'd rather leave them at handler level for consistency.

[vamsimanohar]

I tried to do that but it requires a lot of refactoring and the current code structure is little convoluted.
Currently, sessionId creation happen inside CreateSessionRequest and so the jobName can't be built on the Callee side.