You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As we add support for various runtimes (e.g., Spark, Photon, and future support for Velox), we should store the Spark Runtime information for each application.
This will be consumed by the Python CLI and QualX to make decisions based on the runtime type.
The text was updated successfully, but these errors were encountered:
It would be good to specify in the description which tool(s) this feature is being added to - profiling or qualification.
If an application uses multiple in the future - like Velox and Spark Rapids I guess we can make a VELOX_AND_SPARK_RAPIDS type indicator, otherwise it may have been good to make this a list. Its not totally clear to me what all this is used for to decide which is better.
Is there a qualx issue this can be linked to, to understand the usage?
parthosa
changed the title
[FEA] Store spark runtime for different application type
[FEA] Qualification/Profiling Tool: Store spark runtime for different application type
Nov 18, 2024
As we add support for various runtimes (e.g., Spark, Photon, and future support for Velox), we should store the Spark Runtime information for each application.
This will be consumed by the Python CLI and QualX to make decisions based on the runtime type.
The text was updated successfully, but these errors were encountered: