Handling job creation when using jobs_runs_submit_by_id_and_wait_for_completion

[edmondop]

At the moment, when using the jobs_runs_submit_by_id_and_wait_for_completion, the details of the Databricks job are not available in the parent flow or task until the job completes, and they are returned. However, for long running job one could desire to store the Databricks Job URL as an artifact, for example

https://github.com/PrefectHQ/prefect-databricks/blob/main/prefect_databricks/flows.py#L462

Expectation / Proposal

Traceback / Example

• I would like to help contribute a pull request to resolve this!

[edmondop]

We can close this ! it's fixed with #89