Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get dates of execution plans on lineage diagram #178

Open
abhineet13 opened this issue Feb 15, 2022 · 1 comment
Open

Get dates of execution plans on lineage diagram #178

abhineet13 opened this issue Feb 15, 2022 · 1 comment
Labels

Comments

@abhineet13
Copy link

Background [Optional]

We would like to know the dates each execution plan on the lineage diagram was executed, this helps debug any pipeline issues.

Question

In the attached lineage diagram, execution plan 1) is source for 2). Is it possible to know the date of 1) plan generation?

Screenshot 2022-02-15 at 2 08 31 PM

@wajda wajda transferred this issue from AbsaOSS/spline Feb 15, 2022
@wajda
Copy link
Contributor

wajda commented Feb 15, 2022

We could display timestamps of each job execution, but correctly speaking it wasn't a primary goal for this particular view.
It's focused on the pipeline topology, how jobs and data sources depend on each others. The graph can have cycles and one node can represent multiple job runs. For that reason, instead of trying to mix-in the time info into this (static) view we are considering introducing an additional view that would be specifically focused on chronology.

@wajda wajda added the feature label Feb 15, 2022
@wajda wajda added this to Spline Mar 31, 2022
@wajda wajda moved this to New in Spline Mar 31, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: New
Development

No branches or pull requests

2 participants