You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have an airflow pipeline that extracts data from 12 spreadsheets with 20k rows each.
The steps ran sequentially.
In one of the steps, intermittently, the pipeline failed multiple times because the number of retries of the exponential backoff is exceeded. As you can see in the image below:
Proposal
By changing the exponential factor from 3 to 4 in a fork of this repository, I was able to fix this issue on my pipeline.
The current exponential backoff factor is 3.
Context
Proposal
By changing the exponential factor from
3
to4
in a fork of this repository, I was able to fix this issue on my pipeline.Can we implement this change or are there any problems that I'm not aware of?
I really would like to use the official version of this tap.
Best Regards,
The text was updated successfully, but these errors were encountered: