Rate limiting for repository cloning? #139
Labels
enhancement
New feature or request
Comments
cbrand
added a commit
to cbrand/git-xargs
that referenced
this issue
Jan 8, 2024
Add rate limiting to github clone calls, avoiding issues with github "permission denied" and EOF errors when cloning too many repositories in parallel. Fixes gruntwork-io#139
|
Bumping this, is there anything we can do towards helping to get this PR merged? I'm happy to alter the README files with the documentation if that'd help move this along. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the solution you'd like
The ability to rate limit repository cloning operations
Describe alternatives you've considered
None
Additional context
I'm attempting to do a bulk operation on an org containing 176 repositories, but github is resetting the connection on all these clone operation attempts. It appears that the cloning is all being done in parallel, and my guess is that it's rate limiting operations. I see there's rate limiting on creating pull requests; perhaps applying a similar solution for the cloning operations would allow things to complete. Currently the operations are just failing without retries.
The text was updated successfully, but these errors were encountered: