Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some Harbor Jobs should not run in parallel as it causes DB deadlocks #21062

Open
Vad1mo opened this issue Oct 18, 2024 · 2 comments
Open

Some Harbor Jobs should not run in parallel as it causes DB deadlocks #21062

Vad1mo opened this issue Oct 18, 2024 · 2 comments

Comments

@Vad1mo
Copy link
Member

Vad1mo commented Oct 18, 2024

Some jobs that should not run in parallel; however, some do run in parallel, even if it is set in the code otherwise.

Running jobs in parallel, here the GC job causes the DB to Lock, and put the system in a not usable state.
image

Bildschirmfoto 2024-10-18 um 10 43 08

Steps to reproduce the problem:

  • Run jobs in parallel, specifically the GC job

Versions:
Please specify the versions of the following systems.

  • harbor version: >=2.11

Additional context:

image

@wy65701436
Copy link
Contributor

wy65701436 commented Oct 21, 2024

do you mean that you run the GC in parallel which results in the deadlock in the DB side?

The GC is designed as a unique job and should not be able to run in parallel. But, if you were able to do so, please provide the environment details so I can investigate further.

@Vad1mo
Copy link
Member Author

Vad1mo commented Oct 21, 2024

The GC is designed as a unique job and should not be able to run in parallel. But, if you were able to do so, please provide the environment details so I can investigate further.

It is quite simple, I was able to replicated it in the demo environment:

https://demo.goharbor.io/harbor/clearing-job/gc

Bildschirmfoto 2024-10-21 um 12 10 17

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants