Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: system tests: start_registry misbehaving #23725

Closed
edsantiago opened this issue Aug 22, 2024 · 3 comments
Closed

CI: system tests: start_registry misbehaving #23725

edsantiago opened this issue Aug 22, 2024 · 3 comments
Assignees
Labels
flakes Flakes from Continuous Integration locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. stale-issue

Comments

@edsantiago
Copy link
Member

Weird one:

[+0554s] not ok 240 [260] podman pull - EXTEND_TIMEOUT_USEC in 2446ms
...
<+     > # # podman [registry opts] network reload --all
<+824ms> # 4aebed84cef198f49bcaae5696ffb7fc812238ac1beda008068deddffc854ae0
         #
<+018ms> # # podman push --tls-verify=false --creds user7V6g:pwZX1laz7cDjf1Z4M quay.io/libpod/testimage:20240123 localhost:42564/name:tag
<+121ms> # Getting image source signatures
         # Copying blob sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef
         # Copying blob sha256:25a964f60e84b2d24f8098376c985a5c057bea74d699ee50c93e417c26516cc3
         # Copying config sha256:1f6acd4c4a1d4d39395870e1c12dbb68da27dd432afecf86e7cb6e23cf4b75d0
         # Writing manifest to image destination
         #
<+011ms> # # podman pull --tls-verify=false --creds user7V6g:pwZX1laz7cDjf1Z4M localhost:42564/name:tag
<+049ms> # Trying to pull localhost:42564/name:tag...
         # Error: dial unixgram /tmp/CI_a4XK/podman_bats.XbmZm2/notify.sock: connect: no such file or directory
<+005ms> # [ rc=125 (** EXPECTED 0 **) ]

Seeing something similar in a quadlet test too:

<+     > # # podman [...] network reload --all
         #
<+133ms> # # podman login --authfile=/tmp/CI_Ia6y/podman_bats.cgIxJ5/authfile.json --tls-verify=false --username userfzbg --password pwnHxU9N3L2sFAVj3 localhost:42412
<+076ms> # Error: authenticating creds for "localhost:42412": pinging container registry localhost:42412: Get "http://localhost:42412/v2/": dial tcp [::1]:42412: connect: connection refused

This is NOT IN PARALLEL. It is in serial system tests, run prior to parallel, but it is only happening in my parallel-testing PR.

It is possible that these are two separate issues, and I'm being silly by treating them as one because of the podman network reload. For now, this is my bug to deal with, I'm collecting in one place for convenience, and I'll fork into two later if necessary.

x x x x x x
sys(5) podman(5) debian-13(3) root(4) host(5) sqlite(5)
fedora-40(1) rootless(1)
fedora-40-aarch64(1)
@edsantiago edsantiago added the flakes Flakes from Continuous Integration label Aug 22, 2024
@edsantiago edsantiago self-assigned this Aug 22, 2024
@Luap99
Copy link
Member

Luap99 commented Aug 22, 2024

Weird, podman network reload --all is not parallel safe as it removes all interfaces/firewall rules for the container so all current connections are interrupted leading to weird errors. Although this should not matter for the rootless case here as it uses pasta which doesn't do network reload at all.
But if this happens in the not parallel part that is definitely odd.

Copy link

A friendly reminder that this issue had no activity for 30 days.

@edsantiago
Copy link
Member Author

I'm going to assume this was fixed by #24002

@stale-locking-app stale-locking-app bot added the locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. label Dec 23, 2024
@stale-locking-app stale-locking-app bot locked as resolved and limited conversation to collaborators Dec 23, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
flakes Flakes from Continuous Integration locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. stale-issue
Projects
None yet
Development

No branches or pull requests

2 participants