spacewalk-repo-sync invalid checksums on Uyuni client packages.

[re-verse]

Over the weekend, our spacewalk repo sync for uyuni clients across all operating systems has started throwing invalid checksum errors, even after removing and re-adding repos, re clearing the repodata directory.

I shortened this by removing some of the repetitive errors.
Is there any way to fix this? It's preventing me from bootstrapping and updating servers.

 /usr/bin/spacewalk-repo-sync --channel opensuse_leap15_4-uyuni-client-x86_64  --type yum -Y
20:44:47 ======================================
20:44:47 | Channel: opensuse_leap15_4-uyuni-client-x86_64
20:44:47 ======================================
20:44:47 Sync of channel started.
Retrieving repository 'opensuse_leap15_4-uyuni-client-x86_64' metadata ...........................................................................................[done]
Building repository 'opensuse_leap15_4-uyuni-client-x86_64' cache ................................................................................................[done]
All repositories have been refreshed.
20:44:49 Repo URL: https://download.opensuse.org/repositories/systemsmanagement:/Uyuni:/Stable:/openSUSE_Leap_15-Uyuni-Client-Tools/openSUSE_Leap_15.0/
20:44:49     Packages in repo:               221
20:44:55     Packages already synced:        208
20:44:55     Packages to sync:                13
20:44:55     New packages to download:        13
20:44:55   Downloading packages:
20:44:55 Downloading total 13 files from 1 queues.
20:44:58 ERROR: Download failed: https://download.opensuse.org/repositories/systemsmanagement:/Uyuni:/Stable:/openSUSE_Leap_15-Uyuni-Client-Tools/openSUSE_Leap_15.0/noarch/koan-3.0.1-7.1.uyuni.noarch.rpm - Target file isn't valid. Checksum should be 92b90506edf19706564b5dc15f9cc7fc2083674c2bcc496829ba25dab852e828 (sha256)..
20:44:58     1/13 : koan-3.0.1-7.1.uyuni.noarch.rpm (failed)
20:44:58 ERROR: Download failed: https://download.opensuse.org/repositories/systemsmanagement:/Uyuni:/Stable:/openSUSE_Leap_15-Uyuni-Client-Tools/openSUSE_Leap_15.0/noarch/ansible-test-2.9.27-2.1.uyuni.noarch.rpm - Target file isn't valid. Checksum should be 188b486834d942b212c469765cdc455467db4f5fe48b6031151e287a8a7d4002 (sha256)..
20:44:58     2/13 : ansible-test-2.9.27-2.1.uyuni.noarch.rpm (failed)
20:44:59 ERROR: Download failed: https://download.opensuse.org/repositories/systemsmanagement:/Uyuni:/Stable:/openSUSE_Leap_15-Uyuni-Client-Tools/openSUSE_Leap_15.0/noarch/python2-hwdata-2.3.5-6.1.uyuni.noarch.rpm - Target file isn't valid. Checksum should be e6417099bb56bcf912a62e60462418bd617bb586916f52d7b97f2b38f9474da4 (sha256)..
20:44:59     3/13 : python2-hwdata-2.3.5-6.1.uyuni.noarch.rpm (failed)
20:45:01 ERROR: Download failed: https://download.opensuse.org/repositories/systemsmanagement:/Uyuni:/Stable:/openSUSE_Leap_15-Uyuni-Client-Tools/openSUSE_Leap_15.0/noarch/python3-zypp-plugin-spacewalk-1.0.13-3.1.uyuni.noarch.rpm - Target file isn't valid. Checksum should be de27fdd271732a85f91c7e27e7146e0087140f38981c1ff42d3fca2ab8eeae95 (sha256)..
20:45:01     13/13 : python3-zypp-plugin-spacewalk-1.0.13-3.1.uyuni.noarch.rpm (failed)
20:45:01
20:45:01   Importing packages to DB:
20:45:01 (50, 'checksums did not match 5b7fad707c0167f1577fa58e415d0932add633a61608047b06c11e3754b515b4 vs 873a8b6042785acd0f1780320fea3e00fc32c0744d61731758282b95040fe63b', 'Invalid information uploaded to the server')
20:45:01 (50, 'checksums did not match db28bd89ea6bab6d5f80f38f136fb4a6ff7d3a644f0c2fe2a6c34ebf795cfcfc vs 8999ac05d1574f2b854f0af863a4e84eecdc4682a5bddf93dfab9c46cf049256', 'Invalid information uploaded to the server')
20:45:01 (50, 'checksums did not match 188b486834d942b212c469765cdc455467db4f5fe48b6031151e287a8a7d4002 vs ee6962c0249dba6ae15374ba5f33cac4a35904c7296ffcc9830a79f14cb3a204', 'Invalid information uploaded to the server')

20:45:01   Package batch #1 of 1 completed...
20:45:01
20:45:01   Patches in repo: 0.
20:45:02 Total time: 0:00:14

[agraul]

@re-verse is that still happening? Are all failing downloads from download.opensuse.org? If yes, this might be a problem with the mirror that was used (redirection happens server-side when downloading from download.opensuse.org)

[re-verse]

It appears to be the main download location, but I'm not sure if there is a way to better confirm this:

Error syncing the channel: [Uyuni Client Tools for openSUSE Leap 15.4 (x86_64)](https://uyuni.vk-test.net/rhn/channels/ChannelDetail.do?cid=158)
Command '[/usr/bin/spacewalk-repo-sync, --channel, opensuse_leap15_4-uyuni-client-x86_64, --type, yum, --non-interactive]' exited with error code 6: ... le isn't valid. Checksum should be 9180014d14286162400662f0c3842fd653e8cacc232694b06f2f762ab6004788 (sha256).. 01:48:36 4/6 : python3-pyvmomi-6.7.3-3.4.1.uyuni.noarch.rpm (failed) 01:48:36 ERROR: Download failed: https://download.opensuse.org/repositories/systemsmanagement:/Uyuni:/Stable:/openSUSE_Leap_15-Uyuni-Client-Tools/openSUSE_Leap_15.0/noarch/ansible-doc-2.9.27-2.1.uyuni.noarch.rpm - Target file isn't valid. Checksum should be db28bd89ea6bab6d5f80f38f136fb4a6ff7d3a644f0c2fe2a6c34ebf795cfcfc (sha256).. 01:48:36 5/6 : ansible-doc-2.9.27-2.1.uyuni.noarch.rpm (failed) 01:48:37

[agraul]

Can you follow these troubleshooting instructions starting at "2. Export the settings" and upload the log to https://paste.opensuse.org/ ? I hope that helps us narrow down where the problem comes from.

[re-verse]

Thank you - somehow this resolved itself without me changing anything a couple days later.