Openvino notebook build intermittently fails

[asanzgom]

Describe the bug

Description of problem:

While testing ISVs on RHODS v1.29 RC 2 I got stuck while building an openvino image in the cluster. I keep getting this error in my cluster:

You can remove cached packages by executing 'yum clean packages'.
Error: Transaction test error:
package nodejs-2:14.18.1-1nodesource.x86_64 does not verify: no digest

error: build error: building at STEP "RUN curl -sL https:/...ec-severity=Moderate": while running runtime: exit status 1

Full logs: openvino-notebooks-v2022.3-1-undefined.log

I tried in other clusters without being able to reproduce it, however as I faced it, it could be faced by our customers too.

This issue may be out-of-scope for RHODS, but I think we should investigate and report to Intel if something must be changed

Prerequisites (if any, like setup, operators/versions):
Steps to Reproduce
Install OpenVINO operator (either marketplace or certified)
deploy OpenVINO notebook with default settings from OCP Console > Operators > Installed Operators > Openvino toolkit > Notebook (ns: redhat-ods-applications)
go to OCP Console > Builds > Builds
check the build status
Actual results:

build fails

Expected results:

build succeeds

Reproducibility (Always/Intermittent/Only Once):

Intermittent

Build Details:

The bug is still relevant on RHODS1.34 with OCP 4.12 FIPS enabled

[andrei-kochin]

Hello @asanzgom,

Thank you for reporting the issue!
Looks like the proper repo to report issues is actually https://github.com/openvinotoolkit/operator but anyway unfortunately I can't access the log you've shared. Could you please double check that it is accessible by the link?

Thank you!

[avitial]

@asanzgom do you have an update for us? Seems the log you've shared isn't working.

[asanzgom]

Hello @avitial @andrei-kochin sorry I don't know why the link failed:

openvino-notebooks-v2022.3-1-undefined.log

Error is:

Warning: Push failed, retrying in 5s ...
Registry server Address: 
Registry server User Name: serviceaccount
Registry server Email: [email protected]
Registry server Password: <<non-empty>>
error: build error: Failed to push image: writing blob: initiating layer upload to /v2/redhat-ods-applications/openvino-notebooks-v2022.3/blobs/uploads/ in image-registry.openshift-image-registry.svc:5000: received unexpected HTTP status: 500 Internal Server Error

[andrei-kochin]

@avitial please route this to openvinotoolkit/operator
Thank you

[avitial]

@andrei-kochin I don't have authorization to transfer the issue over to operator, can you help transfer/route the issue?

[andrei-kochin]

@avitial @asanzgom I've cloned the issue to the operator openvinotoolkit/operator#95