OCPBUGS-10395: Bump OVN to disable CT flush #1590

tssurya · 2023-03-16T16:49:48Z

- What this PR does and why is it needed

See https://bugzilla.redhat.com/show_bug.cgi?id=2178962#c0 for details.
/cc @jcaamano @dcbw

openshift-ci-robot · 2023-03-16T16:51:13Z

@tssurya: This pull request references Jira Issue OCPBUGS-10395, which is valid.

3 validation(s) were run on this bug

bug is open, matching expected state (open)
bug target version (4.14.0) matches configured target version for branch (4.14.0)
bug is in the state POST, which is one of the valid states (NEW, ASSIGNED, POST)

The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

- What this PR does and why is it needed

- Special notes for reviewers

- How to verify it

- Description for the changelog

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

openshift-ci-robot · 2023-03-16T16:53:24Z

@tssurya: This pull request references Jira Issue OCPBUGS-10395, which is valid.

3 validation(s) were run on this bug

bug is open, matching expected state (open)
bug target version (4.14.0) matches configured target version for branch (4.14.0)
bug is in the state POST, which is one of the valid states (NEW, ASSIGNED, POST)

In response to this:

- What this PR does and why is it needed

See https://bugzilla.redhat.com/show_bug.cgi?id=2178962#c0 for details.
/cc @jcaamano @dcbw

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

dcbw · 2023-03-16T17:14:54Z

/test images

tssurya · 2023-03-16T17:27:52Z

/test images

dcbw · 2023-03-16T17:37:26Z

/test images

dcbw · 2023-03-16T17:44:54Z

/test images

dcbw · 2023-03-16T17:52:58Z

/test images

dcbw · 2023-03-16T17:54:02Z

/approve
/lgtm

dcbw · 2023-03-16T17:54:57Z

/test images

openshift-ci · 2023-03-16T17:55:54Z

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dcbw, tssurya

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

~~OWNERS~~ [dcbw]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

dcbw · 2023-03-16T17:58:18Z

/test images

dcbw · 2023-03-16T18:08:18Z

/test images

dcbw · 2023-03-16T18:09:16Z

/test images

dcbw · 2023-03-16T18:12:20Z

/test images

tssurya · 2023-03-16T18:15:59Z

/test images

dcbw · 2023-03-16T18:19:19Z

/test images

tssurya · 2023-03-16T18:24:41Z

/test images

dcbw · 2023-03-16T18:28:10Z

/test images

dcbw · 2023-03-16T18:29:52Z

/retest

dcbw · 2023-03-16T18:30:37Z

/payload 4.14 ci blocking

openshift-ci · 2023-03-16T18:30:48Z

@dcbw: trigger 4 job(s) of type blocking for the ci release of OCP 4.14

periodic-ci-openshift-release-master-ci-4.14-e2e-aws-ovn-upgrade
periodic-ci-openshift-release-master-ci-4.14-upgrade-from-stable-4.13-e2e-aws-ovn-upgrade
periodic-ci-openshift-release-master-ci-4.14-upgrade-from-stable-4.13-e2e-azure-sdn-upgrade
periodic-ci-openshift-release-master-ci-4.14-e2e-aws-sdn-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/a5c32900-c428-11ed-9fce-10e0edea7e32-0

sdodson · 2023-03-16T19:58:30Z

Test results from #1588 show success on the same effective change.

tssurya · 2023-03-16T20:32:59Z

/test e2e-aws-ovn-shared-to-local-gateway-mode-migration

openshift-ci-robot · 2023-03-16T20:37:20Z

/retest-required

Remaining retests: 0 against base HEAD 6b3b4b7 and 2 for PR HEAD 5968690 in total

dcbw · 2023-03-16T20:39:03Z

/override ci/prow/e2e-aws-ovn-shared-to-local-gateway-mode-migration

Failure is a systemd cgroup timeout on teardown of KCM pod that overruns the 3m timeout the test allows for the new one to start; but the new one can't start until the old one is gone, which is blocked on the systemd/cgroup thing which runs out the clock.

Mar 16 19:24:22.829206 ip-10-0-169-208 kubenswrapper[2127]: E0316 19:24:22.828926    2127 pod_workers.go:965] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods burstable pod6b0fab377a7eda095957f37ba27eecb2] : unable to destroy cgroup paths for cgroup [kubepods burstable pod6b0fab377a7eda095957f37ba27eecb2] : Timed out while waiting for systemd to remove kubepods-burstable-pod6b0fab377a7eda095957f37ba27eecb2.slice" pod="openshift-kube-controller-manager/kube-controller-manager-ip-10-0-169-208.ec2.internal" podUID=6b0fab377a7eda095957f37ba27eecb2

openshift-ci · 2023-03-16T20:39:21Z

@dcbw: Overrode contexts on behalf of dcbw: ci/prow/e2e-aws-ovn-shared-to-local-gateway-mode-migration

In response to this:

/override ci/prow/e2e-aws-ovn-shared-to-local-gateway-mode-migration

Failure is a systemd cgroup timeout on teardown of KCM pod that overruns the 3m timeout the test allows for the new one to start; but the new one can't start until the old one is gone, which is blocked on the systemd/cgroup thing which runs out the clock.
Mar 16 19:24:22.829206 ip-10-0-169-208 kubenswrapper[2127]: E0316 19:24:22.828926    2127 pod_workers.go:965] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods burstable pod6b0fab377a7eda095957f37ba27eecb2] : unable to destroy cgroup paths for cgroup [kubepods burstable pod6b0fab377a7eda095957f37ba27eecb2] : Timed out while waiting for systemd to remove kubepods-burstable-pod6b0fab377a7eda095957f37ba27eecb2.slice" pod="openshift-kube-controller-manager/kube-controller-manager-ip-10-0-169-208.ec2.internal" podUID=6b0fab377a7eda095957f37ba27eecb2

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

dcbw · 2023-03-16T20:52:12Z

/override ci/prow/e2e-vsphere-ovn

level=error msg=Error: failed to parse ovf: failed to parse ovf: XML syntax error on line 1: illegal character code U+0000
level=error
level=error msg=  with vsphereprivate_import_ova.import[0],
level=error msg=  on main.tf line 70, in resource "vsphereprivate_import_ova" "import":
level=error msg=  70: resource "vsphereprivate_import_ova" "import" {
level=error
level=error msg=failed to fetch Cluster: failed to generate asset "Cluster": failure applying terraform for "pre-bootstrap" stage: failed to create cluster: failed to apply Terraform: exit status 1
level=error
level=error msg=Error: failed to parse ovf: failed to parse ovf: XML syntax error on line 1: illegal character code U+0000
level=error
level=error msg=  with vsphereprivate_import_ova.import[0],
level=error msg=  on main.tf line 70, in resource "vsphereprivate_import_ova" "import":
level=error msg=  70: resource "vsphereprivate_import_ova" "import" {

openshift-ci · 2023-03-16T20:53:16Z

@dcbw: Overrode contexts on behalf of dcbw: ci/prow/e2e-vsphere-ovn

In response to this:

/override ci/prow/e2e-vsphere-ovn

level=error msg=Error: failed to parse ovf: failed to parse ovf: XML syntax error on line 1: illegal character code U+0000
level=error
level=error msg=  with vsphereprivate_import_ova.import[0],
level=error msg=  on main.tf line 70, in resource "vsphereprivate_import_ova" "import":
level=error msg=  70: resource "vsphereprivate_import_ova" "import" {
level=error
level=error msg=failed to fetch Cluster: failed to generate asset "Cluster": failure applying terraform for "pre-bootstrap" stage: failed to create cluster: failed to apply Terraform: exit status 1
level=error
level=error msg=Error: failed to parse ovf: failed to parse ovf: XML syntax error on line 1: illegal character code U+0000
level=error
level=error msg=  with vsphereprivate_import_ova.import[0],
level=error msg=  on main.tf line 70, in resource "vsphereprivate_import_ova" "import":
level=error msg=  70: resource "vsphereprivate_import_ova" "import" {

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

dcbw · 2023-03-16T21:07:16Z

/override ci/prow/e2e-aws-ovn-windows

Windows job just took forever to install...

level=info msg=Waiting up to 40m0s (until 9:37PM) for the cluster at https://api.ci-op-1y4v0nx6-f5adf.origin-ci-int-aws.dev.rhcloud.com:6443 to initialize...
{"component":"entrypoint","file":"k8s.io/test-infra/prow/entrypoint/run.go:164","func":"k8s.io/test-infra/prow/entrypoint.Options.ExecuteProcess","level":"error","msg":"Process did not finish before 2h0m0s timeout","severity":"error","time":"2023-03-16T21:03:07Z"}
Setup phase finished, prepare env for next steps

openshift-ci · 2023-03-16T21:11:01Z

@dcbw: Overrode contexts on behalf of dcbw: ci/prow/e2e-aws-ovn-windows

In response to this:

/override ci/prow/e2e-aws-ovn-windows

Windows job just took forever to install...

level=info msg=Waiting up to 40m0s (until 9:37PM) for the cluster at https://api.ci-op-1y4v0nx6-f5adf.origin-ci-int-aws.dev.rhcloud.com:6443 to initialize...
{"component":"entrypoint","file":"k8s.io/test-infra/prow/entrypoint/run.go:164","func":"k8s.io/test-infra/prow/entrypoint.Options.ExecuteProcess","level":"error","msg":"Process did not finish before 2h0m0s timeout","severity":"error","time":"2023-03-16T21:03:07Z"}
Setup phase finished, prepare env for next steps

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

dcbw · 2023-03-16T21:17:24Z

/override ci/prow/e2e-aws-ovn-windows

Windows job just took forever to install...

level=info msg=Waiting up to 40m0s (until 9:37PM) for the cluster at https://api.ci-op-1y4v0nx6-f5adf.origin-ci-int-aws.dev.rhcloud.com:6443 to initialize...
{"component":"entrypoint","file":"k8s.io/test-infra/prow/entrypoint/run.go:164","func":"k8s.io/test-infra/prow/entrypoint.Options.ExecuteProcess","level":"error","msg":"Process did not finish before 2h0m0s timeout","severity":"error","time":"2023-03-16T21:03:07Z"}
Setup phase finished, prepare env for next steps

openshift-ci · 2023-03-16T21:17:40Z

@dcbw: Overrode contexts on behalf of dcbw: ci/prow/e2e-aws-ovn-windows

In response to this:

/override ci/prow/e2e-aws-ovn-windows

Windows job just took forever to install...

level=info msg=Waiting up to 40m0s (until 9:37PM) for the cluster at https://api.ci-op-1y4v0nx6-f5adf.origin-ci-int-aws.dev.rhcloud.com:6443 to initialize...
{"component":"entrypoint","file":"k8s.io/test-infra/prow/entrypoint/run.go:164","func":"k8s.io/test-infra/prow/entrypoint.Options.ExecuteProcess","level":"error","msg":"Process did not finish before 2h0m0s timeout","severity":"error","time":"2023-03-16T21:03:07Z"}
Setup phase finished, prepare env for next steps

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

dcbw · 2023-03-16T21:32:18Z

/override ci/prow/4.13-upgrade-from-stable-4.12-local-gateway-e2e-aws-ovn-upgrade
/override ci/prow/4.13-upgrade-from-stable-4.12-e2e-aws-ovn-upgrade

These jobs don't actually test anything in this PR because they aren't testing 4.14 at all. We are working on bumping them but for now the results are useless.

openshift-ci · 2023-03-16T21:32:34Z

@dcbw: Overrode contexts on behalf of dcbw: ci/prow/4.13-upgrade-from-stable-4.12-e2e-aws-ovn-upgrade, ci/prow/4.13-upgrade-from-stable-4.12-local-gateway-e2e-aws-ovn-upgrade

In response to this:

/override ci/prow/4.13-upgrade-from-stable-4.12-local-gateway-e2e-aws-ovn-upgrade
/override ci/prow/4.13-upgrade-from-stable-4.12-e2e-aws-ovn-upgrade

These jobs don't actually test anything in this PR because they aren't testing 4.14 at all. We are working on bumping them but for now the results are useless.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

dcbw · 2023-03-16T22:45:27Z

/override ci/prow/e2e-aws-ovn-upgrade
/override ci/prow/e2e-aws-ovn-upgrade-local-gateway

While these jobs failed, we do not see the markers of https://issues.redhat.com/browse/OCPBUGS-10395

openshift-ci · 2023-03-16T22:45:44Z

@dcbw: Overrode contexts on behalf of dcbw: ci/prow/e2e-aws-ovn-upgrade, ci/prow/e2e-aws-ovn-upgrade-local-gateway

In response to this:

/override ci/prow/e2e-aws-ovn-upgrade
/override ci/prow/e2e-aws-ovn-upgrade-local-gateway

While these jobs failed, we do not see the markers of https://issues.redhat.com/browse/OCPBUGS-10395

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

dcbw · 2023-03-16T22:45:59Z

/tide refresh

openshift-ci-robot · 2023-03-16T22:46:26Z

@tssurya: Jira Issue OCPBUGS-10395: Some pull requests linked via external trackers have merged:

The following pull requests linked via external trackers have not merged:

openshift/ovn-kubernetes#1586 is open

These pull request must merge or be unlinked from the Jira bug in order for it to move to the next state. Once unlinked, request a bug refresh with /jira refresh.

Jira Issue OCPBUGS-10395 has not been moved to the MODIFIED state.

In response to this:

- What this PR does and why is it needed

See https://bugzilla.redhat.com/show_bug.cgi?id=2178962#c0 for details.
/cc @jcaamano @dcbw

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

dcbw · 2023-03-17T03:13:09Z

/jira refresh

openshift-ci-robot · 2023-03-17T03:13:13Z

@dcbw: Jira Issue OCPBUGS-10395: All pull requests linked via external trackers have merged:

openshift/ovn-kubernetes#1590

Jira Issue OCPBUGS-10395 has been moved to the MODIFIED state.

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Bump OVN to disable CT flush

5968690

dcbw changed the title ~~Bump OVN to disable CT flush~~ OCPBUGS-10395: Bump OVN to disable CT flush Mar 16, 2023

openshift-ci bot requested review from abhat and dcbw March 16, 2023 16:51

openshift-ci bot assigned dcbw Mar 16, 2023

openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Mar 16, 2023

openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Mar 16, 2023

dcbw merged commit 5cfa88c into openshift:master Mar 16, 2023

dcbw mentioned this pull request Mar 17, 2023

OCPBUGS-10395: rhel9 rollback to ovn22.12-22.12.0-33.el9fdp #1586

Closed

OCPBUGS-10395: Bump OVN to disable CT flush #1590

OCPBUGS-10395: Bump OVN to disable CT flush #1590

Conversation

tssurya commented Mar 16, 2023 • edited Loading

openshift-ci-robot commented Mar 16, 2023

openshift-ci-robot commented Mar 16, 2023

dcbw commented Mar 16, 2023

tssurya commented Mar 16, 2023

dcbw commented Mar 16, 2023

dcbw commented Mar 16, 2023

dcbw commented Mar 16, 2023

dcbw commented Mar 16, 2023

dcbw commented Mar 16, 2023

openshift-ci bot commented Mar 16, 2023

dcbw commented Mar 16, 2023

dcbw commented Mar 16, 2023

dcbw commented Mar 16, 2023

dcbw commented Mar 16, 2023

tssurya commented Mar 16, 2023

dcbw commented Mar 16, 2023

tssurya commented Mar 16, 2023

dcbw commented Mar 16, 2023

dcbw commented Mar 16, 2023

dcbw commented Mar 16, 2023

openshift-ci bot commented Mar 16, 2023

sdodson commented Mar 16, 2023

tssurya commented Mar 16, 2023

openshift-ci-robot commented Mar 16, 2023

dcbw commented Mar 16, 2023

openshift-ci bot commented Mar 16, 2023

dcbw commented Mar 16, 2023

openshift-ci bot commented Mar 16, 2023

dcbw commented Mar 16, 2023

openshift-ci bot commented Mar 16, 2023

dcbw commented Mar 16, 2023

openshift-ci bot commented Mar 16, 2023

dcbw commented Mar 16, 2023

openshift-ci bot commented Mar 16, 2023

dcbw commented Mar 16, 2023

openshift-ci bot commented Mar 16, 2023

dcbw commented Mar 16, 2023

openshift-ci-robot commented Mar 16, 2023

dcbw commented Mar 17, 2023

openshift-ci-robot commented Mar 17, 2023

tssurya commented Mar 16, 2023 •

edited

Loading