Test config changed after I ran a test

[PaulChen79]

Hi testkube,

I've created a test by kubernetes yaml:

spec:
  content:
    repository:
      authType: basic
      branch: main
      path: behavior_tests
      tokenSecret:
        key: GIT_TOKEN
        name: testkube
      type: git
      uri: uri
      usernameSecret:
        key: GIT_USERNAME
        name: testkube
    type: git
  executionRequest:
    args:
    - -r
    - --label-filter=invoice_svc_rpc
    - --keep-going
    - --trace
    argsMode: override
    command:
    - ginkgo
  type: ginkgo/test

After I run the test, either success or failed, my yaml config automitacally changed like below.

spec:
  content:
    repository:
      authType: basic
      branch: main
      path: behavior_tests/tests/integration_test
      tokenSecret:
        key: GIT_TOKEN
        name: testkube
      type: git
      uri: uri
      usernameSecret:
        key: GIT_USERNAME
        name: testkube
    type: git
  executionRequest:
    args:
    - -r --randomize-all --keep-going --trace
    argsMode: override
    command:
    - ginkgo
  type: ginkgo/test
status:
  latestExecution:
    endTime: "2024-05-04T07:10:30Z"
    id: 6635df195cf7c509b6426c6f
    number: 1
    startTime: "2024-05-04T07:09:14Z"
    status: passed

If I run test again it will occur an error because the config is changed

⨯ process started with command: ginkgo, exited with code:1  error: exit status 1
output: ginkgo run failed
  flag provided but not defined: -r --randomize-all --keep-going --trace

How do I fix it?

[vsukhin]

kubectl testkube get test format-test --crd-only

kind: Test
metadata:
  name: format-test
  namespace: testkube
  labels:
    executor: ginkgo-executor
    test-type: ginkgo-test
spec:
  type: ginkgo/test
  content:
    type: git
    repository:
      type: git
      uri: uri
      branch: main
      path: behavior_tests
      usernameSecret:
        name: testkube
        key: GIT_USERNAME
      tokenSecret:
        name: testkube
        key: GIT_TOKEN
      authType: basic
  executionRequest:
    args:
      - "-r"
      - "--label-filter=invoice_svc_rpc"
      - "--keep-going"
      - "--trace"
    argsMode: override
    command:
    - "ginkgo"
status:
  latestExecution:
    id: 6638b4194dfe7a505c813674
    number: 1
    startTime: 2024-05-06T10:42:33Z
    endTime: 2024-05-06T10:42:49Z
    status: failed

[vsukhin]

kubectl describe test format-test -n testkube

Name:         format-test
Namespace:    testkube
Labels:       executor=ginkgo-executor
              test-type=ginkgo-test
Annotations:  <none>
API Version:  tests.testkube.io/v3
Kind:         Test
Metadata:
  Creation Timestamp:  2024-05-06T10:40:36Z
  Generation:          1
  Resource Version:    16476763
  UID:                 96dcea0e-65cc-40de-9b98-80a2e981a62f
Spec:
  Content:
    Repository:
      Auth Type:  basic
      Branch:     main
      Path:       behavior_tests
      Token Secret:
        Key:   GIT_TOKEN
        Name:  testkube
      Type:    git
      Uri:     uri
      Username Secret:
        Key:   GIT_USERNAME
        Name:  testkube
    Type:      git
  Execution Request:
    Args:
      -r
      --label-filter=invoice_svc_rpc
      --keep-going
      --trace
    Args Mode:  override
    Command:
      ginkgo
  Type:  ginkgo/test
Status:
  Latest Execution:
    End Time:    2024-05-06T10:42:49Z
    Id:          6638b4194dfe7a505c813674
    Number:      1
    Start Time:  2024-05-06T10:42:33Z
    Status:      failed
Events:          <none>

[vsukhin]

we don't change test spec after execution. only metadata