Skip to content

API: move to api-version=2 for faster streaming LLM responses #21269

API: move to api-version=2 for faster streaming LLM responses

API: move to api-version=2 for faster streaming LLM responses #21269

Triggered via pull request September 11, 2024 19:55
Status Failure
Total duration 6m 7s
Artifacts

ci.yml

on: pull_request
fast_tests_matrix_prep
0s
fast_tests_matrix_prep
slow_tests_matrix_prep
0s
slow_tests_matrix_prep
Matrix: test-integration
Matrix: test-unit
Matrix: test-e2e
Fit to window
Zoom out
Zoom in

Annotations

15 errors, 14 warnings, and 5 notices
test-unit (ubuntu, 20)
The v0 series of google-github-actions/auth is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions: https://github.com/google-github-actions/auth
test-unit (ubuntu, 20)
The v0 series of google-github-actions/setup-gcloud is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions: https://github.com/google-github-actions/setup-gcloud
src/chat/utils.test.ts > validateAuthStatus > returns auth status for dotcom: vscode/src/chat/utils.test.ts#L30
AssertionError: expected { authenticated: true, …(8) } to strictly equal { …(9) } - Expected + Received Object { "authenticated": true, - "codyApiVersion": 1, + "codyApiVersion": 2, "endpoint": "https://sourcegraph.com/", "hasVerifiedEmail": true, "isFireworksTracingEnabled": false, "primaryEmail": "[email protected]", "requiresVerifiedEmail": true, "siteVersion": "999", "username": "alice", } ❯ src/chat/utils.test.ts:30:11
src/edit.test.ts > Edit > editCommand/code (generate new code): agent/src/edit.test.ts#L117
Error: Snapshot `Edit > editCommand/code (generate new code) > console.error(error) ===================================================[ NOTICE ]======================================================= If you get PollyError or unexpected diff, you might need to update recordings to match your changes. Run the following commands locally to update the recordings: source agent/scripts/export-cody-http-recording-tokens.sh pnpm update-agent-recordings # Press 'u' to update the snapshots if the new behavior makes sense. It's # normal that the LLM returns minor changes to the wording. git commit -am "Update agent recordings" More details in https://github.com/sourcegraph/cody/tree/main/agent#updating-the-polly-http-recordings ==================================================================================================================== 1` mismatched - Expected + Received @@ -5,9 +5,10 @@ level?: number; } export const Heading: React.FC<HeadingProps> = ({ text, level = 1 }) => { const HeadingTag = `h${level}` as keyof JSX.IntrinsicElements; + return <HeadingTag>{text}</HeadingTag>; }; " ❯ src/edit.test.ts:117:42
test-unit (ubuntu, 20)
Process completed with exit code 1.
test-unit (ubuntu, 18)
The v0 series of google-github-actions/setup-gcloud is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions: https://github.com/google-github-actions/setup-gcloud
test-unit (ubuntu, 18)
The v0 series of google-github-actions/auth is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions: https://github.com/google-github-actions/auth
src/chat/utils.test.ts > validateAuthStatus > returns auth status for dotcom: vscode/src/chat/utils.test.ts#L30
AssertionError: expected { authenticated: true, …(8) } to strictly equal { …(9) } - Expected + Received Object { "authenticated": true, - "codyApiVersion": 1, + "codyApiVersion": 2, "endpoint": "https://sourcegraph.com/", "hasVerifiedEmail": true, "isFireworksTracingEnabled": false, "primaryEmail": "[email protected]", "requiresVerifiedEmail": true, "siteVersion": "999", "username": "alice", } ❯ src/chat/utils.test.ts:30:11
src/edit.test.ts > Edit > editCommand/code (generate new code): agent/src/edit.test.ts#L117
Error: Snapshot `Edit > editCommand/code (generate new code) > console.error(error) ===================================================[ NOTICE ]======================================================= If you get PollyError or unexpected diff, you might need to update recordings to match your changes. Run the following commands locally to update the recordings: source agent/scripts/export-cody-http-recording-tokens.sh pnpm update-agent-recordings # Press 'u' to update the snapshots if the new behavior makes sense. It's # normal that the LLM returns minor changes to the wording. git commit -am "Update agent recordings" More details in https://github.com/sourcegraph/cody/tree/main/agent#updating-the-polly-http-recordings ==================================================================================================================== 1` mismatched - Expected + Received @@ -5,9 +5,10 @@ level?: number; } export const Heading: React.FC<HeadingProps> = ({ text, level = 1 }) => { const HeadingTag = `h${level}` as keyof JSX.IntrinsicElements; + return <HeadingTag>{text}</HeadingTag>; }; " ❯ src/edit.test.ts:117:42
test-unit (ubuntu, 18)
Process completed with exit code 1.
test-unit (windows, 20)
The v0 series of google-github-actions/auth is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions: https://github.com/google-github-actions/auth
src/chat/utils.test.ts > validateAuthStatus > returns auth status for dotcom: vscode/src/chat/utils.test.ts#L30
AssertionError: expected { authenticated: true, …(8) } to strictly equal { …(9) } - Expected + Received Object { "authenticated": true, - "codyApiVersion": 1, + "codyApiVersion": 2, "endpoint": "https://sourcegraph.com/", "hasVerifiedEmail": true, "isFireworksTracingEnabled": false, "primaryEmail": "[email protected]", "requiresVerifiedEmail": true, "siteVersion": "999", "username": "alice", } ❯ src/chat/utils.test.ts:30:11
src/edit.test.ts > Edit > editCommand/code (generate new code): agent/src/edit.test.ts#L117
Error: Snapshot `Edit > editCommand/code (generate new code) > console.error(error) ===================================================[ NOTICE ]======================================================= If you get PollyError or unexpected diff, you might need to update recordings to match your changes. Run the following commands locally to update the recordings: source agent/scripts/export-cody-http-recording-tokens.sh pnpm update-agent-recordings # Press 'u' to update the snapshots if the new behavior makes sense. It's # normal that the LLM returns minor changes to the wording. git commit -am "Update agent recordings" More details in https://github.com/sourcegraph/cody/tree/main/agent#updating-the-polly-http-recordings ==================================================================================================================== 1` mismatched - Expected + Received @@ -5,9 +5,10 @@ level?: number; } export const Heading: React.FC<HeadingProps> = ({ text, level = 1 }) => { const HeadingTag = `h${level}` as keyof JSX.IntrinsicElements; + return <HeadingTag>{text}</HeadingTag>; }; " ❯ src/edit.test.ts:117:42
test-unit (windows, 20)
Process completed with exit code 1.
test-unit (windows, 20)
The v0 series of google-github-actions/setup-gcloud is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions: https://github.com/google-github-actions/setup-gcloud
Slow Test: vscode/command-edit.test.ts#L1
vscode/command-edit.test.ts took 35.2s
Slow Test: vscode/enterprise-cody-ignore.test.ts#L1
vscode/enterprise-cody-ignore.test.ts took 18.8s
test-unit (ubuntu, 20)
The following actions use a deprecated Node.js version and will be forced to run on node20: google-github-actions/auth@v0, google-github-actions/setup-gcloud@v0. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Slow Test: vscode/initial-context.test.ts#L1
vscode/initial-context.test.ts took 45.5s
Slow Test: vscode/support-menu-items.test.ts#L1
vscode/support-menu-items.test.ts took 16.3s
Slow Test: vscode/chat-input.test.ts#L1
vscode/chat-input.test.ts took 44.6s
Slow Test: vscode/chat-rateLimit.test.ts#L1
vscode/chat-rateLimit.test.ts took 23.5s
Slow Test: vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.1m
Slow Test: vscode/attribution.test.ts#L1
vscode/attribution.test.ts took 17.5s
test-unit (ubuntu, 18)
The following actions use a deprecated Node.js version and will be forced to run on node20: google-github-actions/auth@v0, google-github-actions/setup-gcloud@v0. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Slow Test: vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 58.1s
Slow Test: vscode/command-core.test.ts#L1
vscode/command-core.test.ts took 34.5s
Slow Test: vscode/code-actions.test.ts#L1
vscode/code-actions.test.ts took 29.6s
test-unit (windows, 20)
The following actions use a deprecated Node.js version and will be forced to run on node20: google-github-actions/auth@v0, google-github-actions/setup-gcloud@v0. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
🎭 Playwright Run Summary
1 skipped 6 passed (1.3m)
🎭 Playwright Run Summary
2 skipped 7 passed (1.3m)
🎭 Playwright Run Summary
10 passed (1.7m)
🎭 Playwright Run Summary
9 passed (1.8m)
🎭 Playwright Run Summary
10 passed (2.3m)