API: move to api-version=2 for faster streaming LLM responses #21269
ci.yml
on: pull_request
fast_tests_matrix_prep
0s
slow_tests_matrix_prep
0s
build
2m 11s
Matrix: test-integration
Matrix: test-unit
Matrix: test-e2e
Annotations
15 errors, 14 warnings, and 5 notices
test-unit (ubuntu, 20)
The v0 series of google-github-actions/auth is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions:
https://github.com/google-github-actions/auth
|
test-unit (ubuntu, 20)
The v0 series of google-github-actions/setup-gcloud is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions:
https://github.com/google-github-actions/setup-gcloud
|
src/chat/utils.test.ts > validateAuthStatus > returns auth status for dotcom:
vscode/src/chat/utils.test.ts#L30
AssertionError: expected { authenticated: true, …(8) } to strictly equal { …(9) }
- Expected
+ Received
Object {
"authenticated": true,
- "codyApiVersion": 1,
+ "codyApiVersion": 2,
"endpoint": "https://sourcegraph.com/",
"hasVerifiedEmail": true,
"isFireworksTracingEnabled": false,
"primaryEmail": "[email protected]",
"requiresVerifiedEmail": true,
"siteVersion": "999",
"username": "alice",
}
❯ src/chat/utils.test.ts:30:11
|
src/edit.test.ts > Edit > editCommand/code (generate new code):
agent/src/edit.test.ts#L117
Error: Snapshot `Edit > editCommand/code (generate new code) >
console.error(error)
===================================================[ NOTICE ]=======================================================
If you get PollyError or unexpected diff, you might need to update recordings to match your changes.
Run the following commands locally to update the recordings:
source agent/scripts/export-cody-http-recording-tokens.sh
pnpm update-agent-recordings
# Press 'u' to update the snapshots if the new behavior makes sense. It's
# normal that the LLM returns minor changes to the wording.
git commit -am "Update agent recordings"
More details in https://github.com/sourcegraph/cody/tree/main/agent#updating-the-polly-http-recordings
====================================================================================================================
1` mismatched
- Expected
+ Received
@@ -5,9 +5,10 @@
level?: number;
}
export const Heading: React.FC<HeadingProps> = ({ text, level = 1 }) => {
const HeadingTag = `h${level}` as keyof JSX.IntrinsicElements;
+
return <HeadingTag>{text}</HeadingTag>;
};
"
❯ src/edit.test.ts:117:42
|
test-unit (ubuntu, 20)
Process completed with exit code 1.
|
test-unit (ubuntu, 18)
The v0 series of google-github-actions/setup-gcloud is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions:
https://github.com/google-github-actions/setup-gcloud
|
test-unit (ubuntu, 18)
The v0 series of google-github-actions/auth is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions:
https://github.com/google-github-actions/auth
|
src/chat/utils.test.ts > validateAuthStatus > returns auth status for dotcom:
vscode/src/chat/utils.test.ts#L30
AssertionError: expected { authenticated: true, …(8) } to strictly equal { …(9) }
- Expected
+ Received
Object {
"authenticated": true,
- "codyApiVersion": 1,
+ "codyApiVersion": 2,
"endpoint": "https://sourcegraph.com/",
"hasVerifiedEmail": true,
"isFireworksTracingEnabled": false,
"primaryEmail": "[email protected]",
"requiresVerifiedEmail": true,
"siteVersion": "999",
"username": "alice",
}
❯ src/chat/utils.test.ts:30:11
|
src/edit.test.ts > Edit > editCommand/code (generate new code):
agent/src/edit.test.ts#L117
Error: Snapshot `Edit > editCommand/code (generate new code) >
console.error(error)
===================================================[ NOTICE ]=======================================================
If you get PollyError or unexpected diff, you might need to update recordings to match your changes.
Run the following commands locally to update the recordings:
source agent/scripts/export-cody-http-recording-tokens.sh
pnpm update-agent-recordings
# Press 'u' to update the snapshots if the new behavior makes sense. It's
# normal that the LLM returns minor changes to the wording.
git commit -am "Update agent recordings"
More details in https://github.com/sourcegraph/cody/tree/main/agent#updating-the-polly-http-recordings
====================================================================================================================
1` mismatched
- Expected
+ Received
@@ -5,9 +5,10 @@
level?: number;
}
export const Heading: React.FC<HeadingProps> = ({ text, level = 1 }) => {
const HeadingTag = `h${level}` as keyof JSX.IntrinsicElements;
+
return <HeadingTag>{text}</HeadingTag>;
};
"
❯ src/edit.test.ts:117:42
|
test-unit (ubuntu, 18)
Process completed with exit code 1.
|
test-unit (windows, 20)
The v0 series of google-github-actions/auth is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions:
https://github.com/google-github-actions/auth
|
src/chat/utils.test.ts > validateAuthStatus > returns auth status for dotcom:
vscode/src/chat/utils.test.ts#L30
AssertionError: expected { authenticated: true, …(8) } to strictly equal { …(9) }
- Expected
+ Received
Object {
"authenticated": true,
- "codyApiVersion": 1,
+ "codyApiVersion": 2,
"endpoint": "https://sourcegraph.com/",
"hasVerifiedEmail": true,
"isFireworksTracingEnabled": false,
"primaryEmail": "[email protected]",
"requiresVerifiedEmail": true,
"siteVersion": "999",
"username": "alice",
}
❯ src/chat/utils.test.ts:30:11
|
src/edit.test.ts > Edit > editCommand/code (generate new code):
agent/src/edit.test.ts#L117
Error: Snapshot `Edit > editCommand/code (generate new code) >
console.error(error)
===================================================[ NOTICE ]=======================================================
If you get PollyError or unexpected diff, you might need to update recordings to match your changes.
Run the following commands locally to update the recordings:
source agent/scripts/export-cody-http-recording-tokens.sh
pnpm update-agent-recordings
# Press 'u' to update the snapshots if the new behavior makes sense. It's
# normal that the LLM returns minor changes to the wording.
git commit -am "Update agent recordings"
More details in https://github.com/sourcegraph/cody/tree/main/agent#updating-the-polly-http-recordings
====================================================================================================================
1` mismatched
- Expected
+ Received
@@ -5,9 +5,10 @@
level?: number;
}
export const Heading: React.FC<HeadingProps> = ({ text, level = 1 }) => {
const HeadingTag = `h${level}` as keyof JSX.IntrinsicElements;
+
return <HeadingTag>{text}</HeadingTag>;
};
"
❯ src/edit.test.ts:117:42
|
test-unit (windows, 20)
Process completed with exit code 1.
|
test-unit (windows, 20)
The v0 series of google-github-actions/setup-gcloud is no longer maintained. It will not receive updates, improvements, or security patches. Please upgrade to the latest supported versions:
https://github.com/google-github-actions/setup-gcloud
|
Slow Test:
vscode/command-edit.test.ts#L1
vscode/command-edit.test.ts took 35.2s
|
Slow Test:
vscode/enterprise-cody-ignore.test.ts#L1
vscode/enterprise-cody-ignore.test.ts took 18.8s
|
test-unit (ubuntu, 20)
The following actions use a deprecated Node.js version and will be forced to run on node20: google-github-actions/auth@v0, google-github-actions/setup-gcloud@v0. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
Slow Test:
vscode/initial-context.test.ts#L1
vscode/initial-context.test.ts took 45.5s
|
Slow Test:
vscode/support-menu-items.test.ts#L1
vscode/support-menu-items.test.ts took 16.3s
|
Slow Test:
vscode/chat-input.test.ts#L1
vscode/chat-input.test.ts took 44.6s
|
Slow Test:
vscode/chat-rateLimit.test.ts#L1
vscode/chat-rateLimit.test.ts took 23.5s
|
Slow Test:
vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.1m
|
Slow Test:
vscode/attribution.test.ts#L1
vscode/attribution.test.ts took 17.5s
|
test-unit (ubuntu, 18)
The following actions use a deprecated Node.js version and will be forced to run on node20: google-github-actions/auth@v0, google-github-actions/setup-gcloud@v0. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
Slow Test:
vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 58.1s
|
Slow Test:
vscode/command-core.test.ts#L1
vscode/command-core.test.ts took 34.5s
|
Slow Test:
vscode/code-actions.test.ts#L1
vscode/code-actions.test.ts took 29.6s
|
test-unit (windows, 20)
The following actions use a deprecated Node.js version and will be forced to run on node20: google-github-actions/auth@v0, google-github-actions/setup-gcloud@v0. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
🎭 Playwright Run Summary
1 skipped
6 passed (1.3m)
|
🎭 Playwright Run Summary
2 skipped
7 passed (1.3m)
|
🎭 Playwright Run Summary
10 passed (1.7m)
|
🎭 Playwright Run Summary
9 passed (1.8m)
|
🎭 Playwright Run Summary
10 passed (2.3m)
|