End to End Tests #1528
Annotations
5 errors, 30 warnings, and 6 notices
login/login.spec.ts:199:21 › Login › Password login › verification after login › with force_verification on › Shows unskippable verification prompt after login if signing keys are set up:
playwright/e2e/login/login.spec.ts#L220
1) login/login.spec.ts:199:21 › Login › Password login › verification after login › with force_verification on › Shows unskippable verification prompt after login if signing keys are set up
Error: expect(locator).not.toBeVisible()
Locator: getByRole('heading', { name: 'Verify this device', level: 1 }).locator('.mx_CompleteSecurity_skip')
Expected: not visible
Received: visible
Call log:
- expect.not.toBeVisible with timeout 5000ms
- waiting for getByRole('heading', { name: 'Verify this device', level: 1 }).locator('.mx_CompleteSecurity_skip')
218 | await expect(h1).toBeVisible();
219 |
> 220 | expect(h1.locator(".mx_CompleteSecurity_skip")).not.toBeVisible();
| ^
221 | });
222 | });
223 | });
at /home/runner/work/element-web/element-web/playwright/e2e/login/login.spec.ts:220:73
|
threads/threads.spec.ts:354:9 › Threads › should send location and reply to the location on ThreadView:
playwright/e2e/threads/threads.spec.ts#L403
1) threads/threads.spec.ts:354:9 › Threads › should send location and reply to the location on ThreadView
Error: Screenshot comparison failed:
2332 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/threads/threads.spec.ts/Reply-to-the-location-on-ThreadView-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView/Reply-to-the-location-on-ThreadView-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView/Reply-to-the-location-on-ThreadView-diff.png
Call log:
- expect.toHaveScreenshot(Reply-to-the-location-on-ThreadView.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_ThreadView')
- locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 2332 pixels (ratio 0.02 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_ThreadView')
- locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 2332 pixels (ratio 0.02 of all image pixels) are different.
401 | // Take a snapshot of reply to the shared location
402 | await page.addStyleTag({ content: css });
> 403 | await expect(page.locator(".mx_ThreadView")).toMatchScreenshot("Reply_to_the_location_on_ThreadView.png");
| ^
404 | });
405 |
406 | test("right panel behaves correctly", async ({ page, app, user }) => {
at /home/runner/work/element-web/element-web/playwright/e2e/threads/threads.spec.ts:403:54
|
accessibility/keyboard-navigation.spec.ts:17:9 › Landmark navigation tests › without any rooms:
playwright/e2e/accessibility/keyboard-navigation.spec.ts#L25
1) accessibility/keyboard-navigation.spec.ts:17:9 › Landmark navigation tests › without any rooms
Error: Timed out 5000ms waiting for expect(locator).toBeFocused()
Locator: locator('.mx_SpaceButton_active')
Expected: focused
Received: inactive
Call log:
- expect.toBeFocused with timeout 5000ms
- waiting for locator('.mx_SpaceButton_active')
- locator resolved to <div tabindex="-1" role="button" aria-label="Home" class="mx_AccessibleButton mx_SpaceButton mx_SpaceButton_home mx_SpaceButton_active mx_SpaceButton_narrow">…</div>
- unexpected value "not focused"
- locator resolved to <div tabindex="-1" role="button" aria-label="Home" class="mx_AccessibleButton mx_SpaceButton mx_SpaceButton_home mx_SpaceButton_active mx_SpaceButton_narrow">…</div>
- unexpected value "not focused"
- locator resolved to <div tabindex="-1" role="button" aria-label="Home" class="mx_AccessibleButton mx_SpaceButton mx_SpaceButton_home mx_SpaceButton_active mx_SpaceButton_narrow">…</div>
- unexpected value "not focused"
- locator resolved to <div tabindex="-1" role="button" aria-label="Home" class="mx_AccessibleButton mx_SpaceButton mx_SpaceButton_home mx_SpaceButton_active mx_SpaceButton_narrow">…</div>
- unexpected value "not focused"
- locator resolved to <div tabindex="-1" role="button" aria-label="Home" class="mx_AccessibleButton mx_SpaceButton mx_SpaceButton_home mx_SpaceButton_active mx_SpaceButton_narrow">…</div>
- unexpected value "not focused"
- locator resolved to <div tabindex="-1" role="button" aria-label="Home" class="mx_AccessibleButton mx_SpaceButton mx_SpaceButton_home mx_SpaceButton_active mx_SpaceButton_narrow">…</div>
- unexpected value "not focused"
- locator resolved to <div tabindex="-1" role="button" aria-label="Home" class="mx_AccessibleButton mx_SpaceButton mx_SpaceButton_home mx_SpaceButton_active mx_SpaceButton_narrow">…</div>
- unexpected value "not focused"
- locator resolved to <div tabindex="-1" role="button" aria-label="Home" class="mx_AccessibleButton mx_SpaceButton mx_SpaceButton_home mx_SpaceButton_active mx_SpaceButton_narrow">…</div>
- unexpected value "not focused"
- locator resolved to <div tabindex="-1" role="button" aria-label="Home" class="mx_AccessibleButton mx_SpaceButton mx_SpaceButton_home mx_SpaceButton_active mx_SpaceButton_narrow">…</div>
- unexpected value "not focused"
23 | // Pressing Control+F6 will first focus the space button
24 | await page.keyboard.press("ControlOrMeta+F6");
> 25 | await expect(page.locator(".mx_SpaceButton_active")).toBeFocused();
| ^
26 |
27 | // Pressing Control+F6 again will focus room search
28 | await page.keyboard.press("ControlOrMeta+F6");
at /home/runner/work/element-web/element-web/playwright/e2e/accessibility/keyboard-navigation.spec.ts:25:62
|
crypto/user-verification.spec.ts:34:9 › User verification › can receive a verification request when there is no existing DM:
playwright/e2e/crypto/user-verification.spec.ts#L1
2) crypto/user-verification.spec.ts:34:9 › User verification › can receive a verification request when there is no existing DM
Test timeout of 30000ms exceeded.
|
crypto/user-verification.spec.ts:34:9 › User verification › can receive a verification request when there is no existing DM:
playwright/e2e/crypto/utils.ts#L374
2) crypto/user-verification.spec.ts:34:9 › User verification › can receive a verification request when there is no existing DM
Error: jsHandle.evaluateHandle: Test timeout of 30000ms exceeded.
at crypto/utils.ts:374
372 | botVerificationRequest: JSHandle<VerificationRequest>,
373 | ): Promise<JSHandle<Verifier>> {
> 374 | return botVerificationRequest.evaluateHandle(async (verificationRequest) => {
| ^
375 | while (!verificationRequest.verifier) {
376 | await new Promise((r) => verificationRequest.once("change" as any, r));
377 | }
at awaitVerifier (/home/runner/work/element-web/element-web/playwright/e2e/crypto/utils.ts:374:35)
at /home/runner/work/element-web/element-web/playwright/e2e/crypto/user-verification.spec.ts:67:48
|
Slow Test:
read-receipts/high-level.spec.ts#L1
read-receipts/high-level.spec.ts took 3.3m
|
Slow Test:
read-receipts/new-messages-in-threads.spec.ts#L1
read-receipts/new-messages-in-threads.spec.ts took 1.7m
|
Slow Test:
read-receipts/editing-messages-in-threads.spec.ts#L1
read-receipts/editing-messages-in-threads.spec.ts took 1.3m
|
Slow Test:
read-receipts/editing-messages-main-timeline.spec.ts#L1
read-receipts/editing-messages-main-timeline.spec.ts took 1.1m
|
Slow Test:
read-receipts/editing-messages-thread-roots.spec.ts#L1
read-receipts/editing-messages-thread-roots.spec.ts took 52.7s
|
Slow Test:
read-receipts/redactions-in-threads.spec.ts#L1
read-receipts/redactions-in-threads.spec.ts took 2.5m
|
Slow Test:
read-receipts/redactions-main-timeline.spec.ts#L1
read-receipts/redactions-main-timeline.spec.ts took 1.9m
|
Slow Test:
read-receipts/new-messages-main-timeline.spec.ts#L1
read-receipts/new-messages-main-timeline.spec.ts took 1.3m
|
Slow Test:
read-receipts/read-receipts.spec.ts#L1
read-receipts/read-receipts.spec.ts took 1.0m
|
Slow Test:
read-receipts/reactions-in-threads.spec.ts#L1
read-receipts/reactions-in-threads.spec.ts took 58.6s
|
Slow Test:
messages/messages.spec.ts#L1
messages/messages.spec.ts took 2.2m
|
Slow Test:
pinned-messages/pinned-messages.spec.ts#L1
pinned-messages/pinned-messages.spec.ts took 1.6m
|
Slow Test:
integration-manager/read_events.spec.ts#L1
integration-manager/read_events.spec.ts took 35.6s
|
Slow Test:
polls/polls.spec.ts#L1
polls/polls.spec.ts took 35.5s
|
Slow Test:
knock/knock-into-room.spec.ts#L1
knock/knock-into-room.spec.ts took 35.1s
|
Slow Test:
read-receipts/redactions-thread-roots.spec.ts#L1
read-receipts/redactions-thread-roots.spec.ts took 1.2m
|
Slow Test:
spaces/spaces.spec.ts#L1
spaces/spaces.spec.ts took 1.1m
|
Slow Test:
right-panel/right-panel.spec.ts#L1
right-panel/right-panel.spec.ts took 1.0m
|
Slow Test:
right-panel/file-panel.spec.ts#L1
right-panel/file-panel.spec.ts took 43.3s
|
Slow Test:
settings/account-user-settings-tab.spec.ts#L1
settings/account-user-settings-tab.spec.ts took 42.4s
|
Slow Test:
timeline/timeline.spec.ts#L1
timeline/timeline.spec.ts took 2.9m
|
Slow Test:
spotlight/spotlight.spec.ts#L1
spotlight/spotlight.spec.ts took 2.1m
|
Slow Test:
spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.7m
|
Slow Test:
user-onboarding/user-onboarding-new.spec.ts#L1
user-onboarding/user-onboarding-new.spec.ts took 33.4s
|
Slow Test:
widgets/widget-pip-close.spec.ts#L1
widgets/widget-pip-close.spec.ts took 23.8s
|
Slow Test:
audio-player/audio-player.spec.ts#L1
audio-player/audio-player.spec.ts took 1.3m
|
Slow Test:
composer/RTE.spec.ts#L1
composer/RTE.spec.ts took 1.2m
|
Slow Test:
crypto/crypto.spec.ts#L1
crypto/crypto.spec.ts took 1.1m
|
Slow Test:
crypto/event-shields.spec.ts#L1
crypto/event-shields.spec.ts took 1.1m
|
Slow Test:
crypto/device-verification.spec.ts#L1
crypto/device-verification.spec.ts took 51.2s
|
🎭 Playwright Run Summary
32 skipped
42 passed (8.5m)
|
🎭 Playwright Run Summary
14 skipped
62 passed (9.6m)
|
🎭 Playwright Run Summary
1 flaky
login/login.spec.ts:199:21 › Login › Password login › verification after login › with force_verification on › Shows unskippable verification prompt after login if signing keys are set up
1 skipped
77 passed (10.5m)
|
🎭 Playwright Run Summary
10 skipped
70 passed (10.5m)
|
🎭 Playwright Run Summary
1 flaky
threads/threads.spec.ts:354:9 › Threads › should send location and reply to the location on ThreadView
4 skipped
66 passed (10.3m)
|
🎭 Playwright Run Summary
2 flaky
accessibility/keyboard-navigation.spec.ts:17:9 › Landmark navigation tests › without any rooms ─
crypto/user-verification.spec.ts:34:9 › User verification › can receive a verification request when there is no existing DM
1 skipped
75 passed (12.9m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-1
Expired
|
6.68 MB |
|
all-blob-reports-2
Expired
|
6.14 MB |
|
all-blob-reports-3
Expired
|
271 KB |
|
all-blob-reports-4
Expired
|
331 KB |
|
all-blob-reports-5
Expired
|
754 KB |
|
all-blob-reports-6
Expired
|
7.09 MB |
|
html-report
|
19.7 MB |
|
webapp
Expired
|
37 MB |
|