Skip to content

Update jest - autoclosed #2700

Update jest - autoclosed

Update jest - autoclosed #2700

Triggered via pull request November 26, 2024 16:15
Status Failure
Total duration 57m 18s
Artifacts 8

end-to-end-tests.yaml

on: pull_request
Build Element-Web
1m 48s
Build Element-Web
Matrix: playwright
end-to-end-tests
31s
end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

14 errors, 30 warnings, and 6 notices
spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 β€Ί Threads Activity Centre β€Ί should mark all threads as read: playwright/e2e/spaces/threads-activity-centre/index.ts#L379
1) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 β€Ί Threads Activity Centre β€Ί should mark all threads as read Error: locator.click: Error: strict mode violation: getByLabel('Mark all as read') resolved to 2 elements: 1) <div tabindex="0" role="button" aria-label="Mark all as read" class="mx_AccessibleButton mx_TopUnreadMessagesBar_markAsRead"></div> aka getByRole('main').getByLabel('Mark all as read') 2) <button tabindex="0" role="button" aria-labelledby=":r6s:" class="_icon-button_bh2qc_17">…</button> aka locator('#thread-panel').getByLabel('Mark all as read') Call log: - waiting for getByLabel('Mark all as read') at spaces/threads-activity-centre/index.ts:379 377 | */ 378 | clickMarkAllThreadsRead() { > 379 | return this.page.getByLabel("Mark all as read").click(); | ^ 380 | } 381 | } 382 | at Helpers.clickMarkAllThreadsRead (/home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/index.ts:379:57) at /home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:149:14
spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 β€Ί Threads Activity Centre β€Ί should mark all threads as read: playwright/e2e/spaces/threads-activity-centre/index.ts#L283
1) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 β€Ί Threads Activity Centre β€Ί should mark all threads as read Error: Screenshot comparison failed: 39 pixels (ratio 0.04 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-no-indicator-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/spaces-threads-activity-ce-ffe63-ld-mark-all-threads-as-read/tac-no-indicator-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/spaces-threads-activity-ce-ffe63-ld-mark-all-threads-as-read/tac-no-indicator-diff.png Call log: - expect.toHaveScreenshot(tac-no-indicator.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('navigation', { name: 'Spaces' }).getByLabel('Threads') - locator resolved to <button tabindex="0" type="button" role="button" id="radix-:r8:" data-state="closed" aria-label="Threads" aria-haspopup="menu" aria-expanded="false" aria-disabled="false" aria-labelledby=":ra:" data-indicator="success" class="_icon-button_bh2qc_17 mx_ThreadsActivityCentreButton">…</button> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 39 pixels (ratio 0.04 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('navigation', { name: 'Spaces' }).getByLabel('Threads') - locator resolved to <button tabindex="0" type="button" role="button" id="radix-:r8:" data-state="closed" aria-label="Threads" aria-haspopup="menu" aria-expanded="false" aria-disabled="false" aria-labelledby=":ra:" data-indicator="success" class="_icon-button_bh2qc_17 mx_ThreadsActivityCentreButton">…</button> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 39 pixels (ratio 0.04 of all image pixels) are different. at spaces/threads-activity-centre/index.ts:283 281 | await expect(this.getTacButton().locator("[data-indicator='success']")).not.toBeVisible(); 282 | await expect(this.getTacButton().locator("[data-indicator='critical']")).not.toBeVisible(); > 283 | await expect(this.getTacButton()).toMatchScreenshot("tac-no-indicator.png"); | ^ 284 | } 285 | 286 | /** at Helpers.assertNoTacIndicator (/home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/index.ts:283:43) at /home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:151:9
read-receipts/redactions-in-threads.spec.ts:410:17 β€Ί Read receipts β€Ί redactions β€Ί in threads β€Ί A thread with a redacted unread is still read after restart: playwright/e2e/read-receipts/index.ts#L446
1) read-receipts/redactions-in-threads.spec.ts:410:17 β€Ί Read receipts β€Ί redactions β€Ί in threads β€Ί A thread with a redacted unread is still read after restart Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible() Locator: getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_dot') Expected: not visible Received: visible Call log: - expect.not.toBeVisible with timeout 5000ms - waiting for getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_dot') - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" at read-receipts/index.ts:446 444 | async assertRead(room: string | { name: string }) { 445 | const tile = this.getRoomListTile(room); > 446 | await expect(tile.locator(".mx_NotificationBadge_dot")).not.toBeVisible(); | ^ 447 | await expect(tile.locator(".mx_NotificationBadge_count")).not.toBeVisible(); 448 | } 449 | at Helpers.assertRead (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:446:69) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/redactions-in-threads.spec.ts:440:28
crypto/backups.spec.ts:26:9 β€Ί Backups β€Ί Create: playwright/e2e/crypto/backups.spec.ts#L1
1) crypto/backups.spec.ts:26:9 β€Ί Backups β€Ί Create, delete and recreate a keys backup ───────────── Test timeout of 30000ms exceeded.
crypto/backups.spec.ts:26:9 β€Ί Backups β€Ί Create: playwright/e2e/crypto/backups.spec.ts#L31
1) crypto/backups.spec.ts:26:9 β€Ί Backups β€Ί Create, delete and recreate a keys backup ───────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }).getByRole('button', { name: 'Set up', exact: true }) 29 | 30 | await expect(securityTab.getByRole("heading", { name: "Secure Backup" })).toBeVisible(); > 31 | await securityTab.getByRole("button", { name: "Set up", exact: true }).click(); | ^ 32 | 33 | const currentDialogLocator = page.locator(".mx_Dialog"); 34 | at /home/runner/work/element-web/element-web/playwright/e2e/crypto/backups.spec.ts:31:80
crypto/backups.spec.ts:26:9 β€Ί Backups β€Ί Create: playwright/e2e/crypto/backups.spec.ts#L1
1) crypto/backups.spec.ts:26:9 β€Ί Backups β€Ί Create, delete and recreate a keys backup ───────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
crypto/backups.spec.ts:26:9 β€Ί Backups β€Ί Create: playwright/e2e/crypto/backups.spec.ts#L31
1) crypto/backups.spec.ts:26:9 β€Ί Backups β€Ί Create, delete and recreate a keys backup ───────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }).getByRole('button', { name: 'Set up', exact: true }) 29 | 30 | await expect(securityTab.getByRole("heading", { name: "Secure Backup" })).toBeVisible(); > 31 | await securityTab.getByRole("button", { name: "Set up", exact: true }).click(); | ^ 32 | 33 | const currentDialogLocator = page.locator(".mx_Dialog"); 34 | at /home/runner/work/element-web/element-web/playwright/e2e/crypto/backups.spec.ts:31:80
crypto/backups.spec.ts:26:9 β€Ί Backups β€Ί Create: playwright/e2e/crypto/backups.spec.ts#L1
1) crypto/backups.spec.ts:26:9 β€Ί Backups β€Ί Create, delete and recreate a keys backup ───────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
crypto/backups.spec.ts:26:9 β€Ί Backups β€Ί Create: playwright/e2e/crypto/backups.spec.ts#L31
1) crypto/backups.spec.ts:26:9 β€Ί Backups β€Ί Create, delete and recreate a keys backup ───────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }).getByRole('button', { name: 'Set up', exact: true }) 29 | 30 | await expect(securityTab.getByRole("heading", { name: "Secure Backup" })).toBeVisible(); > 31 | await securityTab.getByRole("button", { name: "Set up", exact: true }).click(); | ^ 32 | 33 | const currentDialogLocator = page.locator(".mx_Dialog"); 34 | at /home/runner/work/element-web/element-web/playwright/e2e/crypto/backups.spec.ts:31:80
crypto/crypto.spec.ts:97:17 β€Ί Cryptography β€Ί setting up secure key backup should work isDeviceVerified=true β€Ί by recovery code: playwright/e2e/crypto/crypto.spec.ts#L121
2) crypto/crypto.spec.ts:97:17 β€Ί Cryptography β€Ί setting up secure key backup should work isDeviceVerified=true β€Ί by recovery code Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_Dialog').getByText('Secure Backup successful') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_Dialog').getByText('Secure Backup successful') 119 | 120 | // Either way, we end up at a success dialog: > 121 | await expect(dialog.getByText("Secure Backup successful")).toBeVisible(); | ^ 122 | await dialog.getByRole("button", { name: "Done" }).click(); 123 | await expect(dialog.getByText("Secure Backup successful")).not.toBeVisible(); 124 | at /home/runner/work/element-web/element-web/playwright/e2e/crypto/crypto.spec.ts:121:76
crypto/crypto.spec.ts:97:17 β€Ί Cryptography β€Ί setting up secure key backup should work isDeviceVerified=true β€Ί by recovery code: playwright/e2e/crypto/crypto.spec.ts#L121
2) crypto/crypto.spec.ts:97:17 β€Ί Cryptography β€Ί setting up secure key backup should work isDeviceVerified=true β€Ί by recovery code Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_Dialog').getByText('Secure Backup successful') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_Dialog').getByText('Secure Backup successful') 119 | 120 | // Either way, we end up at a success dialog: > 121 | await expect(dialog.getByText("Secure Backup successful")).toBeVisible(); | ^ 122 | await dialog.getByRole("button", { name: "Done" }).click(); 123 | await expect(dialog.getByText("Secure Backup successful")).not.toBeVisible(); 124 | at /home/runner/work/element-web/element-web/playwright/e2e/crypto/crypto.spec.ts:121:76
crypto/crypto.spec.ts:97:17 β€Ί Cryptography β€Ί setting up secure key backup should work isDeviceVerified=true β€Ί by recovery code: playwright/e2e/crypto/crypto.spec.ts#L121
2) crypto/crypto.spec.ts:97:17 β€Ί Cryptography β€Ί setting up secure key backup should work isDeviceVerified=true β€Ί by recovery code Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_Dialog').getByText('Secure Backup successful') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_Dialog').getByText('Secure Backup successful') 119 | 120 | // Either way, we end up at a success dialog: > 121 | await expect(dialog.getByText("Secure Backup successful")).toBeVisible(); | ^ 122 | await dialog.getByRole("button", { name: "Done" }).click(); 123 | await expect(dialog.getByText("Secure Backup successful")).not.toBeVisible(); 124 | at /home/runner/work/element-web/element-web/playwright/e2e/crypto/crypto.spec.ts:121:76
crypto/crypto.spec.ts:131:17 β€Ί Cryptography β€Ί setting up secure key backup should work isDeviceVerified=true β€Ί by passphrase: playwright/e2e/crypto/crypto.spec.ts#L154
3) crypto/crypto.spec.ts:131:17 β€Ί Cryptography β€Ί setting up secure key backup should work isDeviceVerified=true β€Ί by passphrase Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_Dialog').getByText('Secure Backup successful') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_Dialog').getByText('Secure Backup successful') 152 | await copyAndContinue(page); 153 | > 154 | await expect(dialog.getByText("Secure Backup successful")).toBeVisible(); | ^ 155 | await dialog.getByRole("button", { name: "Done" }).click(); 156 | await expect(dialog.getByText("Secure Backup successful")).not.toBeVisible(); 157 | at /home/runner/work/element-web/element-web/playwright/e2e/crypto/crypto.spec.ts:154:76
end-to-end-tests
Process completed with exit code 1.
Slow Test: read-receipts/high-level.spec.ts#L1
read-receipts/high-level.spec.ts took 3.5m
Slow Test: read-receipts/new-messages-in-threads.spec.ts#L1
read-receipts/new-messages-in-threads.spec.ts took 1.8m
Slow Test: read-receipts/editing-messages-in-threads.spec.ts#L1
read-receipts/editing-messages-in-threads.spec.ts took 1.4m
Slow Test: read-receipts/editing-messages-main-timeline.spec.ts#L1
read-receipts/editing-messages-main-timeline.spec.ts took 1.3m
Slow Test: read-receipts/editing-messages-thread-roots.spec.ts#L1
read-receipts/editing-messages-thread-roots.spec.ts took 58.7s
Slow Test: spaces/spaces.spec.ts#L1
spaces/spaces.spec.ts took 1.1m
Slow Test: right-panel/right-panel.spec.ts#L1
right-panel/right-panel.spec.ts took 59.5s
Slow Test: settings/account-user-settings-tab.spec.ts#L1
settings/account-user-settings-tab.spec.ts took 47.8s
Slow Test: right-panel/file-panel.spec.ts#L1
right-panel/file-panel.spec.ts took 41.8s
Slow Test: settings/appearance-user-settings-tab/theme-choice-panel.spec.ts#L1
settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 34.6s
Slow Test: timeline/timeline.spec.ts#L1
timeline/timeline.spec.ts took 2.9m
Slow Test: spotlight/spotlight.spec.ts#L1
spotlight/spotlight.spec.ts took 2.3m
Slow Test: threads/threads.spec.ts#L1
threads/threads.spec.ts took 36.9s
Slow Test: user-onboarding/user-onboarding-new.spec.ts#L1
user-onboarding/user-onboarding-new.spec.ts took 36.0s
Slow Test: widgets/widget-pip-close.spec.ts#L1
widgets/widget-pip-close.spec.ts took 23.6s
Slow Test: messages/messages.spec.ts#L1
messages/messages.spec.ts took 2.5m
Slow Test: pinned-messages/pinned-messages.spec.ts#L1
pinned-messages/pinned-messages.spec.ts took 1.8m
Slow Test: login/login.spec.ts#L1
login/login.spec.ts took 1.1m
Slow Test: knock/knock-into-room.spec.ts#L1
knock/knock-into-room.spec.ts took 41.4s
Slow Test: integration-manager/read_events.spec.ts#L1
integration-manager/read_events.spec.ts took 39.7s
Slow Test: read-receipts/redactions-main-timeline.spec.ts#L1
read-receipts/redactions-main-timeline.spec.ts took 2.2m
Slow Test: read-receipts/new-messages-main-timeline.spec.ts#L1
read-receipts/new-messages-main-timeline.spec.ts took 1.5m
Slow Test: read-receipts/read-receipts.spec.ts#L1
read-receipts/read-receipts.spec.ts took 1.2m
Slow Test: read-receipts/reactions-in-threads.spec.ts#L1
read-receipts/reactions-in-threads.spec.ts took 1.1m
Slow Test: read-receipts/redactions-thread-roots.spec.ts#L1
read-receipts/redactions-thread-roots.spec.ts took 59.2s
Slow Test: composer/RTE.spec.ts#L1
composer/RTE.spec.ts took 1.4m
Slow Test: audio-player/audio-player.spec.ts#L1
audio-player/audio-player.spec.ts took 1.4m
Slow Test: integration-manager/kick.spec.ts#L1
integration-manager/kick.spec.ts took 42.7s
Slow Test: editing/editing.spec.ts#L1
editing/editing.spec.ts took 35.7s
Slow Test: accessibility/keyboard-navigation.spec.ts#L1
accessibility/keyboard-navigation.spec.ts took 34.0s
🎭 Playwright Run Summary
32 skipped 42 passed (9.1m)
🎭 Playwright Run Summary
9 skipped 65 passed (9.3m)
🎭 Playwright Run Summary
1 flaky spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 β€Ί Threads Activity Centre β€Ί should mark all threads as read 3 skipped 68 passed (10.7m)
🎭 Playwright Run Summary
1 skipped 78 passed (11.7m)
🎭 Playwright Run Summary
1 flaky read-receipts/redactions-in-threads.spec.ts:410:17 β€Ί Read receipts β€Ί redactions β€Ί in threads β€Ί A thread with a redacted unread is still read after restart 15 skipped 67 passed (12.3m)
🎭 Playwright Run Summary
14 failed crypto/backups.spec.ts:26:9 β€Ί Backups β€Ί Create, delete and recreate a keys backup ────────────── crypto/crypto.spec.ts:97:17 β€Ί Cryptography β€Ί setting up secure key backup should work isDeviceVerified=true β€Ί by recovery code crypto/crypto.spec.ts:131:17 β€Ί Cryptography β€Ί setting up secure key backup should work isDeviceVerified=true β€Ί by passphrase crypto/crypto.spec.ts:97:17 β€Ί Cryptography β€Ί setting up secure key backup should work isDeviceVerified=false β€Ί by recovery code crypto/crypto.spec.ts:131:17 β€Ί Cryptography β€Ί setting up secure key backup should work isDeviceVerified=false β€Ί by passphrase crypto/crypto.spec.ts:166:9 β€Ί Cryptography β€Ί Can reset cross-signing keys ────────────────────── crypto/decryption-failure-messages.spec.ts:31:13 β€Ί Cryptography β€Ί decryption failure messages β€Ί should handle device-relative historical messages crypto/dehydration.spec.ts:52:5 β€Ί Dehydration β€Ί Create dehydrated device ─────────────────────── crypto/device-verification.spec.ts:68:9 β€Ί Device verification β€Ί Verify device with SAS during login crypto/device-verification.spec.ts:94:9 β€Ί Device verification β€Ί Verify device with QR code during login crypto/device-verification.spec.ts:139:9 β€Ί Device verification β€Ί Verify device with Security Phrase during login crypto/device-verification.spec.ts:160:9 β€Ί Device verification β€Ί Verify device with Security Key during login crypto/event-shields.spec.ts:173:13 β€Ί Cryptography β€Ί event shields β€Ί Should show a grey padlock for a key restored from backup crypto/logout.spec.ts:33:9 β€Ί Logout tests β€Ί If backup is set up show standard confirm ────────── 64 passed (23.9m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-1 Expired
87.2 MB
all-blob-reports-2 Expired
348 KB
all-blob-reports-3 Expired
271 KB
all-blob-reports-4 Expired
4 MB
all-blob-reports-5 Expired
722 KB
all-blob-reports-6 Expired
3.47 MB
html-report Expired
94.3 MB
webapp Expired
34.2 MB