1) settings/appearance-user-settings-tab/theme-choice-panel.spec.ts:70:17 › Appearance user settings tab › Theme Choice Panel › custom theme › should be able to add and remove a custom theme Error: Screenshot comparison failed: 3656 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/theme-choice-panel.spec.ts/theme-panel-custom-theme-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-03376-d-and-remove-a-custom-theme/theme-panel-custom-theme-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-03376-d-and-remove-a-custom-theme/theme-panel-custom-theme-diff.png Call log: - expect.toHaveScreenshot(theme-panel-custom-theme.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByTestId('themePanel') - locator resolved to <div data-testid="themePanel" class="mx_SettingsSubsection mx_SettingsSubsection_newUi">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 3656 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByTestId('themePanel') - locator resolved to <div data-testid="themePanel" class="mx_SettingsSubsection mx_SettingsSubsection_newUi">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 3656 pixels (ratio 0.02 of all image pixels) are different. 75 | 76 | await util.removeCustomTheme(); > 77 | await expect(util.getThemePanel()).toMatchScreenshot("theme-panel-custom-theme.png"); | ^ 78 | }); 79 | }); 80 | }); at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/theme-choice-panel.spec.ts:77:52

1) settings/appearance-user-settings-tab/theme-choice-panel.spec.ts:70:17 › Appearance user settings tab › Theme Choice Panel › custom theme › should be able to add and remove a custom theme Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 3656 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/theme-choice-panel.spec.ts/theme-panel-custom-theme-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-03376-d-and-remove-a-custom-theme-retry1/theme-panel-custom-theme-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-03376-d-and-remove-a-custom-theme-retry1/theme-panel-custom-theme-diff.png Call log: - expect.toHaveScreenshot(theme-panel-custom-theme.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByTestId('themePanel') - locator resolved to <div data-testid="themePanel" class="mx_SettingsSubsection mx_SettingsSubsection_newUi">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 3656 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByTestId('themePanel') - locator resolved to <div data-testid="themePanel" class="mx_SettingsSubsection mx_SettingsSubsection_newUi">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 3656 pixels (ratio 0.02 of all image pixels) are different. 75 | 76 | await util.removeCustomTheme(); > 77 | await expect(util.getThemePanel()).toMatchScreenshot("theme-panel-custom-theme.png"); | ^ 78 | }); 79 | }); 80 | }); at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/theme-choice-panel.spec.ts:77:52

1) settings/appearance-user-settings-tab/theme-choice-panel.spec.ts:70:17 › Appearance user settings tab › Theme Choice Panel › custom theme › should be able to add and remove a custom theme Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 3656 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/theme-choice-panel.spec.ts/theme-panel-custom-theme-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-03376-d-and-remove-a-custom-theme-retry2/theme-panel-custom-theme-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-03376-d-and-remove-a-custom-theme-retry2/theme-panel-custom-theme-diff.png Call log: - expect.toHaveScreenshot(theme-panel-custom-theme.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByTestId('themePanel') - locator resolved to <div data-testid="themePanel" class="mx_SettingsSubsection mx_SettingsSubsection_newUi">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 3656 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByTestId('themePanel') - locator resolved to <div data-testid="themePanel" class="mx_SettingsSubsection mx_SettingsSubsection_newUi">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 3656 pixels (ratio 0.02 of all image pixels) are different. 75 | 76 | await util.removeCustomTheme(); > 77 | await expect(util.getThemePanel()).toMatchScreenshot("theme-panel-custom-theme.png"); | ^ 78 | }); 79 | }); 80 | }); at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/theme-choice-panel.spec.ts:77:52

2) sliding-sync/sliding-sync.spec.ts:251:9 › Sliding Sync › should show a favourite DM only in the favourite sublist Test timeout of 30000ms exceeded while running "beforeEach" hook. 16 | let roomId: string; 17 | > 18 | test.beforeEach(async ({ slidingSyncProxy, page, user, app }) => { | ^ 19 | roomId = await app.client.createRoom({ name: "Test Room" }); 20 | }); 21 | at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:18:10

2) sliding-sync/sliding-sync.spec.ts:251:9 › Sliding Sync › should show a favourite DM only in the favourite sublist Error: page.waitForSelector: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_MatrixChat') to be visible at ../element-web-test.ts:281 279 | }, proxyAddress); 280 | await page.goto("/"); > 281 | await page.waitForSelector(".mx_MatrixChat", { timeout: 30000 }); | ^ 282 | await use(proxyInstance); 283 | await proxy.stop(); 284 | }, at Object.slidingSyncProxy (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:281:20)

Process completed with exit code 1.

1) audio-player/audio-player.spec.ts:235:9 › Audio player › should support creating a reply chain with multiple audio files Test timeout of 30000ms exceeded.

1) audio-player/audio-player.spec.ts:235:9 › Audio player › should support creating a reply chain with multiple audio files Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_EventTile_last').getByRole('button', { name: 'Reply', exact: true }) 244 | const clickButtonReply = async () => { 245 | await tile.hover(); > 246 | await tile.getByRole("button", { name: "Reply", exact: true }).click(); | ^ 247 | }; 248 | 249 | await uploadFile(page, "playwright/sample-files/upload-first.ogg"); at clickButtonReply (/home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:246:76) at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:262:9

2) crypto/crypto.spec.ts:97:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys') 118 | if (!isDeviceVerified) { 119 | const uiaDialogTitle = page.locator(".mx_InteractiveAuthDialog .mx_Dialog_title"); > 120 | await expect(uiaDialogTitle.getByText("Setting up keys")).toBeVisible(); | ^ 121 | await expect(uiaDialogTitle.getByText("Setting up keys")).not.toBeVisible(); 122 | } 123 | at /home/runner/work/element-web/element-web/playwright/e2e/crypto/crypto.spec.ts:120:79

1) login/login.spec.ts:199:21 › Login › Password login › verification after login › with force_verification on › Shows unskippable verification prompt after login if signing keys are set up Error: expect(locator).not.toBeVisible() Locator: getByRole('heading', { name: 'Verify this device', level: 1 }).locator('.mx_CompleteSecurity_skip') Expected: not visible Received: visible Call log: - expect.not.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Verify this device', level: 1 }).locator('.mx_CompleteSecurity_skip') 218 | await expect(h1).toBeVisible(); 219 | > 220 | expect(h1.locator(".mx_CompleteSecurity_skip")).not.toBeVisible(); | ^ 221 | }); 222 | }); 223 | }); at /home/runner/work/element-web/element-web/playwright/e2e/login/login.spec.ts:220:73

Process completed with exit code 1.

timeline/timeline.spec.ts took 2.6m

spotlight/spotlight.spec.ts took 1.9m

spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m

threads/threads.spec.ts took 34.2s

user-onboarding/user-onboarding-new.spec.ts took 30.2s

read-receipts/high-level.spec.ts took 3.4m

read-receipts/new-messages-in-threads.spec.ts took 1.8m

read-receipts/editing-messages-in-threads.spec.ts took 1.3m

read-receipts/editing-messages-main-timeline.spec.ts took 1.2m

read-receipts/editing-messages-thread-roots.spec.ts took 56.0s

read-receipts/redactions-thread-roots.spec.ts took 1.1m

spaces/spaces.spec.ts took 1.0m

right-panel/right-panel.spec.ts took 54.1s

right-panel/file-panel.spec.ts took 38.4s

settings/account-user-settings-tab.spec.ts took 36.7s

read-receipts/redactions-in-threads.spec.ts took 2.8m

read-receipts/redactions-main-timeline.spec.ts took 2.1m

read-receipts/new-messages-main-timeline.spec.ts took 1.5m

read-receipts/read-receipts.spec.ts took 1.2m

read-receipts/reactions-in-threads.spec.ts took 1.1m

composer/RTE.spec.ts took 1.1m

crypto/event-shields.spec.ts took 1.0m

crypto/decryption-failure-messages.spec.ts took 50.0s

crypto/device-verification.spec.ts took 48.0s

integration-manager/kick.spec.ts took 39.7s

messages/messages.spec.ts took 2.4m

pinned-messages/pinned-messages.spec.ts took 1.7m

integration-manager/read_events.spec.ts took 36.9s

knock/knock-into-room.spec.ts took 35.9s

polls/polls.spec.ts took 35.2s

Failed to download action 'https://api.github.com/repos/actions/checkout/tarball/eef61447b9ff4aafe5dcd4e0bbf5d482be7e7871'. Error: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

Back off 25.51 seconds before retry.

Failed to download action 'https://api.github.com/repos/actions/checkout/tarball/eef61447b9ff4aafe5dcd4e0bbf5d482be7e7871'. Error: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

Back off 22.748 seconds before retry.

4 skipped 67 passed (8.9m)

32 skipped 42 passed (8.8m)

1 failed settings/appearance-user-settings-tab/theme-choice-panel.spec.ts:70:17 › Appearance user settings tab › Theme Choice Panel › custom theme › should be able to add and remove a custom theme 1 flaky sliding-sync/sliding-sync.spec.ts:251:9 › Sliding Sync › should show a favourite DM only in the favourite sublist 10 skipped 68 passed (10.3m)

14 skipped 62 passed (10.7m)

2 flaky audio-player/audio-player.spec.ts:235:9 › Audio player › should support creating a reply chain with multiple audio files crypto/crypto.spec.ts:97:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code 1 skipped 75 passed (12.4m)