1) settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:16:9 › Appearance user settings tab › should be rendered properly Error: Screenshot comparison failed: 1 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/appearance-tab-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly/appearance-tab-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly/appearance-tab-diff.png Call log: - expect.toHaveScreenshot(appearance-tab.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1 pixels (ratio 0.01 of all image pixels) are different. 23 | await expect(tab.getByRole("button", { name: "Hide advanced" })).toBeVisible(); 24 | > 25 | await expect(tab).toMatchScreenshot("appearance-tab.png"); | ^ 26 | }); 27 | 28 | test("should support changing font size by using the font size dropdown", async ({ page, app, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:25:27

1) settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:16:9 › Appearance user settings tab › should be rendered properly Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/appearance-tab-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-retry1/appearance-tab-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-retry1/appearance-tab-diff.png Call log: - expect.toHaveScreenshot(appearance-tab.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1 pixels (ratio 0.01 of all image pixels) are different. 23 | await expect(tab.getByRole("button", { name: "Hide advanced" })).toBeVisible(); 24 | > 25 | await expect(tab).toMatchScreenshot("appearance-tab.png"); | ^ 26 | }); 27 | 28 | test("should support changing font size by using the font size dropdown", async ({ page, app, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:25:27

1) settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:16:9 › Appearance user settings tab › should be rendered properly Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/appearance-tab-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-retry2/appearance-tab-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-retry2/appearance-tab-diff.png Call log: - expect.toHaveScreenshot(appearance-tab.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1 pixels (ratio 0.01 of all image pixels) are different. 23 | await expect(tab.getByRole("button", { name: "Hide advanced" })).toBeVisible(); 24 | > 25 | await expect(tab).toMatchScreenshot("appearance-tab.png"); | ^ 26 | }); 27 | 28 | test("should support changing font size by using the font size dropdown", async ({ page, app, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:25:27

Process completed with exit code 1.

1) crypto/crypto.spec.ts:97:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys') 118 | if (!isDeviceVerified) { 119 | const uiaDialogTitle = page.locator(".mx_InteractiveAuthDialog .mx_Dialog_title"); > 120 | await expect(uiaDialogTitle.getByText("Setting up keys")).toBeVisible(); | ^ 121 | await expect(uiaDialogTitle.getByText("Setting up keys")).not.toBeVisible(); 122 | } 123 | at /home/runner/work/element-web/element-web/playwright/e2e/crypto/crypto.spec.ts:120:79

1) permalinks/permalinks.spec.ts:27:9 › permalinks › shoud render permalinks as expected ───────── Error: Screenshot comparison failed: 119 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/permalinks/permalinks.spec.ts/permalink-rendering-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/permalinks-permalinks-perm-8ed31-nder-permalinks-as-expected/permalink-rendering-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/permalinks-permalinks-perm-8ed31-nder-permalinks-as-expected/permalink-rendering-diff.png Call log: - expect.toHaveScreenshot(permalink-rendering.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_RoomView_timeline') - locator resolved to <main class="mx_RoomView_timeline mx_RoomView_timeline_rr_enabled">…</main> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 119 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_RoomView_timeline') - locator resolved to <main class="mx_RoomView_timeline mx_RoomView_timeline_rr_enabled">…</main> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 119 pixels (ratio 0.01 of all image pixels) are different. 93 | getPill(timeline, danielleId); 94 | > 95 | await expect(timeline).toMatchScreenshot("permalink-rendering.png", { | ^ 96 | mask: [ 97 | // Exclude timestamps from the snapshot, for consistency. 98 | page.locator(".mx_MessageTimestamp"), at /home/runner/work/element-web/element-web/playwright/e2e/permalinks/permalinks.spec.ts:95:32

1) permalinks/permalinks.spec.ts:27:9 › permalinks › shoud render permalinks as expected ───────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 119 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/permalinks/permalinks.spec.ts/permalink-rendering-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/permalinks-permalinks-perm-8ed31-nder-permalinks-as-expected-retry1/permalink-rendering-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/permalinks-permalinks-perm-8ed31-nder-permalinks-as-expected-retry1/permalink-rendering-diff.png Call log: - expect.toHaveScreenshot(permalink-rendering.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_RoomView_timeline') - locator resolved to <main class="mx_RoomView_timeline mx_RoomView_timeline_rr_enabled">…</main> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 119 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_RoomView_timeline') - locator resolved to <main class="mx_RoomView_timeline mx_RoomView_timeline_rr_enabled">…</main> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 119 pixels (ratio 0.01 of all image pixels) are different. 93 | getPill(timeline, danielleId); 94 | > 95 | await expect(timeline).toMatchScreenshot("permalink-rendering.png", { | ^ 96 | mask: [ 97 | // Exclude timestamps from the snapshot, for consistency. 98 | page.locator(".mx_MessageTimestamp"), at /home/runner/work/element-web/element-web/playwright/e2e/permalinks/permalinks.spec.ts:95:32

1) permalinks/permalinks.spec.ts:27:9 › permalinks › shoud render permalinks as expected ───────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 119 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/permalinks/permalinks.spec.ts/permalink-rendering-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/permalinks-permalinks-perm-8ed31-nder-permalinks-as-expected-retry2/permalink-rendering-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/permalinks-permalinks-perm-8ed31-nder-permalinks-as-expected-retry2/permalink-rendering-diff.png Call log: - expect.toHaveScreenshot(permalink-rendering.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_RoomView_timeline') - locator resolved to <main class="mx_RoomView_timeline mx_RoomView_timeline_rr_enabled">…</main> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 119 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_RoomView_timeline') - locator resolved to <main class="mx_RoomView_timeline mx_RoomView_timeline_rr_enabled">…</main> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 119 pixels (ratio 0.01 of all image pixels) are different. 93 | getPill(timeline, danielleId); 94 | > 95 | await expect(timeline).toMatchScreenshot("permalink-rendering.png", { | ^ 96 | mask: [ 97 | // Exclude timestamps from the snapshot, for consistency. 98 | page.locator(".mx_MessageTimestamp"), at /home/runner/work/element-web/element-web/playwright/e2e/permalinks/permalinks.spec.ts:95:32

2) polls/polls.spec.ts:222:9 › Polls › should be displayed correctly in thread panel ───────────── Error: Screenshot comparison failed: 2 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/polls/polls.spec.ts/ThreadView-with-a-poll-on-bubble-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/polls-polls-Polls-should-b-4822d-d-correctly-in-thread-panel/ThreadView-with-a-poll-on-bubble-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/polls-polls-Polls-should-b-4822d-d-correctly-in-thread-panel/ThreadView-with-a-poll-on-bubble-layout-diff.png Call log: - expect.toHaveScreenshot(ThreadView-with-a-poll-on-bubble-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2 pixels (ratio 0.01 of all image pixels) are different. 281 | await app.settings.setValue("layout", null, SettingLevel.DEVICE, Layout.Bubble); 282 | await expect(page.locator(".mx_ThreadView .mx_EventTile[data-layout='bubble']").first()).toBeVisible(); > 283 | await expect(page.locator(".mx_ThreadView")).toMatchScreenshot("ThreadView_with_a_poll_on_bubble_layout.png", { | ^ 284 | mask: [page.locator(".mx_MessageTimestamp")], 285 | }); 286 | at /home/runner/work/element-web/element-web/playwright/e2e/polls/polls.spec.ts:283:54

2) polls/polls.spec.ts:222:9 › Polls › should be displayed correctly in thread panel ───────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 2 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/polls/polls.spec.ts/ThreadView-with-a-poll-on-bubble-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/polls-polls-Polls-should-b-4822d-d-correctly-in-thread-panel-retry1/ThreadView-with-a-poll-on-bubble-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/polls-polls-Polls-should-b-4822d-d-correctly-in-thread-panel-retry1/ThreadView-with-a-poll-on-bubble-layout-diff.png Call log: - expect.toHaveScreenshot(ThreadView-with-a-poll-on-bubble-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2 pixels (ratio 0.01 of all image pixels) are different. 281 | await app.settings.setValue("layout", null, SettingLevel.DEVICE, Layout.Bubble); 282 | await expect(page.locator(".mx_ThreadView .mx_EventTile[data-layout='bubble']").first()).toBeVisible(); > 283 | await expect(page.locator(".mx_ThreadView")).toMatchScreenshot("ThreadView_with_a_poll_on_bubble_layout.png", { | ^ 284 | mask: [page.locator(".mx_MessageTimestamp")], 285 | }); 286 | at /home/runner/work/element-web/element-web/playwright/e2e/polls/polls.spec.ts:283:54

2) polls/polls.spec.ts:222:9 › Polls › should be displayed correctly in thread panel ───────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 2 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/polls/polls.spec.ts/ThreadView-with-a-poll-on-bubble-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/polls-polls-Polls-should-b-4822d-d-correctly-in-thread-panel-retry2/ThreadView-with-a-poll-on-bubble-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/polls-polls-Polls-should-b-4822d-d-correctly-in-thread-panel-retry2/ThreadView-with-a-poll-on-bubble-layout-diff.png Call log: - expect.toHaveScreenshot(ThreadView-with-a-poll-on-bubble-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2 pixels (ratio 0.01 of all image pixels) are different. 281 | await app.settings.setValue("layout", null, SettingLevel.DEVICE, Layout.Bubble); 282 | await expect(page.locator(".mx_ThreadView .mx_EventTile[data-layout='bubble']").first()).toBeVisible(); > 283 | await expect(page.locator(".mx_ThreadView")).toMatchScreenshot("ThreadView_with_a_poll_on_bubble_layout.png", { | ^ 284 | mask: [page.locator(".mx_MessageTimestamp")], 285 | }); 286 | at /home/runner/work/element-web/element-web/playwright/e2e/polls/polls.spec.ts:283:54

3) login/login.spec.ts:199:21 › Login › Password login › verification after login › with force_verification on › Shows unskippable verification prompt after login if signing keys are set up Error: expect(locator).not.toBeVisible() Locator: getByRole('heading', { name: 'Verify this device', level: 1 }).locator('.mx_CompleteSecurity_skip') Expected: not visible Received: visible Call log: - expect.not.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Verify this device', level: 1 }).locator('.mx_CompleteSecurity_skip') 218 | await expect(h1).toBeVisible(); 219 | > 220 | expect(h1.locator(".mx_CompleteSecurity_skip")).not.toBeVisible(); | ^ 221 | }); 222 | }); 223 | }); at /home/runner/work/element-web/element-web/playwright/e2e/login/login.spec.ts:220:73

Process completed with exit code 1.

1) threads/threads.spec.ts:354:9 › Threads › should send location and reply to the location on ThreadView Error: Screenshot comparison failed: 2334 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/threads/threads.spec.ts/Reply-to-the-location-on-ThreadView-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView/Reply-to-the-location-on-ThreadView-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView/Reply-to-the-location-on-ThreadView-diff.png Call log: - expect.toHaveScreenshot(Reply-to-the-location-on-ThreadView.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2332 pixels (ratio 0.02 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2334 pixels (ratio 0.02 of all image pixels) are different. 401 | // Take a snapshot of reply to the shared location 402 | await page.addStyleTag({ content: css }); > 403 | await expect(page.locator(".mx_ThreadView")).toMatchScreenshot("Reply_to_the_location_on_ThreadView.png"); | ^ 404 | }); 405 | 406 | test("right panel behaves correctly", async ({ page, app, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/threads/threads.spec.ts:403:54

1) threads/threads.spec.ts:354:9 › Threads › should send location and reply to the location on ThreadView Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 2334 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/threads/threads.spec.ts/Reply-to-the-location-on-ThreadView-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView-retry1/Reply-to-the-location-on-ThreadView-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView-retry1/Reply-to-the-location-on-ThreadView-diff.png Call log: - expect.toHaveScreenshot(Reply-to-the-location-on-ThreadView.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2332 pixels (ratio 0.02 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2334 pixels (ratio 0.02 of all image pixels) are different. 401 | // Take a snapshot of reply to the shared location 402 | await page.addStyleTag({ content: css }); > 403 | await expect(page.locator(".mx_ThreadView")).toMatchScreenshot("Reply_to_the_location_on_ThreadView.png"); | ^ 404 | }); 405 | 406 | test("right panel behaves correctly", async ({ page, app, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/threads/threads.spec.ts:403:54

1) threads/threads.spec.ts:354:9 › Threads › should send location and reply to the location on ThreadView Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 2334 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/threads/threads.spec.ts/Reply-to-the-location-on-ThreadView-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView-retry2/Reply-to-the-location-on-ThreadView-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView-retry2/Reply-to-the-location-on-ThreadView-diff.png Call log: - expect.toHaveScreenshot(Reply-to-the-location-on-ThreadView.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2332 pixels (ratio 0.02 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2334 pixels (ratio 0.02 of all image pixels) are different. 401 | // Take a snapshot of reply to the shared location 402 | await page.addStyleTag({ content: css }); > 403 | await expect(page.locator(".mx_ThreadView")).toMatchScreenshot("Reply_to_the_location_on_ThreadView.png"); | ^ 404 | }); 405 | 406 | test("right panel behaves correctly", async ({ page, app, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/threads/threads.spec.ts:403:54

2) timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout Error: Screenshot comparison failed: 2 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/configured-room-irc-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout/configured-room-irc-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout/configured-room-irc-layout-diff.png Call log: - expect.toHaveScreenshot(configured-room-irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2 pixels (ratio 0.01 of all image pixels) are different. 151 | await expect(page.locator(".mx_TimelineSeparator")).toHaveText("today"); 152 | > 153 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("configured-room-irc-layout.png"); | ^ 154 | }); 155 | 156 | test("should have an expanded generic event list summary (GELS) on IRC layout", async ({ page, app, room }) => { at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:153:57

2) timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 2 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/configured-room-irc-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-retry1/configured-room-irc-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-retry1/configured-room-irc-layout-diff.png Call log: - expect.toHaveScreenshot(configured-room-irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2 pixels (ratio 0.01 of all image pixels) are different. 151 | await expect(page.locator(".mx_TimelineSeparator")).toHaveText("today"); 152 | > 153 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("configured-room-irc-layout.png"); | ^ 154 | }); 155 | 156 | test("should have an expanded generic event list summary (GELS) on IRC layout", async ({ page, app, room }) => { at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:153:57

2) timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 2 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/configured-room-irc-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-retry2/configured-room-irc-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-retry2/configured-room-irc-layout-diff.png Call log: - expect.toHaveScreenshot(configured-room-irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2 pixels (ratio 0.01 of all image pixels) are different. 151 | await expect(page.locator(".mx_TimelineSeparator")).toHaveText("today"); 152 | > 153 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("configured-room-irc-layout.png"); | ^ 154 | }); 155 | 156 | test("should have an expanded generic event list summary (GELS) on IRC layout", async ({ page, app, room }) => { at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:153:57

3) timeline/timeline.spec.ts:156:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout Error: Screenshot comparison failed: 2 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/expanded-gels-irc-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-88c2d--summary-GELS-on-IRC-layout/expanded-gels-irc-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-88c2d--summary-GELS-on-IRC-layout/expanded-gels-irc-layout-diff.png Call log: - expect.toHaveScreenshot(expanded-gels-irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2 pixels (ratio 0.01 of all image pixels) are different. 172 | await expect(gels.getByRole("button", { name: "Collapse" })).toBeVisible(); 173 | > 174 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("expanded-gels-irc-layout.png", { | ^ 175 | mask: [page.locator(".mx_MessageTimestamp")], 176 | css: ` 177 | .mx_TopUnreadMessagesBar, .mx_MessagePanel_myReadMarker { at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:174:57

3) timeline/timeline.spec.ts:156:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 2 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/expanded-gels-irc-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-88c2d--summary-GELS-on-IRC-layout-retry1/expanded-gels-irc-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-88c2d--summary-GELS-on-IRC-layout-retry1/expanded-gels-irc-layout-diff.png Call log: - expect.toHaveScreenshot(expanded-gels-irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2 pixels (ratio 0.01 of all image pixels) are different. 172 | await expect(gels.getByRole("button", { name: "Collapse" })).toBeVisible(); 173 | > 174 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("expanded-gels-irc-layout.png", { | ^ 175 | mask: [page.locator(".mx_MessageTimestamp")], 176 | css: ` 177 | .mx_TopUnreadMessagesBar, .mx_MessagePanel_myReadMarker { at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:174:57

3) timeline/timeline.spec.ts:156:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 2 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/expanded-gels-irc-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-88c2d--summary-GELS-on-IRC-layout-retry2/expanded-gels-irc-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-88c2d--summary-GELS-on-IRC-layout-retry2/expanded-gels-irc-layout-diff.png Call log: - expect.toHaveScreenshot(expanded-gels-irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2 pixels (ratio 0.01 of all image pixels) are different. 172 | await expect(gels.getByRole("button", { name: "Collapse" })).toBeVisible(); 173 | > 174 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("expanded-gels-irc-layout.png", { | ^ 175 | mask: [page.locator(".mx_MessageTimestamp")], 176 | css: ` 177 | .mx_TopUnreadMessagesBar, .mx_MessagePanel_myReadMarker { at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:174:57

4) timeline/timeline.spec.ts:184:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on compact modern/group layout Error: Screenshot comparison failed: 2 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/expanded-gels-modern-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-3585c-compact-modern-group-layout/expanded-gels-modern-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-3585c-compact-modern-group-layout/expanded-gels-modern-layout-diff.png Call log: - expect.toHaveScreenshot(expanded-gels-modern-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2 pixels (ratio 0.01 of all image pixels) are different. 206 | await expect(gels.getByRole("button", { name: "Collapse" })).toBeVisible(); 207 | > 208 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("expanded-gels-modern-layout.png", { | ^ 209 | mask: [page.locator(".mx_MessageTimestamp")], 210 | css: ` 211 | .mx_TopUnreadMessagesBar, .mx_MessagePanel_myReadMarker { at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:208:57

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

read-receipts/high-level.spec.ts took 3.4m

read-receipts/new-messages-in-threads.spec.ts took 1.7m

read-receipts/editing-messages-in-threads.spec.ts took 1.4m

read-receipts/editing-messages-main-timeline.spec.ts took 1.3m

read-receipts/editing-messages-thread-roots.spec.ts took 55.8s

read-receipts/redactions-thread-roots.spec.ts took 1.0m

spaces/spaces.spec.ts took 56.1s

right-panel/right-panel.spec.ts took 52.2s

right-panel/file-panel.spec.ts took 37.5s

settings/account-user-settings-tab.spec.ts took 36.3s

read-receipts/redactions-in-threads.spec.ts took 2.5m

read-receipts/redactions-main-timeline.spec.ts took 1.9m

read-receipts/new-messages-main-timeline.spec.ts took 1.3m

read-receipts/read-receipts.spec.ts took 1.0m

read-receipts/reactions-in-threads.spec.ts took 57.6s

audio-player/audio-player.spec.ts took 1.2m

composer/RTE.spec.ts took 1.1m

crypto/event-shields.spec.ts took 59.1s

crypto/decryption-failure-messages.spec.ts took 49.9s

crypto/device-verification.spec.ts took 45.2s

messages/messages.spec.ts took 2.3m

pinned-messages/pinned-messages.spec.ts took 1.7m

integration-manager/read_events.spec.ts took 41.6s

knock/knock-into-room.spec.ts took 35.8s

integration-manager/send_event.spec.ts took 28.3s

spotlight/spotlight.spec.ts took 2.2m

spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.7m

user-onboarding/user-onboarding-new.spec.ts took 32.4s

widgets/widget-pip-close.spec.ts took 23.7s

widgets/layout.spec.ts took 21.4s

32 skipped 42 passed (8.9m)

1 failed settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:16:9 › Appearance user settings tab › should be rendered properly 10 skipped 69 passed (9.3m)

14 skipped 62 passed (9.7m)

1 flaky crypto/crypto.spec.ts:97:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code 1 skipped 76 passed (11.2m)

2 failed permalinks/permalinks.spec.ts:27:9 › permalinks › shoud render permalinks as expected ────────── polls/polls.spec.ts:222:9 › Polls › should be displayed correctly in thread panel ────────────── 1 flaky login/login.spec.ts:199:21 › Login › Password login › verification after login › with force_verification on › Shows unskippable verification prompt after login if signing keys are set up 1 skipped 75 passed (11.6m)