1) user-onboarding/user-onboarding-new.spec.ts:37:9 › User Onboarding (new user) › app download dialog Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/user-onboarding/user-onboarding-new.spec.ts/User-Onboarding-new-user-app-download-dialog-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/user-onboarding-user-onboa-8144a-ew-user-app-download-dialog/User-Onboarding-new-user-app-download-dialog-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/user-onboarding-user-onboa-8144a-ew-user-app-download-dialog/User-Onboarding-new-user-app-download-dialog-1-diff.png Call log: - expect.toHaveScreenshot(User-Onboarding-new-user-app-download-dialog-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 40 | page.getByRole("dialog").getByRole("heading", { level: 1, name: "Download Element" }), 41 | ).toBeVisible(); > 42 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot( | ^ 43 | "User-Onboarding-new-user-app-download-dialog-1.png", 44 | { 45 | // Set a constant bg behind the modal to ensure screenshot stability at /home/runner/work/element-web/element-web/playwright/e2e/user-onboarding/user-onboarding-new.spec.ts:42:50

1) user-onboarding/user-onboarding-new.spec.ts:37:9 › User Onboarding (new user) › app download dialog Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/user-onboarding/user-onboarding-new.spec.ts/User-Onboarding-new-user-app-download-dialog-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/user-onboarding-user-onboa-8144a-ew-user-app-download-dialog-retry1/User-Onboarding-new-user-app-download-dialog-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/user-onboarding-user-onboa-8144a-ew-user-app-download-dialog-retry1/User-Onboarding-new-user-app-download-dialog-1-diff.png Call log: - expect.toHaveScreenshot(User-Onboarding-new-user-app-download-dialog-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 40 | page.getByRole("dialog").getByRole("heading", { level: 1, name: "Download Element" }), 41 | ).toBeVisible(); > 42 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot( | ^ 43 | "User-Onboarding-new-user-app-download-dialog-1.png", 44 | { 45 | // Set a constant bg behind the modal to ensure screenshot stability at /home/runner/work/element-web/element-web/playwright/e2e/user-onboarding/user-onboarding-new.spec.ts:42:50

1) user-onboarding/user-onboarding-new.spec.ts:37:9 › User Onboarding (new user) › app download dialog Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/user-onboarding/user-onboarding-new.spec.ts/User-Onboarding-new-user-app-download-dialog-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/user-onboarding-user-onboa-8144a-ew-user-app-download-dialog-retry2/User-Onboarding-new-user-app-download-dialog-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/user-onboarding-user-onboa-8144a-ew-user-app-download-dialog-retry2/User-Onboarding-new-user-app-download-dialog-1-diff.png Call log: - expect.toHaveScreenshot(User-Onboarding-new-user-app-download-dialog-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 40 | page.getByRole("dialog").getByRole("heading", { level: 1, name: "Download Element" }), 41 | ).toBeVisible(); > 42 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot( | ^ 43 | "User-Onboarding-new-user-app-download-dialog-1.png", 44 | { 45 | // Set a constant bg behind the modal to ensure screenshot stability at /home/runner/work/element-web/element-web/playwright/e2e/user-onboarding/user-onboarding-new.spec.ts:42:50

2) timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout Error: Screenshot comparison failed: 6560 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/event-tiles-bubble-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout/event-tiles-bubble-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout/event-tiles-bubble-layout-diff.png Call log: - expect.toHaveScreenshot(event-tiles-bubble-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 26765 pixels (ratio 0.05 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 26765 pixels (ratio 0.05 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 6560 pixels (ratio 0.02 of all image pixels) are different. - waiting 500ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 6560 pixels (ratio 0.02 of all image pixels) are different. 555 | page.locator(".mx_RoomView").getByText("This message has an inline emoji 👒"), 556 | ).toBeInViewport(); > 557 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot( | ^ 558 | "event-tiles-bubble-layout.png", 559 | screenshotOptions, 560 | ); at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:557:57

Process completed with exit code 1.

1) read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread Test timeout of 30000ms exceeded.

1) read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.

1) read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.waitForTimeout: Target page, context or browser has been closed at read-receipts/index.ts:516 514 | // If we've just entered the room, the threads panel takes a while to decide 515 | // whether it's open or not - wait here to give it a chance to settle. > 516 | await this.page.waitForTimeout(200); | ^ 517 | 518 | const threadPanel = this.page.locator(".mx_ThreadPanel"); 519 | const isThreadPanelOpen = (await threadPanel.count()) !== 0; at Helpers.openThreadList (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:516:25) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/high-level.spec.ts:251:24

1) read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.

Process completed with exit code 1.

1) register/register.spec.ts:18:9 › Registration › registers an account and lands on the home screen Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/register/register.spec.ts/server-picker-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen/server-picker-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen/server-picker-diff.png Call log: - expect.toHaveScreenshot(server-picker.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 203 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 199 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 20 | await expect(page.getByRole("button", { name: "Continue", exact: true })).toBeVisible(); 21 | > 22 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("server-picker.png"); | ^ 23 | await checkA11y(); 24 | 25 | await page.getByRole("textbox", { name: "Other homeserver" }).fill(homeserver.config.baseUrl); at /home/runner/work/element-web/element-web/playwright/e2e/register/register.spec.ts:22:50

1) register/register.spec.ts:18:9 › Registration › registers an account and lands on the home screen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/register/register.spec.ts/server-picker-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-retry1/server-picker-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-retry1/server-picker-diff.png Call log: - expect.toHaveScreenshot(server-picker.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 203 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 199 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 20 | await expect(page.getByRole("button", { name: "Continue", exact: true })).toBeVisible(); 21 | > 22 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("server-picker.png"); | ^ 23 | await checkA11y(); 24 | 25 | await page.getByRole("textbox", { name: "Other homeserver" }).fill(homeserver.config.baseUrl); at /home/runner/work/element-web/element-web/playwright/e2e/register/register.spec.ts:22:50

1) register/register.spec.ts:18:9 › Registration › registers an account and lands on the home screen Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/register/register.spec.ts/server-picker-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-retry2/server-picker-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-retry2/server-picker-diff.png Call log: - expect.toHaveScreenshot(server-picker.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 197 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 193 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 20 | await expect(page.getByRole("button", { name: "Continue", exact: true })).toBeVisible(); 21 | > 22 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("server-picker.png"); | ^ 23 | await checkA11y(); 24 | 25 | await page.getByRole("textbox", { name: "Other homeserver" }).fill(homeserver.config.baseUrl); at /home/runner/work/element-web/element-web/playwright/e2e/register/register.spec.ts:22:50

2) settings/account-user-settings-tab.spec.ts:26:9 › Account user settings tab › should be rendered properly Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly/account-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly/account-diff.png Call log: - expect.toHaveScreenshot(account.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 25 | 26 | test("should be rendered properly", async ({ uut, user }) => { > 27 | await expect(uut).toMatchScreenshot("account.png"); | ^ 28 | 29 | // Assert that the top heading is rendered 30 | await expect(uut.getByRole("heading", { name: "Account", exact: true })).toBeVisible(); at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:27:27

2) settings/account-user-settings-tab.spec.ts:26:9 › Account user settings tab › should be rendered properly Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-retry1/account-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-retry1/account-diff.png Call log: - expect.toHaveScreenshot(account.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 25 | 26 | test("should be rendered properly", async ({ uut, user }) => { > 27 | await expect(uut).toMatchScreenshot("account.png"); | ^ 28 | 29 | // Assert that the top heading is rendered 30 | await expect(uut.getByRole("heading", { name: "Account", exact: true })).toBeVisible(); at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:27:27

2) settings/account-user-settings-tab.spec.ts:26:9 › Account user settings tab › should be rendered properly Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-retry2/account-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-retry2/account-diff.png Call log: - expect.toHaveScreenshot(account.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 25 | 26 | test("should be rendered properly", async ({ uut, user }) => { > 27 | await expect(uut).toMatchScreenshot("account.png"); | ^ 28 | 29 | // Assert that the top heading is rendered 30 | await expect(uut.getByRole("heading", { name: "Account", exact: true })).toBeVisible(); at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:27:27

3) settings/account-user-settings-tab.spec.ts:74:9 › Account user settings tab › should respond to small screen sizes Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-smallscreen-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes/account-smallscreen-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes/account-smallscreen-diff.png Call log: - expect.toHaveScreenshot(account-smallscreen.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 74 | test("should respond to small screen sizes", async ({ page, uut }) => { 75 | await page.setViewportSize({ width: 700, height: 600 }); > 76 | await expect(uut).toMatchScreenshot("account-smallscreen.png"); | ^ 77 | }); 78 | 79 | test("should show tooltips on narrow screen", async ({ page, uut }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:76:27

3) settings/account-user-settings-tab.spec.ts:74:9 › Account user settings tab › should respond to small screen sizes Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-smallscreen-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-retry1/account-smallscreen-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-retry1/account-smallscreen-diff.png Call log: - expect.toHaveScreenshot(account-smallscreen.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 74 | test("should respond to small screen sizes", async ({ page, uut }) => { 75 | await page.setViewportSize({ width: 700, height: 600 }); > 76 | await expect(uut).toMatchScreenshot("account-smallscreen.png"); | ^ 77 | }); 78 | 79 | test("should show tooltips on narrow screen", async ({ page, uut }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:76:27

3) settings/account-user-settings-tab.spec.ts:74:9 › Account user settings tab › should respond to small screen sizes Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-smallscreen-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-retry2/account-smallscreen-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-retry2/account-smallscreen-diff.png Call log: - expect.toHaveScreenshot(account-smallscreen.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 74 | test("should respond to small screen sizes", async ({ page, uut }) => { 75 | await page.setViewportSize({ width: 700, height: 600 }); > 76 | await expect(uut).toMatchScreenshot("account-smallscreen.png"); | ^ 77 | }); 78 | 79 | test("should show tooltips on narrow screen", async ({ page, uut }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:76:27

4) settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:16:9 › Appearance user settings tab › should be rendered properly Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/appearance-tab-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly/appearance-tab-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly/appearance-tab-diff.png Call log: - expect.toHaveScreenshot(appearance-tab.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 23 | await expect(tab.getByRole("button", { name: "Hide advanced" })).toBeVisible(); 24 | > 25 | await expect(tab).toMatchScreenshot("appearance-tab.png"); | ^ 26 | }); 27 | 28 | test("should support changing font size by using the font size dropdown", async ({ page, app, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:25:27

1) invite/invite-dialog.spec.ts:22:9 › Invite dialog › should support inviting a user to a room ── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/invite/invite-dialog.spec.ts/invite-dialog-room-without-user-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-caaac-t-inviting-a-user-to-a-room/invite-dialog-room-without-user-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-caaac-t-inviting-a-user-to-a-room/invite-dialog-room-without-user-diff.png Call log: - expect.toHaveScreenshot(invite-dialog-room-without-user.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 41 | await expect(other.locator(".mx_InviteDialog_addressBar")).toBeVisible(); 42 | > 43 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("invite-dialog-room-without-user.png"); | ^ 44 | 45 | await expect(other.locator(".mx_InviteDialog_identityServer")).not.toBeVisible(); 46 | at /home/runner/work/element-web/element-web/playwright/e2e/invite/invite-dialog.spec.ts:43:50

1) invite/invite-dialog.spec.ts:22:9 › Invite dialog › should support inviting a user to a room ── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/invite/invite-dialog.spec.ts/invite-dialog-room-without-user-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-caaac-t-inviting-a-user-to-a-room-retry1/invite-dialog-room-without-user-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-caaac-t-inviting-a-user-to-a-room-retry1/invite-dialog-room-without-user-diff.png Call log: - expect.toHaveScreenshot(invite-dialog-room-without-user.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 41 | await expect(other.locator(".mx_InviteDialog_addressBar")).toBeVisible(); 42 | > 43 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("invite-dialog-room-without-user.png"); | ^ 44 | 45 | await expect(other.locator(".mx_InviteDialog_identityServer")).not.toBeVisible(); 46 | at /home/runner/work/element-web/element-web/playwright/e2e/invite/invite-dialog.spec.ts:43:50

1) invite/invite-dialog.spec.ts:22:9 › Invite dialog › should support inviting a user to a room ── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/invite/invite-dialog.spec.ts/invite-dialog-room-without-user-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-caaac-t-inviting-a-user-to-a-room-retry2/invite-dialog-room-without-user-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-caaac-t-inviting-a-user-to-a-room-retry2/invite-dialog-room-without-user-diff.png Call log: - expect.toHaveScreenshot(invite-dialog-room-without-user.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 41 | await expect(other.locator(".mx_InviteDialog_addressBar")).toBeVisible(); 42 | > 43 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("invite-dialog-room-without-user.png"); | ^ 44 | 45 | await expect(other.locator(".mx_InviteDialog_identityServer")).not.toBeVisible(); 46 | at /home/runner/work/element-web/element-web/playwright/e2e/invite/invite-dialog.spec.ts:43:50

2) invite/invite-dialog.spec.ts:76:9 › Invite dialog › should support inviting a user to Direct Messages Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/invite/invite-dialog.spec.ts/invite-dialog-dm-without-user-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-5dca7-g-a-user-to-Direct-Messages/invite-dialog-dm-without-user-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-5dca7-g-a-user-to-Direct-Messages/invite-dialog-dm-without-user-diff.png Call log: - expect.toHaveScreenshot(invite-dialog-dm-without-user.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 85 | 86 | // Take a snapshot of the invite dialog > 87 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("invite-dialog-dm-without-user.png"); | ^ 88 | 89 | await other.getByTestId("invite-dialog-input").fill(bot.credentials.userId); 90 | at /home/runner/work/element-web/element-web/playwright/e2e/invite/invite-dialog.spec.ts:87:50

2) invite/invite-dialog.spec.ts:76:9 › Invite dialog › should support inviting a user to Direct Messages Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/invite/invite-dialog.spec.ts/invite-dialog-dm-without-user-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-5dca7-g-a-user-to-Direct-Messages-retry1/invite-dialog-dm-without-user-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-5dca7-g-a-user-to-Direct-Messages-retry1/invite-dialog-dm-without-user-diff.png Call log: - expect.toHaveScreenshot(invite-dialog-dm-without-user.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 85 | 86 | // Take a snapshot of the invite dialog > 87 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("invite-dialog-dm-without-user.png"); | ^ 88 | 89 | await other.getByTestId("invite-dialog-input").fill(bot.credentials.userId); 90 | at /home/runner/work/element-web/element-web/playwright/e2e/invite/invite-dialog.spec.ts:87:50

2) invite/invite-dialog.spec.ts:76:9 › Invite dialog › should support inviting a user to Direct Messages Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/invite/invite-dialog.spec.ts/invite-dialog-dm-without-user-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-5dca7-g-a-user-to-Direct-Messages-retry2/invite-dialog-dm-without-user-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-5dca7-g-a-user-to-Direct-Messages-retry2/invite-dialog-dm-without-user-diff.png Call log: - expect.toHaveScreenshot(invite-dialog-dm-without-user.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 85 | 86 | // Take a snapshot of the invite dialog > 87 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("invite-dialog-dm-without-user.png"); | ^ 88 | 89 | await other.getByTestId("invite-dialog-input").fill(bot.credentials.userId); 90 | at /home/runner/work/element-web/element-web/playwright/e2e/invite/invite-dialog.spec.ts:87:50

3) pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline Error: Screenshot comparison failed: 41 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-Msg1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline/pinned-message-Msg1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline/pinned-message-Msg1-diff.png Call log: - expect.toHaveScreenshot(pinned-message-Msg1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$VB81Odjc0FpfSq7DccQXgzepC1cVRyllDWTJGLT13v8" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection" data-scroll-tokens="$VB81Odjc0FpfSq7DccQXgzepC1cVRyllDWTJGLT13v8">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 821px by 107px, received 821px by 72px. 371 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$VB81Odjc0FpfSq7DccQXgzepC1cVRyllDWTJGLT13v8" data-scroll-tokens="$VB81Odjc0FpfSq7DccQXgzepC1cVRyllDWTJGLT13v8">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 821px by 72px, received 821px by 107px. 406 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$VB81Odjc0FpfSq7DccQXgzepC1cVRyllDWTJGLT13v8" data-scroll-tokens="$VB81Odjc0FpfSq7DccQXgzepC1cVRyllDWTJGLT13v8">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 41 pixels (ratio 0.01 of all image pixels) are different. 30 | 31 | const tile = util.getEventTile("Msg1"); > 32 | await expect(tile).toMatchScreenshot("pinned-message-Msg1.png", { | ^ 33 | mask: [tile.locator(".mx_MessageTimestamp")], 34 | css: ` 35 | // Hide the jump to bottom button in the timeline to avoid flakiness at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:32:28

3) pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 41 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-Msg1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline-retry1/pinned-message-Msg1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline-retry1/pinned-message-Msg1-diff.png Call log: - expect.toHaveScreenshot(pinned-message-Msg1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$_KPyW6NMJfngoDT5evnDkvx1Cx4d0Rnjkmuq9C2YDk8" data-scroll-tokens="$_KPyW6NMJfngoDT5evnDkvx1Cx4d0Rnjkmuq9C2YDk8">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 41 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$_KPyW6NMJfngoDT5evnDkvx1Cx4d0Rnjkmuq9C2YDk8" data-scroll-tokens="$_KPyW6NMJfngoDT5evnDkvx1Cx4d0Rnjkmuq9C2YDk8">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 41 pixels (ratio 0.01 of all image pixels) are different. 30 | 31 | const tile = util.getEventTile("Msg1"); > 32 | await expect(tile).toMatchScreenshot("pinned-message-Msg1.png", { | ^ 33 | mask: [tile.locator(".mx_MessageTimestamp")], 34 | css: ` 35 | // Hide the jump to bottom button in the timeline to avoid flakiness at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:32:28

3) pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 41 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-Msg1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline-retry2/pinned-message-Msg1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline-retry2/pinned-message-Msg1-diff.png Call log: - expect.toHaveScreenshot(pinned-message-Msg1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$Sybg3zBuhJ_dmv9ZeyDf3oBRV88erF6cHzJTzSQKlWY" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection" data-scroll-tokens="$Sybg3zBuhJ_dmv9ZeyDf3oBRV88erF6cHzJTzSQKlWY">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 41 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$Sybg3zBuhJ_dmv9ZeyDf3oBRV88erF6cHzJTzSQKlWY" data-scroll-tokens="$Sybg3zBuhJ_dmv9ZeyDf3oBRV88erF6cHzJTzSQKlWY">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 41 pixels (ratio 0.01 of all image pixels) are different. 30 | 31 | const tile = util.getEventTile("Msg1"); > 32 | await expect(tile).toMatchScreenshot("pinned-message-Msg1.png", { | ^ 33 | mask: [tile.locator(".mx_MessageTimestamp")], 34 | css: ` 35 | // Hide the jump to bottom button in the timeline to avoid flakiness at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:32:28

4) pinned-messages/pinned-messages.spec.ts:76:9 › Pinned messages › should unpin all messages ──── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/unpin-all-dialog-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-622a2-s-should-unpin-all-messages/unpin-all-dialog-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-622a2-s-should-unpin-all-messages/unpin-all-dialog-diff.png Call log: - expect.toHaveScreenshot(unpin-all-dialog.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ hasText: 'Unpin all messages?' }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ hasText: 'Unpin all messages?' }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 80 | 81 | await util.openUnpinAllDialog(); > 82 | await expect(util.getUnpinAllDialog()).toMatchScreenshot("unpin-all-dialog.png"); | ^ 83 | await util.confirmUnpinAllDialog(); 84 | 85 | await util.assertEmptyPinnedMessagesList(); at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:82:48

1) file-upload/image-upload.spec.ts:28:9 › Image Upload › should show image preview when uploading an image Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/file-upload/image-upload.spec.ts/image-upload-preview-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/file-upload-image-upload-I-bd7ff-iew-when-uploading-an-image/image-upload-preview-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/file-upload-image-upload-I-bd7ff-iew-when-uploading-an-image/image-upload-preview-diff.png Call log: - expect.toHaveScreenshot(image-upload-preview.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 33 | await expect(page.getByRole("button", { name: "Upload" })).toBeEnabled(); 34 | await expect(page.getByRole("button", { name: "Close dialog" })).toBeEnabled(); > 35 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("image-upload-preview.png"); | ^ 36 | }); 37 | }); 38 | at /home/runner/work/element-web/element-web/playwright/e2e/file-upload/image-upload.spec.ts:35:50

1) file-upload/image-upload.spec.ts:28:9 › Image Upload › should show image preview when uploading an image Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/file-upload/image-upload.spec.ts/image-upload-preview-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/file-upload-image-upload-I-bd7ff-iew-when-uploading-an-image-retry1/image-upload-preview-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/file-upload-image-upload-I-bd7ff-iew-when-uploading-an-image-retry1/image-upload-preview-diff.png Call log: - expect.toHaveScreenshot(image-upload-preview.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 33 | await expect(page.getByRole("button", { name: "Upload" })).toBeEnabled(); 34 | await expect(page.getByRole("button", { name: "Close dialog" })).toBeEnabled(); > 35 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("image-upload-preview.png"); | ^ 36 | }); 37 | }); 38 | at /home/runner/work/element-web/element-web/playwright/e2e/file-upload/image-upload.spec.ts:35:50

1) file-upload/image-upload.spec.ts:28:9 › Image Upload › should show image preview when uploading an image Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/file-upload/image-upload.spec.ts/image-upload-preview-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/file-upload-image-upload-I-bd7ff-iew-when-uploading-an-image-retry2/image-upload-preview-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/file-upload-image-upload-I-bd7ff-iew-when-uploading-an-image-retry2/image-upload-preview-diff.png Call log: - expect.toHaveScreenshot(image-upload-preview.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 33 | await expect(page.getByRole("button", { name: "Upload" })).toBeEnabled(); 34 | await expect(page.getByRole("button", { name: "Close dialog" })).toBeEnabled(); > 35 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("image-upload-preview.png"); | ^ 36 | }); 37 | }); 38 | at /home/runner/work/element-web/element-web/playwright/e2e/file-upload/image-upload.spec.ts:35:50

2) forgot-password/forgot-password.spec.ts:42:9 › Forgot Password › renders email verification dialog properly Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/forgot-password/forgot-password.spec.ts/forgot-password-verify-email-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/forgot-password-forgot-pas-c6d2d-erification-dialog-properly/forgot-password-verify-email-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/forgot-password-forgot-pas-c6d2d-erification-dialog-properly/forgot-password-verify-email-diff.png Call log: - expect.toHaveScreenshot(forgot-password-verify-email.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 65 | await expect(page.getByRole("button", { name: "Resend" })).toBeInViewport(); 66 | > 67 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("forgot-password-verify-email.png"); | ^ 68 | }); 69 | }); 70 | at /home/runner/work/element-web/element-web/playwright/e2e/forgot-password/forgot-password.spec.ts:67:50

2) forgot-password/forgot-password.spec.ts:42:9 › Forgot Password › renders email verification dialog properly Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/forgot-password/forgot-password.spec.ts/forgot-password-verify-email-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/forgot-password-forgot-pas-c6d2d-erification-dialog-properly-retry1/forgot-password-verify-email-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/forgot-password-forgot-pas-c6d2d-erification-dialog-properly-retry1/forgot-password-verify-email-diff.png Call log: - expect.toHaveScreenshot(forgot-password-verify-email.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 65 | await expect(page.getByRole("button", { name: "Resend" })).toBeInViewport(); 66 | > 67 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("forgot-password-verify-email.png"); | ^ 68 | }); 69 | }); 70 | at /home/runner/work/element-web/element-web/playwright/e2e/forgot-password/forgot-password.spec.ts:67:50

2) forgot-password/forgot-password.spec.ts:42:9 › Forgot Password › renders email verification dialog properly Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/forgot-password/forgot-password.spec.ts/forgot-password-verify-email-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/forgot-password-forgot-pas-c6d2d-erification-dialog-properly-retry2/forgot-password-verify-email-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/forgot-password-forgot-pas-c6d2d-erification-dialog-properly-retry2/forgot-password-verify-email-diff.png Call log: - expect.toHaveScreenshot(forgot-password-verify-email.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 65 | await expect(page.getByRole("button", { name: "Resend" })).toBeInViewport(); 66 | > 67 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("forgot-password-verify-email.png"); | ^ 68 | }); 69 | }); 70 | at /home/runner/work/element-web/element-web/playwright/e2e/forgot-password/forgot-password.spec.ts:67:50

Process completed with exit code 1.

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

spotlight/spotlight.spec.ts took 2.1m

spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.5m

threads/threads.spec.ts took 34.1s

widgets/widget-pip-close.spec.ts took 20.4s

widgets/layout.spec.ts took 18.1s

read-receipts/new-messages-in-threads.spec.ts took 1.9m

read-receipts/editing-messages-in-threads.spec.ts took 1.4m

read-receipts/editing-messages-main-timeline.spec.ts took 1.3m

read-receipts/editing-messages-thread-roots.spec.ts took 59.7s

read-receipts/redactions-in-threads.spec.ts took 2.8m

read-receipts/redactions-main-timeline.spec.ts took 2.2m

read-receipts/new-messages-main-timeline.spec.ts took 1.7m

read-receipts/read-receipts.spec.ts took 1.2m

read-receipts/reactions-in-threads.spec.ts took 1.1m

read-receipts/redactions-thread-roots.spec.ts took 1.1m

spaces/spaces.spec.ts took 59.7s

right-panel/right-panel.spec.ts took 53.2s

right-panel/file-panel.spec.ts took 37.8s

settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 32.6s

messages/messages.spec.ts took 2.3m

login/login.spec.ts took 57.8s

knock/knock-into-room.spec.ts took 39.7s

integration-manager/read_events.spec.ts took 37.8s

polls/polls.spec.ts took 33.2s

composer/RTE.spec.ts took 1.4m

audio-player/audio-player.spec.ts took 1.3m

crypto/crypto.spec.ts took 1.1m

crypto/event-shields.spec.ts took 1.1m

crypto/device-verification.spec.ts took 48.3s

1 failed user-onboarding/user-onboarding-new.spec.ts:37:9 › User Onboarding (new user) › app download dialog 1 flaky timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout 3 skipped 66 passed (9.6m)

1 failed read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread 32 skipped 41 passed (10.5m)

14 skipped 62 passed (11.1m)

8 failed register/register.spec.ts:18:9 › Registration › registers an account and lands on the home screen settings/account-user-settings-tab.spec.ts:26:9 › Account user settings tab › should be rendered properly settings/account-user-settings-tab.spec.ts:74:9 › Account user settings tab › should respond to small screen sizes settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:16:9 › Appearance user settings tab › should be rendered properly settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:28:9 › Appearance user settings tab › should support changing font size by using the font size dropdown settings/general-room-settings-tab.spec.ts:23:9 › General room settings tab › should be rendered properly settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly settings/security-user-settings-tab.spec.ts:39:17 › Security user settings tab › with posthog enabled › AnalyticsLearnMoreDialog › should be rendered properly 10 skipped 63 passed (11.6m)

4 failed invite/invite-dialog.spec.ts:22:9 › Invite dialog › should support inviting a user to a room ─── invite/invite-dialog.spec.ts:76:9 › Invite dialog › should support inviting a user to Direct Messages pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline pinned-messages/pinned-messages.spec.ts:76:9 › Pinned messages › should unpin all messages ───── 1 skipped 74 passed (11.8m)