1) timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout Error: Screenshot comparison failed: 6560 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/event-tiles-bubble-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout/event-tiles-bubble-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout/event-tiles-bubble-layout-diff.png Call log: - expect.toHaveScreenshot(event-tiles-bubble-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 26765 pixels (ratio 0.05 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 26765 pixels (ratio 0.05 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 6560 pixels (ratio 0.02 of all image pixels) are different. - waiting 500ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 6560 pixels (ratio 0.02 of all image pixels) are different. 555 | page.locator(".mx_RoomView").getByText("This message has an inline emoji 👒"), 556 | ).toBeInViewport(); > 557 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot( | ^ 558 | "event-tiles-bubble-layout.png", 559 | screenshotOptions, 560 | ); at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:557:57

1) settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly Error: Screenshot comparison failed: 133 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png Call log: - expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 133 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 133 pixels (ratio 0.01 of all image pixels) are different. 29 | // Assert that the top heading is rendered 30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible(); > 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png"); | ^ 32 | }); 33 | 34 | test("should be able to change the app language", async ({ uut, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27

1) settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 133 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-retry1/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-retry1/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png Call log: - expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 133 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 133 pixels (ratio 0.01 of all image pixels) are different. 29 | // Assert that the top heading is rendered 30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible(); > 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png"); | ^ 32 | }); 33 | 34 | test("should be able to change the app language", async ({ uut, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27

1) settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 133 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-retry2/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-retry2/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png Call log: - expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 133 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 133 pixels (ratio 0.01 of all image pixels) are different. 29 | // Assert that the top heading is rendered 30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible(); > 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png"); | ^ 32 | }); 33 | 34 | test("should be able to change the app language", async ({ uut, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27

Process completed with exit code 1.

Stale screenshot file

Process completed with exit code 1.

read-receipts/high-level.spec.ts took 3.5m

read-receipts/new-messages-in-threads.spec.ts took 1.7m

read-receipts/editing-messages-in-threads.spec.ts took 1.4m

read-receipts/editing-messages-main-timeline.spec.ts took 1.2m

read-receipts/editing-messages-thread-roots.spec.ts took 58.2s

spotlight/spotlight.spec.ts took 2.1m

spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m

threads/threads.spec.ts took 34.2s

user-onboarding/user-onboarding-new.spec.ts took 30.1s

widgets/widget-pip-close.spec.ts took 20.4s

read-receipts/redactions-thread-roots.spec.ts took 1.1m

spaces/spaces.spec.ts took 56.9s

right-panel/right-panel.spec.ts took 52.4s

settings/account-user-settings-tab.spec.ts took 40.5s

right-panel/file-panel.spec.ts took 36.6s

messages/messages.spec.ts took 2.1m

pinned-messages/pinned-messages.spec.ts took 1.6m

login/login.spec.ts took 56.2s

integration-manager/read_events.spec.ts took 36.3s

knock/knock-into-room.spec.ts took 35.3s

read-receipts/redactions-in-threads.spec.ts took 2.8m

read-receipts/redactions-main-timeline.spec.ts took 2.1m

read-receipts/new-messages-main-timeline.spec.ts took 1.5m

read-receipts/read-receipts.spec.ts took 1.2m

read-receipts/reactions-in-threads.spec.ts took 1.1m

audio-player/audio-player.spec.ts took 1.2m

composer/RTE.spec.ts took 1.2m

crypto/crypto.spec.ts took 59.0s

crypto/event-shields.spec.ts took 57.9s

crypto/device-verification.spec.ts took 44.2s

32 skipped 42 passed (9.0m)

1 flaky timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout 3 skipped 67 passed (9.3m)

1 failed settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly 10 skipped 70 passed (9.5m)

1 skipped 78 passed (10.1m)

14 skipped 62 passed (10.8m)