1) threads/threads.spec.ts:354:9 › Threads › should send location and reply to the location on ThreadView Error: Screenshot comparison failed: 2332 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/threads/threads.spec.ts/Reply-to-the-location-on-ThreadView-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView/Reply-to-the-location-on-ThreadView-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView/Reply-to-the-location-on-ThreadView-diff.png Call log: - expect.toHaveScreenshot(Reply-to-the-location-on-ThreadView.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2332 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2332 pixels (ratio 0.02 of all image pixels) are different. 401 | // Take a snapshot of reply to the shared location 402 | await page.addStyleTag({ content: css }); > 403 | await expect(page.locator(".mx_ThreadView")).toMatchScreenshot("Reply_to_the_location_on_ThreadView.png"); | ^ 404 | }); 405 | 406 | test("right panel behaves correctly", async ({ page, app, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/threads/threads.spec.ts:403:54

1) threads/threads.spec.ts:354:9 › Threads › should send location and reply to the location on ThreadView Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 2332 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/threads/threads.spec.ts/Reply-to-the-location-on-ThreadView-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView-retry1/Reply-to-the-location-on-ThreadView-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView-retry1/Reply-to-the-location-on-ThreadView-diff.png Call log: - expect.toHaveScreenshot(Reply-to-the-location-on-ThreadView.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2332 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2332 pixels (ratio 0.02 of all image pixels) are different. 401 | // Take a snapshot of reply to the shared location 402 | await page.addStyleTag({ content: css }); > 403 | await expect(page.locator(".mx_ThreadView")).toMatchScreenshot("Reply_to_the_location_on_ThreadView.png"); | ^ 404 | }); 405 | 406 | test("right panel behaves correctly", async ({ page, app, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/threads/threads.spec.ts:403:54

1) threads/threads.spec.ts:354:9 › Threads › should send location and reply to the location on ThreadView Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 2332 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/threads/threads.spec.ts/Reply-to-the-location-on-ThreadView-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView-retry2/Reply-to-the-location-on-ThreadView-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/threads-threads-Threads-sh-e51e8--the-location-on-ThreadView-retry2/Reply-to-the-location-on-ThreadView-diff.png Call log: - expect.toHaveScreenshot(Reply-to-the-location-on-ThreadView.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2332 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_ThreadView') - locator resolved to <div class="mx_BaseCard mx_ThreadView mx_ThreadPanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2332 pixels (ratio 0.02 of all image pixels) are different. 401 | // Take a snapshot of reply to the shared location 402 | await page.addStyleTag({ content: css }); > 403 | await expect(page.locator(".mx_ThreadView")).toMatchScreenshot("Reply_to_the_location_on_ThreadView.png"); | ^ 404 | }); 405 | 406 | test("right panel behaves correctly", async ({ page, app, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/threads/threads.spec.ts:403:54

2) timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout Error: Screenshot comparison failed: 6560 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/event-tiles-bubble-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout/event-tiles-bubble-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout/event-tiles-bubble-layout-diff.png Call log: - expect.toHaveScreenshot(event-tiles-bubble-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 26765 pixels (ratio 0.05 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 26765 pixels (ratio 0.05 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 6560 pixels (ratio 0.02 of all image pixels) are different. - waiting 500ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 6560 pixels (ratio 0.02 of all image pixels) are different. 555 | page.locator(".mx_RoomView").getByText("This message has an inline emoji 👒"), 556 | ).toBeInViewport(); > 557 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot( | ^ 558 | "event-tiles-bubble-layout.png", 559 | screenshotOptions, 560 | ); at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:557:57

Process completed with exit code 1.

1) pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline Error: Screenshot comparison failed: 41 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-Msg1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline/pinned-message-Msg1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline/pinned-message-Msg1-diff.png Call log: - expect.toHaveScreenshot(pinned-message-Msg1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$F7yyhHqz3MVfdknhkoE7NjM9vHKgUE-yvNc57ZBUO4E" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection" data-scroll-tokens="$F7yyhHqz3MVfdknhkoE7NjM9vHKgUE-yvNc57ZBUO4E">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 41 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$F7yyhHqz3MVfdknhkoE7NjM9vHKgUE-yvNc57ZBUO4E" data-scroll-tokens="$F7yyhHqz3MVfdknhkoE7NjM9vHKgUE-yvNc57ZBUO4E">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 41 pixels (ratio 0.01 of all image pixels) are different. 30 | 31 | const tile = util.getEventTile("Msg1"); > 32 | await expect(tile).toMatchScreenshot("pinned-message-Msg1.png", { | ^ 33 | mask: [tile.locator(".mx_MessageTimestamp")], 34 | }); 35 | }); at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:32:28

1) crypto/crypto.spec.ts:97:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys') 118 | if (!isDeviceVerified) { 119 | const uiaDialogTitle = page.locator(".mx_InteractiveAuthDialog .mx_Dialog_title"); > 120 | await expect(uiaDialogTitle.getByText("Setting up keys")).toBeVisible(); | ^ 121 | await expect(uiaDialogTitle.getByText("Setting up keys")).not.toBeVisible(); 122 | } 123 | at /home/runner/work/element-web/element-web/playwright/e2e/crypto/crypto.spec.ts:120:79

Stale screenshot file

Process completed with exit code 1.

read-receipts/high-level.spec.ts took 3.3m

read-receipts/new-messages-in-threads.spec.ts took 1.6m

read-receipts/editing-messages-in-threads.spec.ts took 1.4m

read-receipts/editing-messages-main-timeline.spec.ts took 1.1m

read-receipts/editing-messages-thread-roots.spec.ts took 52.0s

spotlight/spotlight.spec.ts took 2.0m

spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m

user-onboarding/user-onboarding-new.spec.ts took 31.3s

widgets/widget-pip-close.spec.ts took 21.7s

widgets/layout.spec.ts took 21.4s

read-receipts/redactions-thread-roots.spec.ts took 1.3m

spaces/spaces.spec.ts took 1.0m

right-panel/right-panel.spec.ts took 55.5s

settings/account-user-settings-tab.spec.ts took 48.1s

right-panel/file-panel.spec.ts took 42.0s

read-receipts/redactions-in-threads.spec.ts took 2.9m

read-receipts/redactions-main-timeline.spec.ts took 2.2m

read-receipts/new-messages-main-timeline.spec.ts took 1.5m

read-receipts/read-receipts.spec.ts took 1.2m

read-receipts/reactions-in-threads.spec.ts took 1.1m

messages/messages.spec.ts took 2.5m

login/login.spec.ts took 1.1m

integration-manager/read_events.spec.ts took 42.9s

knock/knock-into-room.spec.ts took 40.8s

polls/polls.spec.ts took 38.0s

audio-player/audio-player.spec.ts took 1.3m

composer/RTE.spec.ts took 1.2m

crypto/event-shields.spec.ts took 59.7s

crypto/decryption-failure-messages.spec.ts took 51.0s

crypto/device-verification.spec.ts took 47.5s

32 skipped 42 passed (8.5m)

1 failed threads/threads.spec.ts:354:9 › Threads › should send location and reply to the location on ThreadView 1 flaky timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout 4 skipped 65 passed (9.9m)

10 skipped 71 passed (10.3m)

14 skipped 62 passed (11.2m)

1 flaky pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline 1 skipped 77 passed (11.6m)