1) timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout Error: Screenshot comparison failed: 6560 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/event-tiles-bubble-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout/event-tiles-bubble-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout/event-tiles-bubble-layout-diff.png Call log: - expect.toHaveScreenshot(event-tiles-bubble-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 26765 pixels (ratio 0.05 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 26765 pixels (ratio 0.05 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 6560 pixels (ratio 0.02 of all image pixels) are different. - waiting 500ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 6560 pixels (ratio 0.02 of all image pixels) are different. 555 | page.locator(".mx_RoomView").getByText("This message has an inline emoji 👒"), 556 | ).toBeInViewport(); > 557 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot( | ^ 558 | "event-tiles-bubble-layout.png", 559 | screenshotOptions, 560 | ); at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:557:57

1) pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline Error: Screenshot comparison failed: 41 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-Msg1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline/pinned-message-Msg1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline/pinned-message-Msg1-diff.png Call log: - expect.toHaveScreenshot(pinned-message-Msg1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$yNH0uI5L1x2Qs2SkL7RFSpKEYT-gxyx2FI558dGDC_0" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection" data-scroll-tokens="$yNH0uI5L1x2Qs2SkL7RFSpKEYT-gxyx2FI558dGDC_0">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - element is not stable - retrying scroll into view action, attempt #1 - waiting for element to be stable - 41 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$yNH0uI5L1x2Qs2SkL7RFSpKEYT-gxyx2FI558dGDC_0" data-scroll-tokens="$yNH0uI5L1x2Qs2SkL7RFSpKEYT-gxyx2FI558dGDC_0">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 41 pixels (ratio 0.01 of all image pixels) are different. 30 | 31 | const tile = util.getEventTile("Msg1"); > 32 | await expect(tile).toMatchScreenshot("pinned-message-Msg1.png", { | ^ 33 | mask: [tile.locator(".mx_MessageTimestamp")], 34 | css: ` 35 | // Hide the jump to bottom button in the timeline to avoid flakiness at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:32:28

1) pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 41 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-Msg1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline-retry1/pinned-message-Msg1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline-retry1/pinned-message-Msg1-diff.png Call log: - expect.toHaveScreenshot(pinned-message-Msg1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$M7L1ow8wxYXi-j9Jvy7vgGda5kKL-qPXo8bjp9B57jI" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection" data-scroll-tokens="$M7L1ow8wxYXi-j9Jvy7vgGda5kKL-qPXo8bjp9B57jI">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - element is not stable - retrying scroll into view action, attempt #1 - waiting for element to be stable - 41 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$M7L1ow8wxYXi-j9Jvy7vgGda5kKL-qPXo8bjp9B57jI" data-scroll-tokens="$M7L1ow8wxYXi-j9Jvy7vgGda5kKL-qPXo8bjp9B57jI">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 41 pixels (ratio 0.01 of all image pixels) are different. 30 | 31 | const tile = util.getEventTile("Msg1"); > 32 | await expect(tile).toMatchScreenshot("pinned-message-Msg1.png", { | ^ 33 | mask: [tile.locator(".mx_MessageTimestamp")], 34 | css: ` 35 | // Hide the jump to bottom button in the timeline to avoid flakiness at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:32:28

1) pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 41 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-Msg1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline-retry2/pinned-message-Msg1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline-retry2/pinned-message-Msg1-diff.png Call log: - expect.toHaveScreenshot(pinned-message-Msg1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$lRFzlOIgwWYL1WmFQ41KmRHFz774cJEy7xQn-SmAOEU" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection" data-scroll-tokens="$lRFzlOIgwWYL1WmFQ41KmRHFz774cJEy7xQn-SmAOEU">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - element is not stable - retrying scroll into view action, attempt #1 - waiting for element to be stable - 41 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$lRFzlOIgwWYL1WmFQ41KmRHFz774cJEy7xQn-SmAOEU" data-scroll-tokens="$lRFzlOIgwWYL1WmFQ41KmRHFz774cJEy7xQn-SmAOEU">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 41 pixels (ratio 0.01 of all image pixels) are different. 30 | 31 | const tile = util.getEventTile("Msg1"); > 32 | await expect(tile).toMatchScreenshot("pinned-message-Msg1.png", { | ^ 33 | mask: [tile.locator(".mx_MessageTimestamp")], 34 | css: ` 35 | // Hide the jump to bottom button in the timeline to avoid flakiness at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:32:28

Process completed with exit code 1.

Stale screenshot file

Process completed with exit code 1.

read-receipts/high-level.spec.ts took 3.3m

read-receipts/new-messages-in-threads.spec.ts took 1.7m

read-receipts/editing-messages-in-threads.spec.ts took 1.2m

read-receipts/editing-messages-main-timeline.spec.ts took 1.1m

read-receipts/editing-messages-thread-roots.spec.ts took 52.8s

read-receipts/redactions-thread-roots.spec.ts took 1.1m

spaces/spaces.spec.ts took 55.9s

right-panel/right-panel.spec.ts took 52.2s

settings/account-user-settings-tab.spec.ts took 41.6s

right-panel/file-panel.spec.ts took 36.6s

spotlight/spotlight.spec.ts took 2.2m

spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m

threads/threads.spec.ts took 37.0s

user-onboarding/user-onboarding-new.spec.ts took 31.3s

widgets/widget-pip-close.spec.ts took 20.5s

messages/messages.spec.ts took 2.1m

login/login.spec.ts took 56.6s

integration-manager/read_events.spec.ts took 35.6s

knock/knock-into-room.spec.ts took 35.2s

polls/polls.spec.ts took 33.5s

read-receipts/redactions-in-threads.spec.ts took 2.8m

read-receipts/redactions-main-timeline.spec.ts took 2.2m

read-receipts/new-messages-main-timeline.spec.ts took 1.5m

read-receipts/read-receipts.spec.ts took 1.2m

read-receipts/reactions-in-threads.spec.ts took 1.1m

composer/RTE.spec.ts took 1.3m

audio-player/audio-player.spec.ts took 1.2m

crypto/event-shields.spec.ts took 1.1m

crypto/crypto.spec.ts took 1.1m

crypto/device-verification.spec.ts took 50.0s

32 skipped 42 passed (8.4m)

10 skipped 71 passed (9.1m)

1 flaky timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout 3 skipped 67 passed (9.9m)

1 failed pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline 1 skipped 77 passed (10.4m)

14 skipped 62 passed (10.9m)