1) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read Error: locator.click: Error: strict mode violation: getByLabel('Mark all as read') resolved to 2 elements: 1) <div tabindex="0" role="button" aria-label="Mark all as read" class="mx_AccessibleButton mx_TopUnreadMessagesBar_markAsRead"></div> aka getByRole('main').getByLabel('Mark all as read') 2) <button tabindex="0" role="button" aria-labelledby=":r6s:" class="_icon-button_bh2qc_17">…</button> aka locator('#thread-panel').getByLabel('Mark all as read') Call log: - waiting for getByLabel('Mark all as read') at spaces/threads-activity-centre/index.ts:379 377 | */ 378 | clickMarkAllThreadsRead() { > 379 | return this.page.getByLabel("Mark all as read").click(); | ^ 380 | } 381 | } 382 | at Helpers.clickMarkAllThreadsRead (/home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/index.ts:379:57) at /home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:149:14

1) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read Error: Screenshot comparison failed: 39 pixels (ratio 0.04 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-no-indicator-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/spaces-threads-activity-ce-ffe63-ld-mark-all-threads-as-read/tac-no-indicator-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/spaces-threads-activity-ce-ffe63-ld-mark-all-threads-as-read/tac-no-indicator-diff.png Call log: - expect.toHaveScreenshot(tac-no-indicator.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('navigation', { name: 'Spaces' }).getByLabel('Threads') - locator resolved to <button tabindex="0" type="button" role="button" id="radix-:r8:" data-state="closed" aria-label="Threads" aria-haspopup="menu" aria-expanded="false" aria-disabled="false" aria-labelledby=":ra:" data-indicator="success" class="_icon-button_bh2qc_17 mx_ThreadsActivityCentreButton">…</button> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 39 pixels (ratio 0.04 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('navigation', { name: 'Spaces' }).getByLabel('Threads') - locator resolved to <button tabindex="0" type="button" role="button" id="radix-:r8:" data-state="closed" aria-label="Threads" aria-haspopup="menu" aria-expanded="false" aria-disabled="false" aria-labelledby=":ra:" data-indicator="success" class="_icon-button_bh2qc_17 mx_ThreadsActivityCentreButton">…</button> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 39 pixels (ratio 0.04 of all image pixels) are different. at spaces/threads-activity-centre/index.ts:283 281 | await expect(this.getTacButton().locator("[data-indicator='success']")).not.toBeVisible(); 282 | await expect(this.getTacButton().locator("[data-indicator='critical']")).not.toBeVisible(); > 283 | await expect(this.getTacButton()).toMatchScreenshot("tac-no-indicator.png"); | ^ 284 | } 285 | 286 | /** at Helpers.assertNoTacIndicator (/home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/index.ts:283:43) at /home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:151:9

2) timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout Error: Screenshot comparison failed: 6560 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/event-tiles-bubble-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout/event-tiles-bubble-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout/event-tiles-bubble-layout-diff.png Call log: - expect.toHaveScreenshot(event-tiles-bubble-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 26765 pixels (ratio 0.05 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 26765 pixels (ratio 0.05 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 6560 pixels (ratio 0.02 of all image pixels) are different. - waiting 500ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 6560 pixels (ratio 0.02 of all image pixels) are different. 555 | page.locator(".mx_RoomView").getByText("This message has an inline emoji 👒"), 556 | ).toBeInViewport(); > 557 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot( | ^ 558 | "event-tiles-bubble-layout.png", 559 | screenshotOptions, 560 | ); at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:557:57

1) pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline Error: Screenshot comparison failed: 41 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-Msg1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline/pinned-message-Msg1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline/pinned-message-Msg1-diff.png Call log: - expect.toHaveScreenshot(pinned-message-Msg1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$09y8kkGCZ6LFgmhHdn_U81lEGv5hJBbyqetIr06WzxQ" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection" data-scroll-tokens="$09y8kkGCZ6LFgmhHdn_U81lEGv5hJBbyqetIr06WzxQ">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 41 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$09y8kkGCZ6LFgmhHdn_U81lEGv5hJBbyqetIr06WzxQ" data-scroll-tokens="$09y8kkGCZ6LFgmhHdn_U81lEGv5hJBbyqetIr06WzxQ">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 41 pixels (ratio 0.01 of all image pixels) are different. 30 | 31 | const tile = util.getEventTile("Msg1"); > 32 | await expect(tile).toMatchScreenshot("pinned-message-Msg1.png", { | ^ 33 | mask: [tile.locator(".mx_MessageTimestamp")], 34 | css: ` 35 | // Hide the jump to bottom button in the timeline to avoid flakiness at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:32:28

2) pinned-messages/pinned-messages.spec.ts:76:9 › Pinned messages › should unpin all messages ──── Error: Screenshot comparison failed: 2430 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-messages-list-empty-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-622a2-s-should-unpin-all-messages/pinned-messages-list-empty-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-622a2-s-should-unpin-all-messages/pinned-messages-list-empty-diff.png Call log: - expect.toHaveScreenshot(pinned-messages-list-empty.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('#mx_RightPanel') - locator resolved to <aside id="mx_RightPanel" class="mx_RightPanel">…</aside> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2430 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('#mx_RightPanel') - locator resolved to <aside id="mx_RightPanel" class="mx_RightPanel">…</aside> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2430 pixels (ratio 0.02 of all image pixels) are different. at pinned-messages/index.ts:199 197 | async assertEmptyPinnedMessagesList() { 198 | const rightPanel = this.getRightPanel(); > 199 | await expect(rightPanel).toMatchScreenshot(`pinned-messages-list-empty.png`, { | ^ 200 | css: ` 201 | // hide the tooltip "Room information" to avoid flakiness 202 | [data-floating-ui-portal] { at Helpers.assertEmptyPinnedMessagesList (/home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/index.ts:199:34) at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:85:20

2) pinned-messages/pinned-messages.spec.ts:76:9 › Pinned messages › should unpin all messages ──── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 2430 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-messages-list-empty-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-622a2-s-should-unpin-all-messages-retry1/pinned-messages-list-empty-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-622a2-s-should-unpin-all-messages-retry1/pinned-messages-list-empty-diff.png Call log: - expect.toHaveScreenshot(pinned-messages-list-empty.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('#mx_RightPanel') - locator resolved to <aside id="mx_RightPanel" class="mx_RightPanel">…</aside> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 2430 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('#mx_RightPanel') - locator resolved to <aside id="mx_RightPanel" class="mx_RightPanel">…</aside> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 2430 pixels (ratio 0.02 of all image pixels) are different. at pinned-messages/index.ts:199 197 | async assertEmptyPinnedMessagesList() { 198 | const rightPanel = this.getRightPanel(); > 199 | await expect(rightPanel).toMatchScreenshot(`pinned-messages-list-empty.png`, { | ^ 200 | css: ` 201 | // hide the tooltip "Room information" to avoid flakiness 202 | [data-floating-ui-portal] { at Helpers.assertEmptyPinnedMessagesList (/home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/index.ts:199:34) at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:85:20

3) polls/polls.spec.ts:96:9 › Polls › should be creatable and votable ──────────────────────────── Error: Screenshot comparison failed: 121 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/polls/polls.spec.ts/Polls-Timeline-tile-no-votes-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/polls-polls-Polls-should-be-creatable-and-votable/Polls-Timeline-tile-no-votes-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/polls-polls-Polls-should-be-creatable-and-votable/Polls-Timeline-tile-no-votes-diff.png Call log: - expect.toHaveScreenshot(Polls-Timeline-tile-no-votes.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile[data-scroll-tokens="$gyqqkBeV8c1I-YwYUrp6gVIoSrqcq075Tl4SkP6ceFI"]') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$gyqqkBeV8c1I-YwYUrp6gVIoSrqcq075Tl4SkP6ceFI" data-scroll-tokens="$gyqqkBeV8c1I-YwYUrp6gVIoSrqcq075Tl4SkP6ceFI" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection mx_EventTile_noBubble">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 121 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile[data-scroll-tokens="$gyqqkBeV8c1I-YwYUrp6gVIoSrqcq075Tl4SkP6ceFI"]') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$gyqqkBeV8c1I-YwYUrp6gVIoSrqcq075Tl4SkP6ceFI" data-scroll-tokens="$gyqqkBeV8c1I-YwYUrp6gVIoSrqcq075Tl4SkP6ceFI" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection mx_EventTile_noBubble">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 121 pixels (ratio 0.01 of all image pixels) are different. 118 | .filter({ hasText: pollParams.title }) 119 | .getAttribute("data-scroll-tokens"); > 120 | await expect(getPollTile(page, pollId)).toMatchScreenshot("Polls_Timeline_tile_no_votes.png", { | ^ 121 | mask: [page.locator(".mx_MessageTimestamp")], 122 | }); 123 | at /home/runner/work/element-web/element-web/playwright/e2e/polls/polls.spec.ts:120:49

1) read-receipts/read-receipts.spec.ts:279:9 › Read receipts › Should send the correct receipts ── Test timeout of 30000ms exceeded.

1) read-receipts/read-receipts.spec.ts:279:9 › Read receipts › Should send the correct receipts ── Error: page.waitForRequest: Test timeout of 30000ms exceeded. =========================== logs =========================== waiting for request /http:\/\/localhost:\d+\/_matrix\/client\/v3\/room…/ ============================================================ 308 | 309 | // the following code tests the fully read marker somewhere in the middle of the room > 310 | const readMarkersRequestPromise = page.waitForRequest( | ^ 311 | new RegExp(`http://localhost:\\d+/_matrix/client/v3/rooms/${uriEncodedOtherRoomId}/read_markers`), 312 | ); 313 | at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/read-receipts.spec.ts:310:48

1) read-receipts/read-receipts.spec.ts:279:9 › Read receipts › Should send the correct receipts ── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toContain(expected) // indexOf Expected substring: "%24nPoaKCNG8kr3xoVrHJOWcG2Mo0jTw9ERgB_C2PL8_yU" Received string: "http://localhost:39649/_matrix/client/v3/rooms/!EqZechnOrwnRGttKAn%3Alocalhost/receipt/m.read/%24Ma_5TBORItewRBKn5lMIl6AYjOZaRjJiXorEch-p5bs" 302 | const receiptRequest = await receiptRequestPromise; 303 | // assert the read receipt for the last message in the room > 304 | expect(receiptRequest.url()).toContain(uriEncodedLastMessageId); | ^ 305 | expect(receiptRequest.postDataJSON()).toEqual({ 306 | thread_id: "main", 307 | }); at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/read-receipts.spec.ts:304:38

1) read-receipts/read-receipts.spec.ts:279:9 › Read receipts › Should send the correct receipts ── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.

1) read-receipts/read-receipts.spec.ts:279:9 › Read receipts › Should send the correct receipts ── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.waitForRequest: Test timeout of 30000ms exceeded. =========================== logs =========================== waiting for request /http:\/\/localhost:\d+\/_matrix\/client\/v3\/room…/ ============================================================ 308 | 309 | // the following code tests the fully read marker somewhere in the middle of the room > 310 | const readMarkersRequestPromise = page.waitForRequest( | ^ 311 | new RegExp(`http://localhost:\\d+/_matrix/client/v3/rooms/${uriEncodedOtherRoomId}/read_markers`), 312 | ); 313 | at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/read-receipts.spec.ts:310:48

Process completed with exit code 1.

Process completed with exit code 1.

read-receipts/high-level.spec.ts took 3.5m

read-receipts/new-messages-in-threads.spec.ts took 1.8m

read-receipts/editing-messages-in-threads.spec.ts took 1.4m

read-receipts/editing-messages-main-timeline.spec.ts took 1.3m

read-receipts/editing-messages-thread-roots.spec.ts took 58.2s

spotlight/spotlight.spec.ts took 2.3m

threads/threads.spec.ts took 37.6s

user-onboarding/user-onboarding-new.spec.ts took 34.5s

widgets/widget-pip-close.spec.ts took 22.7s

widgets/layout.spec.ts took 21.2s

read-receipts/redactions-thread-roots.spec.ts took 1.1m

spaces/spaces.spec.ts took 57.6s

right-panel/right-panel.spec.ts took 50.7s

settings/account-user-settings-tab.spec.ts took 41.1s

right-panel/file-panel.spec.ts took 36.4s

composer/RTE.spec.ts took 1.3m

audio-player/audio-player.spec.ts took 1.3m

crypto/crypto.spec.ts took 1.1m

crypto/event-shields.spec.ts took 1.0m

crypto/device-verification.spec.ts took 46.2s

messages/messages.spec.ts took 2.1m

login/login.spec.ts took 59.1s

knock/knock-into-room.spec.ts took 35.4s

integration-manager/read_events.spec.ts took 35.4s

knock/manage-knocks.spec.ts took 27.2s

read-receipts/redactions-in-threads.spec.ts took 2.8m

read-receipts/redactions-main-timeline.spec.ts took 2.2m

read-receipts/new-messages-main-timeline.spec.ts took 1.5m

read-receipts/reactions-in-threads.spec.ts took 1.1m

read-receipts/new-messages-thread-roots.spec.ts took 46.5s

32 skipped 42 passed (9.2m)

2 flaky spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout 3 skipped 66 passed (10.4m)

10 skipped 71 passed (9.1m)

78 passed (11.6m)

3 flaky pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline pinned-messages/pinned-messages.spec.ts:76:9 › Pinned messages › should unpin all messages ───── polls/polls.spec.ts:96:9 › Polls › should be creatable and votable ───────────────────────────── 1 skipped 75 passed (10.6m)