1) invite/invite-dialog.spec.ts:22:9 › Invite dialog › should support inviting a user to a room ── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/invite/invite-dialog.spec.ts/invite-dialog-room-without-user-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-caaac-t-inviting-a-user-to-a-room/invite-dialog-room-without-user-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-caaac-t-inviting-a-user-to-a-room/invite-dialog-room-without-user-diff.png Call log: - expect.toHaveScreenshot(invite-dialog-room-without-user.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 41 | await expect(other.locator(".mx_InviteDialog_addressBar")).toBeVisible(); 42 | > 43 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("invite-dialog-room-without-user.png"); | ^ 44 | 45 | await expect(other.locator(".mx_InviteDialog_identityServer")).not.toBeVisible(); 46 | at /home/runner/work/element-web/element-web/playwright/e2e/invite/invite-dialog.spec.ts:43:50

1) invite/invite-dialog.spec.ts:22:9 › Invite dialog › should support inviting a user to a room ── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/invite/invite-dialog.spec.ts/invite-dialog-room-without-user-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-caaac-t-inviting-a-user-to-a-room-retry1/invite-dialog-room-without-user-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-caaac-t-inviting-a-user-to-a-room-retry1/invite-dialog-room-without-user-diff.png Call log: - expect.toHaveScreenshot(invite-dialog-room-without-user.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 41 | await expect(other.locator(".mx_InviteDialog_addressBar")).toBeVisible(); 42 | > 43 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("invite-dialog-room-without-user.png"); | ^ 44 | 45 | await expect(other.locator(".mx_InviteDialog_identityServer")).not.toBeVisible(); 46 | at /home/runner/work/element-web/element-web/playwright/e2e/invite/invite-dialog.spec.ts:43:50

1) invite/invite-dialog.spec.ts:22:9 › Invite dialog › should support inviting a user to a room ── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/invite/invite-dialog.spec.ts/invite-dialog-room-without-user-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-caaac-t-inviting-a-user-to-a-room-retry2/invite-dialog-room-without-user-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-caaac-t-inviting-a-user-to-a-room-retry2/invite-dialog-room-without-user-diff.png Call log: - expect.toHaveScreenshot(invite-dialog-room-without-user.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 41 | await expect(other.locator(".mx_InviteDialog_addressBar")).toBeVisible(); 42 | > 43 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("invite-dialog-room-without-user.png"); | ^ 44 | 45 | await expect(other.locator(".mx_InviteDialog_identityServer")).not.toBeVisible(); 46 | at /home/runner/work/element-web/element-web/playwright/e2e/invite/invite-dialog.spec.ts:43:50

2) invite/invite-dialog.spec.ts:76:9 › Invite dialog › should support inviting a user to Direct Messages Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/invite/invite-dialog.spec.ts/invite-dialog-dm-without-user-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-5dca7-g-a-user-to-Direct-Messages/invite-dialog-dm-without-user-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-5dca7-g-a-user-to-Direct-Messages/invite-dialog-dm-without-user-diff.png Call log: - expect.toHaveScreenshot(invite-dialog-dm-without-user.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 85 | 86 | // Take a snapshot of the invite dialog > 87 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("invite-dialog-dm-without-user.png"); | ^ 88 | 89 | await other.getByTestId("invite-dialog-input").fill(bot.credentials.userId); 90 | at /home/runner/work/element-web/element-web/playwright/e2e/invite/invite-dialog.spec.ts:87:50

2) invite/invite-dialog.spec.ts:76:9 › Invite dialog › should support inviting a user to Direct Messages Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/invite/invite-dialog.spec.ts/invite-dialog-dm-without-user-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-5dca7-g-a-user-to-Direct-Messages-retry1/invite-dialog-dm-without-user-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-5dca7-g-a-user-to-Direct-Messages-retry1/invite-dialog-dm-without-user-diff.png Call log: - expect.toHaveScreenshot(invite-dialog-dm-without-user.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 85 | 86 | // Take a snapshot of the invite dialog > 87 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("invite-dialog-dm-without-user.png"); | ^ 88 | 89 | await other.getByTestId("invite-dialog-input").fill(bot.credentials.userId); 90 | at /home/runner/work/element-web/element-web/playwright/e2e/invite/invite-dialog.spec.ts:87:50

2) invite/invite-dialog.spec.ts:76:9 › Invite dialog › should support inviting a user to Direct Messages Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/invite/invite-dialog.spec.ts/invite-dialog-dm-without-user-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-5dca7-g-a-user-to-Direct-Messages-retry2/invite-dialog-dm-without-user-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/invite-invite-dialog-Invit-5dca7-g-a-user-to-Direct-Messages-retry2/invite-dialog-dm-without-user-diff.png Call log: - expect.toHaveScreenshot(invite-dialog-dm-without-user.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 85 | 86 | // Take a snapshot of the invite dialog > 87 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("invite-dialog-dm-without-user.png"); | ^ 88 | 89 | await other.getByTestId("invite-dialog-input").fill(bot.credentials.userId); 90 | at /home/runner/work/element-web/element-web/playwright/e2e/invite/invite-dialog.spec.ts:87:50

3) pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline Error: Screenshot comparison failed: 41 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-Msg1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline/pinned-message-Msg1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline/pinned-message-Msg1-diff.png Call log: - expect.toHaveScreenshot(pinned-message-Msg1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$VB81Odjc0FpfSq7DccQXgzepC1cVRyllDWTJGLT13v8" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection" data-scroll-tokens="$VB81Odjc0FpfSq7DccQXgzepC1cVRyllDWTJGLT13v8">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 821px by 107px, received 821px by 72px. 371 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$VB81Odjc0FpfSq7DccQXgzepC1cVRyllDWTJGLT13v8" data-scroll-tokens="$VB81Odjc0FpfSq7DccQXgzepC1cVRyllDWTJGLT13v8">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 821px by 72px, received 821px by 107px. 406 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$VB81Odjc0FpfSq7DccQXgzepC1cVRyllDWTJGLT13v8" data-scroll-tokens="$VB81Odjc0FpfSq7DccQXgzepC1cVRyllDWTJGLT13v8">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 41 pixels (ratio 0.01 of all image pixels) are different. 30 | 31 | const tile = util.getEventTile("Msg1"); > 32 | await expect(tile).toMatchScreenshot("pinned-message-Msg1.png", { | ^ 33 | mask: [tile.locator(".mx_MessageTimestamp")], 34 | css: ` 35 | // Hide the jump to bottom button in the timeline to avoid flakiness at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:32:28

3) pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 41 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-Msg1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline-retry1/pinned-message-Msg1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline-retry1/pinned-message-Msg1-diff.png Call log: - expect.toHaveScreenshot(pinned-message-Msg1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$_KPyW6NMJfngoDT5evnDkvx1Cx4d0Rnjkmuq9C2YDk8" data-scroll-tokens="$_KPyW6NMJfngoDT5evnDkvx1Cx4d0Rnjkmuq9C2YDk8">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 41 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$_KPyW6NMJfngoDT5evnDkvx1Cx4d0Rnjkmuq9C2YDk8" data-scroll-tokens="$_KPyW6NMJfngoDT5evnDkvx1Cx4d0Rnjkmuq9C2YDk8">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 41 pixels (ratio 0.01 of all image pixels) are different. 30 | 31 | const tile = util.getEventTile("Msg1"); > 32 | await expect(tile).toMatchScreenshot("pinned-message-Msg1.png", { | ^ 33 | mask: [tile.locator(".mx_MessageTimestamp")], 34 | css: ` 35 | // Hide the jump to bottom button in the timeline to avoid flakiness at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:32:28

3) pinned-messages/pinned-messages.spec.ts:21:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 41 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-Msg1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline-retry2/pinned-message-Msg1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-131a1-ssage-badge-in-the-timeline-retry2/pinned-message-Msg1-diff.png Call log: - expect.toHaveScreenshot(pinned-message-Msg1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$Sybg3zBuhJ_dmv9ZeyDf3oBRV88erF6cHzJTzSQKlWY" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection" data-scroll-tokens="$Sybg3zBuhJ_dmv9ZeyDf3oBRV88erF6cHzJTzSQKlWY">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 41 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile').filter({ hasText: 'Msg1' }) - locator resolved to <li tabindex="-1" aria-live="off" data-self="false" aria-atomic="true" data-layout="group" data-has-reply="false" class="mx_EventTile mx_EventTile_lastInSection" data-event-id="$Sybg3zBuhJ_dmv9ZeyDf3oBRV88erF6cHzJTzSQKlWY" data-scroll-tokens="$Sybg3zBuhJ_dmv9ZeyDf3oBRV88erF6cHzJTzSQKlWY">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 41 pixels (ratio 0.01 of all image pixels) are different. 30 | 31 | const tile = util.getEventTile("Msg1"); > 32 | await expect(tile).toMatchScreenshot("pinned-message-Msg1.png", { | ^ 33 | mask: [tile.locator(".mx_MessageTimestamp")], 34 | css: ` 35 | // Hide the jump to bottom button in the timeline to avoid flakiness at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:32:28

4) pinned-messages/pinned-messages.spec.ts:76:9 › Pinned messages › should unpin all messages ──── Error: Screenshot comparison failed: 4 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/unpin-all-dialog-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-622a2-s-should-unpin-all-messages/unpin-all-dialog-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-622a2-s-should-unpin-all-messages/unpin-all-dialog-diff.png Call log: - expect.toHaveScreenshot(unpin-all-dialog.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ hasText: 'Unpin all messages?' }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 4 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ hasText: 'Unpin all messages?' }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 4 pixels (ratio 0.01 of all image pixels) are different. 80 | 81 | await util.openUnpinAllDialog(); > 82 | await expect(util.getUnpinAllDialog()).toMatchScreenshot("unpin-all-dialog.png"); | ^ 83 | await util.confirmUnpinAllDialog(); 84 | 85 | await util.assertEmptyPinnedMessagesList(); at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:82:48

messages/messages.spec.ts took 2.3m

login/login.spec.ts took 57.8s

knock/knock-into-room.spec.ts took 39.7s

integration-manager/read_events.spec.ts took 37.8s

polls/polls.spec.ts took 33.2s