1) widgets/stickers.spec.ts:103:9 › Stickers › should send a sticker to multiple rooms ─────────── Error: expect.toHaveAttribute: Error: strict mode violation: locator('.mx_EventTile_sticker > a') resolved to 4 elements: 1) <a aria-label="12:06" href="https://matrix.to/#/!wKbqyDYgJdAYXWKxEe:localhost/~!wKbqyDYgJdAYXWKxEe:localhost:m1729598808297.1?via=localhost"></a> aka locator('li').filter({ hasText: 'SallyS' }).getByLabel(':06') 2) <a aria-label="12:06" href="https://matrix.to/#/!wKbqyDYgJdAYXWKxEe:localhost/~!wKbqyDYgJdAYXWKxEe:localhost:m1729598808298.2?via=localhost"></a> aka getByLabel(':06').nth(1) 3) <a aria-label="12:06" href="https://matrix.to/#/!wKbqyDYgJdAYXWKxEe:localhost/~!wKbqyDYgJdAYXWKxEe:localhost:m1729598808299.3?via=localhost"></a> aka getByLabel(':06').nth(2) 4) <a aria-label="12:06" href="https://matrix.to/#/!wKbqyDYgJdAYXWKxEe:localhost/~!wKbqyDYgJdAYXWKxEe:localhost:m1729598808300.4?via=localhost">…</a> aka locator('a').filter({ hasText: ':06' }) Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('.mx_EventTile_sticker > a') 74 | async function expectTimelineSticker(page: Page, roomId: string) { 75 | // Make sure it's in the right room > 76 | await expect(page.locator(".mx_EventTile_sticker > a")).toHaveAttribute("href", new RegExp(`/${roomId}/`)); | ^ 77 | 78 | // Make sure the image points at the sticker image. We will briefly show it 79 | // using the thumbnail URL, but as soon as that fails, we will switch to the at expectTimelineSticker (/home/runner/work/element-web/element-web/playwright/e2e/widgets/stickers.spec.ts:76:61) at /home/runner/work/element-web/element-web/playwright/e2e/widgets/stickers.spec.ts:134:15

1) widgets/stickers.spec.ts:103:9 › Stickers › should send a sticker to multiple rooms ─────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect.toHaveAttribute: Error: strict mode violation: locator('.mx_EventTile_sticker > a') resolved to 4 elements: 1) <a aria-label="12:06" href="https://matrix.to/#/!oxdrOhMQPeoXtflsRg:localhost/~!oxdrOhMQPeoXtflsRg:localhost:m1729598817100.1?via=localhost"></a> aka locator('li').filter({ hasText: 'SallyS' }).getByLabel(':06') 2) <a aria-label="12:06" href="https://matrix.to/#/!oxdrOhMQPeoXtflsRg:localhost/~!oxdrOhMQPeoXtflsRg:localhost:m1729598817101.2?via=localhost"></a> aka getByLabel(':06').nth(1) 3) <a aria-label="12:06" href="https://matrix.to/#/!oxdrOhMQPeoXtflsRg:localhost/~!oxdrOhMQPeoXtflsRg:localhost:m1729598817102.3?via=localhost"></a> aka getByLabel(':06').nth(2) 4) <a aria-label="12:06" href="https://matrix.to/#/!oxdrOhMQPeoXtflsRg:localhost/~!oxdrOhMQPeoXtflsRg:localhost:m1729598817103.4?via=localhost">…</a> aka locator('a').filter({ hasText: ':06' }) Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('.mx_EventTile_sticker > a') 74 | async function expectTimelineSticker(page: Page, roomId: string) { 75 | // Make sure it's in the right room > 76 | await expect(page.locator(".mx_EventTile_sticker > a")).toHaveAttribute("href", new RegExp(`/${roomId}/`)); | ^ 77 | 78 | // Make sure the image points at the sticker image. We will briefly show it 79 | // using the thumbnail URL, but as soon as that fails, we will switch to the at expectTimelineSticker (/home/runner/work/element-web/element-web/playwright/e2e/widgets/stickers.spec.ts:76:61) at /home/runner/work/element-web/element-web/playwright/e2e/widgets/stickers.spec.ts:134:15

1) widgets/stickers.spec.ts:103:9 › Stickers › should send a sticker to multiple rooms ─────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect.toHaveAttribute: Error: strict mode violation: locator('.mx_EventTile_sticker > a') resolved to 4 elements: 1) <a aria-label="12:07" href="https://matrix.to/#/!fddQrsoxSphXiKboAY:localhost/~!fddQrsoxSphXiKboAY:localhost:m1729598825813.1?via=localhost"></a> aka locator('li').filter({ hasText: 'SallyS' }).getByLabel(':07') 2) <a aria-label="12:07" href="https://matrix.to/#/!fddQrsoxSphXiKboAY:localhost/~!fddQrsoxSphXiKboAY:localhost:m1729598825814.2?via=localhost"></a> aka getByLabel(':07').nth(1) 3) <a aria-label="12:07" href="https://matrix.to/#/!fddQrsoxSphXiKboAY:localhost/~!fddQrsoxSphXiKboAY:localhost:m1729598825815.3?via=localhost"></a> aka getByLabel(':07').nth(2) 4) <a aria-label="12:07" href="https://matrix.to/#/!fddQrsoxSphXiKboAY:localhost/~!fddQrsoxSphXiKboAY:localhost:m1729598825816.4?via=localhost">…</a> aka locator('a').filter({ hasText: ':07' }) Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('.mx_EventTile_sticker > a') 74 | async function expectTimelineSticker(page: Page, roomId: string) { 75 | // Make sure it's in the right room > 76 | await expect(page.locator(".mx_EventTile_sticker > a")).toHaveAttribute("href", new RegExp(`/${roomId}/`)); | ^ 77 | 78 | // Make sure the image points at the sticker image. We will briefly show it 79 | // using the thumbnail URL, but as soon as that fails, we will switch to the at expectTimelineSticker (/home/runner/work/element-web/element-web/playwright/e2e/widgets/stickers.spec.ts:76:61) at /home/runner/work/element-web/element-web/playwright/e2e/widgets/stickers.spec.ts:134:15

Process completed with exit code 1.

1) sliding-sync/sliding-sync.spec.ts:178:9 › Sliding Sync › should update user settings promptly ─ Test timeout of 30000ms exceeded while running "beforeEach" hook. 16 | let roomId: string; 17 | > 18 | test.beforeEach(async ({ slidingSyncProxy, page, user, app }) => { | ^ 19 | roomId = await app.client.createRoom({ name: "Test Room" }); 20 | }); 21 | at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:18:10

1) sliding-sync/sliding-sync.spec.ts:178:9 › Sliding Sync › should update user settings promptly ─ Error: page.waitForSelector: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_MatrixChat') to be visible at ../element-web-test.ts:281 279 | }, proxyAddress); 280 | await page.goto("/"); > 281 | await page.waitForSelector(".mx_MatrixChat", { timeout: 30000 }); | ^ 282 | await use(proxyInstance); 283 | await proxy.stop(); 284 | }, at Object.slidingSyncProxy (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:281:20)

1) read-receipts/read-receipts.spec.ts:279:9 › Read receipts › Should send the correct receipts ── Test timeout of 30000ms exceeded.

1) read-receipts/read-receipts.spec.ts:279:9 › Read receipts › Should send the correct receipts ── Error: page.waitForRequest: Test timeout of 30000ms exceeded. =========================== logs =========================== waiting for request /http:\/\/localhost:\d+\/_matrix\/client\/v3\/room…/ ============================================================ 308 | 309 | // the following code tests the fully read marker somewhere in the middle of the room > 310 | const readMarkersRequestPromise = page.waitForRequest( | ^ 311 | new RegExp(`http://localhost:\\d+/_matrix/client/v3/rooms/${uriEncodedOtherRoomId}/read_markers`), 312 | ); 313 | at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/read-receipts.spec.ts:310:48

1) read-receipts/read-receipts.spec.ts:279:9 › Read receipts › Should send the correct receipts ── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.

1) read-receipts/read-receipts.spec.ts:279:9 › Read receipts › Should send the correct receipts ── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.waitForRequest: Test timeout of 30000ms exceeded. =========================== logs =========================== waiting for request /http:\/\/localhost:\d+\/_matrix\/client\/v3\/room…/ ============================================================ 308 | 309 | // the following code tests the fully read marker somewhere in the middle of the room > 310 | const readMarkersRequestPromise = page.waitForRequest( | ^ 311 | new RegExp(`http://localhost:\\d+/_matrix/client/v3/rooms/${uriEncodedOtherRoomId}/read_markers`), 312 | ); 313 | at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/read-receipts.spec.ts:310:48

1) read-receipts/read-receipts.spec.ts:279:9 › Read receipts › Should send the correct receipts ── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.

1) read-receipts/read-receipts.spec.ts:279:9 › Read receipts › Should send the correct receipts ── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.waitForRequest: Test timeout of 30000ms exceeded. =========================== logs =========================== waiting for request /http:\/\/localhost:\d+\/_matrix\/client\/v3\/room…/ ============================================================ 308 | 309 | // the following code tests the fully read marker somewhere in the middle of the room > 310 | const readMarkersRequestPromise = page.waitForRequest( | ^ 311 | new RegExp(`http://localhost:\\d+/_matrix/client/v3/rooms/${uriEncodedOtherRoomId}/read_markers`), 312 | ); 313 | at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/read-receipts.spec.ts:310:48

Process completed with exit code 1.

1) oidc/oidc-aware.spec.ts:16:9 › OIDC Aware › can register an account and manage it ───────────── Error: Timed out 10000ms waiting for expect(locator).toHaveURL(expected) Locator: locator(':root') Expected pattern: /\/#\/home$/ Received string: "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" Call log: - expect.toHaveURL with timeout 10000ms - waiting for locator(':root') - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/?loginToken=TDXayMTev8zsVSNpHl1ozhHEfhaxlNpA" 20 | 21 | // Eventually, we should end up at the home screen. > 22 | await expect(page).toHaveURL(/\/#\/home$/, { timeout: 10000 }); | ^ 23 | await expect(page.getByRole("heading", { name: "Welcome alice", exact: true })).toBeVisible(); 24 | 25 | // Open settings and navigate to account management at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-aware.spec.ts:22:28

2) polls/polls.spec.ts:96:9 › Polls › should be creatable and votable ──────────────────────────── Error: Screenshot comparison failed: 121 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/polls/polls.spec.ts/Polls-Timeline-tile-no-votes-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/polls-polls-Polls-should-be-creatable-and-votable/Polls-Timeline-tile-no-votes-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/polls-polls-Polls-should-be-creatable-and-votable/Polls-Timeline-tile-no-votes-diff.png Call log: - expect.toHaveScreenshot(Polls-Timeline-tile-no-votes.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile[data-scroll-tokens="$95_IdXeGMLULD4yq0o3DExQs3peFIaUOrJEFltmH_N0"]') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$95_IdXeGMLULD4yq0o3DExQs3peFIaUOrJEFltmH_N0" data-scroll-tokens="$95_IdXeGMLULD4yq0o3DExQs3peFIaUOrJEFltmH_N0" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection mx_EventTile_noBubble">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 121 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile[data-scroll-tokens="$95_IdXeGMLULD4yq0o3DExQs3peFIaUOrJEFltmH_N0"]') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$95_IdXeGMLULD4yq0o3DExQs3peFIaUOrJEFltmH_N0" data-scroll-tokens="$95_IdXeGMLULD4yq0o3DExQs3peFIaUOrJEFltmH_N0" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection mx_EventTile_noBubble">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 121 pixels (ratio 0.01 of all image pixels) are different. 118 | .filter({ hasText: pollParams.title }) 119 | .getAttribute("data-scroll-tokens"); > 120 | await expect(getPollTile(page, pollId)).toMatchScreenshot("Polls_Timeline_tile_no_votes.png", { | ^ 121 | mask: [page.locator(".mx_MessageTimestamp")], 122 | }); 123 | at /home/runner/work/element-web/element-web/playwright/e2e/polls/polls.spec.ts:120:49

1) chat-export/html-export.spec.ts:92:9 › HTML Export › should export html successfully and match screenshot Error: Screenshot comparison failed: 7413 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/chat-export/html-export.spec.ts/html-export-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/chat-export-html-export-HT-b262f-sfully-and-match-screenshot/html-export-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/chat-export-html-export-HT-b262f-sfully-and-match-screenshot/html-export-diff.png Call log: - expect.toHaveScreenshot(html-export.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 7413 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 7413 pixels (ratio 0.01 of all image pixels) are different. 121 | const zip = await extractZipFileToPath(zipPath, dirPath); 122 | await page.goto(`file://${dirPath}/${Object.keys(zip.files)[0]}/messages.html`); > 123 | await expect(page).toMatchScreenshot("html-export.png", { | ^ 124 | mask: [ 125 | // We need to mask the whole thing because the width of the time part changes 126 | page.locator(".mx_TimelineSeparator"), at /home/runner/work/element-web/element-web/playwright/e2e/chat-export/html-export.spec.ts:123:28

1) chat-export/html-export.spec.ts:92:9 › HTML Export › should export html successfully and match screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 7413 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/chat-export/html-export.spec.ts/html-export-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/chat-export-html-export-HT-b262f-sfully-and-match-screenshot-retry1/html-export-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/chat-export-html-export-HT-b262f-sfully-and-match-screenshot-retry1/html-export-diff.png Call log: - expect.toHaveScreenshot(html-export.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 7413 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 7413 pixels (ratio 0.01 of all image pixels) are different. 121 | const zip = await extractZipFileToPath(zipPath, dirPath); 122 | await page.goto(`file://${dirPath}/${Object.keys(zip.files)[0]}/messages.html`); > 123 | await expect(page).toMatchScreenshot("html-export.png", { | ^ 124 | mask: [ 125 | // We need to mask the whole thing because the width of the time part changes 126 | page.locator(".mx_TimelineSeparator"), at /home/runner/work/element-web/element-web/playwright/e2e/chat-export/html-export.spec.ts:123:28

1) chat-export/html-export.spec.ts:92:9 › HTML Export › should export html successfully and match screenshot Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 7413 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/chat-export/html-export.spec.ts/html-export-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/chat-export-html-export-HT-b262f-sfully-and-match-screenshot-retry2/html-export-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/chat-export-html-export-HT-b262f-sfully-and-match-screenshot-retry2/html-export-diff.png Call log: - expect.toHaveScreenshot(html-export.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 7413 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 7413 pixels (ratio 0.01 of all image pixels) are different. 121 | const zip = await extractZipFileToPath(zipPath, dirPath); 122 | await page.goto(`file://${dirPath}/${Object.keys(zip.files)[0]}/messages.html`); > 123 | await expect(page).toMatchScreenshot("html-export.png", { | ^ 124 | mask: [ 125 | // We need to mask the whole thing because the width of the time part changes 126 | page.locator(".mx_TimelineSeparator"), at /home/runner/work/element-web/element-web/playwright/e2e/chat-export/html-export.spec.ts:123:28

Process completed with exit code 1.

Stale screenshot file

Process completed with exit code 1.

read-receipts/high-level.spec.ts took 3.3m

read-receipts/new-messages-in-threads.spec.ts took 1.6m

read-receipts/editing-messages-in-threads.spec.ts took 1.2m

read-receipts/editing-messages-main-timeline.spec.ts took 1.2m

read-receipts/editing-messages-thread-roots.spec.ts took 52.0s

timeline/timeline.spec.ts took 2.6m

spotlight/spotlight.spec.ts took 2.1m

spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m

threads/threads.spec.ts took 34.3s

user-onboarding/user-onboarding-new.spec.ts took 31.2s

read-receipts/redactions-thread-roots.spec.ts took 59.3s

spaces/spaces.spec.ts took 59.1s

right-panel/right-panel.spec.ts took 52.9s

settings/account-user-settings-tab.spec.ts took 40.9s

right-panel/file-panel.spec.ts took 36.8s

read-receipts/redactions-in-threads.spec.ts took 2.6m

read-receipts/redactions-main-timeline.spec.ts took 1.9m

read-receipts/new-messages-main-timeline.spec.ts took 1.4m

read-receipts/reactions-in-threads.spec.ts took 56.6s

read-receipts/new-messages-thread-roots.spec.ts took 42.4s

messages/messages.spec.ts took 2.2m

pinned-messages/pinned-messages.spec.ts took 1.6m

login/login.spec.ts took 1.0m

integration-manager/read_events.spec.ts took 35.4s

knock/knock-into-room.spec.ts took 35.4s

composer/RTE.spec.ts took 1.2m

audio-player/audio-player.spec.ts took 1.2m

crypto/crypto.spec.ts took 1.0m

crypto/event-shields.spec.ts took 54.5s

crypto/decryption-failure-messages.spec.ts took 50.6s

32 skipped 42 passed (8.3m)

1 failed widgets/stickers.spec.ts:103:9 › Stickers › should send a sticker to multiple rooms ──────────── 3 skipped 67 passed (9.4m)

1 flaky sliding-sync/sliding-sync.spec.ts:178:9 › Sliding Sync › should update user settings promptly ── 10 skipped 70 passed (9.7m)

1 failed read-receipts/read-receipts.spec.ts:279:9 › Read receipts › Should send the correct receipts ─── 14 skipped 61 passed (11.0m)

2 flaky oidc/oidc-aware.spec.ts:16:9 › OIDC Aware › can register an account and manage it ────────────── polls/polls.spec.ts:96:9 › Polls › should be creatable and votable ───────────────────────────── 1 skipped 76 passed (10.9m)