Go back to Ubuntu latest for GHA #1557
Annotations
10 errors, 5 warnings, and 1 notice
Run Playwright tests:
playwright/e2e/register/email.spec.ts#L58
1) register/email.spec.ts:41:9 › Email Registration › registers an account and lands on the use case selection screen
Error: Screenshot comparison failed:
990 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/register/email.spec.ts/registration-check-your-email-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/register-email-Email-Regis-9a494-e-use-case-selection-screen/registration-check-your-email-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/register-email-Email-Regis-9a494-e-use-case-selection-screen/registration-check-your-email-diff.png
Call log:
- expect.toHaveScreenshot(registration-check-your-email.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 990 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 990 pixels (ratio 0.01 of all image pixels) are different.
56 |
57 | await expect(page.getByText("Check your email to continue")).toBeVisible();
> 58 | await expect(page).toMatchScreenshot("registration_check_your_email.png", screenshotOptions);
| ^
59 | await checkA11y();
60 |
61 | await expect(page.getByText("An error was encountered when sending the email")).not.toBeVisible();
at /home/runner/work/element-web/element-web/playwright/e2e/register/email.spec.ts:58:28
|
Run Playwright tests:
playwright/e2e/register/email.spec.ts#L58
1) register/email.spec.ts:41:9 › Email Registration › registers an account and lands on the use case selection screen
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
990 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/register/email.spec.ts/registration-check-your-email-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/register-email-Email-Regis-9a494-e-use-case-selection-screen-retry1/registration-check-your-email-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/register-email-Email-Regis-9a494-e-use-case-selection-screen-retry1/registration-check-your-email-diff.png
Call log:
- expect.toHaveScreenshot(registration-check-your-email.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 990 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 990 pixels (ratio 0.01 of all image pixels) are different.
56 |
57 | await expect(page.getByText("Check your email to continue")).toBeVisible();
> 58 | await expect(page).toMatchScreenshot("registration_check_your_email.png", screenshotOptions);
| ^
59 | await checkA11y();
60 |
61 | await expect(page.getByText("An error was encountered when sending the email")).not.toBeVisible();
at /home/runner/work/element-web/element-web/playwright/e2e/register/email.spec.ts:58:28
|
Run Playwright tests:
playwright/e2e/register/email.spec.ts#L58
1) register/email.spec.ts:41:9 › Email Registration › registers an account and lands on the use case selection screen
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
990 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/register/email.spec.ts/registration-check-your-email-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/register-email-Email-Regis-9a494-e-use-case-selection-screen-retry2/registration-check-your-email-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/register-email-Email-Regis-9a494-e-use-case-selection-screen-retry2/registration-check-your-email-diff.png
Call log:
- expect.toHaveScreenshot(registration-check-your-email.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 990 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 990 pixels (ratio 0.01 of all image pixels) are different.
56 |
57 | await expect(page.getByText("Check your email to continue")).toBeVisible();
> 58 | await expect(page).toMatchScreenshot("registration_check_your_email.png", screenshotOptions);
| ^
59 | await checkA11y();
60 |
61 | await expect(page.getByText("An error was encountered when sending the email")).not.toBeVisible();
at /home/runner/work/element-web/element-web/playwright/e2e/register/email.spec.ts:58:28
|
Run Playwright tests:
playwright/e2e/register/register.spec.ts#L33
2) register/register.spec.ts:18:9 › Registration › registers an account and lands on the home screen
Error: Screenshot comparison failed:
591 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/register/register.spec.ts/registration-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen/registration-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen/registration-diff.png
Call log:
- expect.toHaveScreenshot(registration.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 735 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 126 pixels (ratio 0.01 of all image pixels) are different.
- waiting 250ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 591 pixels (ratio 0.01 of all image pixels) are different.
31 | // Hide the server text as it contains the randomly allocated Homeserver port
32 | const screenshotOptions = { mask: [page.locator(".mx_ServerPicker_server")], includeDialogBackground: true };
> 33 | await expect(page).toMatchScreenshot("registration.png", screenshotOptions);
| ^
34 | await checkA11y();
35 |
36 | await page.getByRole("textbox", { name: "Username", exact: true }).fill("alice");
at /home/runner/work/element-web/element-web/playwright/e2e/register/register.spec.ts:33:28
|
Run Playwright tests:
playwright/e2e/register/register.spec.ts#L33
2) register/register.spec.ts:18:9 › Registration › registers an account and lands on the home screen
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
591 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/register/register.spec.ts/registration-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-retry1/registration-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-retry1/registration-diff.png
Call log:
- expect.toHaveScreenshot(registration.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 730 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 123 pixels (ratio 0.01 of all image pixels) are different.
- waiting 250ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 591 pixels (ratio 0.01 of all image pixels) are different.
31 | // Hide the server text as it contains the randomly allocated Homeserver port
32 | const screenshotOptions = { mask: [page.locator(".mx_ServerPicker_server")], includeDialogBackground: true };
> 33 | await expect(page).toMatchScreenshot("registration.png", screenshotOptions);
| ^
34 | await checkA11y();
35 |
36 | await page.getByRole("textbox", { name: "Username", exact: true }).fill("alice");
at /home/runner/work/element-web/element-web/playwright/e2e/register/register.spec.ts:33:28
|
Run Playwright tests:
playwright/e2e/register/register.spec.ts#L33
2) register/register.spec.ts:18:9 › Registration › registers an account and lands on the home screen
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
591 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/register/register.spec.ts/registration-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-retry2/registration-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-retry2/registration-diff.png
Call log:
- expect.toHaveScreenshot(registration.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 735 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 126 pixels (ratio 0.01 of all image pixels) are different.
- waiting 250ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 591 pixels (ratio 0.01 of all image pixels) are different.
31 | // Hide the server text as it contains the randomly allocated Homeserver port
32 | const screenshotOptions = { mask: [page.locator(".mx_ServerPicker_server")], includeDialogBackground: true };
> 33 | await expect(page).toMatchScreenshot("registration.png", screenshotOptions);
| ^
34 | await checkA11y();
35 |
36 | await page.getByRole("textbox", { name: "Username", exact: true }).fill("alice");
at /home/runner/work/element-web/element-web/playwright/e2e/register/register.spec.ts:33:28
|
Run Playwright tests:
playwright/e2e/release-announcement/index.ts#L45
3) release-announcement/releaseAnnouncement.spec.ts:21:9 › Release announcement › should display the release announcement process
Error: Screenshot comparison failed:
875 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/release-announcement/releaseAnnouncement.spec.ts/release-announcement-Threads-Activity-Centre-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process/release-announcement-Threads-Activity-Centre-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process/release-announcement-Threads-Activity-Centre-diff.png
Call log:
- expect.toHaveScreenshot(release-announcement-Threads-Activity-Centre.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 875 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 875 pixels (ratio 0.01 of all image pixels) are different.
at release-announcement/index.ts:45
43 | async assertReleaseAnnouncementIsVisible(name: string) {
44 | await expect(this.getReleaseAnnouncement(name)).toBeVisible();
> 45 | await expect(this.page).toMatchScreenshot(`release-announcement-${name}.png`);
| ^
46 | }
47 |
48 | /**
at Helpers.assertReleaseAnnouncementIsVisible (/home/runner/work/element-web/element-web/playwright/e2e/release-announcement/index.ts:45:33)
at /home/runner/work/element-web/element-web/playwright/e2e/release-announcement/releaseAnnouncement.spec.ts:23:9
|
Run Playwright tests:
playwright/e2e/release-announcement/index.ts#L45
3) release-announcement/releaseAnnouncement.spec.ts:21:9 › Release announcement › should display the release announcement process
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
875 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/release-announcement/releaseAnnouncement.spec.ts/release-announcement-Threads-Activity-Centre-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process-retry1/release-announcement-Threads-Activity-Centre-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process-retry1/release-announcement-Threads-Activity-Centre-diff.png
Call log:
- expect.toHaveScreenshot(release-announcement-Threads-Activity-Centre.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 875 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 875 pixels (ratio 0.01 of all image pixels) are different.
at release-announcement/index.ts:45
43 | async assertReleaseAnnouncementIsVisible(name: string) {
44 | await expect(this.getReleaseAnnouncement(name)).toBeVisible();
> 45 | await expect(this.page).toMatchScreenshot(`release-announcement-${name}.png`);
| ^
46 | }
47 |
48 | /**
at Helpers.assertReleaseAnnouncementIsVisible (/home/runner/work/element-web/element-web/playwright/e2e/release-announcement/index.ts:45:33)
at /home/runner/work/element-web/element-web/playwright/e2e/release-announcement/releaseAnnouncement.spec.ts:23:9
|
Run Playwright tests:
playwright/e2e/release-announcement/index.ts#L45
3) release-announcement/releaseAnnouncement.spec.ts:21:9 › Release announcement › should display the release announcement process
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
875 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/release-announcement/releaseAnnouncement.spec.ts/release-announcement-Threads-Activity-Centre-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process-retry2/release-announcement-Threads-Activity-Centre-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process-retry2/release-announcement-Threads-Activity-Centre-diff.png
Call log:
- expect.toHaveScreenshot(release-announcement-Threads-Activity-Centre.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 875 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 875 pixels (ratio 0.01 of all image pixels) are different.
at release-announcement/index.ts:45
43 | async assertReleaseAnnouncementIsVisible(name: string) {
44 | await expect(this.getReleaseAnnouncement(name)).toBeVisible();
> 45 | await expect(this.page).toMatchScreenshot(`release-announcement-${name}.png`);
| ^
46 | }
47 |
48 | /**
at Helpers.assertReleaseAnnouncementIsVisible (/home/runner/work/element-web/element-web/playwright/e2e/release-announcement/index.ts:45:33)
at /home/runner/work/element-web/element-web/playwright/e2e/release-announcement/releaseAnnouncement.spec.ts:23:9
|
Run Playwright tests:
playwright/e2e/right-panel/file-panel.spec.ts#L130
4) right-panel/file-panel.spec.ts:51:13 › FilePanel › render › should list tiles on the panel ────
Error: Screenshot comparison failed:
415 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/right-panel/file-panel.spec.ts/file-tiles-list-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/right-panel-file-panel-Fil-1729c-uld-list-tiles-on-the-panel/file-tiles-list-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/right-panel-file-panel-Fil-1729c-uld-list-tiles-on-the-panel/file-tiles-list-diff.png
Call log:
- expect.toHaveScreenshot(file-tiles-list.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_FilePanel').locator('.mx_RoomView_MessageList')
- locator resolved to <ol aria-live="polite" class="mx_RoomView_MessageList">…</ol>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 415 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_FilePanel').locator('.mx_RoomView_MessageList')
- locator resolved to <ol aria-live="polite" class="mx_RoomView_MessageList">…</ol>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 415 pixels (ratio 0.01 of all image pixels) are different.
128 |
129 | // Take a snapshot of file tiles list on FilePanel
> 130 | await expect(filePanelMessageList).toMatchScreenshot("file-tiles-list.png", {
| ^
131 | // Exclude timestamps & flaky seek bar from snapshot
132 | mask: [page.locator(".mx_MessageTimestamp, .mx_AudioPlayer_seek")],
133 | });
at /home/runner/work/element-web/element-web/playwright/e2e/right-panel/file-panel.spec.ts:130:48
|
Run Playwright tests:
read-receipts/redactions-thread-roots.spec.ts#L1
read-receipts/redactions-thread-roots.spec.ts took 1.0m
|
Run Playwright tests:
settings/appearance-user-settings-tab/theme-choice-panel.spec.ts#L1
settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 29.5s
|
Run Playwright tests:
sliding-sync/sliding-sync.spec.ts#L1
sliding-sync/sliding-sync.spec.ts took 24.7s
|
Run Playwright tests:
room/room.spec.ts#L1
room/room.spec.ts took 19.9s
|
Run Playwright tests:
read-receipts/room-list-order.spec.ts#L1
read-receipts/room-list-order.spec.ts took 19.2s
|
Run Playwright tests
16 failed
register/email.spec.ts:41:9 › Email Registration › registers an account and lands on the use case selection screen
register/register.spec.ts:18:9 › Registration › registers an account and lands on the home screen
release-announcement/releaseAnnouncement.spec.ts:21:9 › Release announcement › should display the release announcement process
right-panel/file-panel.spec.ts:51:13 › FilePanel › render › should list tiles on the panel ─────
right-panel/notification-panel.spec.ts:24:9 › NotificationPanel › should render empty state ────
right-panel/right-panel.spec.ts:41:13 › RightPanel › in rooms › should handle long room address and long room name
room/room-header.spec.ts:23:13 › Room Header › with feature_notifications enabled › should render default buttons properly
room/room-header.spec.ts:54:13 › Room Header › with feature_notifications enabled › should render a very long room name without collapsing the buttons
room/room-header.spec.ts:102:17 › Room Header › with a video room › and with feature_notifications enabled › should render buttons for chat, room info, threads and facepile
room-directory/room-directory.spec.ts:50:9 › Room Directory › should allow finding published rooms in directory
settings/account-user-settings-tab.spec.ts:26:9 › Account user settings tab › should be rendered properly
settings/account-user-settings-tab.spec.ts:74:9 › Account user settings tab › should respond to small screen sizes
settings/general-room-settings-tab.spec.ts:23:9 › General room settings tab › should be rendered properly
settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly
spaces/spaces.spec.ts:91:9 › Spaces › should allow user to create private space ────────────────
spaces/spaces.spec.ts:219:9 › Spaces › should render subspaces in the space panel only when expanded
10 skipped
54 passed (13.8m)
|
Loading