Skip to content

End to End Tests

End to End Tests #1765

Triggered via merge group October 21, 2024 17:45
Status Success
Total duration 14m 41s
Artifacts 8

end-to-end-tests.yaml

on: merge_group
Build Element-Web
1m 51s
Build Element-Web
Matrix: playwright
end-to-end-tests
29s
end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

2 errors, 30 warnings, and 6 notices
timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC: playwright/e2e/timeline/timeline.spec.ts#L557
1) timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout Error: Screenshot comparison failed: 6560 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/event-tiles-bubble-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout/event-tiles-bubble-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout/event-tiles-bubble-layout-diff.png Call log: - expect.toHaveScreenshot(event-tiles-bubble-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 26765 pixels (ratio 0.05 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 26765 pixels (ratio 0.05 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 6560 pixels (ratio 0.02 of all image pixels) are different. - waiting 500ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 6560 pixels (ratio 0.02 of all image pixels) are different. 555 | page.locator(".mx_RoomView").getByText("This message has an inline emoji 👒"), 556 | ).toBeInViewport(); > 557 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot( | ^ 558 | "event-tiles-bubble-layout.png", 559 | screenshotOptions, 560 | ); at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:557:57
timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC: playwright/e2e/timeline/timeline.spec.ts#L557
1) timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 6560 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/event-tiles-bubble-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout-retry1/event-tiles-bubble-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout-retry1/event-tiles-bubble-layout-diff.png Call log: - expect.toHaveScreenshot(event-tiles-bubble-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 377 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 6937 pixels (ratio 0.02 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 6560 pixels (ratio 0.02 of all image pixels) are different. 555 | page.locator(".mx_RoomView").getByText("This message has an inline emoji 👒"), 556 | ).toBeInViewport(); > 557 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot( | ^ 558 | "event-tiles-bubble-layout.png", 559 | screenshotOptions, 560 | ); at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:557:57
Slow Test: read-receipts/high-level.spec.ts#L1
read-receipts/high-level.spec.ts took 3.5m
Slow Test: read-receipts/new-messages-in-threads.spec.ts#L1
read-receipts/new-messages-in-threads.spec.ts took 1.9m
Slow Test: read-receipts/editing-messages-in-threads.spec.ts#L1
read-receipts/editing-messages-in-threads.spec.ts took 1.3m
Slow Test: read-receipts/editing-messages-main-timeline.spec.ts#L1
read-receipts/editing-messages-main-timeline.spec.ts took 1.2m
Slow Test: read-receipts/editing-messages-thread-roots.spec.ts#L1
read-receipts/editing-messages-thread-roots.spec.ts took 58.7s
Slow Test: read-receipts/redactions-thread-roots.spec.ts#L1
read-receipts/redactions-thread-roots.spec.ts took 1.2m
Slow Test: spaces/spaces.spec.ts#L1
spaces/spaces.spec.ts took 57.0s
Slow Test: right-panel/right-panel.spec.ts#L1
right-panel/right-panel.spec.ts took 51.2s
Slow Test: settings/account-user-settings-tab.spec.ts#L1
settings/account-user-settings-tab.spec.ts took 42.2s
Slow Test: right-panel/file-panel.spec.ts#L1
right-panel/file-panel.spec.ts took 36.7s
Slow Test: read-receipts/redactions-in-threads.spec.ts#L1
read-receipts/redactions-in-threads.spec.ts took 2.6m
Slow Test: read-receipts/redactions-main-timeline.spec.ts#L1
read-receipts/redactions-main-timeline.spec.ts took 2.0m
Slow Test: read-receipts/new-messages-main-timeline.spec.ts#L1
read-receipts/new-messages-main-timeline.spec.ts took 1.4m
Slow Test: read-receipts/read-receipts.spec.ts#L1
read-receipts/read-receipts.spec.ts took 1.1m
Slow Test: read-receipts/reactions-in-threads.spec.ts#L1
read-receipts/reactions-in-threads.spec.ts took 1.0m
Slow Test: spotlight/spotlight.spec.ts#L1
spotlight/spotlight.spec.ts took 2.3m
Slow Test: spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.8m
Slow Test: threads/threads.spec.ts#L1
threads/threads.spec.ts took 39.5s
Slow Test: user-onboarding/user-onboarding-new.spec.ts#L1
user-onboarding/user-onboarding-new.spec.ts took 30.4s
Slow Test: widgets/widget-pip-close.spec.ts#L1
widgets/widget-pip-close.spec.ts took 20.9s
Slow Test: composer/RTE.spec.ts#L1
composer/RTE.spec.ts took 1.2m
Slow Test: audio-player/audio-player.spec.ts#L1
audio-player/audio-player.spec.ts took 1.2m
Slow Test: crypto/event-shields.spec.ts#L1
crypto/event-shields.spec.ts took 1.0m
Slow Test: crypto/crypto.spec.ts#L1
crypto/crypto.spec.ts took 59.0s
Slow Test: crypto/device-verification.spec.ts#L1
crypto/device-verification.spec.ts took 43.8s
Slow Test: messages/messages.spec.ts#L1
messages/messages.spec.ts took 2.3m
Slow Test: pinned-messages/pinned-messages.spec.ts#L1
pinned-messages/pinned-messages.spec.ts took 1.8m
Slow Test: login/login.spec.ts#L1
login/login.spec.ts took 1.1m
Slow Test: knock/knock-into-room.spec.ts#L1
knock/knock-into-room.spec.ts took 39.6s
Slow Test: integration-manager/read_events.spec.ts#L1
integration-manager/read_events.spec.ts took 37.8s
🎭 Playwright Run Summary
32 skipped 42 passed (9.1m)
🎭 Playwright Run Summary
10 skipped 71 passed (9.4m)
🎭 Playwright Run Summary
14 skipped 62 passed (10.2m)
🎭 Playwright Run Summary
1 flaky timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout 3 skipped 67 passed (10.4m)
🎭 Playwright Run Summary
78 passed (10.8m)
🎭 Playwright Run Summary
1 skipped 78 passed (11.4m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-1 Expired
669 KB
all-blob-reports-2 Expired
348 KB
all-blob-reports-3 Expired
271 KB
all-blob-reports-4 Expired
331 KB
all-blob-reports-5 Expired
755 KB
all-blob-reports-6 Expired
5.38 MB
html-report Expired
6.04 MB
webapp Expired
36.9 MB