test: add a11y tests to showcases #11412
Annotations
5 errors and 1 notice
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
1) [webkit] › default.ts:52:2 › DBCheckbox › should match screenshot ─────────────────────────────
Error: Screenshot comparison failed:
3837 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/checkbox/showcase/webkit/regular/neutral-bg-lvl-1/DBCheckbox-should-match-screenshot.png
Received: /__w/mono/mono/showcases/vue-showcase/test-results/checkbox-showcase-checkbox-b4ab0-box-should-match-screenshot-webkit/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/vue-showcase/test-results/checkbox-showcase-checkbox-b4ab0-box-should-match-screenshot-webkit/regular-neutral-bg-lvl-1-diff.png
Call log:
- page._expectScreenshot with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 3837 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 3837 pixels (ratio 0.01 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
1) [webkit] › default.ts:52:2 › DBCheckbox › should match screenshot ─────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
3837 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/checkbox/showcase/webkit/regular/neutral-bg-lvl-1/DBCheckbox-should-match-screenshot.png
Received: /__w/mono/mono/showcases/vue-showcase/test-results/checkbox-showcase-checkbox-b4ab0-box-should-match-screenshot-webkit-retry1/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/vue-showcase/test-results/checkbox-showcase-checkbox-b4ab0-box-should-match-screenshot-webkit-retry1/regular-neutral-bg-lvl-1-diff.png
Call log:
- page._expectScreenshot with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 3837 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 3837 pixels (ratio 0.01 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
2) [webkit] › default.ts:52:2 › DBSelect › should match screenshot ───────────────────────────────
Error: Screenshot comparison failed:
2380 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/select/showcase/webkit/regular/neutral-bg-lvl-1/DBSelect-should-match-screenshot.png
Received: /__w/mono/mono/showcases/vue-showcase/test-results/select-showcase-select-DBSelect-should-match-screenshot-webkit/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/vue-showcase/test-results/select-showcase-select-DBSelect-should-match-screenshot-webkit/regular-neutral-bg-lvl-1-diff.png
Call log:
- page._expectScreenshot with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 2380 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 2380 pixels (ratio 0.01 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
2) [webkit] › default.ts:52:2 › DBSelect › should match screenshot ───────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
2380 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/select/showcase/webkit/regular/neutral-bg-lvl-1/DBSelect-should-match-screenshot.png
Received: /__w/mono/mono/showcases/vue-showcase/test-results/select-showcase-select-DBSelect-should-match-screenshot-webkit-retry1/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/vue-showcase/test-results/select-showcase-select-DBSelect-should-match-screenshot-webkit-retry1/regular-neutral-bg-lvl-1-diff.png
Call log:
- page._expectScreenshot with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 2380 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 2380 pixels (ratio 0.01 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
👩🔬 Test showcase with Playwright 🎭
Process completed with exit code 1.
|
🔣 Print GitHub Report
2 failed
[webkit] › default.ts:52:2 › DBCheckbox › should match screenshot ──────────────────────────────
[webkit] › default.ts:52:2 › DBSelect › should match screenshot ────────────────────────────────
100 passed (2.8m)
|
Loading