test: add a11y tests to showcases #11574
Annotations
11 errors and 1 notice
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
1) [mobile_chrome] › default.ts:52:2 › DBInput › should match screenshot ─────────────────────────
Error: Screenshot comparison failed:
Expected an image 393px by 4507px, received 393px by 4951px. 66012 pixels (ratio 0.04 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/input/showcase/mobile-chrome/regular/neutral-bg-lvl-1/DBInput-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/input-showcase-input-DBInput-should-match-screenshot-mobile-chrome/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/input-showcase-input-DBInput-should-match-screenshot-mobile-chrome/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 393px by 4507px, received 393px by 4951px. 66011 pixels (ratio 0.04 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 393px by 4507px, received 393px by 4951px. 66012 pixels (ratio 0.04 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
1) [mobile_chrome] › default.ts:52:2 › DBInput › should match screenshot ─────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 393px by 4507px, received 393px by 4951px. 66012 pixels (ratio 0.04 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/input/showcase/mobile-chrome/regular/neutral-bg-lvl-1/DBInput-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/input-showcase-input-DBInput-should-match-screenshot-mobile-chrome-retry1/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/input-showcase-input-DBInput-should-match-screenshot-mobile-chrome-retry1/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 393px by 4507px, received 393px by 4951px. 66011 pixels (ratio 0.04 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 393px by 4507px, received 393px by 4951px. 66012 pixels (ratio 0.04 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
2) [mobile_chrome] › default.ts:52:2 › DBRadio › should match screenshot ─────────────────────────
Error: Screenshot comparison failed:
1658 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/radio/showcase/mobile-chrome/regular/neutral-bg-lvl-1/DBRadio-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/radio-showcase-radio-DBRadio-should-match-screenshot-mobile-chrome/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/radio-showcase-radio-DBRadio-should-match-screenshot-mobile-chrome/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 1658 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 1658 pixels (ratio 0.01 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
2) [mobile_chrome] › default.ts:52:2 › DBRadio › should match screenshot ─────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
1658 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/radio/showcase/mobile-chrome/regular/neutral-bg-lvl-1/DBRadio-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/radio-showcase-radio-DBRadio-should-match-screenshot-mobile-chrome-retry1/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/radio-showcase-radio-DBRadio-should-match-screenshot-mobile-chrome-retry1/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 1658 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 1658 pixels (ratio 0.01 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
3) [mobile_chrome] › default.ts:52:2 › DBSelect › should match screenshot ────────────────────────
Error: Screenshot comparison failed:
Expected an image 393px by 2491px, received 393px by 2511px. 32097 pixels (ratio 0.04 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/select/showcase/mobile-chrome/regular/neutral-bg-lvl-1/DBSelect-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/select-showcase-select-DBSelect-should-match-screenshot-mobile-chrome/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/select-showcase-select-DBSelect-should-match-screenshot-mobile-chrome/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 393px by 2491px, received 393px by 2511px. 32097 pixels (ratio 0.04 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 393px by 2491px, received 393px by 2511px. 32097 pixels (ratio 0.04 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
3) [mobile_chrome] › default.ts:52:2 › DBSelect › should match screenshot ────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 393px by 2491px, received 393px by 2511px. 32097 pixels (ratio 0.04 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/select/showcase/mobile-chrome/regular/neutral-bg-lvl-1/DBSelect-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/select-showcase-select-DBSelect-should-match-screenshot-mobile-chrome-retry1/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/select-showcase-select-DBSelect-should-match-screenshot-mobile-chrome-retry1/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 393px by 2491px, received 393px by 2511px. 32097 pixels (ratio 0.04 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 393px by 2491px, received 393px by 2511px. 32097 pixels (ratio 0.04 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
4) [mobile_chrome] › default.ts:52:2 › DBSwitch › should match screenshot ────────────────────────
Error: Screenshot comparison failed:
4412 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/switch/showcase/mobile-chrome/regular/neutral-bg-lvl-1/DBSwitch-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/switch-showcase-switch-DBSwitch-should-match-screenshot-mobile-chrome/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/switch-showcase-switch-DBSwitch-should-match-screenshot-mobile-chrome/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4412 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4412 pixels (ratio 0.01 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
4) [mobile_chrome] › default.ts:52:2 › DBSwitch › should match screenshot ────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
4412 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/switch/showcase/mobile-chrome/regular/neutral-bg-lvl-1/DBSwitch-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/switch-showcase-switch-DBSwitch-should-match-screenshot-mobile-chrome-retry1/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/switch-showcase-switch-DBSwitch-should-match-screenshot-mobile-chrome-retry1/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4412 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4412 pixels (ratio 0.01 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
5) [mobile_chrome] › default.ts:52:2 › DBTabItem › should match screenshot ───────────────────────
Error: Screenshot comparison failed:
1700 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/tab-item/showcase/mobile-chrome/regular/neutral-bg-lvl-1/DBTabItem-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/tab-item-showcase-tab-item-DBTabItem-should-match-screenshot-mobile-chrome/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/tab-item-showcase-tab-item-DBTabItem-should-match-screenshot-mobile-chrome/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 1700 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 1700 pixels (ratio 0.01 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
5) [mobile_chrome] › default.ts:52:2 › DBTabItem › should match screenshot ───────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
1700 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/tab-item/showcase/mobile-chrome/regular/neutral-bg-lvl-1/DBTabItem-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/tab-item-showcase-tab-item-DBTabItem-should-match-screenshot-mobile-chrome-retry1/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/tab-item-showcase-tab-item-DBTabItem-should-match-screenshot-mobile-chrome-retry1/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 1700 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 1700 pixels (ratio 0.01 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
👩🔬 Test showcase with Playwright 🎭
Process completed with exit code 1.
|
🔣 Print GitHub Report
6 failed
[mobile_chrome] › default.ts:52:2 › DBInput › should match screenshot ──────────────────────────
[mobile_chrome] › default.ts:52:2 › DBRadio › should match screenshot ──────────────────────────
[mobile_chrome] › default.ts:52:2 › DBSelect › should match screenshot ─────────────────────────
[mobile_chrome] › default.ts:52:2 › DBSwitch › should match screenshot ─────────────────────────
[mobile_chrome] › default.ts:52:2 › DBTabItem › should match screenshot ────────────────────────
[mobile_chrome] › default.ts:52:2 › DBTextarea › should match screenshot ───────────────────────
10 skipped
94 passed (2.1m)
|
Loading