test: add a11y tests to showcases #11574
Annotations
11 errors and 1 notice
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
1) [webkit] › default.ts:52:2 › DBAccordion › should match screenshot ────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 1737px, received 1280px by 1757px. 67504 pixels (ratio 0.04 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/accordion/showcase/webkit/regular/neutral-bg-lvl-1/DBAccordion-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/accordion-showcase-accordi-6d7f3-ion-should-match-screenshot-webkit/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/accordion-showcase-accordi-6d7f3-ion-should-match-screenshot-webkit/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 1280px by 1737px, received 1280px by 1757px. 67504 pixels (ratio 0.04 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 1280px by 1737px, received 1280px by 1757px. 67504 pixels (ratio 0.04 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
1) [webkit] › default.ts:52:2 › DBAccordion › should match screenshot ────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 1737px, received 1280px by 1757px. 67504 pixels (ratio 0.04 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/accordion/showcase/webkit/regular/neutral-bg-lvl-1/DBAccordion-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/accordion-showcase-accordi-6d7f3-ion-should-match-screenshot-webkit-retry1/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/accordion-showcase-accordi-6d7f3-ion-should-match-screenshot-webkit-retry1/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 1280px by 1737px, received 1280px by 1757px. 67504 pixels (ratio 0.04 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 1280px by 1737px, received 1280px by 1757px. 67504 pixels (ratio 0.04 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
2) [webkit] › default.ts:52:2 › DBAccordionItem › should match screenshot ────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 1655px, received 1280px by 1675px. 63499 pixels (ratio 0.03 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/accordion-item/showcase/webkit/regular/neutral-bg-lvl-1/DBAccordionItem-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/accordion-item-showcase-ac-d5097-tem-should-match-screenshot-webkit/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/accordion-item-showcase-ac-d5097-tem-should-match-screenshot-webkit/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 1280px by 1655px, received 1280px by 1675px. 63499 pixels (ratio 0.03 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 1280px by 1655px, received 1280px by 1675px. 63499 pixels (ratio 0.03 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
2) [webkit] › default.ts:52:2 › DBAccordionItem › should match screenshot ────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 1655px, received 1280px by 1675px. 63499 pixels (ratio 0.03 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/accordion-item/showcase/webkit/regular/neutral-bg-lvl-1/DBAccordionItem-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/accordion-item-showcase-ac-d5097-tem-should-match-screenshot-webkit-retry1/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/accordion-item-showcase-ac-d5097-tem-should-match-screenshot-webkit-retry1/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 1280px by 1655px, received 1280px by 1675px. 63499 pixels (ratio 0.03 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 1280px by 1655px, received 1280px by 1675px. 63499 pixels (ratio 0.03 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
3) [webkit] › default.ts:52:2 › DBBadge › should match screenshot ────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 2955px, received 1280px by 2975px. 117833 pixels (ratio 0.04 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/badge/showcase/webkit/regular/neutral-bg-lvl-1/DBBadge-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 1280px by 2955px, received 1280px by 2975px. 117833 pixels (ratio 0.04 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 1280px by 2955px, received 1280px by 2975px. 117833 pixels (ratio 0.04 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
3) [webkit] › default.ts:52:2 › DBBadge › should match screenshot ────────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 2955px, received 1280px by 2975px. 117833 pixels (ratio 0.04 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/badge/showcase/webkit/regular/neutral-bg-lvl-1/DBBadge-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit-retry1/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit-retry1/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 1280px by 2955px, received 1280px by 2975px. 117833 pixels (ratio 0.04 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 1280px by 2955px, received 1280px by 2975px. 117833 pixels (ratio 0.04 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
4) [webkit] › default.ts:52:2 › DBBrand › should match screenshot ────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 1330px, received 1280px by 1350px. 54080 pixels (ratio 0.04 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/brand/showcase/webkit/regular/neutral-bg-lvl-1/DBBrand-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/brand-showcase-brand-DBBrand-should-match-screenshot-webkit/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/brand-showcase-brand-DBBrand-should-match-screenshot-webkit/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 1280px by 1330px, received 1280px by 1350px. 54080 pixels (ratio 0.04 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 1280px by 1330px, received 1280px by 1350px. 54080 pixels (ratio 0.04 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
4) [webkit] › default.ts:52:2 › DBBrand › should match screenshot ────────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 1330px, received 1280px by 1350px. 54080 pixels (ratio 0.04 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/brand/showcase/webkit/regular/neutral-bg-lvl-1/DBBrand-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/brand-showcase-brand-DBBrand-should-match-screenshot-webkit-retry1/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/brand-showcase-brand-DBBrand-should-match-screenshot-webkit-retry1/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 1280px by 1330px, received 1280px by 1350px. 54080 pixels (ratio 0.04 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 1280px by 1330px, received 1280px by 1350px. 54080 pixels (ratio 0.04 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
5) [webkit] › default.ts:52:2 › DBButton › should match screenshot ───────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 2630px, received 1280px by 2650px. 100937 pixels (ratio 0.03 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/button/showcase/webkit/regular/neutral-bg-lvl-1/DBButton-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/button-showcase-button-DBButton-should-match-screenshot-webkit/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/button-showcase-button-DBButton-should-match-screenshot-webkit/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 1280px by 2630px, received 1280px by 2650px. 100937 pixels (ratio 0.03 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 1280px by 2630px, received 1280px by 2650px. 100937 pixels (ratio 0.03 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
🔣 Print GitHub Report:
showcases/e2e/default.ts#L89
5) [webkit] › default.ts:52:2 › DBButton › should match screenshot ───────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 2630px, received 1280px by 2650px. 100937 pixels (ratio 0.03 of all image pixels) are different.
Expected: /__w/mono/mono/__snapshots__/button/showcase/webkit/regular/neutral-bg-lvl-1/DBButton-should-match-screenshot.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/button-showcase-button-DBButton-should-match-screenshot-webkit-retry1/regular-neutral-bg-lvl-1-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/button-showcase-button-DBButton-should-match-screenshot-webkit-retry1/regular-neutral-bg-lvl-1-diff.png
Call log:
- expect.toHaveScreenshot(regular/neutral-bg-lvl-1.png) with timeout 10000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 1280px by 2630px, received 1280px by 2650px. 100937 pixels (ratio 0.03 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 1280px by 2630px, received 1280px by 2650px. 100937 pixels (ratio 0.03 of all image pixels) are different.
87 | }
88 |
> 89 | await expect(page).toHaveScreenshot(
| ^
90 | [density, `neutral-bg-lvl-1.png`],
91 | config
92 | );
at /__w/mono/mono/showcases/e2e/default.ts:89:22
|
👩🔬 Test showcase with Playwright 🎭
Process completed with exit code 1.
|
🔣 Print GitHub Report
27 failed
[webkit] › default.ts:52:2 › DBAccordion › should match screenshot ─────────────────────────────
[webkit] › default.ts:52:2 › DBAccordionItem › should match screenshot ─────────────────────────
[webkit] › default.ts:52:2 › DBBadge › should match screenshot ─────────────────────────────────
[webkit] › default.ts:52:2 › DBBrand › should match screenshot ─────────────────────────────────
[webkit] › default.ts:52:2 › DBButton › should match screenshot ────────────────────────────────
[webkit] › default.ts:52:2 › DBCard › should match screenshot ──────────────────────────────────
[webkit] › default.ts:52:2 › DBCheckbox › should match screenshot ──────────────────────────────
[webkit] › default.ts:52:2 › DBDivider › should match screenshot ───────────────────────────────
[webkit] › default.ts:52:2 › DBDrawer › should match screenshot ────────────────────────────────
[webkit] › default.ts:52:2 › DBHeader › should match screenshot ────────────────────────────────
[webkit] › default.ts:52:2 › DBIcon › should match screenshot ──────────────────────────────────
[webkit] › default.ts:52:2 › DBInfotext › should match screenshot ──────────────────────────────
[webkit] › default.ts:52:2 › DBInput › should match screenshot ─────────────────────────────────
[webkit] › default.ts:52:2 › DBLink › should match screenshot ──────────────────────────────────
[webkit] › default.ts:52:2 › DBNavigation › should match screenshot ────────────────────────────
[webkit] › default.ts:52:2 › DBNavigationItem › should match screenshot ────────────────────────
[webkit] › default.ts:52:2 › DBNotification › should match screenshot ──────────────────────────
[webkit] › default.ts:52:2 › DBPopover › should match screenshot ───────────────────────────────
[webkit] › default.ts:52:2 › DBRadio › should match screenshot ─────────────────────────────────
[webkit] › default.ts:52:2 › DBSection › should match screenshot ───────────────────────────────
[webkit] › default.ts:52:2 › DBSelect › should match screenshot ────────────────────────────────
[webkit] › default.ts:52:2 › DBSwitch › should match screenshot ────────────────────────────────
[webkit] › default.ts:52:2 › DBTabItem › should match screenshot ───────────────────────────────
[webkit] › default.ts:52:2 › DBTabs › should match screenshot ──────────────────────────────────
[webkit] › default.ts:52:2 › DBTag › should match screenshot ───────────────────────────────────
[webkit] › default.ts:52:2 › DBTextarea › should match screenshot ──────────────────────────────
[webkit] › default.ts:52:2 › DBTooltip › should match screenshot ───────────────────────────────
10 skipped
73 passed (6.1m)
|
Loading