1) [chromium] › welcome.spec.ts:145:5 › can import a template ──────────────────────────────────── Error: Screenshot comparison failed: 1114 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/welcome.spec.ts-snapshots/can-import-a-template-1-chromium-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/welcome-can-import-a-template-chromium/can-import-a-template-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/welcome-can-import-a-template-chromium/can-import-a-template-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1114 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1114 pixels (ratio 0.01 of all image pixels) are different. 158 | ).toBeDisabled(); 159 | await expect(page.locator('.detected-link').first()).toBeVisible(); > 160 | await expect(page).toHaveScreenshot(); | ^ 161 | await page.getByLabel('Close').click(); 162 | await expect( 163 | page.getByRole('heading', { at /__w/bitauth-ide/bitauth-ide/tests/welcome.spec.ts:160:22

1) [chromium] › welcome.spec.ts:145:5 › can import a template ──────────────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1114 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/welcome.spec.ts-snapshots/can-import-a-template-1-chromium-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/welcome-can-import-a-template-chromium-retry1/can-import-a-template-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/welcome-can-import-a-template-chromium-retry1/can-import-a-template-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1114 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1114 pixels (ratio 0.01 of all image pixels) are different. 158 | ).toBeDisabled(); 159 | await expect(page.locator('.detected-link').first()).toBeVisible(); > 160 | await expect(page).toHaveScreenshot(); | ^ 161 | await page.getByLabel('Close').click(); 162 | await expect( 163 | page.getByRole('heading', { at /__w/bitauth-ide/bitauth-ide/tests/welcome.spec.ts:160:22

1) [chromium] › welcome.spec.ts:145:5 › can import a template ──────────────────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1114 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/welcome.spec.ts-snapshots/can-import-a-template-1-chromium-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/welcome-can-import-a-template-chromium-retry2/can-import-a-template-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/welcome-can-import-a-template-chromium-retry2/can-import-a-template-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1114 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1114 pixels (ratio 0.01 of all image pixels) are different. 158 | ).toBeDisabled(); 159 | await expect(page.locator('.detected-link').first()).toBeVisible(); > 160 | await expect(page).toHaveScreenshot(); | ^ 161 | await page.getByLabel('Close').click(); 162 | await expect( 163 | page.getByRole('heading', { at /__w/bitauth-ide/bitauth-ide/tests/welcome.spec.ts:160:22

2) [firefox] › autosave.spec.ts:3:5 › autosaves after every action ─────────────────────────────── Error: Screenshot comparison failed: 1325 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts-snapshots/autosaves-after-every-action-1-firefox-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-firefox/autosaves-after-every-action-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-firefox/autosaves-after-every-action-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1325 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1325 pixels (ratio 0.01 of all image pixels) are different. 47 | await expect(page.locator('.detected-link').first()).toBeVisible(); 48 | await page.getByText('Paste a template below to import.').click(); > 49 | await expect(page).toHaveScreenshot(); | ^ 50 | await page.getByRole('button', { name: 'Import Template' }).click(); 51 | await expect(page.locator('h1 .title')).toHaveText('Untitled'); 52 | await page.getByRole('button', { name: 'Scratch Pad' }).click(); at /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts:49:22

2) [firefox] › autosave.spec.ts:3:5 › autosaves after every action ─────────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1325 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts-snapshots/autosaves-after-every-action-1-firefox-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-firefox-retry1/autosaves-after-every-action-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-firefox-retry1/autosaves-after-every-action-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1325 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1325 pixels (ratio 0.01 of all image pixels) are different. 47 | await expect(page.locator('.detected-link').first()).toBeVisible(); 48 | await page.getByText('Paste a template below to import.').click(); > 49 | await expect(page).toHaveScreenshot(); | ^ 50 | await page.getByRole('button', { name: 'Import Template' }).click(); 51 | await expect(page.locator('h1 .title')).toHaveText('Untitled'); 52 | await page.getByRole('button', { name: 'Scratch Pad' }).click(); at /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts:49:22

2) [firefox] › autosave.spec.ts:3:5 › autosaves after every action ─────────────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1325 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts-snapshots/autosaves-after-every-action-1-firefox-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-firefox-retry2/autosaves-after-every-action-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-firefox-retry2/autosaves-after-every-action-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1325 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1325 pixels (ratio 0.01 of all image pixels) are different. 47 | await expect(page.locator('.detected-link').first()).toBeVisible(); 48 | await page.getByText('Paste a template below to import.').click(); > 49 | await expect(page).toHaveScreenshot(); | ^ 50 | await page.getByRole('button', { name: 'Import Template' }).click(); 51 | await expect(page.locator('h1 .title')).toHaveText('Untitled'); 52 | await page.getByRole('button', { name: 'Scratch Pad' }).click(); at /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts:49:22

3) [firefox] › editor.spec.ts:3:5 › renders spacers as expected ────────────────────────────────── Error: Screenshot comparison failed: 721 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts-snapshots/renders-spacers-as-expected-1-firefox-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/editor-renders-spacers-as-expected-firefox/renders-spacers-as-expected-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/editor-renders-spacers-as-expected-firefox/renders-spacers-as-expected-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 2334 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1613 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 721 pixels (ratio 0.01 of all image pixels) are different. 11 | `window._IDE_E2E_TESTING_VIEW_CONFIG.setFrames2SplitHeight(10)`, 12 | ); > 13 | await expect(page).toHaveScreenshot(); | ^ 14 | await page.getByRole('button', { name: 'False' }).click(); 15 | await expect(page).toHaveScreenshot(); 16 | }); at /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts:13:22

3) [firefox] › editor.spec.ts:3:5 › renders spacers as expected ────────────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 721 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts-snapshots/renders-spacers-as-expected-1-firefox-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/editor-renders-spacers-as-expected-firefox-retry1/renders-spacers-as-expected-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/editor-renders-spacers-as-expected-firefox-retry1/renders-spacers-as-expected-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 2334 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1613 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 721 pixels (ratio 0.01 of all image pixels) are different. 11 | `window._IDE_E2E_TESTING_VIEW_CONFIG.setFrames2SplitHeight(10)`, 12 | ); > 13 | await expect(page).toHaveScreenshot(); | ^ 14 | await page.getByRole('button', { name: 'False' }).click(); 15 | await expect(page).toHaveScreenshot(); 16 | }); at /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts:13:22

3) [firefox] › editor.spec.ts:3:5 › renders spacers as expected ────────────────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 721 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts-snapshots/renders-spacers-as-expected-1-firefox-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/editor-renders-spacers-as-expected-firefox-retry2/renders-spacers-as-expected-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/editor-renders-spacers-as-expected-firefox-retry2/renders-spacers-as-expected-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 2334 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1613 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 721 pixels (ratio 0.01 of all image pixels) are different. 11 | `window._IDE_E2E_TESTING_VIEW_CONFIG.setFrames2SplitHeight(10)`, 12 | ); > 13 | await expect(page).toHaveScreenshot(); | ^ 14 | await page.getByRole('button', { name: 'False' }).click(); 15 | await expect(page).toHaveScreenshot(); 16 | }); at /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts:13:22

4) [firefox] › editor.spec.ts:18:5 › renders error as expected for a non-push opcode in unlocking script Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Unlock', exact: true }) Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Unlock', exact: true }) 23 | await expect( 24 | page.getByRole('heading', { name: 'Unlock', exact: true }), > 25 | ).toBeVisible(); | ^ 26 | await expect( 27 | page.getByText('Unlocking bytecode may contain only push operations.'), 28 | ).toBeVisible(); at /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts:25:5

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636