1) [webkit] › autosave.spec.ts:3:5 › autosaves after every action ──────────────────────────────── Error: Screenshot comparison failed: 1228 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts-snapshots/autosaves-after-every-action-1-webkit-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-webkit/autosaves-after-every-action-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-webkit/autosaves-after-every-action-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1228 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1228 pixels (ratio 0.01 of all image pixels) are different. 47 | await expect(page.locator('.detected-link').first()).toBeVisible(); 48 | await page.getByText('Paste a template below to import.').click(); > 49 | await expect(page).toHaveScreenshot(); | ^ 50 | await page.getByRole('button', { name: 'Import Template' }).click(); 51 | await expect(page.locator('h1 .title')).toHaveText('Untitled'); 52 | await page.getByRole('button', { name: 'Scratch Pad' }).click(); at /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts:49:22

1) [webkit] › autosave.spec.ts:3:5 › autosaves after every action ──────────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1228 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts-snapshots/autosaves-after-every-action-1-webkit-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-webkit-retry1/autosaves-after-every-action-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-webkit-retry1/autosaves-after-every-action-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1228 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1228 pixels (ratio 0.01 of all image pixels) are different. 47 | await expect(page.locator('.detected-link').first()).toBeVisible(); 48 | await page.getByText('Paste a template below to import.').click(); > 49 | await expect(page).toHaveScreenshot(); | ^ 50 | await page.getByRole('button', { name: 'Import Template' }).click(); 51 | await expect(page.locator('h1 .title')).toHaveText('Untitled'); 52 | await page.getByRole('button', { name: 'Scratch Pad' }).click(); at /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts:49:22

1) [webkit] › autosave.spec.ts:3:5 › autosaves after every action ──────────────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1228 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts-snapshots/autosaves-after-every-action-1-webkit-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-webkit-retry2/autosaves-after-every-action-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-webkit-retry2/autosaves-after-every-action-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 1228 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 1228 pixels (ratio 0.01 of all image pixels) are different. 47 | await expect(page.locator('.detected-link').first()).toBeVisible(); 48 | await page.getByText('Paste a template below to import.').click(); > 49 | await expect(page).toHaveScreenshot(); | ^ 50 | await page.getByRole('button', { name: 'Import Template' }).click(); 51 | await expect(page.locator('h1 .title')).toHaveText('Untitled'); 52 | await page.getByRole('button', { name: 'Scratch Pad' }).click(); at /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts:49:22

2) [webkit] › editor.spec.ts:3:5 › renders spacers as expected ─────────────────────────────────── Error: Screenshot comparison failed: 699 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts-snapshots/renders-spacers-as-expected-1-webkit-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/editor-renders-spacers-as-expected-webkit/renders-spacers-as-expected-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/editor-renders-spacers-as-expected-webkit/renders-spacers-as-expected-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 699 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 699 pixels (ratio 0.01 of all image pixels) are different. 11 | `window._IDE_E2E_TESTING_VIEW_CONFIG.setFrames2SplitHeight(10)`, 12 | ); > 13 | await expect(page).toHaveScreenshot(); | ^ 14 | await page.getByRole('button', { name: 'False' }).click(); 15 | await expect(page).toHaveScreenshot(); 16 | }); at /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts:13:22

2) [webkit] › editor.spec.ts:3:5 › renders spacers as expected ─────────────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 699 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts-snapshots/renders-spacers-as-expected-1-webkit-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/editor-renders-spacers-as-expected-webkit-retry1/renders-spacers-as-expected-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/editor-renders-spacers-as-expected-webkit-retry1/renders-spacers-as-expected-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 699 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 699 pixels (ratio 0.01 of all image pixels) are different. 11 | `window._IDE_E2E_TESTING_VIEW_CONFIG.setFrames2SplitHeight(10)`, 12 | ); > 13 | await expect(page).toHaveScreenshot(); | ^ 14 | await page.getByRole('button', { name: 'False' }).click(); 15 | await expect(page).toHaveScreenshot(); 16 | }); at /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts:13:22

2) [webkit] › editor.spec.ts:3:5 › renders spacers as expected ─────────────────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 699 pixels (ratio 0.01 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts-snapshots/renders-spacers-as-expected-1-webkit-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/editor-renders-spacers-as-expected-webkit-retry2/renders-spacers-as-expected-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/editor-renders-spacers-as-expected-webkit-retry2/renders-spacers-as-expected-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 699 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 699 pixels (ratio 0.01 of all image pixels) are different. 11 | `window._IDE_E2E_TESTING_VIEW_CONFIG.setFrames2SplitHeight(10)`, 12 | ); > 13 | await expect(page).toHaveScreenshot(); | ^ 14 | await page.getByRole('button', { name: 'False' }).click(); 15 | await expect(page).toHaveScreenshot(); 16 | }); at /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts:13:22

3) [webkit] › editor.spec.ts:18:5 › renders error as expected for a non-push opcode in unlocking script Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Unlock', exact: true }) Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Unlock', exact: true }) 23 | await expect( 24 | page.getByRole('heading', { name: 'Unlock', exact: true }), > 25 | ).toBeVisible(); | ^ 26 | await expect( 27 | page.getByText('Unlocking bytecode may contain only push operations.'), 28 | ).toBeVisible(); at /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts:25:5

3) [webkit] › editor.spec.ts:18:5 › renders error as expected for a non-push opcode in unlocking script Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Unlock', exact: true }) Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Unlock', exact: true }) 23 | await expect( 24 | page.getByRole('heading', { name: 'Unlock', exact: true }), > 25 | ).toBeVisible(); | ^ 26 | await expect( 27 | page.getByText('Unlocking bytecode may contain only push operations.'), 28 | ).toBeVisible(); at /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts:25:5

3) [webkit] › editor.spec.ts:18:5 › renders error as expected for a non-push opcode in unlocking script Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Unlock', exact: true }) Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Unlock', exact: true }) 23 | await expect( 24 | page.getByRole('heading', { name: 'Unlock', exact: true }), > 25 | ).toBeVisible(); | ^ 26 | await expect( 27 | page.getByText('Unlocking bytecode may contain only push operations.'), 28 | ).toBeVisible(); at /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts:25:5

4) [webkit] › editor.spec.ts:32:5 › displays evaluation of tested scripts ──────────────────────── Error: Screenshot comparison failed: 20277 pixels (ratio 0.03 of all image pixels) are different. Expected: /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts-snapshots/displays-evaluation-of-tested-scripts-1-webkit-linux.png Received: /__w/bitauth-ide/bitauth-ide/test-results/editor-displays-evaluation-of-tested-scripts-webkit/displays-evaluation-of-tested-scripts-1-actual.png Diff: /__w/bitauth-ide/bitauth-ide/test-results/editor-displays-evaluation-of-tested-scripts-webkit/displays-evaluation-of-tested-scripts-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 20277 pixels (ratio 0.03 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 20277 pixels (ratio 0.03 of all image pixels) are different. 33 | await loadTemplate(page, 'tests/fixtures/state-merkle-trees.json'); 34 | await page.getByRole('button', { name: 'Empty Leaf', exact: true }).click(); > 35 | await expect(page).toHaveScreenshot(); | ^ 36 | await page.getByRole('button', { name: 'Filled Leaf', exact: true }).click(); 37 | await expect(page).toHaveScreenshot(); 38 | await page.getByRole('button', { name: 'Left Sibling', exact: true }).click(); at /__w/bitauth-ide/bitauth-ide/tests/editor.spec.ts:35:22

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636