Skip to content

Add performance and caching tests for stdout/stderr #445

Add performance and caching tests for stdout/stderr

Add performance and caching tests for stdout/stderr #445

Triggered via pull request November 29, 2024 10:20
Status Success
Total duration 38m 9s
Artifacts 3

galata.yml

on: pull_request
Visual Regression Tests
37m 56s
Visual Regression Tests
Matrix: Visual Regression Documentation
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 1 warning, and 2 notices
Visual Regression Documentation (3.10.6)
Event loop is closed
[documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception: core/galata/test/documentation/debugger.test.ts#L189
1) [documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception Error: Screenshot comparison failed: 366 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/debugger.test.ts-snapshots/debugger-stop-on-raised-exception-documentation-linux.png Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-debugge-b2db7-er-Breakpoints-on-exception-documentation/debugger-stop-on-raised-exception-actual.png Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-debugge-b2db7-er-Breakpoints-on-exception-documentation/debugger-stop-on-raised-exception-diff.png 187 | clip: { y: 110, x: 300, width: 300, height: 80 } 188 | }) > 189 | ).toMatchSnapshot('debugger_stop_on_raised_exception.png'); | ^ 190 | await page.click('jp-button[title^=Continue]'); 191 | await page.click('jp-button[title^=Continue]'); 192 | }); at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/debugger.test.ts:189:7
[documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception: core/galata/src/helpers/notebook.ts#L456
1) [documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception Error: page.waitForTimeout: Test ended. at src/helpers/notebook.ts:456 454 | let done = false; 455 | do { > 456 | await this.page.waitForTimeout(20); | ^ 457 | done = await this.page.evaluate(cellIdx => { 458 | return window.galata.haveBeenExecuted(cellIdx); 459 | }, cellIndex); at NotebookHelper.waitForRun (/home/runner/work/jupyterlab/jupyterlab/core/galata/src/helpers/notebook.ts:456:23) at NotebookHelper.runCell (/home/runner/work/jupyterlab/jupyterlab/core/galata/src/helpers/notebook.ts:1411:5)
[jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script): galata/test/jupyterlab/debugger.test.ts#L1
1) [jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script) Test timeout of 60000ms exceeded.
[jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script): galata/src/helpers/debuggerpanel.ts#L30
1) [jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script) Error: locator.getAttribute: Test timeout of 60000ms exceeded. Call log: - waiting for getByRole('main').locator('[role="tabpanel"][id="id-018e27ba-ff7d-4229-8de8-ffab863e89d2"]').locator('.jp-Toolbar').first().locator('.jp-DebuggerBugButton') at src/helpers/debuggerpanel.ts:30 28 | const button = toolbar?.locator('.jp-DebuggerBugButton'); 29 | if (((await button?.count()) ?? 0) > 0) { > 30 | return (await button!.getAttribute('aria-pressed')) === 'true'; | ^ 31 | } 32 | return false; 33 | } at DebuggerHelper.isOn (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/debuggerpanel.ts:30:29) at /home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/debuggerpanel.ts:55:40 at Timeout.check (/home/runner/work/jupyterlab/jupyterlab/galata/src/utils.ts:183:11)
[jupyterlab] › test/jupyterlab/html-viewer.test.ts:26:7 › HTML Viewer › should notify links are blocked for untrusted file: galata/test/jupyterlab/html-viewer.test.ts#L30
2) [jupyterlab] › test/jupyterlab/html-viewer.test.ts:26:7 › HTML Viewer › should notify links are blocked for untrusted file TypeError: Cannot read properties of null (reading 'getByRole') 28 | }) => { 29 | const frame = page.frame({ url: url => url.protocol == 'blob:' }); > 30 | await frame!.getByRole('link', { name: 'GitHub' }).hover(); | ^ 31 | 32 | const warningCount = await frame!.evaluate(() => { 33 | let count = 0; at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/html-viewer.test.ts:30:18
[jupyterlab] › test/jupyterlab/inline-completer.test.ts:145:9 › Inline Completer › Invoke on Tab › Shows up on Tab: galata/test/jupyterlab/inline-completer.test.ts#L22
3) [jupyterlab] › test/jupyterlab/inline-completer.test.ts:145:9 › Inline Completer › Invoke on Tab › Shows up on Tab Test timeout of 60000ms exceeded while running "beforeEach" hook. 20 | 21 | test.describe('Inline Completer', () => { > 22 | test.beforeEach(async ({ page }) => { | ^ 23 | await page.notebook.createNew(fileName); 24 | await page.notebook.setCell(0, 'code', 'suggestion_1 = 1'); 25 | await page.notebook.addCell( at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/inline-completer.test.ts:22:8
[jupyterlab] › test/jupyterlab/inline-completer.test.ts:145:9 › Inline Completer › Invoke on Tab › Shows up on Tab: galata/src/helpers/notebook.ts#L1269
3) [jupyterlab] › test/jupyterlab/inline-completer.test.ts:145:9 › Inline Completer › Invoke on Tab › Shows up on Tab Error: locator.evaluate: Test timeout of 60000ms exceeded. at src/helpers/notebook.ts:1269 1267 | // Wait until the CodeMirror highlighting is stable 1268 | // over 10 consecutive animation frames. > 1269 | await cell.evaluate((cell: HTMLElement) => { | ^ 1270 | let _resolve: () => void; 1271 | const promise = new Promise<void>(resolve => { 1272 | _resolve = resolve; at NotebookHelper.setCell (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/notebook.ts:1269:18) at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/inline-completer.test.ts:24:5
[jupyterlab] › test/jupyterlab/inline-completer.test.ts:254:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter: galata/test/jupyterlab/inline-completer.test.ts#L22
4) [jupyterlab] › test/jupyterlab/inline-completer.test.ts:254:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter Test timeout of 60000ms exceeded while running "beforeEach" hook. 20 | 21 | test.describe('Inline Completer', () => { > 22 | test.beforeEach(async ({ page }) => { | ^ 23 | await page.notebook.createNew(fileName); 24 | await page.notebook.setCell(0, 'code', 'suggestion_1 = 1'); 25 | await page.notebook.addCell( at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/inline-completer.test.ts:22:8
[jupyterlab] › test/jupyterlab/inline-completer.test.ts:254:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter: galata/src/helpers/notebook.ts#L1269
4) [jupyterlab] › test/jupyterlab/inline-completer.test.ts:254:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter Error: locator.evaluate: Test timeout of 60000ms exceeded. at src/helpers/notebook.ts:1269 1267 | // Wait until the CodeMirror highlighting is stable 1268 | // over 10 consecutive animation frames. > 1269 | await cell.evaluate((cell: HTMLElement) => { | ^ 1270 | let _resolve: () => void; 1271 | const promise = new Promise<void>(resolve => { 1272 | _resolve = resolve; at NotebookHelper.setCell (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/notebook.ts:1269:18) at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/inline-completer.test.ts:24:5
Visual Regression Tests
No files were found with the provided path: galata/test-jupyterlab-results galata/test-results. No artifacts will be uploaded.
🎭 Playwright Run Summary
1 flaky [documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception 62 passed (4.3m)
🎭 Playwright Run Summary
4 flaky [jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script) [jupyterlab] › test/jupyterlab/html-viewer.test.ts:26:7 › HTML Viewer › should notify links are blocked for untrusted file [jupyterlab] › test/jupyterlab/inline-completer.test.ts:145:9 › Inline Completer › Invoke on Tab › Shows up on Tab [jupyterlab] › test/jupyterlab/inline-completer.test.ts:254:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter 487 passed (31.2m)

Artifacts

Produced during runtime
Name Size
jupyterlab-documentation-report
953 KB
jupyterlab-documentation-test-assets
10.1 KB
jupyterlab-galata-report
5.25 MB