Add performance and caching tests for stdout/stderr #445
galata.yml
on: pull_request
Visual Regression Tests
37m 56s
Matrix: Visual Regression Documentation
Annotations
10 errors, 1 warning, and 2 notices
Visual Regression Documentation (3.10.6)
Event loop is closed
|
[documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception:
core/galata/test/documentation/debugger.test.ts#L189
1) [documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception
Error: Screenshot comparison failed:
366 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/debugger.test.ts-snapshots/debugger-stop-on-raised-exception-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-debugge-b2db7-er-Breakpoints-on-exception-documentation/debugger-stop-on-raised-exception-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-debugge-b2db7-er-Breakpoints-on-exception-documentation/debugger-stop-on-raised-exception-diff.png
187 | clip: { y: 110, x: 300, width: 300, height: 80 }
188 | })
> 189 | ).toMatchSnapshot('debugger_stop_on_raised_exception.png');
| ^
190 | await page.click('jp-button[title^=Continue]');
191 | await page.click('jp-button[title^=Continue]');
192 | });
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/debugger.test.ts:189:7
|
[documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception:
core/galata/src/helpers/notebook.ts#L456
1) [documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception
Error: page.waitForTimeout: Test ended.
at src/helpers/notebook.ts:456
454 | let done = false;
455 | do {
> 456 | await this.page.waitForTimeout(20);
| ^
457 | done = await this.page.evaluate(cellIdx => {
458 | return window.galata.haveBeenExecuted(cellIdx);
459 | }, cellIndex);
at NotebookHelper.waitForRun (/home/runner/work/jupyterlab/jupyterlab/core/galata/src/helpers/notebook.ts:456:23)
at NotebookHelper.runCell (/home/runner/work/jupyterlab/jupyterlab/core/galata/src/helpers/notebook.ts:1411:5)
|
[jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script):
galata/test/jupyterlab/debugger.test.ts#L1
1) [jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script)
Test timeout of 60000ms exceeded.
|
[jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script):
galata/src/helpers/debuggerpanel.ts#L30
1) [jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script)
Error: locator.getAttribute: Test timeout of 60000ms exceeded.
Call log:
- waiting for getByRole('main').locator('[role="tabpanel"][id="id-018e27ba-ff7d-4229-8de8-ffab863e89d2"]').locator('.jp-Toolbar').first().locator('.jp-DebuggerBugButton')
at src/helpers/debuggerpanel.ts:30
28 | const button = toolbar?.locator('.jp-DebuggerBugButton');
29 | if (((await button?.count()) ?? 0) > 0) {
> 30 | return (await button!.getAttribute('aria-pressed')) === 'true';
| ^
31 | }
32 | return false;
33 | }
at DebuggerHelper.isOn (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/debuggerpanel.ts:30:29)
at /home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/debuggerpanel.ts:55:40
at Timeout.check (/home/runner/work/jupyterlab/jupyterlab/galata/src/utils.ts:183:11)
|
[jupyterlab] › test/jupyterlab/html-viewer.test.ts:26:7 › HTML Viewer › should notify links are blocked for untrusted file:
galata/test/jupyterlab/html-viewer.test.ts#L30
2) [jupyterlab] › test/jupyterlab/html-viewer.test.ts:26:7 › HTML Viewer › should notify links are blocked for untrusted file
TypeError: Cannot read properties of null (reading 'getByRole')
28 | }) => {
29 | const frame = page.frame({ url: url => url.protocol == 'blob:' });
> 30 | await frame!.getByRole('link', { name: 'GitHub' }).hover();
| ^
31 |
32 | const warningCount = await frame!.evaluate(() => {
33 | let count = 0;
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/html-viewer.test.ts:30:18
|
[jupyterlab] › test/jupyterlab/inline-completer.test.ts:145:9 › Inline Completer › Invoke on Tab › Shows up on Tab:
galata/test/jupyterlab/inline-completer.test.ts#L22
3) [jupyterlab] › test/jupyterlab/inline-completer.test.ts:145:9 › Inline Completer › Invoke on Tab › Shows up on Tab
Test timeout of 60000ms exceeded while running "beforeEach" hook.
20 |
21 | test.describe('Inline Completer', () => {
> 22 | test.beforeEach(async ({ page }) => {
| ^
23 | await page.notebook.createNew(fileName);
24 | await page.notebook.setCell(0, 'code', 'suggestion_1 = 1');
25 | await page.notebook.addCell(
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/inline-completer.test.ts:22:8
|
[jupyterlab] › test/jupyterlab/inline-completer.test.ts:145:9 › Inline Completer › Invoke on Tab › Shows up on Tab:
galata/src/helpers/notebook.ts#L1269
3) [jupyterlab] › test/jupyterlab/inline-completer.test.ts:145:9 › Inline Completer › Invoke on Tab › Shows up on Tab
Error: locator.evaluate: Test timeout of 60000ms exceeded.
at src/helpers/notebook.ts:1269
1267 | // Wait until the CodeMirror highlighting is stable
1268 | // over 10 consecutive animation frames.
> 1269 | await cell.evaluate((cell: HTMLElement) => {
| ^
1270 | let _resolve: () => void;
1271 | const promise = new Promise<void>(resolve => {
1272 | _resolve = resolve;
at NotebookHelper.setCell (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/notebook.ts:1269:18)
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/inline-completer.test.ts:24:5
|
[jupyterlab] › test/jupyterlab/inline-completer.test.ts:254:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter:
galata/test/jupyterlab/inline-completer.test.ts#L22
4) [jupyterlab] › test/jupyterlab/inline-completer.test.ts:254:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter
Test timeout of 60000ms exceeded while running "beforeEach" hook.
20 |
21 | test.describe('Inline Completer', () => {
> 22 | test.beforeEach(async ({ page }) => {
| ^
23 | await page.notebook.createNew(fileName);
24 | await page.notebook.setCell(0, 'code', 'suggestion_1 = 1');
25 | await page.notebook.addCell(
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/inline-completer.test.ts:22:8
|
[jupyterlab] › test/jupyterlab/inline-completer.test.ts:254:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter:
galata/src/helpers/notebook.ts#L1269
4) [jupyterlab] › test/jupyterlab/inline-completer.test.ts:254:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter
Error: locator.evaluate: Test timeout of 60000ms exceeded.
at src/helpers/notebook.ts:1269
1267 | // Wait until the CodeMirror highlighting is stable
1268 | // over 10 consecutive animation frames.
> 1269 | await cell.evaluate((cell: HTMLElement) => {
| ^
1270 | let _resolve: () => void;
1271 | const promise = new Promise<void>(resolve => {
1272 | _resolve = resolve;
at NotebookHelper.setCell (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/notebook.ts:1269:18)
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/inline-completer.test.ts:24:5
|
Visual Regression Tests
No files were found with the provided path: galata/test-jupyterlab-results
galata/test-results. No artifacts will be uploaded.
|
🎭 Playwright Run Summary
1 flaky
[documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception
62 passed (4.3m)
|
🎭 Playwright Run Summary
4 flaky
[jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script)
[jupyterlab] › test/jupyterlab/html-viewer.test.ts:26:7 › HTML Viewer › should notify links are blocked for untrusted file
[jupyterlab] › test/jupyterlab/inline-completer.test.ts:145:9 › Inline Completer › Invoke on Tab › Shows up on Tab
[jupyterlab] › test/jupyterlab/inline-completer.test.ts:254:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter
487 passed (31.2m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
jupyterlab-documentation-report
|
953 KB |
|
jupyterlab-documentation-test-assets
|
10.1 KB |
|
jupyterlab-galata-report
|
5.25 MB |
|