This repository has been archived by the owner on Sep 11, 2024. It is now read-only.
End to End Tests #11026
Annotations
11 errors, 28 warnings, and 6 notices
user-view/user-view.spec.ts:25:9 › UserView › should render the user view as expected:
matrix-react-sdk/playwright/e2e/user-view/user-view.spec.ts#L31
1) user-view/user-view.spec.ts:25:9 › UserView › should render the user view as expected ─────────
Error: Screenshot comparison failed:
76 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/user-view/user-view.spec.ts/user-info-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/user-view-user-view-UserVi-3a259-r-the-user-view-as-expected/user-info-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/user-view-user-view-UserVi-3a259-r-the-user-view-as-expected/user-info-diff.png
Call log:
- expect.toHaveScreenshot(user-info.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#mx_RightPanel')
- locator resolved to <aside id="mx_RightPanel" class="mx_RightPanel">…</aside>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 76 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#mx_RightPanel')
- locator resolved to <aside id="mx_RightPanel" class="mx_RightPanel">…</aside>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 76 pixels (ratio 0.01 of all image pixels) are different.
29 | await expect(rightPanel.getByRole("heading", { name: bot.credentials.displayName, exact: true })).toBeVisible();
30 | await expect(rightPanel.getByText("1 session")).toBeVisible();
> 31 | await expect(rightPanel).toMatchScreenshot("user-info.png", {
| ^
32 | mask: [page.locator(".mx_UserInfo_profile_mxid")],
33 | });
34 | });
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/user-view/user-view.spec.ts:31:34
|
read-receipts/read-receipts.spec.ts:229:9 › Read receipts › Recognises unread messages on a thread after receiving a unthreaded receipt for earlier ones:
matrix-react-sdk/playwright/e2e/read-receipts/read-receipts.spec.ts#L92
1) read-receipts/read-receipts.spec.ts:229:9 › Read receipts › Recognises unread messages on a thread after receiving a unthreaded receipt for earlier ones
Test timeout of 30000ms exceeded while running "beforeEach" hook.
90 | };
91 |
> 92 | test.beforeEach(async ({ page, app, user, bot }) => {
| ^
93 | /*
94 | * Create 2 rooms:
95 | *
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/read-receipts/read-receipts.spec.ts:92:10
|
read-receipts/read-receipts.spec.ts:229:9 › Read receipts › Recognises unread messages on a thread after receiving a unthreaded receipt for earlier ones:
matrix-react-sdk/playwright/element-web-test.ts#L230
1) read-receipts/read-receipts.spec.ts:229:9 › Read receipts › Recognises unread messages on a thread after receiving a unthreaded receipt for earlier ones
Error: page.waitForSelector: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.mx_MatrixChat') to be visible
at ../element-web-test.ts:230
228 | user: async ({ pageWithCredentials: page, credentials }, use) => {
229 | await page.goto("/");
> 230 | await page.waitForSelector(".mx_MatrixChat", { timeout: 30000 });
| ^
231 | await use(credentials);
232 | },
233 |
at Object.user (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/element-web-test.ts:230:20)
|
knock/knock-into-room.spec.ts:213:9 › Knock Into Room › should knock into the room and knock is cancelled by user himself:
matrix-react-sdk/playwright/e2e/knock/knock-into-room.spec.ts#L1
1) knock/knock-into-room.spec.ts:213:9 › Knock Into Room › should knock into the room and knock is cancelled by user himself
Test timeout of 30000ms exceeded while setting up "user".
|
knock/knock-into-room.spec.ts:213:9 › Knock Into Room › should knock into the room and knock is cancelled by user himself:
matrix-react-sdk/playwright/element-web-test.ts#L230
1) knock/knock-into-room.spec.ts:213:9 › Knock Into Room › should knock into the room and knock is cancelled by user himself
Error: page.waitForSelector: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.mx_MatrixChat') to be visible
at ../element-web-test.ts:230
228 | user: async ({ pageWithCredentials: page, credentials }, use) => {
229 | await page.goto("/");
> 230 | await page.waitForSelector(".mx_MatrixChat", { timeout: 30000 });
| ^
231 | await use(credentials);
232 | },
233 |
at Object.user (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/element-web-test.ts:230:20)
|
read-receipts/editing-messages-thread-roots.spec.ts:98:17 › Read receipts › editing messages › thread roots › Marking a room as read after an edit of a thread root keeps it read:
matrix-react-sdk/playwright/e2e/read-receipts/editing-messages-thread-roots.spec.ts#L1
2) read-receipts/editing-messages-thread-roots.spec.ts:98:17 › Read receipts › editing messages › thread roots › Marking a room as read after an edit of a thread root keeps it read
Test timeout of 30000ms exceeded while setting up "user".
|
read-receipts/editing-messages-thread-roots.spec.ts:98:17 › Read receipts › editing messages › thread roots › Marking a room as read after an edit of a thread root keeps it read:
matrix-react-sdk/playwright/element-web-test.ts#L230
2) read-receipts/editing-messages-thread-roots.spec.ts:98:17 › Read receipts › editing messages › thread roots › Marking a room as read after an edit of a thread root keeps it read
Error: page.waitForSelector: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.mx_MatrixChat') to be visible
at ../element-web-test.ts:230
228 | user: async ({ pageWithCredentials: page, credentials }, use) => {
229 | await page.goto("/");
> 230 | await page.waitForSelector(".mx_MatrixChat", { timeout: 30000 });
| ^
231 | await use(credentials);
232 | },
233 |
at Object.user (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/element-web-test.ts:230:20)
|
read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read:
matrix-react-sdk/playwright/e2e/read-receipts/high-level.spec.ts#L1
3) read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read
Test timeout of 30000ms exceeded.
|
read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read:
matrix-react-sdk/playwright/e2e/read-receipts/index.ts#L429
3) read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read
Error: expect.not.toBeVisible: Target page, context or browser has been closed
at read-receipts/index.ts:429
427 | */
428 | async assertMessageNotLoaded(messagePart: string) {
> 429 | await expect(this.page.locator(".mx_EventTile_body").getByText(messagePart)).not.toBeVisible();
| ^
430 | }
431 |
432 | /**
at Helpers.assertMessageNotLoaded (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/read-receipts/index.ts:429:90)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/read-receipts/high-level.spec.ts:106:24
|
read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read:
matrix-react-sdk/playwright/e2e/read-receipts/high-level.spec.ts#L1
3) read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read:
matrix-react-sdk/playwright/pages/ElementAppPage.ts#L100
3) read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByRole('tree', { name: 'Rooms' }).locator('[title="Room Beta"],[aria-label="Room Beta"]').first()
- locator resolved to <div tabindex="-1" role="treeitem" aria-selected="false" aria-label="Room Beta" class="mx_AccessibleButton mx_RoomTile">…</div>
- attempting click action
- waiting for element to be visible, enabled and stable
at ../pages/ElementAppPage.ts:100
98 | .locator(`[title="${name}"],[aria-label="${name}"]`)
99 | .first()
> 100 | .click();
| ^
101 | }
102 |
103 | public async viewRoomById(roomId: string): Promise<void> {
at ElementAppPage.viewRoomByName (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/pages/ElementAppPage.ts:100:14)
at Helpers.goTo (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/read-receipts/index.ts:378:24)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/read-receipts/high-level.spec.ts:105:24
|
Slow Test:
matrix-react-sdk/read-receipts/new-messages-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/new-messages-in-threads.spec.ts took 2.6m
|
Slow Test:
matrix-react-sdk/read-receipts/new-messages-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/new-messages-main-timeline.spec.ts took 1.9m
|
Slow Test:
matrix-react-sdk/read-receipts/new-messages-thread-roots.spec.ts#L1
matrix-react-sdk/read-receipts/new-messages-thread-roots.spec.ts took 55.3s
|
Slow Test:
matrix-react-sdk/timeline/timeline.spec.ts#L1
matrix-react-sdk/timeline/timeline.spec.ts took 3.7m
|
Slow Test:
matrix-react-sdk/spotlight/spotlight.spec.ts#L1
matrix-react-sdk/spotlight/spotlight.spec.ts took 2.9m
|
Slow Test:
matrix-react-sdk/threads/threads.spec.ts#L1
matrix-react-sdk/threads/threads.spec.ts took 1.0m
|
Slow Test:
matrix-react-sdk/user-onboarding/user-onboarding-new.spec.ts#L1
matrix-react-sdk/user-onboarding/user-onboarding-new.spec.ts took 38.7s
|
Slow Test:
matrix-react-sdk/widgets/layout.spec.ts#L1
matrix-react-sdk/widgets/layout.spec.ts took 29.2s
|
Slow Test:
matrix-react-sdk/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
matrix-react-sdk/spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.8m
|
Slow Test:
matrix-react-sdk/spaces/spaces.spec.ts#L1
matrix-react-sdk/spaces/spaces.spec.ts took 1.4m
|
Slow Test:
matrix-react-sdk/right-panel/right-panel.spec.ts#L1
matrix-react-sdk/right-panel/right-panel.spec.ts took 1.3m
|
Slow Test:
matrix-react-sdk/settings/general-user-settings-tab.spec.ts#L1
matrix-react-sdk/settings/general-user-settings-tab.spec.ts took 55.2s
|
Slow Test:
matrix-react-sdk/right-panel/file-panel.spec.ts#L1
matrix-react-sdk/right-panel/file-panel.spec.ts took 53.5s
|
Slow Test:
matrix-react-sdk/read-receipts/redactions-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/redactions-in-threads.spec.ts took 3.3m
|
Slow Test:
matrix-react-sdk/read-receipts/redactions-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/redactions-main-timeline.spec.ts took 2.7m
|
Slow Test:
matrix-react-sdk/read-receipts/reactions-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/reactions-in-threads.spec.ts took 1.5m
|
Slow Test:
matrix-react-sdk/read-receipts/redactions-thread-roots.spec.ts#L1
matrix-react-sdk/read-receipts/redactions-thread-roots.spec.ts took 1.2m
|
Slow Test:
matrix-react-sdk/read-receipts/reactions-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/reactions-main-timeline.spec.ts took 1.0m
|
Slow Test:
matrix-react-sdk/audio-player/audio-player.spec.ts#L1
matrix-react-sdk/audio-player/audio-player.spec.ts took 1.8m
|
Slow Test:
matrix-react-sdk/crypto/crypto.spec.ts#L1
matrix-react-sdk/crypto/crypto.spec.ts took 1.5m
|
Slow Test:
matrix-react-sdk/crypto/decryption-failure-messages.spec.ts#L1
matrix-react-sdk/crypto/decryption-failure-messages.spec.ts took 1.3m
|
Slow Test:
matrix-react-sdk/crypto/device-verification.spec.ts#L1
matrix-react-sdk/crypto/device-verification.spec.ts took 1.1m
|
Slow Test:
matrix-react-sdk/crypto/event-shields.spec.ts#L1
matrix-react-sdk/crypto/event-shields.spec.ts took 1.1m
|
Slow Test:
matrix-react-sdk/read-receipts/editing-messages-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/editing-messages-main-timeline.spec.ts took 1.6m
|
Slow Test:
matrix-react-sdk/read-receipts/editing-messages-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/editing-messages-in-threads.spec.ts took 1.6m
|
Slow Test:
matrix-react-sdk/login/login.spec.ts#L1
matrix-react-sdk/login/login.spec.ts took 53.1s
|
Slow Test:
matrix-react-sdk/integration-manager/send_event.spec.ts#L1
matrix-react-sdk/integration-manager/send_event.spec.ts took 52.4s
|
Slow Test:
matrix-react-sdk/integration-manager/read_events.spec.ts#L1
matrix-react-sdk/integration-manager/read_events.spec.ts took 52.0s
|
🎭 Playwright Run Summary
43 skipped
23 passed (2.9m)
|
🎭 Playwright Run Summary
1 flaky
user-view/user-view.spec.ts:25:9 › UserView › should render the user view as expected ──────────
4 skipped
55 passed (5.8m)
|
🎭 Playwright Run Summary
9 skipped
69 passed (6.8m)
|
🎭 Playwright Run Summary
1 flaky
read-receipts/read-receipts.spec.ts:229:9 › Read receipts › Recognises unread messages on a thread after receiving a unthreaded receipt for earlier ones
3 skipped
60 passed (7.2m)
|
🎭 Playwright Run Summary
1 skipped
72 passed (8.0m)
|
🎭 Playwright Run Summary
3 flaky
knock/knock-into-room.spec.ts:213:9 › Knock Into Room › should knock into the room and knock is cancelled by user himself
read-receipts/editing-messages-thread-roots.spec.ts:98:17 › Read receipts › editing messages › thread roots › Marking a room as read after an edit of a thread root keeps it read
read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read
2 skipped
71 passed (11.3m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-1
Expired
|
735 KB |
|
all-blob-reports-2
Expired
|
16.9 MB |
|
all-blob-reports-3
Expired
|
201 KB |
|
all-blob-reports-4
Expired
|
3.87 MB |
|
all-blob-reports-5
Expired
|
526 KB |
|
all-blob-reports-6
Expired
|
2.57 MB |
|
html-report
Expired
|
22.7 MB |
|
webapp
Expired
|
38.3 MB |
|