Skip to content
This repository has been archived by the owner on Sep 11, 2024. It is now read-only.

End to End Tests #11026

End to End Tests

End to End Tests #11026

Triggered via merge group July 24, 2024 11:13
Status Success
Total duration 15m 48s
Artifacts 8

end-to-end-tests.yaml

on: merge_group
Build Element-Web
2m 22s
Build Element-Web
Matrix: playwright
end-to-end-tests
31s
end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

11 errors, 28 warnings, and 6 notices
user-view/user-view.spec.ts:25:9 › UserView › should render the user view as expected: matrix-react-sdk/playwright/e2e/user-view/user-view.spec.ts#L31
1) user-view/user-view.spec.ts:25:9 › UserView › should render the user view as expected ───────── Error: Screenshot comparison failed: 76 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/user-view/user-view.spec.ts/user-info-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/user-view-user-view-UserVi-3a259-r-the-user-view-as-expected/user-info-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/user-view-user-view-UserVi-3a259-r-the-user-view-as-expected/user-info-diff.png Call log: - expect.toHaveScreenshot(user-info.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('#mx_RightPanel') - locator resolved to <aside id="mx_RightPanel" class="mx_RightPanel">…</aside> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 76 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('#mx_RightPanel') - locator resolved to <aside id="mx_RightPanel" class="mx_RightPanel">…</aside> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 76 pixels (ratio 0.01 of all image pixels) are different. 29 | await expect(rightPanel.getByRole("heading", { name: bot.credentials.displayName, exact: true })).toBeVisible(); 30 | await expect(rightPanel.getByText("1 session")).toBeVisible(); > 31 | await expect(rightPanel).toMatchScreenshot("user-info.png", { | ^ 32 | mask: [page.locator(".mx_UserInfo_profile_mxid")], 33 | }); 34 | }); at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/user-view/user-view.spec.ts:31:34
read-receipts/read-receipts.spec.ts:229:9 › Read receipts › Recognises unread messages on a thread after receiving a unthreaded receipt for earlier ones: matrix-react-sdk/playwright/e2e/read-receipts/read-receipts.spec.ts#L92
1) read-receipts/read-receipts.spec.ts:229:9 › Read receipts › Recognises unread messages on a thread after receiving a unthreaded receipt for earlier ones Test timeout of 30000ms exceeded while running "beforeEach" hook. 90 | }; 91 | > 92 | test.beforeEach(async ({ page, app, user, bot }) => { | ^ 93 | /* 94 | * Create 2 rooms: 95 | * at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/read-receipts/read-receipts.spec.ts:92:10
read-receipts/read-receipts.spec.ts:229:9 › Read receipts › Recognises unread messages on a thread after receiving a unthreaded receipt for earlier ones: matrix-react-sdk/playwright/element-web-test.ts#L230
1) read-receipts/read-receipts.spec.ts:229:9 › Read receipts › Recognises unread messages on a thread after receiving a unthreaded receipt for earlier ones Error: page.waitForSelector: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_MatrixChat') to be visible at ../element-web-test.ts:230 228 | user: async ({ pageWithCredentials: page, credentials }, use) => { 229 | await page.goto("/"); > 230 | await page.waitForSelector(".mx_MatrixChat", { timeout: 30000 }); | ^ 231 | await use(credentials); 232 | }, 233 | at Object.user (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/element-web-test.ts:230:20)
knock/knock-into-room.spec.ts:213:9 › Knock Into Room › should knock into the room and knock is cancelled by user himself: matrix-react-sdk/playwright/e2e/knock/knock-into-room.spec.ts#L1
1) knock/knock-into-room.spec.ts:213:9 › Knock Into Room › should knock into the room and knock is cancelled by user himself Test timeout of 30000ms exceeded while setting up "user".
knock/knock-into-room.spec.ts:213:9 › Knock Into Room › should knock into the room and knock is cancelled by user himself: matrix-react-sdk/playwright/element-web-test.ts#L230
1) knock/knock-into-room.spec.ts:213:9 › Knock Into Room › should knock into the room and knock is cancelled by user himself Error: page.waitForSelector: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_MatrixChat') to be visible at ../element-web-test.ts:230 228 | user: async ({ pageWithCredentials: page, credentials }, use) => { 229 | await page.goto("/"); > 230 | await page.waitForSelector(".mx_MatrixChat", { timeout: 30000 }); | ^ 231 | await use(credentials); 232 | }, 233 | at Object.user (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/element-web-test.ts:230:20)
read-receipts/editing-messages-thread-roots.spec.ts:98:17 › Read receipts › editing messages › thread roots › Marking a room as read after an edit of a thread root keeps it read: matrix-react-sdk/playwright/e2e/read-receipts/editing-messages-thread-roots.spec.ts#L1
2) read-receipts/editing-messages-thread-roots.spec.ts:98:17 › Read receipts › editing messages › thread roots › Marking a room as read after an edit of a thread root keeps it read Test timeout of 30000ms exceeded while setting up "user".
read-receipts/editing-messages-thread-roots.spec.ts:98:17 › Read receipts › editing messages › thread roots › Marking a room as read after an edit of a thread root keeps it read: matrix-react-sdk/playwright/element-web-test.ts#L230
2) read-receipts/editing-messages-thread-roots.spec.ts:98:17 › Read receipts › editing messages › thread roots › Marking a room as read after an edit of a thread root keeps it read Error: page.waitForSelector: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_MatrixChat') to be visible at ../element-web-test.ts:230 228 | user: async ({ pageWithCredentials: page, credentials }, use) => { 229 | await page.goto("/"); > 230 | await page.waitForSelector(".mx_MatrixChat", { timeout: 30000 }); | ^ 231 | await use(credentials); 232 | }, 233 | at Object.user (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/element-web-test.ts:230:20)
read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read: matrix-react-sdk/playwright/e2e/read-receipts/high-level.spec.ts#L1
3) read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read Test timeout of 30000ms exceeded.
read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read: matrix-react-sdk/playwright/e2e/read-receipts/index.ts#L429
3) read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read Error: expect.not.toBeVisible: Target page, context or browser has been closed at read-receipts/index.ts:429 427 | */ 428 | async assertMessageNotLoaded(messagePart: string) { > 429 | await expect(this.page.locator(".mx_EventTile_body").getByText(messagePart)).not.toBeVisible(); | ^ 430 | } 431 | 432 | /** at Helpers.assertMessageNotLoaded (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/read-receipts/index.ts:429:90) at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/read-receipts/high-level.spec.ts:106:24
read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read: matrix-react-sdk/playwright/e2e/read-receipts/high-level.spec.ts#L1
3) read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read: matrix-react-sdk/playwright/pages/ElementAppPage.ts#L100
3) read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('tree', { name: 'Rooms' }).locator('[title="Room Beta"],[aria-label="Room Beta"]').first() - locator resolved to <div tabindex="-1" role="treeitem" aria-selected="false" aria-label="Room Beta" class="mx_AccessibleButton mx_RoomTile">…</div> - attempting click action - waiting for element to be visible, enabled and stable at ../pages/ElementAppPage.ts:100 98 | .locator(`[title="${name}"],[aria-label="${name}"]`) 99 | .first() > 100 | .click(); | ^ 101 | } 102 | 103 | public async viewRoomById(roomId: string): Promise<void> { at ElementAppPage.viewRoomByName (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/pages/ElementAppPage.ts:100:14) at Helpers.goTo (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/read-receipts/index.ts:378:24) at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/read-receipts/high-level.spec.ts:105:24
Slow Test: matrix-react-sdk/read-receipts/new-messages-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/new-messages-in-threads.spec.ts took 2.6m
Slow Test: matrix-react-sdk/read-receipts/new-messages-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/new-messages-main-timeline.spec.ts took 1.9m
Slow Test: matrix-react-sdk/read-receipts/new-messages-thread-roots.spec.ts#L1
matrix-react-sdk/read-receipts/new-messages-thread-roots.spec.ts took 55.3s
Slow Test: matrix-react-sdk/timeline/timeline.spec.ts#L1
matrix-react-sdk/timeline/timeline.spec.ts took 3.7m
Slow Test: matrix-react-sdk/spotlight/spotlight.spec.ts#L1
matrix-react-sdk/spotlight/spotlight.spec.ts took 2.9m
Slow Test: matrix-react-sdk/threads/threads.spec.ts#L1
matrix-react-sdk/threads/threads.spec.ts took 1.0m
Slow Test: matrix-react-sdk/user-onboarding/user-onboarding-new.spec.ts#L1
matrix-react-sdk/user-onboarding/user-onboarding-new.spec.ts took 38.7s
Slow Test: matrix-react-sdk/widgets/layout.spec.ts#L1
matrix-react-sdk/widgets/layout.spec.ts took 29.2s
Slow Test: matrix-react-sdk/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
matrix-react-sdk/spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.8m
Slow Test: matrix-react-sdk/spaces/spaces.spec.ts#L1
matrix-react-sdk/spaces/spaces.spec.ts took 1.4m
Slow Test: matrix-react-sdk/right-panel/right-panel.spec.ts#L1
matrix-react-sdk/right-panel/right-panel.spec.ts took 1.3m
Slow Test: matrix-react-sdk/settings/general-user-settings-tab.spec.ts#L1
matrix-react-sdk/settings/general-user-settings-tab.spec.ts took 55.2s
Slow Test: matrix-react-sdk/right-panel/file-panel.spec.ts#L1
matrix-react-sdk/right-panel/file-panel.spec.ts took 53.5s
Slow Test: matrix-react-sdk/read-receipts/redactions-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/redactions-in-threads.spec.ts took 3.3m
Slow Test: matrix-react-sdk/read-receipts/redactions-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/redactions-main-timeline.spec.ts took 2.7m
Slow Test: matrix-react-sdk/read-receipts/reactions-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/reactions-in-threads.spec.ts took 1.5m
Slow Test: matrix-react-sdk/read-receipts/redactions-thread-roots.spec.ts#L1
matrix-react-sdk/read-receipts/redactions-thread-roots.spec.ts took 1.2m
Slow Test: matrix-react-sdk/read-receipts/reactions-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/reactions-main-timeline.spec.ts took 1.0m
Slow Test: matrix-react-sdk/audio-player/audio-player.spec.ts#L1
matrix-react-sdk/audio-player/audio-player.spec.ts took 1.8m
Slow Test: matrix-react-sdk/crypto/crypto.spec.ts#L1
matrix-react-sdk/crypto/crypto.spec.ts took 1.5m
Slow Test: matrix-react-sdk/crypto/decryption-failure-messages.spec.ts#L1
matrix-react-sdk/crypto/decryption-failure-messages.spec.ts took 1.3m
Slow Test: matrix-react-sdk/crypto/device-verification.spec.ts#L1
matrix-react-sdk/crypto/device-verification.spec.ts took 1.1m
Slow Test: matrix-react-sdk/crypto/event-shields.spec.ts#L1
matrix-react-sdk/crypto/event-shields.spec.ts took 1.1m
Slow Test: matrix-react-sdk/read-receipts/editing-messages-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/editing-messages-main-timeline.spec.ts took 1.6m
Slow Test: matrix-react-sdk/read-receipts/editing-messages-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/editing-messages-in-threads.spec.ts took 1.6m
Slow Test: matrix-react-sdk/login/login.spec.ts#L1
matrix-react-sdk/login/login.spec.ts took 53.1s
Slow Test: matrix-react-sdk/integration-manager/send_event.spec.ts#L1
matrix-react-sdk/integration-manager/send_event.spec.ts took 52.4s
Slow Test: matrix-react-sdk/integration-manager/read_events.spec.ts#L1
matrix-react-sdk/integration-manager/read_events.spec.ts took 52.0s
🎭 Playwright Run Summary
43 skipped 23 passed (2.9m)
🎭 Playwright Run Summary
1 flaky user-view/user-view.spec.ts:25:9 › UserView › should render the user view as expected ────────── 4 skipped 55 passed (5.8m)
🎭 Playwright Run Summary
9 skipped 69 passed (6.8m)
🎭 Playwright Run Summary
1 flaky read-receipts/read-receipts.spec.ts:229:9 › Read receipts › Recognises unread messages on a thread after receiving a unthreaded receipt for earlier ones 3 skipped 60 passed (7.2m)
🎭 Playwright Run Summary
1 skipped 72 passed (8.0m)
🎭 Playwright Run Summary
3 flaky knock/knock-into-room.spec.ts:213:9 › Knock Into Room › should knock into the room and knock is cancelled by user himself read-receipts/editing-messages-thread-roots.spec.ts:98:17 › Read receipts › editing messages › thread roots › Marking a room as read after an edit of a thread root keeps it read read-receipts/high-level.spec.ts:89:13 › Read receipts › Paging up › Paging up through old messages after a room is read leaves the room read 2 skipped 71 passed (11.3m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-1 Expired
735 KB
all-blob-reports-2 Expired
16.9 MB
all-blob-reports-3 Expired
201 KB
all-blob-reports-4 Expired
3.87 MB
all-blob-reports-5 Expired
526 KB
all-blob-reports-6 Expired
2.57 MB
html-report Expired
22.7 MB
webapp Expired
38.3 MB