Skip to content

E2E Tests on Atomic - All #169

E2E Tests on Atomic - All

E2E Tests on Atomic - All #169

Manually triggered February 6, 2025 20:00
Status Success
Total duration 32m 11s
Artifacts 1

e2e-tests-atomic.yml

on: workflow_dispatch
Matrix: wp-nightly-tests
Fit to window
Zoom out
Zoom in

Annotations

8 errors, 5 warnings, and 1 notice
[chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:71:9 › Saved cards › When using a 3ds card added on checkout › should process a payment with the saved card: tests/e2e-pw/utils/shopper.ts#L384
1) [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:71:9 › Saved cards › When using a 3ds card added on checkout › should process a payment with the saved card Error: Timed out 30000ms waiting for expect(locator).toHaveText(expected) Locator: locator('.cart-contents .count') Expected pattern: /1 items?/ Received string: "2 items" Call log: - expect.toHaveText with timeout 30000ms - waiting for locator('.cart-contents .count') 34 × locator resolved to <span class="count">2 items</span> - unexpected value "2 items" at ../utils/shopper.ts:384 382 | 383 | // Make sure the number of items in the cart is incremented before adding another item. > 384 | await expect( page.locator( '.cart-contents .count' ) ).toHaveText( | ^ 385 | new RegExp( `${ ++cartSize } items?` ), 386 | { 387 | timeout: 30000, at setupProductCheckout (/home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/utils/shopper.ts:384:60) at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:72:6
[chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:71:9 › Saved cards › When using a 3ds card added on checkout › should process a payment with the saved card: tests/e2e-pw/utils/shopper.ts#L575
1) [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:71:9 › Saved cards › When using a 3ds card added on checkout › should process a payment with the saved card Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 100ms waiting for expect(locator).toBeVisible() Locator: getByText('Visa ending in 3184 (expires 03/45)').first() Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 100ms - waiting for getByText('Visa ending in 3184 (expires 03/45)').first() at ../utils/shopper.ts:575 573 | ) 574 | .first(); > 575 | await expect( option ).toBeVisible( { timeout: 100 } ); | ^ 576 | await option.click(); 577 | }; 578 | at selectSavedCardOnCheckout (/home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/utils/shopper.ts:575:25) at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:73:37
[chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:71:9 › Saved cards › When using a 3ds card added on checkout › should process a payment with the saved card: tests/e2e-pw/utils/shopper.ts#L575
1) [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:71:9 › Saved cards › When using a 3ds card added on checkout › should process a payment with the saved card Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 100ms waiting for expect(locator).toBeVisible() Locator: getByText('Visa ending in 3184 (expires 03/45)').first() Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 100ms - waiting for getByText('Visa ending in 3184 (expires 03/45)').first() at ../utils/shopper.ts:575 573 | ) 574 | .first(); > 575 | await expect( option ).toBeVisible( { timeout: 100 } ); | ^ 576 | await option.click(); 577 | }; 578 | at selectSavedCardOnCheckout (/home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/utils/shopper.ts:575:25) at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:73:37
[chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:84:9 › Saved cards › When using a 3ds card added on checkout › should delete the card: tests/e2e-pw/utils/shopper.ts#L559
2) [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:84:9 › Saved cards › When using a 3ds card added on checkout › should delete the card Error: Timed out 100ms waiting for expect(locator).toBeVisible() Locator: getByRole('row', { name: 'Visa ending in 3184' }).first() Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 100ms - waiting for getByRole('row', { name: 'Visa ending in 3184' }).first() at ../utils/shopper.ts:559 557 | ) => { 558 | const row = page.getByRole( 'row', { name: card.label } ).first(); > 559 | await expect( row ).toBeVisible( { timeout: 100 } ); | ^ 560 | const button = row.getByRole( 'link', { name: 'Delete' } ); 561 | await expect( button ).toBeVisible( { timeout: 100 } ); 562 | await expect( button ).toBeEnabled( { timeout: 100 } ); at deleteSavedCard (/home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/utils/shopper.ts:559:22) at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:86:27
[chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:84:9 › Saved cards › When using a 3ds card added on checkout › should delete the card: tests/e2e-pw/utils/shopper.ts#L559
2) [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:84:9 › Saved cards › When using a 3ds card added on checkout › should delete the card Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 100ms waiting for expect(locator).toBeVisible() Locator: getByRole('row', { name: 'Visa ending in 3184' }).first() Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 100ms - waiting for getByRole('row', { name: 'Visa ending in 3184' }).first() at ../utils/shopper.ts:559 557 | ) => { 558 | const row = page.getByRole( 'row', { name: card.label } ).first(); > 559 | await expect( row ).toBeVisible( { timeout: 100 } ); | ^ 560 | const button = row.getByRole( 'link', { name: 'Delete' } ); 561 | await expect( button ).toBeVisible( { timeout: 100 } ); 562 | await expect( button ).toBeEnabled( { timeout: 100 } ); at deleteSavedCard (/home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/utils/shopper.ts:559:22) at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:86:27
[chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:84:9 › Saved cards › When using a 3ds card added on checkout › should delete the card: tests/e2e-pw/utils/shopper.ts#L559
2) [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:84:9 › Saved cards › When using a 3ds card added on checkout › should delete the card Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 100ms waiting for expect(locator).toBeVisible() Locator: getByRole('row', { name: 'Visa ending in 3184' }).first() Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 100ms - waiting for getByRole('row', { name: 'Visa ending in 3184' }).first() at ../utils/shopper.ts:559 557 | ) => { 558 | const row = page.getByRole( 'row', { name: card.label } ).first(); > 559 | await expect( row ).toBeVisible( { timeout: 100 } ); | ^ 560 | const button = row.getByRole( 'link', { name: 'Delete' } ); 561 | await expect( button ).toBeVisible( { timeout: 100 } ); 562 | await expect( button ).toBeEnabled( { timeout: 100 } ); at deleteSavedCard (/home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/utils/shopper.ts:559:22) at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:86:27
[chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-failures.spec.ts:24:6 › Shopper > Checkout > Failures with various cards › should throw an error that the card was simply declined: tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-failures.spec.ts#L18
3) [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-failures.spec.ts:24:6 › Shopper > Checkout > Failures with various cards › should throw an error that the card was simply declined Test timeout of 120000ms exceeded while running "beforeEach" hook. 16 | }; 17 | > 18 | test.beforeEach( async ( { page } ) => { | ^ 19 | await shopper.addToCartFromShopPage( page ); 20 | await shopper.setupCheckout( page ); 21 | await shopper.selectPaymentMethod( page ); at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-failures.spec.ts:18:7
[chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-failures.spec.ts:24:6 › Shopper > Checkout > Failures with various cards › should throw an error that the card was simply declined: tests/e2e-pw/utils/shopper.ts#L325
3) [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-failures.spec.ts:24:6 › Shopper > Checkout > Failures with various cards › should throw an error that the card was simply declined Error: locator.click: Test timeout of 120000ms exceeded. Call log: - waiting for getByLabel(/Add\s+(?:to\s+cart:\s*)?“Beanie”(?:\s+to\s+your\s+cart)?/) at ../utils/shopper.ts:325 323 | 324 | const addToCartButton = page.getByLabel( addToCartRegex ); > 325 | await addToCartButton.click(); | ^ 326 | 327 | try { 328 | await expect( addToCartButton ).toHaveAttribute( 'class', /added/, { at Object.addToCartFromShopPage (/home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/utils/shopper.ts:325:24) at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-failures.spec.ts:19:3
Slow Test: [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-myaccount-saved-cards.spec.ts#L1
[chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-myaccount-saved-cards.spec.ts took 3.1m
Slow Test: [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-purchase-site-editor.spec.ts#L1
[chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-purchase-site-editor.spec.ts took 1.6m
Slow Test: [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-bnpls-checkout.spec.ts#L1
[chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-bnpls-checkout.spec.ts took 1.2m
Slow Test: [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-purchase.spec.ts#L1
[chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-purchase.spec.ts took 1.1m
Slow Test: [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-wc-blocks-checkout-failures.spec.ts#L1
[chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-wc-blocks-checkout-failures.spec.ts took 1.1m
🎭 Playwright Run Summary
2 failed [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:71:9 › Saved cards › When using a 3ds card added on checkout › should process a payment with the saved card [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:84:9 › Saved cards › When using a 3ds card added on checkout › should delete the card 1 flaky [chromium] › tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-failures.spec.ts:24:6 › Shopper > Checkout > Failures with various cards › should throw an error that the card was simply declined 87 passed (31.3m)

Artifacts

Produced during runtime
Name Size
wp(nightly)-wc(latest)-wcpay-shopper
38.8 MB