chore(tests): add capturing and uploading of screen capture of ui tests #8338
benchmarking.yml
on: pull_request
Build app and test runner
6m 52s
Collect app metrics
12m 9s
Matrix: Run benchmarks on Sauce Labs
Annotations
26 errors and 4 warnings
SentrySpanTests.test_spanStart_profileStart_spanEnd_profileEnd_spanIncludesProfileID:
Tests/SentryTests/Transaction/SentrySpanTests.swift#L1
Restarting after unexpected exit, crash, or test timeout in SentrySpanTests.test_spanStart_profileStart_spanEnd_profileEnd_spanIncludesProfileID(); summary will include totals from previous launches.
|
SentryANRTrackerV2Tests.testFullyBlockingFollowedByFullyBlocking_BothReported:
Tests/SentryTests/Integrations/ANR/SentryANRTrackerV2Tests.swift#L1
[Sentry] [debug] [timeIntervalSince1970:1739981942.497878] [SentryANRTrackerV2:167] Ignoring app hang cause one happened recently./Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Integrations/ANR/SentryANRTrackerV2Tests.swift:276 - Asynchronous wait failed: Exceeded timeout of 1 seconds, with unfulfilled expectations: "Test Delegate ANR Detection".
|
SentryANRTrackerV2Tests.testFullyBlockingFollowedByFullyBlocking_BothReported:
Tests/SentryTests/Integrations/ANR/SentryANRTrackerV2Tests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Integrations/ANR/SentryANRTrackerV2Tests.swift:280 - Asynchronous wait failed: Exceeded timeout of 1 seconds, with unfulfilled expectations: "Test Delegate ANR Stopped".
|
SentryANRTrackerV2Tests.testFullyBlockingFollowedByFullyBlocking_BothReported:
Tests/SentryTests/Integrations/ANR/SentryANRTrackerV2Tests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Integrations/ANR/SentryANRTrackerV2Tests.swift:282 - Asynchronous wait failed: Exceeded timeout of 1 seconds, with unfulfilled expectations: "Test Delegate ANR Detection", "Test Delegate ANR Stopped".
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:898 - XCTAssertEqual failed: ("SentryFlushResult(rawValue: 1)") is not equal to ("SentryFlushResult(rawValue: 0)") - Flush should not time out.
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:900 - XCTAssertEqual failed: ("1") is not equal to ("0")
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:898 - XCTAssertEqual failed: ("SentryFlushResult(rawValue: 2)") is not equal to ("SentryFlushResult(rawValue: 0)") - Flush should not time out.
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:900 - XCTAssertEqual failed: ("2") is not equal to ("0")
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:898 - XCTAssertEqual failed: ("SentryFlushResult(rawValue: 2)") is not equal to ("SentryFlushResult(rawValue: 0)") - Flush should not time out.
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:900 - XCTAssertEqual failed: ("3") is not equal to ("0")
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:898 - XCTAssertEqual failed: ("SentryFlushResult(rawValue: 2)") is not equal to ("SentryFlushResult(rawValue: 0)") - Flush should not time out.
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:900 - XCTAssertEqual failed: ("4") is not equal to ("0")
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:898 - XCTAssertEqual failed: ("SentryFlushResult(rawValue: 2)") is not equal to ("SentryFlushResult(rawValue: 0)") - Flush should not time out.
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:900 - XCTAssertEqual failed: ("5") is not equal to ("0")
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:898 - XCTAssertEqual failed: ("SentryFlushResult(rawValue: 2)") is not equal to ("SentryFlushResult(rawValue: 0)") - Flush should not time out.
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:900 - XCTAssertEqual failed: ("6") is not equal to ("0")
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:898 - XCTAssertEqual failed: ("SentryFlushResult(rawValue: 2)") is not equal to ("SentryFlushResult(rawValue: 0)") - Flush should not time out.
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:900 - XCTAssertEqual failed: ("7") is not equal to ("0")
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:898 - XCTAssertEqual failed: ("SentryFlushResult(rawValue: 2)") is not equal to ("SentryFlushResult(rawValue: 0)") - Flush should not time out.
|
SentryHttpTransportTests.testFlush_CallingFlushDirectlyAfterCapture_Flushes:
Tests/SentryTests/Networking/SentryHttpTransportTests.swift#L1
/Users/runner/work/sentry-cocoa/sentry-cocoa/Tests/SentryTests/Networking/SentryHttpTransportTests.swift:900 - XCTAssertEqual failed: ("7") is not equal to ("0")
|
Run benchmarks on Sauce Labs (High-end device)
Canceling since a higher priority waiting request for 'Benchmarking-philprime/ui-test-automatic-capturing' exists
|
Run benchmarks on Sauce Labs (High-end device)
The operation was canceled.
|
Run benchmarks on Sauce Labs (Low-end device)
Canceling since a higher priority waiting request for 'Benchmarking-philprime/ui-test-automatic-capturing' exists
|
Run benchmarks on Sauce Labs (Low-end device)
The operation was canceled.
|
Run benchmarks on Sauce Labs (Mid-range device)
Canceling since a higher priority waiting request for 'Benchmarking-philprime/ui-test-automatic-capturing' exists
|
Run benchmarks on Sauce Labs (Mid-range device)
The operation was canceled.
|
Collect app metrics:
--- xcodebuild#L1
Using the first of multiple matching destinations:
|
Collect app metrics:
Sentry.xcodeproj#L1
The iOS deployment target 'IPHONEOS_DEPLOYMENT_TARGET' is set to 11.0, but the range of supported deployment target versions is 12.0 to 17.2.99. (in target 'Sentry' from project 'Sentry')
|
Collect app metrics:
--- xcodebuild#L1
Using the first of multiple matching destinations:
|
Collect app metrics:
Sentry.xcodeproj#L1
The iOS Simulator deployment target 'IPHONEOS_DEPLOYMENT_TARGET' is set to 11.0, but the range of supported deployment target versions is 12.0 to 17.2.99. (in target 'Sentry' from project 'Sentry')
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
DerivedData-Xcode
|
10.2 MB |
|
app-sdk-metrics-results
|
345 Bytes |
|