[Security Solution] Flaky test runner for sourcerer and overview Cypress tests

[jpdjere]

Summary

Flaky test runner for Cypress tests in:

• x-pack/test/security_solution_cypress/cypress/e2e/detection_response/sourcerer
• x-pack/test/security_solution_cypress/cypress/e2e/overview

Related failing-test issues

e2e/detection_response/sourcerer

1. Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/data_sources/sourcerer·cy·ts - Sourcerer Default scope "before each" hook for "correctly loads SIEM data view" "before each" hook for "correctly loads SIEM data view" #165766
2. Broken test: x-pack/test/security_solution_cypress/cypress/e2e/detection_response/sourcerer/sourcerer_timeline.cy.ts - Timeline scope  #169402
   Test reported as failing while running flaky-test-runner. Marked as legit-flake and assigned to @elastic/security-detection-engine

e2e/overview

4. Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/overview/cti_link_panel·cy·ts - CTI Link Panel renders disabled threat intel module as expected renders disabled threat intel module as expected #165765
   Marked as legit-flake
5. Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/overview/cti_link_panel·cy·ts - CTI Link Panel "before each" hook for "renders disabled threat intel module as expected" "before each" hook for "renders disabled threat intel module as expected" #165709
   Marked as legit-flake

Flaky test runner link

https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3591

[kibana-ci]

💔 Build Failed

• Buildkite Build
• Commit: 7f3fe7b
• Interpreting CI Failures

Failed CI Steps

• FTR Configs #53
• Serverless Security Cypress Tests #1
• Serverless Security Cypress Tests #1
• Serverless Security Cypress Tests #4
• Serverless Security Cypress Tests #4
• Security Solution Cypress Tests #1
• Security Solution Cypress Tests #1
• Security Solution Cypress Tests #5
• Security Solution Cypress Tests #5
• Investigations - Security Solution Cypress Tests #5
• Investigations - Security Solution Cypress Tests #5
• Security Solution Cypress tests, burning changed specs #1

Test Failures

• [job] [logs] Serverless Security Cypress Tests #1 / CTI Link Panel enabled threat intel module "before all" hook for "renders disabled dashboard module as expected when there are no events in the selected time period" "before all" hook for "renders disabled dashboard module as expected when there are no events in the selected time period"
• [job] [logs] Serverless Security Cypress Tests #1 / CTI Link Panel enabled threat intel module "before all" hook for "renders disabled dashboard module as expected when there are no events in the selected time period" "before all" hook for "renders disabled dashboard module as expected when there are no events in the selected time period"
• [job] [logs] Security Solution Cypress Tests #1 / CTI Link Panel enabled threat intel module renders dashboard module as expected when there are events in the selected time period renders dashboard module as expected when there are events in the selected time period
• [job] [logs] Security Solution Cypress Tests #1 / CTI Link Panel enabled threat intel module renders dashboard module as expected when there are events in the selected time period renders dashboard module as expected when there are events in the selected time period
• [job] [logs] FTR Configs #53 / index_patterns index_patterns/_fields_for_wildcard route filter fields can filter
• [job] [logs] Investigations - Security Solution Cypress Tests #5 / Timeline Discover ESQL State "before each" hook for "should remember columns when navigating away and back to discover " "before each" hook for "should remember columns when navigating away and back to discover "
• [job] [logs] Investigations - Security Solution Cypress Tests #5 / Timeline Discover ESQL State "before each" hook for "should remember columns when navigating away and back to discover " "before each" hook for "should remember columns when navigating away and back to discover "
• [job] [logs] Serverless Security Cypress Tests #4 / Timeline scope Alerts checkbox alerts checkbox behaves as expected alerts checkbox behaves as expected
• [job] [logs] Security Solution Cypress Tests #5 / Timeline scope Alerts checkbox alerts checkbox behaves as expected alerts checkbox behaves as expected
• [job] [logs] Security Solution Cypress Tests #5 / Timeline scope Alerts checkbox alerts checkbox behaves as expected alerts checkbox behaves as expected
• [job] [logs] Serverless Security Cypress Tests #4 / Timeline scope Alerts checkbox alerts checkbox behaves as expected alerts checkbox behaves as expected
• [job] [logs] Serverless Security Cypress Tests #4 / Timeline scope Modified badge Selecting new data view does not add a modified badge Selecting new data view does not add a modified badge
• [job] [logs] Security Solution Cypress Tests #5 / Timeline scope Modified badge Selecting new data view does not add a modified badge Selecting new data view does not add a modified badge
• [job] [logs] Security Solution Cypress Tests #5 / Timeline scope Modified badge Selecting new data view does not add a modified badge Selecting new data view does not add a modified badge
• [job] [logs] Serverless Security Cypress Tests #4 / Timeline scope Modified badge Selecting new data view does not add a modified badge Selecting new data view does not add a modified badge
• [job] [logs] Serverless Security Cypress Tests #4 / Timeline scope Modified badge shows modified badge when index patterns change and removes when reset shows modified badge when index patterns change and removes when reset
• [job] [logs] Security Solution Cypress Tests #5 / Timeline scope Modified badge shows modified badge when index patterns change and removes when reset shows modified badge when index patterns change and removes when reset
• [job] [logs] Security Solution Cypress Tests #5 / Timeline scope Modified badge shows modified badge when index patterns change and removes when reset shows modified badge when index patterns change and removes when reset
• [job] [logs] Serverless Security Cypress Tests #4 / Timeline scope Modified badge shows modified badge when index patterns change and removes when reset shows modified badge when index patterns change and removes when reset

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

[jpdjere]

This PR doesn't need merging but contains important information about triaging of failing tests belonging to @elastic/security-detection-engine .

Closing.