Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry/multiple_conditions·cy·ts - Add multiple conditions and validate the generated exceptions Use multipe OR conditions and validate it generates multiple exceptions Use multipe OR conditions and validate it generates multiple exceptions #165652

Closed
kibanamachine opened this issue Sep 5, 2023 · 3 comments
Closed

Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry/multiple_conditions·cy·ts - Add multiple conditions and validate the generated exceptions Use multipe OR conditions and validate it generates multiple exceptions Use multipe OR conditions and validate it generates multiple exceptions #165652

kibanamachine opened this issue Sep 5, 2023 · 3 comments
Assignees
@yctercero
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Detection Engine Security Solution Detection Engine Area

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Sep 5, 2023 •
edited
Loading

A test failed on a tracked branch

CypressError: Timed out retrying after 150050ms: `cy.click()` failed because this element:

`<button type="button" class="euiButton css-8utmkn-euiButtonDisplay-m-defaultMinWidth-fill-primary" data-test-subj="addExceptionConfirmButton">...</button>`

is being covered by another element:

`<span class="css-1bascr2-euiButtonDisplayContent">See the...</span>`

Fix this problem, or use {force: true} to disable error checking.

https://on.cypress.io/element-cannot-be-interacted-with
    at ensureIsDescendent (https://localhost:5618/__cypress/runner/cypress_runner.js:139649:76)
    at ensureDescendents (https://localhost:5618/__cypress/runner/cypress_runner.js:139700:5)
    at ensureDescendentsAndScroll (https://localhost:5618/__cypress/runner/cypress_runner.js:139706:14)
    at ensureElIsNotCovered (https://localhost:5618/__cypress/runner/cypress_runner.js:139837:5)
    at runAllChecks (https://localhost:5618/__cypress/runner/cypress_runner.js:140017:52)
    at retryActionability (https://localhost:5618/__cypress/runner/cypress_runner.js:140054:16)
    at tryCatcher (https://localhost:5618/__cypress/runner/cypress_runner.js:18744:23)
    at Promise.attempt.Promise.try (https://localhost:5618/__cypress/runner/cypress_runner.js:16018:29)
    at whenStable (https://localhost:5618/__cypress/runner/cypress_runner.js:156168:65)
    at <unknown> (https://localhost:5618/__cypress/runner/cypress_runner.js:155609:14)
    at tryCatcher (https://localhost:5618/__cypress/runner/cypress_runner.js:18744:23)
    at Promise._settlePromiseFromHandler (https://localhost:5618/__cypress/runner/cypress_runner.js:16679:31)
    at Promise._settlePromise (https://localhost:5618/__cypress/runner/cypress_runner.js:16736:18)
    at Promise._settlePromise0 (https://localhost:5618/__cypress/runner/cypress_runner.js:16781:10)
    at Promise._settlePromises (https://localhost:5618/__cypress/runner/cypress_runner.js:16861:18)
    at Promise._fulfill (https://localhost:5618/__cypress/runner/cypress_runner.js:16805:18)
    at <unknown> (https://localhost:5618/__cypress/runner/cypress_runner.js:18419:46)
From Your Spec Code:
    at submitNewExceptionItem (webpack:///./tasks/exceptions.ts:180:22)
    at Context.eval (webpack:///./e2e/exceptions/entry/multiple_conditions.cy.ts:90:28)

First failure: CI Build - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Sep 5, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Sep 5, 2023
@kibanamachine kibanamachine added the Team:Detection Engine Security Solution Detection Engine Area label Sep 5, 2023
@botelastic botelastic bot removed the needs-team Issues missing a team label label Sep 5, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

mistic added a commit that referenced this issue Sep 6, 2023
@mistic
skip flaky suite (#165652)
308b50d
@mistic
Copy link
Member

mistic commented Sep 6, 2023

Skipped.

main: 308b50d

@maximpn maximpn self-assigned this Sep 17, 2023
@jpdjere jpdjere mentioned this issue Oct 18, 2023
Merged
@jpdjere
Copy link
Contributor

jpdjere commented Oct 19, 2023

Flakiness investigated as part of: #169211

Flaky test runner shows no flakiness for this test on 200 runs.

Closing issue but tagging @yctercero and @elastic/security-detection-engine team to keep an eye open on this issue in case it's reopened, since the error reported is not conclusively a CI/infra issue, and might need a fix for an edge case.

@jpdjere jpdjere closed this as completed Oct 19, 2023
jpdjere added a commit that referenced this issue Oct 24, 2023
@jpdjere
[Security Solution] Enable Serverless for exceptions/entry and `exc…
9a73009 
…eptions/rule_details_flow` Cypress tests (#169211)

## Summary

Flaky test runner for Cypress tests in:
- `x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry` 
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/rule_details_flow`

## Changes

-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry/use_value_list.cy.ts`
**enabled on Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry/multiple_conditions.cy.ts`
**enabled on Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/rule_details_flow/read_only_view.cy.ts`
**removed from Serverless testing**

## Related failing-test issues

### `exceptions/entry`
1. #165734
2. #165652
3. #165651

### `exceptions/rule_details_flow`
4. #165773
5. #165742
6. #165736
7. #163923
8. #164007
9. #169382
**Unreported flaky test that was discovered when investigating these
issues. Tagged as `legit-flake` and assigned to
@elastic/security-detection-engine**
10. #169274
**Flaky test reported by the Kibana machine while this investigation was
taking place.
Since the flaky test runner for the related tests detected flakiness for
the same test file (though not same test), I'm marking this as
legit-flake for it to be investigated.**

### Flaky test runner link

-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3577
-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3621
[SERVERLESS TAGS ADJUSTED]
kibanamachine pushed a commit to kibanamachine/kibana that referenced this issue Oct 24, 2023
@jpdjere
[Security Solution] Enable Serverless for exceptions/entry and `exc…
336ad3f 
…eptions/rule_details_flow` Cypress tests (elastic#169211)

## Summary

Flaky test runner for Cypress tests in:
- `x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry`
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/rule_details_flow`

## Changes

-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry/use_value_list.cy.ts`
**enabled on Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry/multiple_conditions.cy.ts`
**enabled on Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/rule_details_flow/read_only_view.cy.ts`
**removed from Serverless testing**

## Related failing-test issues

### `exceptions/entry`
1. elastic#165734
2. elastic#165652
3. elastic#165651

### `exceptions/rule_details_flow`
4. elastic#165773
5. elastic#165742
6. elastic#165736
7. elastic#163923
8. elastic#164007
9. elastic#169382
**Unreported flaky test that was discovered when investigating these
issues. Tagged as `legit-flake` and assigned to
@elastic/security-detection-engine**
10. elastic#169274
**Flaky test reported by the Kibana machine while this investigation was
taking place.
Since the flaky test runner for the related tests detected flakiness for
the same test file (though not same test), I'm marking this as
legit-flake for it to be investigated.**

### Flaky test runner link

-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3577
-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3621
[SERVERLESS TAGS ADJUSTED]

(cherry picked from commit 9a73009)
kibanamachine referenced this issue Oct 26, 2023
@kibanamachine @jpdjere
[8.11] [Security Solution] Enable Serverless for exceptions/entry a…
a0c37df 
…nd `exceptions/rule_details_flow` Cypress tests (#169211) (#169679)

# Backport

This will backport the following commits from `main` to `8.11`:
- [[Security Solution] Enable Serverless for `exceptions/entry` and
`exceptions/rule_details_flow` Cypress tests
(#169211)](#169211)

<!--- Backport version: 8.9.7 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Juan Pablo
Djeredjian","email":"[email protected]"},"sourceCommit":{"committedDate":"2023-10-24T16:04:12Z","message":"[Security
Solution] Enable Serverless for `exceptions/entry` and
`exceptions/rule_details_flow` Cypress tests (#169211)\n\n##
Summary\r\n\r\nFlaky test runner for Cypress tests in:\r\n-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry`
\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/rule_details_flow`\r\n\r\n##
Changes\r\n\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry/use_value_list.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry/multiple_conditions.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/rule_details_flow/read_only_view.cy.ts`\r\n**removed
from Serverless testing**\r\n\r\n## Related failing-test
issues\r\n\r\n### `exceptions/entry`\r\n1.
https://github.com/elastic/kibana/issues/165734\r\n2.
https://github.com/elastic/kibana/issues/165652\r\n3.
https://github.com/elastic/kibana/issues/165651\r\n\r\n###
`exceptions/rule_details_flow`\r\n4.
https://github.com/elastic/kibana/issues/165773\r\n5.
https://github.com/elastic/kibana/issues/165742\r\n6.
https://github.com/elastic/kibana/issues/165736\r\n7.
https://github.com/elastic/kibana/issues/163923\r\n8.
https://github.com/elastic/kibana/issues/164007\r\n9.
https://github.com/elastic/kibana/issues/169382\r\n**Unreported flaky
test that was discovered when investigating these\r\nissues. Tagged as
`legit-flake` and assigned
to\r\n@elastic/security-detection-engine**\r\n10.
https://github.com/elastic/kibana/issues/169274\r\n**Flaky test reported
by the Kibana machine while this investigation was\r\ntaking
place.\r\nSince the flaky test runner for the related tests detected
flakiness for\r\nthe same test file (though not same test), I'm marking
this as\r\nlegit-flake for it to be investigated.**\r\n\r\n### Flaky
test runner
link\r\n\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3577\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3621\r\n[SERVERLESS
TAGS
ADJUSTED]","sha":"9a73009c2b2effab436cae61735cccc79af1a21d","branchLabelMapping":{"^v8.12.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","Team:Detections
and Resp","Team:Detection
Engine","v8.11.0","v8.12.0"],"number":169211,"url":"https://github.com/elastic/kibana/pull/169211","mergeCommit":{"message":"[Security
Solution] Enable Serverless for `exceptions/entry` and
`exceptions/rule_details_flow` Cypress tests (#169211)\n\n##
Summary\r\n\r\nFlaky test runner for Cypress tests in:\r\n-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry`
\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/rule_details_flow`\r\n\r\n##
Changes\r\n\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry/use_value_list.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry/multiple_conditions.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/rule_details_flow/read_only_view.cy.ts`\r\n**removed
from Serverless testing**\r\n\r\n## Related failing-test
issues\r\n\r\n### `exceptions/entry`\r\n1.
https://github.com/elastic/kibana/issues/165734\r\n2.
https://github.com/elastic/kibana/issues/165652\r\n3.
https://github.com/elastic/kibana/issues/165651\r\n\r\n###
`exceptions/rule_details_flow`\r\n4.
https://github.com/elastic/kibana/issues/165773\r\n5.
https://github.com/elastic/kibana/issues/165742\r\n6.
https://github.com/elastic/kibana/issues/165736\r\n7.
https://github.com/elastic/kibana/issues/163923\r\n8.
https://github.com/elastic/kibana/issues/164007\r\n9.
https://github.com/elastic/kibana/issues/169382\r\n**Unreported flaky
test that was discovered when investigating these\r\nissues. Tagged as
`legit-flake` and assigned
to\r\n@elastic/security-detection-engine**\r\n10.
https://github.com/elastic/kibana/issues/169274\r\n**Flaky test reported
by the Kibana machine while this investigation was\r\ntaking
place.\r\nSince the flaky test runner for the related tests detected
flakiness for\r\nthe same test file (though not same test), I'm marking
this as\r\nlegit-flake for it to be investigated.**\r\n\r\n### Flaky
test runner
link\r\n\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3577\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3621\r\n[SERVERLESS
TAGS
ADJUSTED]","sha":"9a73009c2b2effab436cae61735cccc79af1a21d"}},"sourceBranch":"main","suggestedTargetBranches":["8.11"],"targetPullRequestStates":[{"branch":"8.11","label":"v8.11.0","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v8.12.0","labelRegex":"^v8.12.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/169211","number":169211,"mergeCommit":{"message":"[Security
Solution] Enable Serverless for `exceptions/entry` and
`exceptions/rule_details_flow` Cypress tests (#169211)\n\n##
Summary\r\n\r\nFlaky test runner for Cypress tests in:\r\n-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry`
\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/rule_details_flow`\r\n\r\n##
Changes\r\n\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry/use_value_list.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/entry/multiple_conditions.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/rule_details_flow/read_only_view.cy.ts`\r\n**removed
from Serverless testing**\r\n\r\n## Related failing-test
issues\r\n\r\n### `exceptions/entry`\r\n1.
https://github.com/elastic/kibana/issues/165734\r\n2.
https://github.com/elastic/kibana/issues/165652\r\n3.
https://github.com/elastic/kibana/issues/165651\r\n\r\n###
`exceptions/rule_details_flow`\r\n4.
https://github.com/elastic/kibana/issues/165773\r\n5.
https://github.com/elastic/kibana/issues/165742\r\n6.
https://github.com/elastic/kibana/issues/165736\r\n7.
https://github.com/elastic/kibana/issues/163923\r\n8.
https://github.com/elastic/kibana/issues/164007\r\n9.
https://github.com/elastic/kibana/issues/169382\r\n**Unreported flaky
test that was discovered when investigating these\r\nissues. Tagged as
`legit-flake` and assigned
to\r\n@elastic/security-detection-engine**\r\n10.
https://github.com/elastic/kibana/issues/169274\r\n**Flaky test reported
by the Kibana machine while this investigation was\r\ntaking
place.\r\nSince the flaky test runner for the related tests detected
flakiness for\r\nthe same test file (though not same test), I'm marking
this as\r\nlegit-flake for it to be investigated.**\r\n\r\n### Flaky
test runner
link\r\n\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3577\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3621\r\n[SERVERLESS
TAGS ADJUSTED]","sha":"9a73009c2b2effab436cae61735cccc79af1a21d"}}]}]
BACKPORT-->

Co-authored-by: Juan Pablo Djeredjian <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@yctercero yctercero

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Detection Engine Security Solution Detection Engine Area
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@maximpn @mistic @jpdjere @yctercero @kibanamachine