Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/manage_exceptions·cy·ts - Add, edit and delete exception Add, Edit and delete Exception item "before each" hook for "should create exception item from Shared Exception List page and linked to a Rule" "before each" hook for "should create exception item from Shared Exception List page and linked to a Rule" #165795

Closed
kibanamachine opened this issue Sep 6, 2023 · 3 comments
Closed

Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/manage_exceptions·cy·ts - Add, edit and delete exception Add, Edit and delete Exception item "before each" hook for "should create exception item from Shared Exception List page and linked to a Rule" "before each" hook for "should create exception item from Shared Exception List page and linked to a Rule" #165795

kibanamachine opened this issue Sep 6, 2023 · 3 comments
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Detection Engine Security Solution Detection Engine Area

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Sep 6, 2023 •
edited
Loading

A test failed on a tracked branch

CypressError: `cy.request()` timed out waiting `30000ms` for a response from your server.

The request we sent was:

Method: POST
URL: https://localhost:5634/internal/security/login

No response was received within the timeout.

This error occurred while creating the session. Because the session setup failed, we failed the test.

https://on.cypress.io/request

Because this error occurred during a `before each` hook we are skipping the remaining tests in the current suite: `Add, edit and delete exception`
    at <unknown> (https://localhost:5634/__cypress/runner/cypress_runner.js:149171:78)
    at tryCatcher (https://localhost:5634/__cypress/runner/cypress_runner.js:18744:23)
    at <unknown> (https://localhost:5634/__cypress/runner/cypress_runner.js:13866:41)
    at tryCatcher (https://localhost:5634/__cypress/runner/cypress_runner.js:18744:23)
    at Promise._settlePromiseFromHandler (https://localhost:5634/__cypress/runner/cypress_runner.js:16679:31)
    at Promise._settlePromise (https://localhost:5634/__cypress/runner/cypress_runner.js:16736:18)
    at Promise._settlePromise0 (https://localhost:5634/__cypress/runner/cypress_runner.js:16781:10)
    at Promise._settlePromises (https://localhost:5634/__cypress/runner/cypress_runner.js:16857:18)
    at _drainQueueStep (https://localhost:5634/__cypress/runner/cypress_runner.js:13451:12)
    at _drainQueue (https://localhost:5634/__cypress/runner/cypress_runner.js:13444:9)
    at ../../node_modules/bluebird/js/release/async.js.Async._drainQueues (https://localhost:5634/__cypress/runner/cypress_runner.js:13460:5)
    at Async.drainQueues (https://localhost:5634/__cypress/runner/cypress_runner.js:13330:14)
From Your Spec Code:
    at Object.eval [as setup] (webpack:///./tasks/login.ts:235:7)

First failure: CI Build - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Sep 6, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Sep 6, 2023
@kibanamachine kibanamachine added the Team:Detection Engine Security Solution Detection Engine Area label Sep 6, 2023
@botelastic botelastic bot removed the needs-team Issues missing a team label label Sep 6, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

mistic added a commit that referenced this issue Sep 6, 2023
@mistic
skip flaky suite (#165795)
ecc372d
@mistic
Copy link
Member

mistic commented Sep 6, 2023

Skipped.

main: ecc372d

@jpdjere jpdjere mentioned this issue Oct 18, 2023
Merged
@jpdjere
Copy link
Contributor

jpdjere commented Oct 19, 2023

Flakiness investigated as part of: #169182

Flaky test runner shows no real flakiness for this test on 200 runs. Closing issue assuming reported flakiness was due to infra issue or unexpected and non-repeatable Kibana timeout.

@jpdjere jpdjere closed this as completed Oct 19, 2023
jpdjere added a commit that referenced this issue Nov 3, 2023
@jpdjere
[Security Solution] Unskip and enable for Serverless `shared_exceptio…
c0c7d13 
…n_lists_management` Cypress tests (#169182)

## Summary

Running flaky test runner for:
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management`

## Changes

-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/list_detail_page/list_details.cy.ts`
**enabled on Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/manage_exceptions.cy.ts`
**enabled on Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/manage_exceptions.cy.ts`
**enabled on Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/filter_table.cy.ts`
**enabled on Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/import_lists.cy.ts`
**enabled on Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/manage_lists.cy.ts`
**unskipped and enabled in Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/read_only.cy.ts`
**removed from Serverless testing**


## Related failing-test issues
1. #165874
2. #165838
3. #165795
4. #165743 - **Closed as
duplicate of _#165640**
5. #165690
6. #165640

### Flaky test runner link

-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3557#_
(Only ESS) 🟢
-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3564#_
(ESS and Serverless)
-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3613
(Serverless evaluated and corrected)
-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3878
[V3]
-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3891
[V4]
jpdjere added a commit to jpdjere/kibana that referenced this issue Nov 6, 2023
@jpdjere
[Security Solution] Unskip and enable for Serverless `shared_exceptio…
a2c3aec 
…n_lists_management` Cypress tests (elastic#169182)

## Summary

Running flaky test runner for:
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management`

## Changes

-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/list_detail_page/list_details.cy.ts`
**enabled on Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/manage_exceptions.cy.ts`
**enabled on Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/manage_exceptions.cy.ts`
**enabled on Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/filter_table.cy.ts`
**enabled on Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/import_lists.cy.ts`
**enabled on Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/manage_lists.cy.ts`
**unskipped and enabled in Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/read_only.cy.ts`
**removed from Serverless testing**

## Related failing-test issues
1. elastic#165874
2. elastic#165838
3. elastic#165795
4. elastic#165743 - **Closed as
duplicate of _#165640**
5. elastic#165690
6. elastic#165640

### Flaky test runner link

-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3557#_
(Only ESS) 🟢
-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3564#_
(ESS and Serverless)
-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3613
(Serverless evaluated and corrected)
-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3878
[V3]
-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3891
[V4]

(cherry picked from commit c0c7d13)

# Conflicts:
#	x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/list_detail_page/list_details.cy.ts
#	x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/manage_exceptions.cy.ts
#	x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/manage_lists.cy.ts
#	x-pack/test/security_solution_cypress/package.json
jpdjere referenced this issue Nov 6, 2023
@jpdjere
[8.11] [Security Solution] Unskip and enable for Serverless `shared_e…
0dec28c 
…xception_lists_management` Cypress tests (#169182) (#170669)

# Backport

This will backport the following commits from `main` to `8.11`:
- [[Security Solution] Unskip and enable for Serverless
`shared_exception_lists_management` Cypress tests
(#169182)](#169182)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Juan Pablo
Djeredjian","email":"[email protected]"},"sourceCommit":{"committedDate":"2023-11-03T22:35:09Z","message":"[Security
Solution] Unskip and enable for Serverless
`shared_exception_lists_management` Cypress tests (#169182)\n\n##
Summary\r\n\r\nRunning flaky test runner
for:\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management`\r\n\r\n##
Changes\r\n\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/list_detail_page/list_details.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/manage_exceptions.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/manage_exceptions.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/filter_table.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/import_lists.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/manage_lists.cy.ts`\r\n**unskipped
and enabled in
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/read_only.cy.ts`\r\n**removed
from Serverless testing**\r\n\r\n\r\n## Related failing-test
issues\r\n1. https://github.com/elastic/kibana/issues/165874\r\n2.
https://github.com/elastic/kibana/issues/165838\r\n3.
https://github.com/elastic/kibana/issues/165795\r\n4.
#165743 - **Closed
as\r\nduplicate of _#165640**\r\n5.
https://github.com/elastic/kibana/issues/165690\r\n6.
https://github.com/elastic/kibana/issues/165640\r\n\r\n### Flaky test
runner
link\r\n\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3557#_\r\n(Only
ESS)
🟢\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3564#_\r\n(ESS
and
Serverless)\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3613\r\n(Serverless
evaluated and
corrected)\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3878\r\n[V3]\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3891\r\n[V4]","sha":"c0c7d1365f9e034128de8cbb03ac5733aefcd22f","branchLabelMapping":{"^v8.12.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:fix","Team:Detections
and Resp","Team:Detection
Engine","v8.11.0","v8.12.0"],"number":169182,"url":"https://github.com/elastic/kibana/pull/169182","mergeCommit":{"message":"[Security
Solution] Unskip and enable for Serverless
`shared_exception_lists_management` Cypress tests (#169182)\n\n##
Summary\r\n\r\nRunning flaky test runner
for:\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management`\r\n\r\n##
Changes\r\n\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/list_detail_page/list_details.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/manage_exceptions.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/manage_exceptions.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/filter_table.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/import_lists.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/manage_lists.cy.ts`\r\n**unskipped
and enabled in
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/read_only.cy.ts`\r\n**removed
from Serverless testing**\r\n\r\n\r\n## Related failing-test
issues\r\n1. https://github.com/elastic/kibana/issues/165874\r\n2.
https://github.com/elastic/kibana/issues/165838\r\n3.
https://github.com/elastic/kibana/issues/165795\r\n4.
#165743 - **Closed
as\r\nduplicate of _#165640**\r\n5.
https://github.com/elastic/kibana/issues/165690\r\n6.
https://github.com/elastic/kibana/issues/165640\r\n\r\n### Flaky test
runner
link\r\n\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3557#_\r\n(Only
ESS)
🟢\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3564#_\r\n(ESS
and
Serverless)\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3613\r\n(Serverless
evaluated and
corrected)\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3878\r\n[V3]\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3891\r\n[V4]","sha":"c0c7d1365f9e034128de8cbb03ac5733aefcd22f"}},"sourceBranch":"main","suggestedTargetBranches":["8.11"],"targetPullRequestStates":[{"branch":"8.11","label":"v8.11.0","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v8.12.0","labelRegex":"^v8.12.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/169182","number":169182,"mergeCommit":{"message":"[Security
Solution] Unskip and enable for Serverless
`shared_exception_lists_management` Cypress tests (#169182)\n\n##
Summary\r\n\r\nRunning flaky test runner
for:\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management`\r\n\r\n##
Changes\r\n\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/list_detail_page/list_details.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/manage_exceptions.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/manage_exceptions.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/filter_table.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/import_lists.cy.ts`\r\n**enabled
on
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/manage_lists.cy.ts`\r\n**unskipped
and enabled in
Serverless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/exceptions/shared_exception_lists_management/shared_exception_list_page/read_only.cy.ts`\r\n**removed
from Serverless testing**\r\n\r\n\r\n## Related failing-test
issues\r\n1. https://github.com/elastic/kibana/issues/165874\r\n2.
https://github.com/elastic/kibana/issues/165838\r\n3.
https://github.com/elastic/kibana/issues/165795\r\n4.
#165743 - **Closed
as\r\nduplicate of _#165640**\r\n5.
https://github.com/elastic/kibana/issues/165690\r\n6.
https://github.com/elastic/kibana/issues/165640\r\n\r\n### Flaky test
runner
link\r\n\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3557#_\r\n(Only
ESS)
🟢\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3564#_\r\n(ESS
and
Serverless)\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3613\r\n(Serverless
evaluated and
corrected)\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3878\r\n[V3]\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3891\r\n[V4]","sha":"c0c7d1365f9e034128de8cbb03ac5733aefcd22f"}}]}]
BACKPORT-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Detection Engine Security Solution Detection Engine Area
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@mistic @jpdjere @kibanamachine