Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Keep running integration tests of modules without environment #18125

Merged
merged 3 commits into from
Apr 30, 2020

Conversation

jsoriano
Copy link
Member

Modules that don't define a local environment with docker compose or
kubernetes (kind) are not being executed. Fall back to the old default
of docker in that case.

Affected modules are the system modules, the stack ones (because they
use the docker compose defined in the beat directory) and cloud modules
(in #17480).

Continues with #17656, unblocks #17480.

Modules that don't define a local environment with docker compose or
kubernetes (kind) are not being executed. Fall back to the old default
of docker in that case.
@jsoriano jsoriano requested a review from blakerouse April 30, 2020 09:00
@jsoriano jsoriano self-assigned this Apr 30, 2020
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Apr 30, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-platforms (Team:Platforms)

@jsoriano jsoriano added needs_backport PR is waiting to be backported to other branches. v7.8.0 Team:Integrations Label for the Integrations team and removed Team:Platforms Label for the Integrations - Platforms team needs_team Indicates that the issue/PR needs a Team:* label labels Apr 30, 2020
@elasticmachine
Copy link
Collaborator

elasticmachine commented Apr 30, 2020

💔 Build Failed

Pipeline View Test View Changes Artifacts preview stats

Expand to view the summary

Build stats

Test stats 🧪

Test Results
Failed 2
Passed 7017
Skipped 1093
Total 8112

Test errors

Expand to view the tests failures

  • Name: Build and Test / Filebeat Mac OS X / test_clean_removed_with_clean_inactive – test_registrar.Test
    • Status: FAILED
    • Age: 1
    • Duration: 0.921
    • Error Details:
      -------------------- >> begin captured stdout << ---------------------
      registry size: 2
      registry size after remove: 2

--------------------- >> end captured stdout << ----------------------

  • Name: Build and Test / Filebeat x-pack / runTest – nose.failure.Failure

    • Status: FAILED
    • Age: 1
    • Duration: 0
    • Error Details: Cannot subscript an existing Union. Use Union[u, t] instead.

Steps errors

Expand to view the steps failures

  • Name: Report to Codecov

    • Description: curl -sSLo codecov https://codecov.io/bash for i in auditbeat filebeat heartbeat libbeat metricbeat packetbeat winlogbeat journalbeat do FILE="${i}/build/coverage/full.cov" if [ -f "${FILE}" ]; then bash codecov -f "${FILE}" fi done

    • Result: FAILURE

    • Duration: 2 min 23 sec<

    • Start Time: 2020-04-30T17:05:01.623+0000

  • Name: Mage update build test

    • Description: mage update build test

    • Result: FAILURE

    • Duration: 6 min 40 sec<

    • Start Time: 2020-04-30T17:30:47.368+0000

  • Name: Mage build unitTest

    • Description: mage build unitTest

    • Result: FAILURE

    • Duration: 7 min 38 sec<

    • Start Time: 2020-04-30T17:27:01.039+0000

  • Name: Make -C generator/_templates/metricbeat test

    • Description: make -C generator/_templates/metricbeat test

    • Result: FAILURE

    • Duration: 1 min 53 sec<

    • Start Time: 2020-04-30T17:30:43.486+0000

  • Name: Make -C generator/_templates/beat test

    • Description: make -C generator/_templates/beat test

    • Result: FAILURE

    • Duration: 2 min 40 sec<

    • Start Time: 2020-04-30T17:42:14.188+0000

  • Name: Make -C generator/_templates/metricbeat test

    • Description: make -C generator/_templates/metricbeat test

    • Result: FAILURE

    • Duration: 1 min 16 sec<

    • Start Time: 2020-04-30T17:54:27.815+0000

  • Name: Make -C generator/_templates/beat test

    • Description: make -C generator/_templates/beat test

    • Result: FAILURE

    • Duration: 7 min 46 sec<

    • Start Time: 2020-04-30T18:26:05.442+0000

Log output

Expand to view the last 100 lines of log output

[2020-04-30T18:36:40.815Z] [success] 15.43% test_base.Test.test_start_stop: 0.2656s
[2020-04-30T18:36:40.815Z] ----------------------------------------------------------------------
[2020-04-30T18:36:40.815Z] Ran 8 tests in 1.724s
[2020-04-30T18:36:40.815Z] 
[2020-04-30T18:36:40.815Z] OK (SKIP=6)
[2020-04-30T18:36:40.815Z] >> python test: Unit Testing Complete
[2020-04-30T18:36:40.887Z] Recording test results
[2020-04-30T18:36:46.241Z] Stashed 2 file(s)
[2020-04-30T18:36:46.252Z] Archiving artifacts
[2020-04-30T18:36:48.702Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats
[2020-04-30T18:36:49.033Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-04-30T18:36:49.050Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Lint
[2020-04-30T18:36:49.132Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Generators-Metricbeat-Linux
[2020-04-30T18:36:49.215Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Elastic-Agent-Mac-OS-X
[2020-04-30T18:36:49.303Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Elastic-Agent-x-pack
[2020-04-30T18:36:49.389Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Filebeat-Mac-OS-X
[2020-04-30T18:36:49.495Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Journalbeat-oss
[2020-04-30T18:36:49.575Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Winlogbeat-oss
[2020-04-30T18:36:49.661Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Elastic-Agent-x-pack-Windows
[2020-04-30T18:36:49.756Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Dockerlogbeat
[2020-04-30T18:36:49.856Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Functionbeat-x-pack
[2020-04-30T18:36:49.933Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Filebeat-x-pack
[2020-04-30T18:36:50.012Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-04-30T18:36:50.110Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Winlogbeat-Windows-x-pack
[2020-04-30T18:36:50.195Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Heartbeat-oss
[2020-04-30T18:36:50.277Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-04-30T18:36:50.374Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Auditbeat-x-pack
[2020-04-30T18:36:50.574Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Filebeat-Windows
[2020-04-30T18:36:50.720Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Libbeat-x-pack
[2020-04-30T18:36:50.819Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Generators-Beat-Linux
[2020-04-30T18:36:50.918Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Auditbeat-Linux
[2020-04-30T18:36:51.000Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-Windows
[2020-04-30T18:36:51.127Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Packetbeat-oss
[2020-04-30T18:36:51.245Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Auditbeat-crosscompile
[2020-04-30T18:36:51.414Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Heartbeat-Mac-OS-X
[2020-04-30T18:36:51.630Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Generators-Metricbeat-Mac-OS-X
[2020-04-30T18:36:51.762Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Winlogbeat-Windows
[2020-04-30T18:36:51.860Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Functionbeat-Mac-OS-X-x-pack
[2020-04-30T18:36:51.949Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Filebeat-oss
[2020-04-30T18:36:52.048Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-Mac-OS-X
[2020-04-30T18:36:52.151Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Libbeat-oss
[2020-04-30T18:36:52.271Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-Python-integration-tests
[2020-04-30T18:36:52.431Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Heartbeat-Windows
[2020-04-30T18:36:52.532Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Auditbeat-Mac-OS-X
[2020-04-30T18:36:52.673Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests
[2020-04-30T18:36:52.761Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-04-30T18:36:52.847Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Libbeat-crosscompile
[2020-04-30T18:36:52.941Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Libbeat-stress-tests
[2020-04-30T18:36:53.029Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Generators-Beat-Mac-OS-X
[2020-04-30T18:36:53.120Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Functionbeat-Windows
[2020-04-30T18:36:53.237Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Auditbeat-Windows
[2020-04-30T18:36:53.628Z] + cat
[2020-04-30T18:36:53.628Z] + /usr/local/bin/runbld ./runbld-script
[2020-04-30T18:36:53.628Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-04-30T18:37:00.364Z] runbld>>> runbld started
[2020-04-30T18:37:00.364Z] runbld>>> 1.6.11/a66728ff8f4356963772e6e6d2069392fa06acbe
[2020-04-30T18:37:01.749Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-18125' in order of occurrence in the config (last value wins).
[2020-04-30T18:37:03.140Z] runbld>>> Debug logging enabled.
[2020-04-30T18:37:03.140Z] runbld>>> Storing result
[2020-04-30T18:37:03.140Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-04-30T18:37:03.140Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200430183702-AF698139
[2020-04-30T18:37:03.140Z] runbld>>> Adding system facts.
[2020-04-30T18:37:04.096Z] runbld>>> Adding vcs info for the latest commit:  c29070d8c7ce023c03843ceb54001e72c0600223
[2020-04-30T18:37:04.096Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-04-30T18:37:04.096Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-04-30T18:37:04.096Z] Processing JUnit reports with runbld...
[2020-04-30T18:37:04.096Z] + echo 'Processing JUnit reports with runbld...'
[2020-04-30T18:37:04.670Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-04-30T18:37:04.670Z] runbld>>> DURATION: 16ms
[2020-04-30T18:37:04.670Z] runbld>>> STDOUT: 40 bytes
[2020-04-30T18:37:04.670Z] runbld>>> STDERR: 49 bytes
[2020-04-30T18:37:04.670Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-04-30T18:37:04.670Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats
[2020-04-30T18:37:06.058Z] runbld>>> Storing build metadata: 
[2020-04-30T18:37:06.058Z] runbld>>> Adding test report.
[2020-04-30T18:37:06.058Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats
[2020-04-30T18:37:07.013Z] runbld>>> Found 100 test output files
[2020-04-30T18:37:07.588Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-openmetrics.xml
[2020-04-30T18:37:07.588Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-istio.xml
[2020-04-30T18:37:07.588Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-iis.xml
[2020-04-30T18:37:07.588Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-activemq.xml
[2020-04-30T18:37:07.849Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-tomcat.xml
[2020-04-30T18:37:07.849Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-cloudfoundry.xml
[2020-04-30T18:37:08.438Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests/metricbeat/build/TEST-go-integration-windows.xml
[2020-04-30T18:37:08.438Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests/metricbeat/build/TEST-go-integration-graphite.xml
[2020-04-30T18:37:09.014Z] runbld>>> Test output logs contained: Errors: 1 Failures: 1 Tests: 7962 Skipped: 890
[2020-04-30T18:37:09.014Z] runbld>>> Storing result
[2020-04-30T18:37:09.014Z] runbld>>> FAILURES: 2
[2020-04-30T18:37:09.589Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-04-30T18:37:09.589Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200430183702-AF698139
[2020-04-30T18:37:09.589Z] runbld>>> Email notification disabled by environment variable.
[2020-04-30T18:37:09.589Z] runbld>>> Slack notification disabled by environment variable.
[2020-04-30T18:37:15.789Z] Running on worker-395930 in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18125
[2020-04-30T18:37:15.961Z] [INFO] getVaultSecret: Getting secrets
[2020-04-30T18:37:16.066Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-04-30T18:37:18.435Z] + chmod 755 generate-build-data.sh
[2020-04-30T18:37:18.436Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18125/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18125/runs/5 FAILURE 6900019
[2020-04-30T18:37:18.436Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18125/runs/5/steps/?limit=10000 -o steps-info.json
[2020-04-30T18:37:19.895Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18125/runs/5/tests/?status=FAILED -o tests-errors.json
[2020-04-30T18:37:22.187Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18125/runs/5/log/ -o pipeline-log.txt

@jsoriano jsoriano force-pushed the keep-support-modules-without-env branch from fee7c3c to 3c34a2b Compare April 30, 2020 14:45
Copy link
Contributor

@blakerouse blakerouse left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

@jsoriano
Copy link
Member Author

Failing tests are also failing in master, merging.

@jsoriano jsoriano merged commit b6ca76b into elastic:master Apr 30, 2020
@jsoriano jsoriano deleted the keep-support-modules-without-env branch April 30, 2020 18:50
@jsoriano jsoriano removed the needs_backport PR is waiting to be backported to other branches. label May 4, 2020
jsoriano added a commit to jsoriano/beats that referenced this pull request May 4, 2020
…c#18125)

Modules that don't define a local environment with docker compose or
kubernetes (kind) are not being executed. Fall back to the old default
of docker in that case.

(cherry picked from commit b6ca76b)
jsoriano added a commit that referenced this pull request May 5, 2020
#18162)

Modules that don't define a local environment with docker compose or
kubernetes (kind) are not being executed. Fall back to the old default
of docker in that case.

(cherry picked from commit b6ca76b)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants