Skip to content
This repository has been archived by the owner on Sep 17, 2024. It is now read-only.

fix: support selecting the platform in docker-compose #751

Merged
merged 5 commits into from
Feb 17, 2021

Conversation

mdelapenya
Copy link
Contributor

@mdelapenya mdelapenya commented Feb 17, 2021

What does this PR do?

It adds the platform element to the docker-compose files for metricbeat and the elastic-agent, so that we will be able to target AMD64 or ARM64 (last one in the near future). This change forced us to upgrade compose files versions from 2.3 to 2.4, which is the version where platform attribute appeared.

Because of that, all files in the execution must use the same version, so we are updating all compose files in consequence. And that means that when synchronising the Integrations from Beats, we must enforce the 2.4 version too.

Why is it important?

We want to make sure we consume the proper platform. After Beats creating ARM images, we need to make sure we consume the proper platform.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have run the Unit tests for the CLI, and they are passing locally
  • I have run the End-2-End tests for the suite I'm working on, and they are passing locally
  • I have noticed new Go dependencies (run make notice in the proper directory)

Author's Checklist

  • [ ]

How to test this PR locally

Related issues

@mdelapenya mdelapenya self-assigned this Feb 17, 2021
@mdelapenya mdelapenya requested a review from a team February 17, 2021 07:45
@elasticmachine
Copy link
Contributor

elasticmachine commented Feb 17, 2021

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: Pull request #751 updated

  • Start Time: 2021-02-17T09:26:09.237+0000

  • Duration: 29 min 31 sec

  • Commit: ebcdb92

Test stats 🧪

Test Results
Failed 1
Passed 116
Skipped 0
Total 117

Trends 🧪

Image of Build Times

Image of Tests

Test errors 1

Expand to view the tests failures

Initializing / End-To-End Tests / ubuntu-18.04_fleet_fleet_mode_agent / Restarting the centos host with persistent agent restarts backend processes – Fleet Mode Agent
    Expand to view the error details

     Step the "metricbeat" process is in the "started" state on the host 
    

  • no stacktrace

Steps errors 4

Expand to view the steps failures

Run functional tests for fleet:fleet_mode_agent && ~@nightly
  • Took 23 min 25 sec . View more details on here
  • Description: .ci/scripts/functional-test.sh "fleet" "fleet_mode_agent && ~@nightly" "8.0.0-SNAPSHOT" "8.0.0-SNAPSHOT"
Archive the artifacts
  • Took 0 min 1 sec . View more details on here
  • Description: [2021-02-17T09:54:36.759Z] Archiving artifacts script returned exit code 2
Archive the artifacts
  • Took 0 min 0 sec . View more details on here
  • Description: [2021-02-17T09:54:38.136Z] Archiving artifacts hudson.AbortException: script returned exit code 2
Error signal
  • Took 0 min 0 sec . View more details on here
  • Description: hudson.AbortException: script returned exit code 2

Log output

Expand to view the last 100 lines of log output

[2021-02-17T09:52:33.706Z] time="2021-02-17T09:52:32Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=8.794993474s hostname=3077ebcf05a0 isAgentInStatus=false retry=5 status=offline
[2021-02-17T09:52:35.611Z] time="2021-02-17T09:52:35Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:52:35.611Z] time="2021-02-17T09:52:35Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=11.388219584s hostname=3077ebcf05a0 isAgentInStatus=false retry=6 status=offline
[2021-02-17T09:52:38.142Z] time="2021-02-17T09:52:37Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:52:38.142Z] time="2021-02-17T09:52:37Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=14.074760285s hostname=3077ebcf05a0 isAgentInStatus=false retry=7 status=offline
[2021-02-17T09:52:41.427Z] time="2021-02-17T09:52:40Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:52:41.427Z] time="2021-02-17T09:52:40Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=17.110115374s hostname=3077ebcf05a0 isAgentInStatus=false retry=8 status=offline
[2021-02-17T09:52:45.620Z] time="2021-02-17T09:52:45Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:52:45.620Z] time="2021-02-17T09:52:45Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=21.489724271s hostname=3077ebcf05a0 isAgentInStatus=false retry=9 status=offline
[2021-02-17T09:52:52.182Z] time="2021-02-17T09:52:52Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:52:52.182Z] time="2021-02-17T09:52:52Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=28.160542713s hostname=3077ebcf05a0 isAgentInStatus=false retry=10 status=offline
[2021-02-17T09:52:56.368Z] time="2021-02-17T09:52:56Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:52:56.368Z] time="2021-02-17T09:52:56Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=32.432264584s hostname=3077ebcf05a0 isAgentInStatus=false retry=11 status=offline
[2021-02-17T09:53:00.560Z] time="2021-02-17T09:53:00Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:53:00.560Z] time="2021-02-17T09:53:00Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=36.683452007s hostname=3077ebcf05a0 isAgentInStatus=false retry=12 status=offline
[2021-02-17T09:53:04.787Z] time="2021-02-17T09:53:04Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:53:04.787Z] time="2021-02-17T09:53:04Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=40.487477646s hostname=3077ebcf05a0 isAgentInStatus=false retry=13 status=offline
[2021-02-17T09:53:08.071Z] time="2021-02-17T09:53:07Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:53:08.071Z] time="2021-02-17T09:53:07Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=44.09930397s hostname=3077ebcf05a0 isAgentInStatus=false retry=14 status=offline
[2021-02-17T09:53:13.339Z] time="2021-02-17T09:53:13Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:53:13.339Z] time="2021-02-17T09:53:13Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=49.403677549s hostname=3077ebcf05a0 isAgentInStatus=false retry=15 status=offline
[2021-02-17T09:53:18.611Z] time="2021-02-17T09:53:17Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:53:18.611Z] time="2021-02-17T09:53:17Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=53.9485138s hostname=3077ebcf05a0 isAgentInStatus=false retry=16 status=offline
[2021-02-17T09:53:23.887Z] time="2021-02-17T09:53:22Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:53:23.887Z] time="2021-02-17T09:53:22Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=59.010471774s hostname=3077ebcf05a0 isAgentInStatus=false retry=17 status=offline
[2021-02-17T09:53:26.422Z] time="2021-02-17T09:53:26Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:53:26.422Z] time="2021-02-17T09:53:26Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=1m2.3808977s hostname=3077ebcf05a0 isAgentInStatus=false retry=18 status=offline
[2021-02-17T09:53:30.610Z] time="2021-02-17T09:53:30Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:53:30.610Z] time="2021-02-17T09:53:30Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=1m6.570963384s hostname=3077ebcf05a0 isAgentInStatus=false retry=19 status=offline
[2021-02-17T09:53:37.203Z] time="2021-02-17T09:53:37Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:53:37.203Z] time="2021-02-17T09:53:37Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=1m13.243789757s hostname=3077ebcf05a0 isAgentInStatus=false retry=20 status=offline
[2021-02-17T09:53:43.765Z] time="2021-02-17T09:53:43Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:53:43.765Z] time="2021-02-17T09:53:43Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=1m19.274009632s hostname=3077ebcf05a0 isAgentInStatus=false retry=21 status=offline
[2021-02-17T09:53:46.300Z] time="2021-02-17T09:53:45Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:53:46.300Z] time="2021-02-17T09:53:45Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=1m22.095139386s hostname=3077ebcf05a0 isAgentInStatus=false retry=22 status=offline
[2021-02-17T09:53:54.571Z] time="2021-02-17T09:53:53Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:53:54.571Z] time="2021-02-17T09:53:53Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=1m29.623573994s hostname=3077ebcf05a0 isAgentInStatus=false retry=23 status=offline
[2021-02-17T09:53:58.761Z] time="2021-02-17T09:53:58Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:53:58.761Z] time="2021-02-17T09:53:58Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=1m34.208879726s hostname=3077ebcf05a0 isAgentInStatus=false retry=24 status=offline
[2021-02-17T09:54:01.294Z] time="2021-02-17T09:54:01Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:54:01.294Z] time="2021-02-17T09:54:01Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=1m37.297324617s hostname=3077ebcf05a0 isAgentInStatus=false retry=25 status=offline
[2021-02-17T09:54:07.882Z] time="2021-02-17T09:54:07Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:54:07.882Z] time="2021-02-17T09:54:07Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=1m43.729505205s hostname=3077ebcf05a0 isAgentInStatus=false retry=26 status=offline
[2021-02-17T09:54:11.170Z] time="2021-02-17T09:54:10Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:54:11.170Z] time="2021-02-17T09:54:10Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=1m46.725906136s hostname=3077ebcf05a0 isAgentInStatus=false retry=27 status=offline
[2021-02-17T09:54:13.704Z] time="2021-02-17T09:54:13Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:54:13.704Z] time="2021-02-17T09:54:13Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=1m49.521666751s hostname=3077ebcf05a0 isAgentInStatus=false retry=28 status=offline
[2021-02-17T09:54:20.518Z] time="2021-02-17T09:54:19Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:54:20.518Z] time="2021-02-17T09:54:19Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=1m55.643891347s hostname=3077ebcf05a0 isAgentInStatus=false retry=29 status=offline
[2021-02-17T09:54:23.808Z] time="2021-02-17T09:54:23Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:54:23.808Z] time="2021-02-17T09:54:23Z" level=warning msg="The Agent is not in the offline status yet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 elapsedTime=1m59.431223721s hostname=3077ebcf05a0 isAgentInStatus=false retry=30 status=offline
[2021-02-17T09:54:30.375Z] time="2021-02-17T09:54:30Z" level=debug msg="Agent listed in Fleet with online status" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:54:30.375Z] time="2021-02-17T09:54:30Z" level=info msg="The Agent is in the desired status" elapsedTime=2m6.212700477s hostname=3077ebcf05a0 isAgentInStatus=true retries=31 status=offline
[2021-02-17T09:54:30.942Z] OCI runtime exec failed: exec failed: container_linux.go:370: starting container process caused: exec: "elastic-agent": executable file not found in $PATH: unknown
[2021-02-17T09:54:31.201Z] time="2021-02-17T09:54:30Z" level=error msg="Could not execute command in container" command="[elastic-agent uninstall -f]" error="Could not run compose file: [/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-751/.op/compose/profiles/fleet/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-751/.op/compose/services/debian-systemd/docker-compose.yml] - Local Docker compose exited abnormally whilst running docker-compose: [exec -T debian-systemd elastic-agent uninstall -f]. exit status 126" service=debian-systemd
[2021-02-17T09:54:31.201Z] time="2021-02-17T09:54:30Z" level=error msg="Could not run agent command in the box" command="[elastic-agent uninstall -f]" error="Could not run compose file: [/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-751/.op/compose/profiles/fleet/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-751/.op/compose/services/debian-systemd/docker-compose.yml] - Local Docker compose exited abnormally whilst running docker-compose: [exec -T debian-systemd elastic-agent uninstall -f]. exit status 126" profile=fleet service=debian-systemd
[2021-02-17T09:54:31.201Z] time="2021-02-17T09:54:30Z" level=warning msg="Could not uninstall the agent after the scenario: Could not run compose file: [/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-751/.op/compose/profiles/fleet/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-751/.op/compose/services/debian-systemd/docker-compose.yml] - Local Docker compose exited abnormally whilst running docker-compose: [exec -T debian-systemd elastic-agent uninstall -f]. exit status 126"
[2021-02-17T09:54:31.201Z] time="2021-02-17T09:54:31Z" level=debug msg="Un-enrolling agent in Fleet" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3 hostname=3077ebcf05a0
[2021-02-17T09:54:31.768Z] time="2021-02-17T09:54:31Z" level=debug msg="Fleet agent was unenrolled" agentID=d428f040-7105-11eb-8c5e-432bdb9240b3
[2021-02-17T09:54:32.335Z] Stopping fleet_debian-systemd_elastic-agent_1 ... 
[2021-02-17T09:54:32.903Z] 
Stopping fleet_debian-systemd_elastic-agent_1 ... done
Removing fleet_debian-systemd_elastic-agent_1 ... 
[2021-02-17T09:54:32.903Z] 
Removing fleet_debian-systemd_elastic-agent_1 ... done
Going to remove fleet_debian-systemd_elastic-agent_1
[2021-02-17T09:54:33.162Z] time="2021-02-17T09:54:32Z" level=debug msg="Docker compose executed." cmd="[rm -fvs debian-systemd]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-751/.op/compose/profiles/fleet/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-751/.op/compose/services/debian-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz495265016 centos_systemdAgentBinaryTargetPath:/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz centos_systemdContainerName:fleet_centos-systemd_elastic-agent_1 centos_systemdTag:latest debian_systemdAgentBinarySrcPath:/tmp/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz495265016 debian_systemdAgentBinaryTargetPath:/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz debian_systemdContainerName:fleet_debian-systemd_elastic-agent_1 debian_systemdTag:stretch kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-751/src/github.com/elastic/e2e-testing/e2e/_suites/fleet/configurations/kibana.config.yml stackVersion:8.0.0-SNAPSHOT]" profile=fleet
[2021-02-17T09:54:33.162Z] time="2021-02-17T09:54:32Z" level=debug msg="Service removed from compose" profile=fleet service=debian-systemd
[2021-02-17T09:54:33.728Z] time="2021-02-17T09:54:33Z" level=debug msg="The token was deleted" tokenID=cf63c710-7105-11eb-8c5e-432bdb9240b3
[2021-02-17T09:54:33.728Z] time="2021-02-17T09:54:33Z" level=info msg="Integration deleted from the configuration" integration= packageConfigId= policyID=32f13040-7103-11eb-8c5e-432bdb9240b3 version=
[2021-02-17T09:54:33.728Z] time="2021-02-17T09:54:33Z" level=debug msg="Destroying Fleet runtime dependencies"
[2021-02-17T09:54:34.295Z] Stopping fleet_kibana_1           ... 
[2021-02-17T09:54:34.295Z] Stopping fleet_package-registry_1 ... 
[2021-02-17T09:54:34.295Z] Stopping fleet_elasticsearch_1    ... 
[2021-02-17T09:54:35.380Z] 
Stopping fleet_kibana_1           ... done

Stopping fleet_package-registry_1 ... done

Stopping fleet_elasticsearch_1    ... done
Removing fleet_kibana_1           ... 
[2021-02-17T09:54:35.380Z] Removing fleet_package-registry_1 ... 
[2021-02-17T09:54:35.380Z] Removing fleet_elasticsearch_1    ... 
[2021-02-17T09:54:35.380Z] 
Removing fleet_kibana_1           ... done

Removing fleet_package-registry_1 ... done

Removing fleet_elasticsearch_1    ... done
Removing network fleet_default
[2021-02-17T09:54:35.639Z] time="2021-02-17T09:54:35Z" level=debug msg="Docker compose executed." cmd="[down --remove-orphans]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-751/.op/compose/profiles/fleet/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz495265016 centos_systemdAgentBinaryTargetPath:/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz centos_systemdContainerName:fleet_centos-systemd_elastic-agent_1 centos_systemdTag:latest debian_systemdAgentBinarySrcPath:/tmp/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz495265016 debian_systemdAgentBinaryTargetPath:/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz debian_systemdContainerName:fleet_debian-systemd_elastic-agent_1 debian_systemdTag:stretch kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-751/src/github.com/elastic/e2e-testing/e2e/_suites/fleet/configurations/kibana.config.yml stackVersion:8.0.0-SNAPSHOT]" profile=fleet
[2021-02-17T09:54:35.639Z] time="2021-02-17T09:54:35Z" level=debug msg="Elastic Agent binary was removed." installer=centos-systemd-8.0.0-SNAPSHOT path=/tmp/elastic-agent-8.0.0-SNAPSHOT-x86_64.rpm242451645
[2021-02-17T09:54:35.639Z] time="2021-02-17T09:54:35Z" level=debug msg="Elastic Agent binary was removed." installer=centos-tar-8.0.0-SNAPSHOT path=/tmp/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz495265016
[2021-02-17T09:54:35.639Z] time="2021-02-17T09:54:35Z" level=debug msg="Elastic Agent binary was removed." installer=debian-systemd-8.0.0-SNAPSHOT path=/tmp/elastic-agent-8.0.0-SNAPSHOT-amd64.deb905434615
[2021-02-17T09:54:35.639Z] time="2021-02-17T09:54:35Z" level=debug msg="Elastic Agent binary was removed." installer=docker-default-8.0.0-SNAPSHOT path=/tmp/elastic-agent-8.0.0-SNAPSHOT-docker-image-linux-amd64.tar.gz031402730
[2021-02-17T09:54:35.898Z] time="2021-02-17T09:54:35Z" level=debug msg="Elastic Agent binary was removed." installer=docker-ubi8-8.0.0-SNAPSHOT path=/tmp/elastic-agent-ubi8-8.0.0-SNAPSHOT-docker-image-linux-amd64.tar.gz265099073
[2021-02-17T09:54:35.898Z] Makefile:61: recipe for target 'functional-test' failed
[2021-02-17T09:54:35.898Z] make: *** [functional-test] Error 1
[2021-02-17T09:54:35.944Z] [INFO] Stopping Filebeat Docker container
[2021-02-17T09:54:36.226Z] + docker exec -t 173c7e5561acf5faeef7d43604aec77b499a286a10d1fc9087ca4710eaef883e chmod -R ugo+rw /output
[2021-02-17T09:54:36.485Z] + docker stop --time 30 173c7e5561acf5faeef7d43604aec77b499a286a10d1fc9087ca4710eaef883e
[2021-02-17T09:54:36.743Z] 173c7e5561acf5faeef7d43604aec77b499a286a10d1fc9087ca4710eaef883e
[2021-02-17T09:54:36.759Z] Archiving artifacts
[2021-02-17T09:54:37.534Z] Recording test results
[2021-02-17T09:54:38.118Z] [Checks API] No suitable checks publisher found.
[2021-02-17T09:54:38.136Z] Archiving artifacts
[2021-02-17T09:54:38.171Z] Failed in branch ubuntu-18.04_fleet_fleet_mode_agent
[2021-02-17T09:54:39.291Z] Stage "Release" skipped due to earlier failure(s)
[2021-02-17T09:54:39.674Z] Running on worker-1244230 in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-751
[2021-02-17T09:54:39.714Z] [INFO] getVaultSecret: Getting secrets
[2021-02-17T09:54:39.799Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-02-17T09:54:42.037Z] + chmod 755 generate-build-data.sh
[2021-02-17T09:54:42.037Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-751/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-751/runs/4 FAILURE 1711404
[2021-02-17T09:54:42.037Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-751/runs/4/steps/?limit=10000 -o steps-info.json
[2021-02-17T09:54:46.165Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-751/runs/4/tests/?status=FAILED -o tests-errors.json
[2021-02-17T09:54:46.865Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-751/runs/4/log/ -o pipeline-log.txt

@mdelapenya mdelapenya marked this pull request as ready for review February 17, 2021 09:55
@@ -95,6 +95,7 @@ func (sats *StandAloneTestSuite) aStandaloneAgentIsDeployed(image string) error

profileEnv["elasticAgentContainerName"] = containerName
profileEnv["elasticAgentConfigFile"] = sats.AgentConfigFilePath
profileEnv["elasticAgentPlatform"] = "linux/amd64"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This value will be eventually dynamic for ARM/AMD

@@ -359,6 +359,7 @@ func (mts *MetricbeatTestSuite) runMetricbeatService() error {
}

env["metricbeatDockerNamespace"] = e2e.GetDockerNamespaceEnvVar()
env["metricbeatPlatform"] = "linux/amd64"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This value will be eventually dynamic for ARM/AMD

@@ -221,6 +221,9 @@ func sanitizeComposeFile(composeFilePath string, targetFilePath string) error {
return err
}

// sets version to 2.4 for testing purpose
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not testing anymore?

Suggested change
// sets version to 2.4 for testing purpose

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well, I mean testing the execution of the tests. I added there to explain why we are setting that version there. Maybe it's not clear enough and it could be deleted

@mdelapenya
Copy link
Contributor Author

The failed test could be considered flaky. Merging

@mdelapenya mdelapenya merged commit b6228a8 into elastic:master Feb 17, 2021
@mdelapenya mdelapenya deleted the docker-compose-platform branch February 17, 2021 10:11
mdelapenya added a commit to mdelapenya/e2e-testing that referenced this pull request Feb 17, 2021
* fix: support selecting the platform in docker-compose

* fix: wrong interpolation format

* fix: use a docker-compose version for platform

* chore: bump all compose files to 2.4

* chore: sanitise Beats compose files to enforce 2.4 compose version
mdelapenya added a commit to mdelapenya/e2e-testing that referenced this pull request Feb 17, 2021
* fix: support selecting the platform in docker-compose

* fix: wrong interpolation format

* fix: use a docker-compose version for platform

* chore: bump all compose files to 2.4

* chore: sanitise Beats compose files to enforce 2.4 compose version
mdelapenya added a commit to mdelapenya/e2e-testing that referenced this pull request Feb 17, 2021
* fix: support selecting the platform in docker-compose

* fix: wrong interpolation format

* fix: use a docker-compose version for platform

* chore: bump all compose files to 2.4

* chore: sanitise Beats compose files to enforce 2.4 compose version
mdelapenya added a commit to mdelapenya/e2e-testing that referenced this pull request Feb 17, 2021
* fix: support selecting the platform in docker-compose

* fix: wrong interpolation format

* fix: use a docker-compose version for platform

* chore: bump all compose files to 2.4

* chore: sanitise Beats compose files to enforce 2.4 compose version
mdelapenya added a commit that referenced this pull request Feb 17, 2021
* fix: support selecting the platform in docker-compose

* fix: wrong interpolation format

* fix: use a docker-compose version for platform

* chore: bump all compose files to 2.4

* chore: sanitise Beats compose files to enforce 2.4 compose version
mdelapenya added a commit that referenced this pull request Feb 17, 2021
* fix: support selecting the platform in docker-compose

* fix: wrong interpolation format

* fix: use a docker-compose version for platform

* chore: bump all compose files to 2.4

* chore: sanitise Beats compose files to enforce 2.4 compose version
mdelapenya added a commit that referenced this pull request Feb 17, 2021
* fix: support selecting the platform in docker-compose

* fix: wrong interpolation format

* fix: use a docker-compose version for platform

* chore: bump all compose files to 2.4

* chore: sanitise Beats compose files to enforce 2.4 compose version
mdelapenya added a commit that referenced this pull request Feb 17, 2021
* fix: support selecting the platform in docker-compose

* fix: wrong interpolation format

* fix: use a docker-compose version for platform

* chore: bump all compose files to 2.4

* chore: sanitise Beats compose files to enforce 2.4 compose version
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants