Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Golang 1.15.4 #68

Closed
wants to merge 3 commits into from

Conversation

kvch
Copy link
Contributor

@kvch kvch commented Nov 9, 2020

In Golang 1.15 darwin/386 is not supported anymore. Thus, I have dropped it from the new Makefile.

@kvch kvch requested a review from v1v November 9, 2020 14:52
@kvch kvch mentioned this pull request Nov 9, 2020
3 tasks
@elasticmachine
Copy link

elasticmachine commented Nov 9, 2020

💔 Build Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: Pull request #68 updated

  • Start Time: 2020-12-03T13:30:03.517+0000

  • Duration: 56 min 0 sec

Steps errors 1

Expand to view the steps failures

Shell Script

  • Took 53 min 34 sec . View more details on here
  • Description: make build

Log output

Expand to view the last 100 lines of log output

[2020-12-03T14:25:18.954Z] Removing intermediate container e60b80fe0fd2
[2020-12-03T14:25:18.954Z]  ---> 4a7cb82fa790
[2020-12-03T14:25:18.954Z] Step 8/16 : ARG FPM_VERSION
[2020-12-03T14:25:18.954Z]  ---> Running in e0ccb4ef6e12
[2020-12-03T14:25:18.954Z] Removing intermediate container e0ccb4ef6e12
[2020-12-03T14:25:18.954Z]  ---> ba0352bce291
[2020-12-03T14:25:18.954Z] Step 9/16 : RUN gem install fpm -v "$FPM_VERSION"
[2020-12-03T14:25:19.214Z]  ---> Running in 5c93ee11778f
[2020-12-03T14:25:21.756Z] Successfully installed stud-0.0.23
[2020-12-03T14:25:21.756Z] Successfully installed cabin-0.9.0
[2020-12-03T14:25:21.756Z] Successfully installed clamp-1.0.1
[2020-12-03T14:25:21.756Z] Successfully installed mustache-0.99.8
[2020-12-03T14:25:21.756Z] Successfully installed insist-1.0.0
[2020-12-03T14:25:21.756Z] Successfully installed dotenv-2.7.6
[2020-12-03T14:25:21.756Z] Successfully installed pleaserun-0.0.31
[2020-12-03T14:25:21.756Z] Successfully installed io-like-0.3.1
[2020-12-03T14:25:21.756Z] Building native extensions.  This could take a while...
[2020-12-03T14:26:00.518Z] Successfully installed ffi-1.13.1
[2020-12-03T14:26:00.518Z] Successfully installed ruby-xz-0.2.3
[2020-12-03T14:26:00.518Z] Successfully installed childprocess-0.9.0
[2020-12-03T14:26:00.518Z] Successfully installed arr-pm-0.0.10
[2020-12-03T14:26:00.518Z] Successfully installed backports-3.18.2
[2020-12-03T14:26:00.518Z] Successfully installed fpm-1.11.0
[2020-12-03T14:26:00.518Z] Parsing documentation for stud-0.0.23
[2020-12-03T14:26:00.518Z] Installing ri documentation for stud-0.0.23
[2020-12-03T14:26:00.518Z] Parsing documentation for cabin-0.9.0
[2020-12-03T14:26:00.518Z] Installing ri documentation for cabin-0.9.0
[2020-12-03T14:26:00.518Z] Parsing documentation for clamp-1.0.1
[2020-12-03T14:26:00.518Z] Installing ri documentation for clamp-1.0.1
[2020-12-03T14:26:00.518Z] Parsing documentation for mustache-0.99.8
[2020-12-03T14:26:00.518Z] Installing ri documentation for mustache-0.99.8
[2020-12-03T14:26:00.518Z] Parsing documentation for insist-1.0.0
[2020-12-03T14:26:00.518Z] Installing ri documentation for insist-1.0.0
[2020-12-03T14:26:00.518Z] Parsing documentation for dotenv-2.7.6
[2020-12-03T14:26:00.518Z] Installing ri documentation for dotenv-2.7.6
[2020-12-03T14:26:00.518Z] Parsing documentation for pleaserun-0.0.31
[2020-12-03T14:26:00.518Z] Installing ri documentation for pleaserun-0.0.31
[2020-12-03T14:26:00.518Z] Parsing documentation for io-like-0.3.1
[2020-12-03T14:26:00.518Z] Installing ri documentation for io-like-0.3.1
[2020-12-03T14:26:00.518Z] Parsing documentation for ffi-1.13.1
[2020-12-03T14:26:00.518Z] Installing ri documentation for ffi-1.13.1
[2020-12-03T14:26:00.518Z] Parsing documentation for ruby-xz-0.2.3
[2020-12-03T14:26:00.518Z] Installing ri documentation for ruby-xz-0.2.3
[2020-12-03T14:26:00.518Z] Parsing documentation for childprocess-0.9.0
[2020-12-03T14:26:00.518Z] Installing ri documentation for childprocess-0.9.0
[2020-12-03T14:26:00.518Z] Parsing documentation for arr-pm-0.0.10
[2020-12-03T14:26:00.518Z] Installing ri documentation for arr-pm-0.0.10
[2020-12-03T14:26:00.518Z] Parsing documentation for backports-3.18.2
[2020-12-03T14:26:00.518Z] Installing ri documentation for backports-3.18.2
[2020-12-03T14:26:00.518Z] Parsing documentation for fpm-1.11.0
[2020-12-03T14:26:00.518Z] Installing ri documentation for fpm-1.11.0
[2020-12-03T14:26:00.518Z] Done installing documentation for stud, cabin, clamp, mustache, insist, dotenv, pleaserun, io-like, ffi, ruby-xz, childprocess, arr-pm, backports, fpm after 30 seconds
[2020-12-03T14:26:00.518Z] 14 gems installed
[2020-12-03T14:26:00.518Z] Removing intermediate container 5c93ee11778f
[2020-12-03T14:26:00.518Z]  ---> c500f7a526dd
[2020-12-03T14:26:00.518Z] Step 10/16 : COPY rootfs /
[2020-12-03T14:26:00.518Z]  ---> 7572f257e63b
[2020-12-03T14:26:00.518Z] Step 11/16 : ENTRYPOINT  ["/entrypoint.sh"]
[2020-12-03T14:26:00.518Z]  ---> Running in e1f95f60ad1a
[2020-12-03T14:26:00.518Z] Removing intermediate container e1f95f60ad1a
[2020-12-03T14:26:00.518Z]  ---> cc309181c825
[2020-12-03T14:26:00.518Z] Step 12/16 : ARG BUILD_DATE
[2020-12-03T14:26:00.780Z]  ---> Running in 045cc34b73bd
[2020-12-03T14:26:00.780Z] Removing intermediate container 045cc34b73bd
[2020-12-03T14:26:00.780Z]  ---> 5e274547220a
[2020-12-03T14:26:00.780Z] Step 13/16 : ARG IMAGE
[2020-12-03T14:26:00.780Z]  ---> Running in d6382a0f993c
[2020-12-03T14:26:01.042Z] Removing intermediate container d6382a0f993c
[2020-12-03T14:26:01.042Z]  ---> 33393779401c
[2020-12-03T14:26:01.042Z] Step 14/16 : ARG VCS_REF
[2020-12-03T14:26:01.042Z]  ---> Running in 30ec152c6ccf
[2020-12-03T14:26:01.303Z] Removing intermediate container 30ec152c6ccf
[2020-12-03T14:26:01.303Z]  ---> 210991794b12
[2020-12-03T14:26:01.303Z] Step 15/16 : ARG VCS_URL
[2020-12-03T14:26:01.303Z]  ---> Running in c91e539cee7e
[2020-12-03T14:26:01.565Z] Removing intermediate container c91e539cee7e
[2020-12-03T14:26:01.565Z]  ---> 98c917ccd602
[2020-12-03T14:26:01.565Z] Step 16/16 : LABEL org.label-schema.build-date=$BUILD_DATE       org.label-schema.name=$IMAGE       org.label-schema.vcs-ref=$VCS_REF       org.label-schema.vcs-url=$VCS_URL       org.label-schema.schema-version="1.0"
[2020-12-03T14:26:01.565Z]  ---> Running in 51f2cdee9c4c
[2020-12-03T14:26:01.826Z] Removing intermediate container 51f2cdee9c4c
[2020-12-03T14:26:01.826Z]  ---> 1a3fa3cbe948
[2020-12-03T14:26:01.826Z] Successfully built 1a3fa3cbe948
[2020-12-03T14:26:01.826Z] Successfully tagged docker.elastic.co/beats-dev/fpm:1.11.0
[2020-12-03T14:26:01.826Z] make[1]: Leaving directory '/var/lib/jenkins/workspace/eats_golang-crossbuild-mbp_PR-68/src/github.com/elastic/golang-crossbuild/fpm'
[2020-12-03T14:26:01.826Z] exit $(cat ".status.build")
[2020-12-03T14:26:01.826Z] Makefile:5: recipe for target 'build' failed
[2020-12-03T14:26:01.826Z] make: *** [build] Error 1
[2020-12-03T14:26:02.950Z] Stage "Staging" skipped due to earlier failure(s)
[2020-12-03T14:26:02.970Z] Stage "Release" skipped due to earlier failure(s)
[2020-12-03T14:26:02.981Z] Stage "Release" skipped due to earlier failure(s)
[2020-12-03T14:26:03.152Z] Running on Jenkins in /var/lib/jenkins/workspace/eats_golang-crossbuild-mbp_PR-68
[2020-12-03T14:26:03.215Z] [INFO] getVaultSecret: Getting secrets
[2020-12-03T14:26:03.267Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-12-03T14:26:03.818Z] + chmod 755 generate-build-data.sh
[2020-12-03T14:26:03.818Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/golang-crossbuild-mbp/PR-68/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/golang-crossbuild-mbp/PR-68/runs/4 FAILURE 3360041
[2020-12-03T14:26:03.818Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/golang-crossbuild-mbp/PR-68/runs/4/steps/?limit=10000 -o steps-info.json
[2020-12-03T14:26:04.369Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/golang-crossbuild-mbp/PR-68/runs/4/tests/?status=FAILED -o tests-errors.json
[2020-12-03T14:26:04.369Z] Retry 1/3 exited 22, retrying in 1 seconds...
[2020-12-03T14:26:05.713Z] Retry 2/3 exited 22, retrying in 2 seconds...
[2020-12-03T14:26:07.575Z] Retry 3/3 exited 22, no more retries left.

@v1v v1v requested a review from a team November 10, 2020 09:05
@v1v
Copy link
Member

v1v commented Nov 10, 2020

I see some failures in the publishing

[2020-11-09T16:45:36.771Z] 1.15.4-arm: digest: sha256:4b8220b64af4137fec93ea89793b9bb2e170676820670d9ece382bf4e3138bec size: 2207

[2020-11-09T16:45:36.771Z] make[2]: Leaving directory '/var/lib/jenkins/workspace/eats_golang-crossbuild-mbp_PR-68/src/github.com/elastic/golang-crossbuild/go1.15/arm'

[2020-11-09T16:45:36.771Z] make[2]: Entering directory '/var/lib/jenkins/workspace/eats_golang-crossbuild-mbp_PR-68/src/github.com/elastic/golang-crossbuild/go1.15/mips'

[2020-11-09T16:45:36.771Z] echo ">> Pushing docker.elastic.co/observability-ci/golang-crossbuild:1.15.4-mips"

[2020-11-09T16:45:36.771Z] >> Pushing docker.elastic.co/observability-ci/golang-crossbuild:1.15.4-mips

[2020-11-09T16:45:36.771Z] The push refers to repository [docker.elastic.co/observability-ci/golang-crossbuild]

[2020-11-09T16:45:36.771Z] tag does not exist: docker.elastic.co/observability-ci/golang-crossbuild:1.15.4-mips

[2020-11-09T16:45:36.771Z] ..//../Makefile.common:9: recipe for target 'push' failed

[2020-11-09T16:45:36.771Z] make[2]: *** [push] Error 1

[2020-11-09T16:45:36.771Z] make[2]: Leaving directory '/var/lib/jenkins/workspace/eats_golang-crossbuild-mbp_PR-68/src/github.com/elastic/golang-crossbuild/go1.15/mips'

[2020-11-09T16:45:36.771Z] Makefile:8: recipe for target 'push' failed

[2020-11-09T16:45:36.771Z] make[1]: *** [push] Error 1

[2020-11-09T16:45:36.771Z] make[1]: Leaving directory '/var/lib/jenkins/workspace/eats_golang-crossbuild-mbp_PR-68/src/github.com/elastic/golang-crossbuild/go1.15'

[2020-11-09T16:45:36.771Z] make[1]: Entering directory '/var/lib/jenkins/workspace/eats_golang-crossbuild-mbp_PR-68/src/github.com/elastic/golang-crossbuild/go1.15'

[2020-11-09T16:45:36.771Z] make[2]: Entering directory '/var/lib/jenkins/workspace/eats_golang-crossbuild-mbp_PR-68/src/github.com/elastic/golang-crossbuild/go1.15/base'

[2020-11-09T16:45:36.771Z] echo ">> Pushing docker.elastic.co/observability-ci/golang-crossbuild:1.15.4-base-debian7"

Copy link
Member

@v1v v1v left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see some failures in the publishing stage



[2020-11-09T16:30:17.820Z] echo ">> Pushing docker.elastic.co/observability-ci/golang-crossbuild:1.13.10-mips"

[2020-11-09T16:30:17.820Z] >> Pushing docker.elastic.co/observability-ci/golang-crossbuild:1.13.10-mips

[2020-11-09T16:30:17.820Z] The push refers to repository [docker.elastic.co/observability-ci/golang-crossbuild]

[2020-11-09T16:30:17.820Z] tag does not exist: docker.elastic.co/observability-ci/golang-crossbuild:1.13.10-mips

[2020-11-09T16:30:17.820Z] ..//../Makefile.common:9: recipe for target 'push' failed

[2020-11-09T16:30:17.820Z] make[2]: *** [push] Error 1

[2020-11-09T16:30:17.820Z] make[2]: Leaving directory '/var/lib/jenkins/workspace/eats_golang-crossbuild-mbp_PR-68/src/github.com/elastic/golang-crossbuild/go1.13/mips'

[2020-11-09T16:30:17.820Z] Makefile:8: recipe for target 'push' failed

[2020-11-09T16:30:17.820Z] make[1]: *** [push] Error 1

https://beats-ci.elastic.co/blue/organizations/jenkins/Beats%2Fgolang-crossbuild-mbp/detail/PR-68/1/pipeline/104#step-156-log-1199

@v1v
Copy link
Member

v1v commented Nov 10, 2020

You can use the CLI

$ curl -s 'https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/pipelines/golang-crossbuild-mbp/branches/PR-68/runs/1/nodes/104/log/?start=0' | grep failed -B 5

And I see another one when building the docker image:

[2020-11-09T15:53:25.464Z]  ---> efa0a4251391
[2020-11-09T15:53:25.464Z] Step 4/10 : RUN     dpkg --add-architecture mips64el     && apt-get update -qq     && apt-get install -qq -y       --no-install-recommends       --allow-unauthenticated         crossbuild-essential-mipsel         gcc-mips-linux-gnu         g++-mips-linux-gnu         gcc-6-mips64-linux-gnuabi64         g++-6-mips64-linux-gnuabi64         gcc-6-mips64el-linux-gnuabi64         g++-6-mips64el-linux-gnuabi64         librpm-dev:mips64el         libc-dev:mips64el         libpopt-dev:mips64el         linux-libc-dev:mips64el         libxml2-dev:mips64el         libxml2:mips64el         libicu-dev:mips64el         libicu57:mips64el         icu-devtools:mips64el         libsystemd-dev:mips64el     && rm -rf /var/lib/apt/lists/*
[2020-11-09T15:53:25.464Z]  ---> Running in 998abc42f95f
[2020-11-09T15:53:33.596Z] E: Unable to correct problems, you have held broken packages.
[2020-11-09T15:53:33.596Z] The command '/bin/sh -c dpkg --add-architecture mips64el     && apt-get update -qq     && apt-get install -qq -y       --no-install-recommends       --allow-unauthenticated         crossbuild-essential-mipsel         gcc-mips-linux-gnu         g++-mips-linux-gnu         gcc-6-mips64-linux-gnuabi64         g++-6-mips64-linux-gnuabi64         gcc-6-mips64el-linux-gnuabi64         g++-6-mips64el-linux-gnuabi64         librpm-dev:mips64el         libc-dev:mips64el         libpopt-dev:mips64el         linux-libc-dev:mips64el         libxml2-dev:mips64el         libxml2:mips64el         libicu-dev:mips64el         libicu57:mips64el         icu-devtools:mips64el         libsystemd-dev:mips64el     && rm -rf /var/lib/apt/lists/*' returned a non-zero code: 100
[2020-11-09T15:53:33.596Z] ../Makefile.common:13: recipe for target 'build' failed

@kvch
Copy link
Contributor Author

kvch commented Nov 10, 2020

Thanks I will look into the problem.

@v1v
Copy link
Member

v1v commented Nov 10, 2020

For the record, I ran the some CLI for the master build and I did not see any failures:

$ curl -s 'https://beats-ci.elastic.co/job/Beats/job/golang-crossbuild-mbp/job/master/16/consoleText' | grep failed 

I'm working on populating the errorlevel to the CI since it seems the current makefiles are not doing it -> #69

@kvch
Copy link
Contributor Author

kvch commented Nov 10, 2020

It seems that my changes are unrelated to the issue you have described according to #69

@v1v
Copy link
Member

v1v commented Dec 1, 2020

There are still some failures:

$ curl -s 'https://beats-ci.elastic.co/job/Beats/job/golang-crossbuild-mbp/job/PR-68/2/consoleText' | grep failed
[2020-11-10T10:03:36.643Z] ../Makefile.common:13: recipe for target 'build' failed
[2020-11-10T10:03:36.643Z] Makefile:4: recipe for target 'build' failed
[2020-11-10T10:12:04.547Z] ../Makefile.common:13: recipe for target 'build' failed
[2020-11-10T10:12:04.547Z] Makefile:4: recipe for target 'build' failed
[2020-11-10T10:20:07.881Z] ../Makefile.common:13: recipe for target 'build' failed
[2020-11-10T10:20:07.881Z] Makefile:4: recipe for target 'build' failed
[2020-11-10T10:24:49.511Z] ../Makefile.common:13: recipe for target 'build' failed
[2020-11-10T10:24:49.511Z] Makefile:4: recipe for target 'build' failed
[2020-11-10T10:25:01.375Z] ../Makefile.common:13: recipe for target 'build' failed
[2020-11-10T10:25:01.376Z] Makefile:4: recipe for target 'build' failed
[2020-11-10T10:25:13.749Z] ../Makefile.common:13: recipe for target 'build' failed
[2020-11-10T10:25:13.749Z] Makefile:4: recipe for target 'build' failed
[2020-11-10T10:58:09.080Z] ..//../Makefile.common:9: recipe for target 'push' failed
[2020-11-10T10:58:09.080Z] Makefile:8: recipe for target 'push' failed
[2020-11-10T11:05:49.650Z] ..//../Makefile.common:9: recipe for target 'push' failed
[2020-11-10T11:05:49.650Z] Makefile:8: recipe for target 'push' failed
[2020-11-10T11:13:23.668Z] ..//../Makefile.common:9: recipe for target 'push' failed
[2020-11-10T11:13:23.668Z] Makefile:8: recipe for target 'push' failed

@v1v
Copy link
Member

v1v commented Dec 1, 2020

jenkins run the tests please

@kuisathaverat
Copy link
Contributor

These two issues resolve all architecture and package issues we have, we only have to update them to the new go version, I suggest to close this PR and allow us to bump the go version and merge #62 to resolve the primary issue here, and them re-work and merge #65 to create one Docker image by architecture, now we are mixing little-endian, endia-little, 64bits, and 32bit architectures in the same container

@kvch kvch force-pushed the update-golang-to-1.15.4 branch from 4ddc5ca to ed0b34e Compare December 3, 2020 13:29
@kuisathaverat
Copy link
Contributor

I have rework #65 and #68 (This PR) on #72

@kvch
Copy link
Contributor Author

kvch commented Dec 3, 2020

I am closing it in favour of #72

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants