Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add kind testing against ARM64 #457

Merged
merged 2 commits into from
Mar 29, 2019
Merged

Add kind testing against ARM64 #457

merged 2 commits into from
Mar 29, 2019

Conversation

mrhillsman
Copy link
Contributor

@mrhillsman mrhillsman commented Mar 7, 2019

Request: theopenlab/openlab#211

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 7, 2019

Build failed.

@mrhillsman
Copy link
Contributor Author

recheck

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 8, 2019

Build failed.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 8, 2019

Build failed.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 8, 2019

Build failed.

@mrhillsman
Copy link
Contributor Author

mrhillsman commented Mar 11, 2019

For docker we can use the galaxy role - https://github.com/geerlingguy/ansible-role-docker

docker_edition: ce
docker_package: docker-{{ docker_edition }}-<VERSION> or docker-{{ docker_edition }}=<VERSION>
* redhat/centos and ubuntu/debian for the latter

@mrhillsman
Copy link
Contributor Author

For bazel we could use the role - https://galaxy.ansible.com/andrewrothstein/bazel
I am not sure of this user so need to investigate

@mrhillsman
Copy link
Contributor Author

recheck

1 similar comment
@kiwik
Copy link
Contributor

kiwik commented Mar 12, 2019

recheck

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 12, 2019

Build failed.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 12, 2019

Build failed.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 12, 2019

Build succeeded.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 12, 2019

Build succeeded.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 13, 2019

Build succeeded.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 15, 2019

Build succeeded.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 15, 2019

Zuul encountered a syntax error while parsing its configuration in the
repo theopenlab/openlab-zuul-jobs on branch master. The error was:

mapping values are not allowed in this context
in "theopenlab/openlab-zuul-jobs/zuul.d/projects.yaml@master", line 11, column 21

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 15, 2019

Zuul encountered a syntax error while parsing its configuration in the
repo theopenlab/openlab-zuul-jobs on branch master. The error was:

The project "kubernetes-sigs/kind" was not found. All projects
referenced within a Zuul configuration must first be added to the main
configuration file by the Zuul administrator.

The error appears in the following project stanza:

project:
name: kubernetes-sigs/kind
periodic:
jobs:
- kind-integration-test-arm64:
branches: master

in "theopenlab/openlab-zuul-jobs/zuul.d/projects.yaml@master", line 6, column 3

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 15, 2019

Build succeeded.

@mrhillsman mrhillsman changed the title [WIP] Add kind testing against ARM64 Add kind testing against ARM64 Mar 16, 2019
@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 19, 2019

Build succeeded.

@mrhillsman mrhillsman requested a review from kiwik March 20, 2019 00:10
@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 20, 2019

Build succeeded.

@kiwik kiwik requested review from Yikun and ZhengZhenyu March 28, 2019 06:46
@ZhengZhenyu
Copy link
Contributor

Have a question here, I saw that in your commit there are a huge number of files added and that basically https://github.com/andrewrothstein/ansible-bazel and related requirements, I uderstand that we need it for the job, but could there be a way of not putting them all to the current roles? as we can see from https://github.com/theopenlab/openlab-zuul-jobs/tree/efa8423c2c7c711c3373a61ff6080afcb079deb9/roles you added quite alot files and the relationship between who depends on who can only be find when we actually open it and read the details, it seems really hard to understand what it actually does or maintain if we want to change something or, let's see, remove the job, we have to find out the relationship between each other.

Copy link
Member

@Yikun Yikun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just some nits, and left part is lgtm.

playbooks/kind-integration-test-arm64/post.yaml Outdated Show resolved Hide resolved
zuul.d/nodesets.yaml Show resolved Hide resolved
@mrhillsman
Copy link
Contributor Author

Have a question here, I saw that in your commit there are a huge number of files added and that basically https://github.com/andrewrothstein/ansible-bazel and related requirements, I uderstand that we need it for the job, but could there be a way of not putting them all to the current roles? as we can see from https://github.com/theopenlab/openlab-zuul-jobs/tree/efa8423c2c7c711c3373a61ff6080afcb079deb9/roles you added quite alot files and the relationship between who depends on who can only be find when we actually open it and read the details, it seems really hard to understand what it actually does or maintain if we want to change something or, let's see, remove the job, we have to find out the relationship between each other.

Dependencies for roles are found in the meta folder. This is a standard in ansible - https://docs.ansible.com/ansible/latest/user_guide/playbooks_reuse_roles.html#role-dependencies

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 28, 2019

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 28, 2019

Build failed.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Mar 28, 2019

Build succeeded.

@mrhillsman mrhillsman requested a review from Yikun March 28, 2019 17:32
Copy link
Member

@Yikun Yikun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks, LGTM

@mrhillsman mrhillsman merged commit 602ae18 into theopenlab:master Mar 29, 2019
@@ -141,6 +135,13 @@
- packer-functional-devstack-mitaka:
branches: master

- project:
name: kubernetes-sigs/kind
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Duplicated setting.


- project:
name: kubernetes-sigs/kind
periodic:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @mrhillsman , we have done refactor for periodic pipeline, you add kind job at here in block periodic-0/12, but refer pipeline periodic, it's obvious error, please check document and choose a suitable pipeline.

https://docs.openlabtesting.org/publications/contributors/development-guide#periodic-job-and-pipeline-schedule

become: yes
roles:
- config-golang
- install-docker-ce
Copy link
Contributor

@kiwik kiwik Mar 29, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

install-docker-ce should be updated to support ARM arch, like I say in previous comments.

  1. support ARM arch in https://github.com/theopenlab/openlab-zuul-jobs/blob/master/roles/install-docker-ce/tasks/main.yml#L24
  2. cgroupdriver is not supported in ARM arch, should be updated in https://github.com/theopenlab/openlab-zuul-jobs/blob/master/roles/install-docker-ce/tasks/main.yml#L40

So I believe docker can not be launched in current job define.

Copy link
Contributor

@ZhengZhenyu ZhengZhenyu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

comments inline

go get sigs.k8s.io/kind
go get k8s.io/kubeadm
go get k8s.io/kubernetes
go get k8s.io/test-infra
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

seems should be go get -u k8s.io/test-infra/kubetest according to https://github.com/kubernetes/test-infra/tree/master/kubetest I failed to install it with your command(it didn't got installed since it is a too wide package) and succed with go get -u k8s.io/test-infra/kubetest

--kind-binary-version=build \
--kind-base-image="kindest/base:latest" \
--kind-config-path=./../../k8s.io/kubeadm/tests/e2e/kind/single-cp/single-cp.yaml \
--build=bazel \
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the --build=bazel is not neccessary as seems from https://github.com/kubernetes/test-infra/blob/master/kubetest/kind/kind.go#L241 if we don't pass anything, we will use existing node-image(which was built in line 27) passing other value will trigger a re-build of the node-image which makes the previous build useless.

cmd: |
cd $GOPATH/src/sigs.k8s.io/kind && go install .
kind build base-image --image kindest/base:latest --source $GOPATH/src/sigs.k8s.io/kind/images/base --loglevel debug
kind build node-image --type bazel --image kindest/node:latest --base-image kindest/base:latest --kube-root=$GOPATH/src/k8s.io/kubernetes/ --loglevel debug
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can just remove this one if you are using --build=bazel in the below command, it takes around 20 mins for each build in our vexxhost vm, so quite time consuming to build twice.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants