Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a KEP for artifact management. #721

Closed
wants to merge 1 commit into from

Conversation

brendandburns
Copy link
Contributor

@k8s-ci-robot k8s-ci-robot added kind/kep Categorizes KEP tracking issues and PRs modifying the KEP directory sig/architecture Categorizes an issue or PR as relevant to SIG Architecture. sig/contributor-experience Categorizes an issue or PR as relevant to SIG Contributor Experience. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. sig/pm cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. labels Jan 24, 2019
@brendandburns brendandburns removed sig/architecture Categorizes an issue or PR as relevant to SIG Architecture. sig/pm labels Jan 24, 2019
@brendandburns brendandburns requested review from justinsb and dims and removed request for jdumars and Phillels January 24, 2019 05:32
ss to a
project staging area relevant to their particular artifacts (either storage buck
et or image
registry). Each project is free to manage their assets in the staging area however they feel
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

have we given any thought to excessive resource usage? If all projects have no limits here it seems like the resource usage could get pretty spectacular.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Storage is really, really cheap. I don't think this will be an issue. (though general cost management for k8s-infra is definitely being worked on, so we can detect and manage it if it occurs)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fair, I was thinking moreso of bandwidth though (?)

FWIW I really appreciate this and am not trying to throw up any hurdles here, this has been an extremely common ask and will be really nice to have. :-)

title: Kubernetes Community Artifact Serving
authors:
- "@brendandburns"
owning-sig: sig-contributor-experience
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this the right SIG? if so we should CC them
I might suggest release as a possible better fit (or maybe testing)?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't really care.

The right fit is actually the k8s-infra working group.

That working group is under the auspices of 4 different SIGs. I don't care which one we choose (and honestly I think this really just shows that this field doesn't fit all KEPs)

@justinsb @dims let me know which one you want here.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

contrib-ex or cluster-lifecycle, IMO

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok, I'm sticking w/ contrib-ex unless there are violent objections.

Copy link
Member

@timothysc timothysc Jan 25, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This document describes how official artifacts (Container Images, Binaries) for the Kubernetes
project are managed and distributed.

This really should be owned by sig-release.

@calebamiles
Copy link
Contributor

/hold
use of NEXT_KEP_NUMBER is deprecated

@k8s-ci-robot k8s-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jan 24, 2019
@brendandburns
Copy link
Contributor Author

@calebamiles What is the right process? The template still talks about NEXT_KEP_NUMBER perhaps we should update it?

Copy link
Member

@thockin thockin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for converting to KEP. I know the image promoted has a KEP but that is focused on GCR for now.

Is this a good place to accumulate the details of the mirroring / distribution / verification design? How about details of global redirector design and availability and monitoring and alerting?

There are tons of details that need to be debated and written down.

title: Kubernetes Community Artifact Serving
authors:
- "@brendandburns"
owning-sig: sig-contributor-experience
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

contrib-ex or cluster-lifecycle, IMO

@k8s-ci-robot k8s-ci-robot added sig/architecture Categorizes an issue or PR as relevant to SIG Architecture. sig/pm labels Jan 24, 2019
@brendandburns
Copy link
Contributor Author

Comments addressed, still looking for feedback from @calebamiles about what I should do wrt NEXT_KEP_NUMBER.

@brendandburns
Copy link
Contributor Author

@thockin wrt to the additional details, I'd prefer a commit and iterate approach (as suggested in the KEP template) rather than try to get it all correct here, I think we're going to be learning as we go anyway.

@dims
Copy link
Member

dims commented Jan 24, 2019

I like this. +1 to iterate

/lgtm

cc @kubernetes/sig-contributor-experience-pr-reviews @nikhita @tpepper

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jan 24, 2019
@brendandburns
Copy link
Contributor Author

@dims, thanks for the lgtm. Do you know the right process for the NEXT_KEP_NUMBER stuff? That seems like the last blocker....

@k8s-ci-robot k8s-ci-robot removed the do-not-merge/blocked-paths Indicates that a PR should not merge because it touches files in blocked paths. label Jan 26, 2019
@brendandburns
Copy link
Contributor Author

Comments addressed. I personally don't think this needs any more bike-shedding. @dims @justinsb @thockin please indicate if there are any blockers, otherwise let's merge and iterate as needed.

@justaugustus
Copy link
Member

@brendandburns -- I would argue that this isn't bikeshedding, or maybe "bikeshedding for cause".

k8s-infra is a Working Group, which composed of:

  • SIG Arch
  • SIG ContribEx
  • SIG Release
  • SIG Testing

By SC definition, it is meant to be a short-lived effort.
Ultimately, the code and maintenance of process and procedure for artifact management will belong to some subproject, and by extension, the KEP should be owned by that subproject's SIG.

I think given the SIGs that are involved in the effort, SIG Release and the Release Engineering subproject is the most appropriate place.

There is also a KEP being discussed for building Kubernetes artifacts (#707) and it would be nice if these two were close together.

@justaugustus
Copy link
Member

As the question of ownership is between SIG ContribEx and SIG Release, I'm also adding the respective Chairs/TLs:

ContribEx:
/assign @Phillels @parispittman @cblecker @nikhita

Release (+1 from me):
/assign @calebamiles @tpepper

@parispittman
Copy link

This seems like it should be owned by SIG Release. If it's owned by contribex - who will maintain and be in the owners files? Assuming dims, justinsb, and brendandburns? I will circulate this on our mailing list.

title: Kubernetes Community Artifact Serving
authors:
- "@brendandburns"
owning-sig: sig-contributor-experience
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

strong disagree that contribex should own this, IMO this is sig-release, under their release-engineering subproject

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would be more comfortable with the merge and iterate approach if we got this right

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+100. I think that comment was also made in previous versions too.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 about sig-release.

cc @cblecker

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, this shouldn't be contribex. +1 to sig-release

@brendandburns
Copy link
Contributor Author

I'm fine with sig-release. @thockin any concerns?

I think that the k8s-infra working group isn't really a traditional working group. (I actually think it's more like a committee than a working group) it's never going to disband imho, since we're always going to need people to be on-call for the infrastructure that we deploy.

Copy link
Contributor

@javier-b-perez javier-b-perez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@timothysc
Copy link
Member

FWIW other foundations hire full-time staff to manage their infra, and imo CNCF should do the same.

Copy link
Member

@cblecker cblecker left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm okay with merge and iterate, provided the owning sig is changed

title: Kubernetes Community Artifact Serving
authors:
- "@brendandburns"
owning-sig: sig-contributor-experience
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, this shouldn't be contribex. +1 to sig-release

@justinsb
Copy link
Member

I think this looks great and is in keeping with what we discussed / agreed in the meetings. I'm now all enthusiastic to implement artifacts.k8s.io/kops now as a victim guinea pig :-)

@justaugustus
Copy link
Member

Closing this in favor of #791, which updates the owning SIG to SIG Release.
Please send approvals over there.

/close

@k8s-ci-robot
Copy link
Contributor

@justaugustus: Closed this PR.

In response to this:

Closing this in favor of #791, which updates the owning SIG to SIG Release.
Please send approvals over there.

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@brendandburns
Copy link
Contributor Author

brendandburns commented Jan 30, 2019

Please re-open, I don't think the process of hijacking into a new PR is a good idea.

Especially since you could have just added a Github suggestion to do the edit.

@brendandburns
Copy link
Contributor Author

/open

@justaugustus
Copy link
Member

The code suggestion was dismissed, but we've got it sorted now
/reopen

@k8s-ci-robot
Copy link
Contributor

@justaugustus: Failed to re-open PR: state cannot be changed. The master branch was force-pushed or recreated.

In response to this:

The code suggestion was dismissed, but we've got it sorted now
/reopen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. kind/kep Categorizes KEP tracking issues and PRs modifying the KEP directory sig/architecture Categorizes an issue or PR as relevant to SIG Architecture. sig/contributor-experience Categorizes an issue or PR as relevant to SIG Contributor Experience. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.