Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Code coverage status of Che repositories #18621

Closed
13 of 94 tasks
rhopp opened this issue Dec 15, 2020 · 3 comments
Closed
13 of 94 tasks

Code coverage status of Che repositories #18621

rhopp opened this issue Dec 15, 2020 · 3 comments
Labels
kind/epic A long-lived, PM-driven feature request. Must include a checklist of items that must be completed. kind/task Internal things, technical debt, and to-do tasks to be performed. lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. roadmap/6-months Epics that are planned to complete in the medium term (within 6 months) severity/P2 Has a minor but important impact to the usage or development of the system.

Comments

@rhopp
Copy link
Contributor

rhopp commented Dec 15, 2020

What

Different repositories are in different shape as per testing (unit tests mostly) goes. The problem is, that even though some of the owners/contributors of some of the repositories might know the state, it's generally not easy to obtain this information. And for some repositories this information does not exist at all. Goal of this issue is to analyze current status of testing & code coverage in all the repositories, that makes Che.

We are aware, that code coverage is "just a number" and that components with low coverage could be in good shape as well as components with great coverage could be in bad shape.

The goal of this issue is not to make a sudden strong push for every component to have very high coverage. It's more to analyze current status and create action items, if this analysis shows it's required.

How

We would like to do this in steps:

  1. Every team will make sure that code coverage analysis is in place in all their repos and will post current code coverage levels in here for initial analysis (to decide, whether further investment is needed here - will be decided on case-by-case basis)
    • If code coverage analysis does not make sense for some repos, that's valid output of this step as well.
  2. Teams will create automation, that will report current code coverage percentage.
    • As different repos are written in different languages and will most probably be using different tools for reporting this, we need to agree on single way of reporting this number, so it could then be scraped automatically monitored. First proposed solution was to use https://shields.io/category/coverage and place the badge into root Readme.md of the repo. (if anybody have a better idea, feel free to propose it)
  3. We (most probably QE) will create dashboard which will be scraping data provided by step 2. and monitor trends.

Step 1 tracking

Please update with current code coverage percentage. I understand that for quite some repositories it wouldn't make even sense to report any number. In such cases please fill not-applicable, preferably with short description why. This list of repositories was automatically generated using https://raw.githubusercontent.com/eclipse/che/master/.repositories.yaml

Step 2 tracking

Here plese check the checkbox, when you have automated reporting of current state done according to description of step 2. If you'll track this work as an issue, please link the issue here.

@rhopp rhopp added kind/epic A long-lived, PM-driven feature request. Must include a checklist of items that must be completed. kind/task Internal things, technical debt, and to-do tasks to be performed. labels Dec 15, 2020
@che-bot che-bot added the status/need-triage An issue that needs to be prioritized by the curator responsible for the triage. See https://github. label Dec 15, 2020
@azatsarynnyy azatsarynnyy added severity/P2 Has a minor but important impact to the usage or development of the system. and removed status/need-triage An issue that needs to be prioritized by the curator responsible for the triage. See https://github. labels Dec 15, 2020
@azatsarynnyy
Copy link
Member

I'm setting P2. Feel free to reprioritize it if needed.

@ericwill ericwill mentioned this issue Jan 14, 2021
33 tasks
amisevsk added a commit to eclipse-che/che-plugin-broker that referenced this issue Jan 14, 2021
Update badge source to comply with issue
eclipse-che/che#18621

Signed-off-by: Angel Misevski <[email protected]>
sleshchenko pushed a commit to eclipse-che/che-plugin-broker that referenced this issue Jan 15, 2021
Update badge source to comply with issue
eclipse-che/che#18621

Signed-off-by: Angel Misevski <[email protected]>
@sunix sunix assigned sunix and unassigned sunix Jan 28, 2021
@ericwill
Copy link
Contributor

ericwill commented Feb 2, 2021

* [ ]  [che-sidecar-bazel](https://github.com/che-dockerfiles/che-sidecar-bazel)

* [ ]  [che-sidecar-protobuf](https://github.com/che-dockerfiles/che-sidecar-protobuf)

* [ ]  [che-sidecar-tekton](https://github.com/che-dockerfiles/che-sidecar-tekton)

* [ ]  [che-sidecar-kubernetes-tooling](https://github.com/che-dockerfiles/che-sidecar-kubernetes-tooling)

* [ ]  [che-sidecar-openshift-connector](https://github.com/che-dockerfiles/che-sidecar-openshift-connector)

* [ ]  [che-sidecar-python](https://github.com/che-dockerfiles/che-sidecar-python)

* [ ]  [che-sidecar-go](https://github.com/che-dockerfiles/che-sidecar-go)

* [ ]  [che-sidecar-sonarlint](https://github.com/che-dockerfiles/che-sidecar-sonarlint)

* [ ]  [che-sidecar-dotnet](https://github.com/che-dockerfiles/che-sidecar-dotnet)

* [ ]  [che-sidecar-shellcheck](https://github.com/che-dockerfiles/che-sidecar-shellcheck)

* [ ]  [che-sidecar-camelk](https://github.com/che-dockerfiles/che-sidecar-camelk)

* [ ]  [che-sidecar-vale](https://github.com/che-dockerfiles/che-sidecar-vale)

* [ ]  [che-buildkit-base](https://github.com/che-dockerfiles/che-buildkit-base)

* [ ]  [che-sidecar-scala](https://github.com/che-dockerfiles/che-sidecar-scala)

* [ ]  [che-buildah-base](https://github.com/che-dockerfiles/che-buildah-base)

* [ ]  [che-sidecar-podman](https://github.com/che-dockerfiles/che-sidecar-podman)

* [ ]  [che-sidecar-clang](https://github.com/che-dockerfiles/che-sidecar-clang)

* [ ]  [che-sidecar-php](https://github.com/che-dockerfiles/che-sidecar-php)

* [ ]  [che-sidecar-java](https://github.com/che-dockerfiles/che-sidecar-java)

* [ ]  [che-sidecar-dependency-analytics](https://github.com/che-dockerfiles/che-sidecar-dependency-analytics)

* [ ]  [che-sidecar-node](https://github.com/che-dockerfiles/che-sidecar-node)

These are all part of the plugin registry now, they don't need to be listed here.

* [ ]  [devfile-registry](https://github.com/eclipse/che-devfile-registry)

This repo doesn't have any unit tests as it's mostly bash scripts and Dockerfiles.

@che-bot
Copy link
Contributor

che-bot commented Oct 12, 2021

Issues go stale after 180 days of inactivity. lifecycle/stale issues rot after an additional 7 days of inactivity and eventually close.

Mark the issue as fresh with /remove-lifecycle stale in a new comment.

If this issue is safe to close now please do so.

Moderators: Add lifecycle/frozen label to avoid stale mode.

@che-bot che-bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Oct 12, 2021
@l0rd l0rd added the roadmap/6-months Epics that are planned to complete in the medium term (within 6 months) label Oct 26, 2021
@che-bot che-bot closed this as completed Nov 4, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/epic A long-lived, PM-driven feature request. Must include a checklist of items that must be completed. kind/task Internal things, technical debt, and to-do tasks to be performed. lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. roadmap/6-months Epics that are planned to complete in the medium term (within 6 months) severity/P2 Has a minor but important impact to the usage or development of the system.
Projects
None yet
Development

No branches or pull requests

6 participants