-
Notifications
You must be signed in to change notification settings - Fork 93
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CI: switch to codecov CircleCI orb #995
Conversation
fbbca8c
to
ed5a6c9
Compare
Codecov Report
@@ Coverage Diff @@
## develop #995 +/- ##
===========================================
- Coverage 60.43% 59.15% -1.29%
===========================================
Files 42 45 +3
Lines 5750 8353 +2603
===========================================
+ Hits 3475 4941 +1466
- Misses 1827 2950 +1123
- Partials 448 462 +14
Continue to review full report at Codecov.
|
2a265f0
to
c628b7c
Compare
c628b7c
to
ac4a324
Compare
I know you are still working on this, but once you are ready if you can please replace upload_coverage on line 64 in .circleci/config.yml too, and delete the upload_coverage.sh script |
36f0c77
to
7648a30
Compare
I looked into why the coverage is changing in this PR (causing it to fail as intended when coverage decreases) even though we're not actually touching the code being tested. I suspect the answer is hidden in this bash script though I haven't identified the exact cause. It is re-writing the coverage file before uploading (you can see the Regardless of the root cause of the above, the difference we're seeing is that the previously untracked files |
What do you think about setting a coverage target for new code only? We can discuss the target, I'd consider something like 75% to start but maybe we can go higher? https://docs.codecov.com/docs/common-recipe-list#ensure-all-code-is-covered |
The default config has a project check which checks the coverage of the project as a whole is non-decreasing, and a patch check which verifies the coverage in the PR is greater than some limit you set. I disabled the patch in favor of just ensuring that we're always increasing coverage as a whole. My thinking was that setting 70% per patch will never guarantee that we get above 70% while just ensuring that we're improving the project's coverage in theory will. I'm open to different settings if people have strong opinions about it. |
Discussed this morning and we've agreed to track the coverage % in the patch, and to initially prevent it from blocking PRs on failure. In the future as we get more complete coverage we will enable it to block PRs on failure. |
updated title, this uses a circleci orb, not a github action |
Summary
Add a codecov config file to directly configure upload steps instead of using the bash uploader since that has been deprecated.