Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Checking CircleCI tests run once and only once #2749

Merged
merged 54 commits into from
Sep 8, 2021

Conversation

algojack
Copy link
Contributor

Summary

Our partitioned tests might be skipping tests or running them twice. Here we want to make sure they don't do that.

Test Plan

Testing in CircleCI on this branch before merging to master

@algojack algojack self-assigned this Aug 16, 2021
@codecov-commenter
Copy link

codecov-commenter commented Aug 16, 2021

Codecov Report

Merging #2749 (d083c52) into master (9f81a92) will decrease coverage by 0.03%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #2749      +/-   ##
==========================================
- Coverage   47.14%   47.11%   -0.04%     
==========================================
  Files         349      349              
  Lines       56430    56430              
==========================================
- Hits        26606    26588      -18     
- Misses      26845    26861      +16     
- Partials     2979     2981       +2     
Impacted Files Coverage Δ
catchup/service.go 69.35% <0.00%> (-1.56%) ⬇️
network/requestTracker.go 70.25% <0.00%> (-1.30%) ⬇️
catchup/peerSelector.go 98.95% <0.00%> (-1.05%) ⬇️
cmd/tealdbg/debugger.go 72.86% <0.00%> (-1.01%) ⬇️
data/transactions/verify/txn.go 45.08% <0.00%> (-0.90%) ⬇️
ledger/acctupdates.go 62.13% <0.00%> (-0.42%) ⬇️
network/wsPeer.go 74.37% <0.00%> (ø)
network/wsNetwork.go 61.09% <0.00%> (ø)
data/transactions/logic/opcodes.go 100.00% <0.00%> (+4.00%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9f81a92...d083c52. Read the comment docs.

@algojack algojack force-pushed the jack/1489-checking-circleci-tests-run-only-once branch from c952d98 to 68e791c Compare August 17, 2021 18:19
@algojack algojack force-pushed the jack/1489-checking-circleci-tests-run-only-once branch from a5d4058 to 12bb942 Compare August 18, 2021 14:33
@algojack algojack marked this pull request as ready for review August 20, 2021 15:22
@cce
Copy link
Contributor

cce commented Sep 7, 2021

OK, I pushed the revert of 11d153a to undo the double-sharding skips that intentionally introduced.

@algojack
Copy link
Contributor Author

algojack commented Sep 7, 2021

once i clean up normal tests, i will switch to nightlies and clean up nightlies too, before switching back to normal.

cce
cce previously approved these changes Sep 7, 2021
@algojack algojack changed the title DO NOT MERGE - Checking CircleCI tests run once and only once Checking CircleCI tests run once and only once Sep 8, 2021
@algojohnlee algojohnlee merged commit 4da75fa into master Sep 8, 2021
@algojohnlee algojohnlee deleted the jack/1489-checking-circleci-tests-run-only-once branch September 8, 2021 20:40
algojohnlee pushed a commit that referenced this pull request Sep 16, 2021
Based on the matrix job @algojack added in #2749, this turns the other per-platform jobs into matrix jobs too. The most significant change in this PR is switching from building in the home directory (/home/circleci on Linux and /Users/distiller on Mac) to instead build out of /opt/cibuild to make it easier for the matrix jobs to share configuration.
PhearZero pushed a commit to PhearNet/crypto that referenced this pull request Jan 17, 2025
Our partitioned tests might be skipping tests or running them twice. Here we want to make sure they don't do that.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants