Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Arcade PR pipeline uploads GBs of pipeline artifacts unnecessarily #7979

Open
Tracked by #2053
premun opened this issue Sep 29, 2021 · 1 comment
Open
Tracked by #2053

Arcade PR pipeline uploads GBs of pipeline artifacts unnecessarily #7979

premun opened this issue Sep 29, 2021 · 1 comment

Comments

@premun
Copy link
Member

premun commented Sep 29, 2021

The Arcade PR pipeline takes over 1 hour to finish while it's doing some unnecessary things:

  • Uploading 6 GB of pipeline artifacts that are not used (it is upload in the Test phase at the very end)
  • Uploading 4 GB in the build phase where I don't think the artifacts are used for anything (needs to be verified)

Furthermore, when building the test phase, we send unit tests to 4 queues to test the Helix SDK. However, we build the tests 4 times even though we probably can only do it once, however, this does only takes several minutes so not a high priority

@ghost ghost added the Needs Triage A new issue that needs to be associated with an epic. label Sep 29, 2021
@premun premun added Needs Triage A new issue that needs to be associated with an epic. TechnicalDebt and removed Needs Triage A new issue that needs to be associated with an epic. labels Sep 29, 2021
@premun premun changed the title Arcade PR pipeline is inefficient Arcade PR pipeline uploads GBs of pipeline artifacts unnecessarily Sep 29, 2021
@premun premun removed the Needs Triage A new issue that needs to be associated with an epic. label Oct 20, 2021
@premun
Copy link
Member Author

premun commented Dec 13, 2021

This has now been amplified by #8252 since we upload build artifacts from the test stages (needlessly as there is no more stage after that which would use them) and now we upload them from all the new stages:

image

Maybe we could do something about this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants