Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make XHarness tests run in parallel with other arcade testing #8252

Closed
1 of 2 tasks
michellemcdaniel opened this issue Dec 10, 2021 · 1 comment · Fixed by #8255
Closed
1 of 2 tasks

Make XHarness tests run in parallel with other arcade testing #8252

michellemcdaniel opened this issue Dec 10, 2021 · 1 comment · Fixed by #8255
Assignees

Comments

@michellemcdaniel
Copy link
Contributor

  • This issue is blocking
  • This issue is causing unreasonable pain

Today, XHarness tests run after all the regular arcade tests finish. Frequently, the xharness tests timeout, despite the regular tests completing successfully, and you have to rerun the entire job (aka, all of the arcade tests + all the xharness tests). Xharness tests should be broken out into a separate job per configuration, so that when they need to be rerun, we don't have to rerun ALL of the tests (and possibly time out again).

@premun
Copy link
Member

premun commented Dec 13, 2021

Oh, it looks like that when runtime is running the full BCL suite on the 10 iPhones we have and Arcade runs at the same time, they pile up on the few devices. I never noticed because runtime-staging rolling build only runs 2x a day and it's out of my hours.

Thanks for this @adiaaida. Can we now maybe prioritize #7979?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants