Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ember exam #1996

Merged
merged 10 commits into from
Aug 18, 2016
Merged

Add ember exam #1996

merged 10 commits into from
Aug 18, 2016

Conversation

jrjohnson
Copy link
Member

Ember exam makes it possible to split tests and run them in parallel. This has two advantages:

  1. Each travis build is faster (taking total time from 14minutes to 8 minutes)
  2. When there are errors it is easier to match criteria and run a smaller local set of tests to fix them.

It turns out there were some problems here that had to be worked out:
1 - testgroups just got in the way, they are removed, the bulk of the file changes are just removing those.
2 - We had some tests that would sporadically fail when run in isolation this way. I fixed those and that is the rest of the file changes. The next step is probably to add randomization to try and identify these ordering issues.

I attempted to keep commits separate so hopefully it is easy to follow the changes I had to make to get this working.

Add bower to cache
Split into 4 processes
Use multiple variables to split tests into acceptance groups
Move non-acceptance tests to the front so we will fail faster when they are broken
These were never that effective and ember-exam provides a better test
splitting strategy.
This was necessary for ember-cli 2.7 which moves the test loaded from
bower to NPM.
This is necessary because tests create and destroy this object very
quickly.
Test was only checking CPs and was flakey.
100ms isn't long enough, every other test here uses a full second.
@stopfstedt
Copy link
Member

👍

@stopfstedt stopfstedt merged commit f77774e into ilios:master Aug 18, 2016
@jrjohnson jrjohnson deleted the add-ember-exam branch August 18, 2016 16:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants