WIP - Parallelize CI, update run-int task #344
Conversation
- Break up test tasks by domain - Parallelize CI pipeline for faster tests
tasks/test.rake
Outdated
| 'test:monitoring', | ||
| 'test:pubsub', | ||
| 'test:sql', | ||
| 'test:storage'] |
There was a problem hiding this comment.
Style/StringLiterals: Prefer double-quoted strings unless you need single quotes to avoid extra backslashes for escaping.
tasks/test.rake
Outdated
| multitask :parallel => ['test:compute', | ||
| 'test:monitoring', | ||
| 'test:pubsub', | ||
| 'test:sql', |
There was a problem hiding this comment.
Style/StringLiterals: Prefer double-quoted strings unless you need single quotes to avoid extra backslashes for escaping.
tasks/test.rake
Outdated
| desc "Test everything in parallel" | ||
| multitask :parallel => ['test:compute', | ||
| 'test:monitoring', | ||
| 'test:pubsub', |
There was a problem hiding this comment.
Style/StringLiterals: Prefer double-quoted strings unless you need single quotes to avoid extra backslashes for escaping.
tasks/test.rake
Outdated
| namespace :test do | ||
| mock = ENV["FOG_MOCK"] || "true" | ||
| task :travis do | ||
| sh("export FOG_MOCK=#{mock} && bundle exec shindont") | ||
| end | ||
|
|
||
| desc "Test everything in parallel" | ||
| multitask :parallel => ['test:compute', | ||
| 'test:monitoring', |
There was a problem hiding this comment.
Style/StringLiterals: Prefer double-quoted strings unless you need single quotes to avoid extra backslashes for escaping.
tasks/test.rake
Outdated
| namespace :test do | ||
| mock = ENV["FOG_MOCK"] || "true" | ||
| task :travis do | ||
| sh("export FOG_MOCK=#{mock} && bundle exec shindont") | ||
| end | ||
|
|
||
| desc "Test everything in parallel" | ||
| multitask :parallel => ['test:compute', |
There was a problem hiding this comment.
Style/StringLiterals: Prefer double-quoted strings unless you need single quotes to avoid extra backslashes for escaping.
Temikus
force-pushed
the
update_ci
branch
2 times, most recently
from
f985b8e to
4376fa6
Compare
tasks/test.rake
Outdated
| "test:pubsub", | ||
| "test:sql", | ||
| "test:storage"] | ||
|
|
There was a problem hiding this comment.
Layout/TrailingWhitespace: Trailing whitespace detected.
Overall looks like a 3X speed improvement with a small caveat of slightly broken but useful output. Invoke with `rake test:parallel`
|
I'll merge this so I can benefit from it in the SQL branch. |
, allowing to get the results for relevant sections ASAP and compartmentalising test so they can be rerun if needed (in case of underlying API flakiness or collisions).
rake test:paralleltask, which has about 3X performance with a caveat of ugly (but useful) output.@icco FYI - this should improve our testing situation somewhat.