Use async apis #10

derwasp · 2019-04-17T11:53:56Z

Use async apis instead of sync apis for everything but the S3 download jobs because of S3: Data read has a different checksum than expected aws/aws-sdk-java-v2#953
Actually make the threads setting work: now we can limit the amount of parallel executions with it
Download artifacts after each job has finished and not at the end of all the jobs
Moved the helper functions to separate files

Closes #6 #2

move helpers & extensions to separate files use async apis

…bs via a queue

Denys Zhuravel added 11 commits April 16, 2019 10:48

pre-red file in chunks

513f4ec

move helpers & extensions to separate files use async apis

extract a function to run one build

e607b64

move a few things around

6d9885c

move everything to one function that limits the amount of parallel jo…

66e36e8

…bs via a queue

simplify usage of the dequeue function

f15acba

wait for the s3 tasks to finish after the jobs are scheduled

2e636c0

-

07a78c2

use the sync s3 client because of aws/aws-sdk-java-v2#953

220a043

await on the s3 tasks on the very end of the job

b774a9d

re: await on the s3 tasks on the very end of the job

c69ab78

remove the redundant runBlocking

3fa74d4

derwasp marked this pull request as ready for review April 20, 2019 13:44

derwasp requested a review from a team April 21, 2019 11:12

derwasp merged commit 89fab8e into master Apr 21, 2019

delete-merged-branch bot deleted the feature/use-async-apis branch April 21, 2019 11:12

Provide feedback