Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

{CI} new pipeline to run full automation test for cross verification #12732

Merged
merged 9 commits into from
Mar 25, 2020

Conversation

haroldrandom
Copy link
Contributor

@haroldrandom haroldrandom commented Mar 24, 2020

This pipeline is for cross verification for Incremental Test.

Backgroud:

Currently, incremental test has a bug that it cannot verify on scenario that one change on a single command module has potential bad impact on another command module.
It can only run command modules based on modified files.
One of this scenario is bumping SDK.

Adding this pipeline to collect statistic and provide a backup for verification.

Test Plan:

This is the pipeline https://dev.azure.com/azure-sdk/public/_build?definitionId=1623&_a=summary

Follow Up

The exploit of Incremental Test will be fixed soon.


This checklist is used to make sure that common guidelines for a pull request are followed.

@haroldrandom haroldrandom added this to the S167 milestone Mar 24, 2020
@haroldrandom haroldrandom self-assigned this Mar 24, 2020
@haroldrandom haroldrandom requested a review from yonzhan March 24, 2020 08:40
@haroldrandom haroldrandom changed the title [CI] new pipeline to run full automation test [CI] new pipeline to run full automation test for cross verification Mar 24, 2020
@haroldrandom
Copy link
Contributor Author

The Automation Test that enabled Incremental Test of original pipeline has finished and the Automation Test of the new added full test pipeline is still running because it's running on all modules.

It's expected.
image

@Azure Azure deleted a comment from azure-pipelines bot Mar 24, 2020
@haroldrandom
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 2 pipeline(s).

@fengzhou-msft
Copy link
Member

How to trigger the specific pipeline?

@haroldrandom haroldrandom changed the title [CI] new pipeline to run full automation test for cross verification {CI} new pipeline to run full automation test for cross verification Mar 25, 2020
@haroldrandom
Copy link
Contributor Author

haroldrandom commented Mar 25, 2020

How to trigger the specific pipeline?

via comment here azp run Azure.azure-cli or azp run CLI Automation Full Test

@haroldrandom haroldrandom merged commit 1384789 into dev Mar 25, 2020
@haroldrandom haroldrandom deleted the full-test-pipeline branch March 25, 2020 07:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants