[Form Recognizer] Resource group TrainingData used in test cases not found.

[zedy-wj]

We are running live Tests against other clouds like US Gov and Azure China Cloud. The goal is to check whether new azure sdk package work with other clouds or not.

Error Description:
An error occurs during the deployment of test resources:

     | Exception calling "Invoke" with "0" argument(s): "The running command
     | stopped because the preference variable "ErrorActionPreference" or
     | common parameter is set to Stop: 08:22:18 - The deployment
     | 't08ecd62c4b804a19' failed with error(s). Showing 3 out of 12 error(s).
     | Status Message: Resource group 'TrainingData' could not be found.
     | (Code:ResourceGroupNotFound)  Status Message: Resource group
     | 'TrainingData' could not be found. (Code:ResourceGroupNotFound)  Status
     | Message: Resource group 'TrainingData' could not be found.
     | (Code:ResourceGroupNotFound)  CorrelationId:
     | 8f7ec574-ab87-419c-8bae-8a0b4cbaee8a"

There is an existing storage account in the previous resource group TrainingData, in which some blobs and containers are created for use in some test cases. From the error message, this resource group( TrainingData) no longer exists. Should we restore this resource group or modify the test case?

This issue currently does not occur in UsGov and China clouds (the test team has configured static data in sovereign clouds). It only occurs in the Public cloud.

Pipeline status: https://dev.azure.com/azure-sdk/internal/_build/results?buildId=4364999&view=results

Expected behavior:
All tests can pass normally.

@kinelski, @benbp for notification.

[zedy-wj]

@benbp - The same error also occurs in js sdk form recognizer pipeline: https://dev.azure.com/azure-sdk/internal/_build/results?buildId=4365002&view=logs&j=43701d7e-216c-59bf-08d1-1efd0c7ac90a&t=ab7504d1-0931-5f5b-4856-14ba60b3e108&l=148. Do you have any ideas?

[jsquire]

@v-xuto: The label test-sovereign-cloud has been removed from the repository. Let's please not add it back in, it's unnecessary here.

[benbp]

@samvaity @weshaggard any idea if we used to port the training data resource group into sovereign subscriptions? I don't think we ever did, but not sure how these tests used to work then.

[weshaggard]

I don't believe so. I would suggest not test these that require static training data in the other clouds. I don't believe there is much if any value give the clouds should have the same version of the service deployed.

[zedy-wj]

@samvaity @weshaggard any idea if we used to port the training data resource group into sovereign subscriptions? I don't think we ever did, but not sure how these tests used to work then.

We (sovereign cloud testing team) once (about 3 years ago) manually migrated some static test data from Public Cloud to sovereign subscriptions (UsGov and China Clouds). And we have been testing in this way all along.

[zedy-wj]

Modified some information in description:

• This issue currently does not occur in UsGov and China clouds (the test team has configured static data in sovereign clouds). It only occurs in the Public cloud.

Since the daily pipeline of Form Recognizer has been disabled (for unknown reasons, it started on October 12th), in order to reproduce this issue, we temporarily enabled this pipeline (now it has been changed back to disabled state). The main branch is also experiencing the same problem.

Please refer to the latest daily pipeline of formrecognizer here: https://dev.azure.com/azure-sdk/internal/_build/results?buildId=4379949&view=results

[weshaggard]

This is probably related to the move to the TME subscription then. @benbp you copied over the training data storage account. It looks like we are missing an update to https://github.com/Azure/azure-sdk-for-net/blob/main/sdk/formrecognizer/test-resources.json, similar to what @samvaity did in java Azure/azure-sdk-for-java#42901

[kinelski]

This is probably related to the move to the TME subscription then. @benbp you copied over the training data storage account. It looks like we are missing an update to https://github.com/Azure/azure-sdk-for-net/blob/main/sdk/formrecognizer/test-resources.json, similar to what @samvaity did in java Azure/azure-sdk-for-java#42901

We did this for the new Form Recognizer library (aka Document Intelligence) in this PR: #47390

We can do the same for the old package.

It's been mentioned in this thread, but the pipeline for the old package is currently disabled, though. We still haven't migrated its tests to use identity-based authentication, and we have a couple of tests hanging in the service-side, which prevents us from re-recording (this is properly documented in this issue: #46605).

[zedy-wj]

The sovereign cloud testing work has come to an end. Thank you for your work and support. We will close this issue.