Unstable integration tests - cloudformation_exports_info #157

tremble · 2020-07-25T11:46:20Z

SUMMARY

cloudformation_exports_info tests frequently fail for example:


cloudformation_exports_info-SwS4ob / /root/ansible_collections/community/aws/tests/output/.tmp/integration/cloudformation_exports_info-1o029W-ÅÑŚÌβŁÈ/tests/integration/targets/cloudformation_exports_info/tasks/main.yml:12 / [testhost] testhost: cloudformation_exports_info : Create a minimal stack with an export set by parameter stack_name={{ stack_name }}, template_body={{ lookup('file','test_stack.yml') }}, template_parameters=AnsibleMapping([(u'TestParamName', u'cf-exports-param'), (u'TestParamValue', u'Set By CF Exports'), (u'BucketSuffix', u'{{ resource_prefix }}')])

failure: rc=0

{
"changed": true, 
"events": [
"StackEvent AWS::CloudFormation::Stack shippable-1597-30 ROLLBACK_COMPLETE", 
"StackEvent AWS::CloudFormation::Stack shippable-1597-30 ROLLBACK_IN_PROGRESS", 
"StackEvent AWS::CloudFormation::Stack shippable-1597-30 CREATE_IN_PROGRESS"
], 
"log": [], 
"output": "Problem with CREATE. Rollback complete", 
"resource_actions": [
"cloudformation:ListStackResources", 
"cloudformation:DescribeStackEvents", 
"cloudformation:CreateStack", 
"cloudformation:DescribeStacks"
], 
"stack_outputs": {}, 
"stack_resources": []
}

ISSUE TYPE

Bug Report

COMPONENT NAME

cloudformation
cloudformation_exports_info

ANSIBLE VERSION

CI

CONFIGURATION

CI

OS / ENVIRONMENT

C

STEPS TO REPRODUCE

Run integration tests in CI

EXPECTED RESULTS

Tests consistently pass

ACTUAL RESULTS

Up to a 50% failure rate

The text was updated successfully, but these errors were encountered:

…rates over the last week ansible-collections#158 ansible-collections#157 ansible-collections#159 ansible-collections#153 ansible-collections#154 ansible-collections#155 ansible-collections#156

…rates over the last week (#160) #158 #157 #159 #153 #154 #155 #156

ansibullbot · 2021-02-21T10:29:45Z

Files identified in the description:

If these files are inaccurate, please update the component name section of the description or use the !component bot command.

click here for bot help

ansibullbot · 2021-02-21T10:29:45Z

cc @jillr @mmoyle @s-hertel @wimnat
click here for bot help

ansibullbot · 2021-02-21T10:45:26Z

Files identified in the description:

[plugins/modules/cloudformation_exports_info.py](https://github.com/['ansible-collections/amazon.aws', 'ansible-collections/community.aws', 'ansible-collections/community.vmware']/blob/main/plugins/modules/cloudformation_exports_info.py)

If these files are inaccurate, please update the component name section of the description or use the !component bot command.

click here for bot help

…rates over the last week (ansible-collections#160) ansible-collections#158 ansible-collections#157 ansible-collections#159 ansible-collections#153 ansible-collections#154 ansible-collections#155 ansible-collections#156

…g so much in parallel so we shouldn't have the capacity related issues we were seeing (#1349) Mark cloudformation_exports_info tests stable again SUMMARY fixes: #157 re-enable the cloudformation_exports_info tests. The CI account isn't as busy these days because we don't run "full" integration tests anywhere near as often any more. This should mean that the (likely) capacity related issues we were seeing should be gone. ISSUE TYPE Bugfix Pull Request COMPONENT NAME cloudformation_exports_info ADDITIONAL INFORMATION Reviewed-by: Alina Buzachis <None>

…rates over the last week (ansible-collections#160) ansible-collections/community.aws#158 ansible-collections/community.aws#157 ansible-collections/community.aws#159 ansible-collections/community.aws#153 ansible-collections/community.aws#154 ansible-collections/community.aws#155 ansible-collections/community.aws#156 This commit was initially merged in https://github.com/ansible-collections/community.aws See: ansible-collections/community.aws@61783c7

tremble mentioned this issue Jul 25, 2020

Mark a number of integration tests as unstable based on high failure rates over the last week #160

Merged

jillr pushed a commit that referenced this issue Jul 27, 2020

Mark a number of integration tests as unstable based on high failure …

61783c7

…rates over the last week (#160) #158 #157 #159 #153 #154 #155 #156

This comment has been minimized.

Sign in to view

ansibullbot added affects_2.10 has_pr needs_info This issue requires further information. Please answer any outstanding questions needs_template This issue/PR has an incomplete description. Please fill in the proposed template correctly needs_triage labels Aug 19, 2020

goneri added CI and removed needs_triage labels Feb 10, 2021

ansibullbot added bug This issue/PR relates to a bug module module and removed needs_info This issue requires further information. Please answer any outstanding questions needs_template This issue/PR has an incomplete description. Please fill in the proposed template correctly labels Feb 21, 2021

tremble mentioned this issue Jul 12, 2022

Mark cloudformation_exports_info tests stable again #1349

Merged

tremble closed this as completed Jul 12, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Unstable integration tests - cloudformation_exports_info #157

Unstable integration tests - cloudformation_exports_info #157

tremble commented Jul 25, 2020 •

edited

Loading

This comment has been minimized.

This comment has been minimized.

ansibullbot commented Feb 21, 2021 •

edited by tremble

Loading

ansibullbot commented Feb 21, 2021

ansibullbot commented Feb 21, 2021

Unstable integration tests - cloudformation_exports_info #157

Unstable integration tests - cloudformation_exports_info #157

Comments

tremble commented Jul 25, 2020 • edited Loading

SUMMARY

ISSUE TYPE

COMPONENT NAME

ANSIBLE VERSION

CONFIGURATION

OS / ENVIRONMENT

STEPS TO REPRODUCE

EXPECTED RESULTS

ACTUAL RESULTS

This comment has been minimized.

This comment has been minimized.

ansibullbot commented Feb 21, 2021 • edited by tremble Loading

ansibullbot commented Feb 21, 2021

ansibullbot commented Feb 21, 2021

tremble commented Jul 25, 2020 •

edited

Loading

ansibullbot commented Feb 21, 2021 •

edited by tremble

Loading