Unable to enable instance recovery on Terraform created instances

[stonith]

When Terraform creates instances, instance recovery is not available as an option in Cloudwatch. I was able to track this down to a bug in the AWS API. AWS is looking to fix this on their end however it's probably going to take some time as it may break functionality.

If you specify ephemeral storage via the API on an instance type that doesn't support ephemeral storage ie. C4, T2, etc. the block devices are created in AWS's system but not visible to the user in the instance OS, AWS Console, or API. I had to have a support person confirm that they saw the block devices on their end. As per the Instance Recovery documentation: "Currently, the recover action is not supported for... instances launched with block device mappings for instance store volumes." which means the invisible block devices end up blocking the instance recovery option.

Steps to Reproduce:

• create an instance that supports instance recovery ie. T2, C4, etc with Terraform (or AWS API AND specify ephemeral storage)
• attempt to enable instance recovery on the instance by creating a Cloudwatch alarm with the instance recovery action

Comparions

• create same instance via AWS Web Console and enable instance recovery
• create same instance via AWS API WITHOUT specifying ephemeral storage and enable instance recovery

[jen20]

Hi @stonith! Thanks for opening the issue. I'm going to merge this into #5388 (as it is marginally older), which I think is referencing the same thing. It looks like this should be fixable.

[ghost]

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.