Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Basic auth deprecated on latest GKE (Cloud Foundation templates) #463

Open
claudiobizzotto opened this issue Jun 6, 2019 · 9 comments · May be fixed by #464
Open

Basic auth deprecated on latest GKE (Cloud Foundation templates) #463

claudiobizzotto opened this issue Jun 6, 2019 · 9 comments · May be fixed by #464

Comments

@claudiobizzotto
Copy link
Contributor

claudiobizzotto commented Jun 6, 2019

Using the GKE Cloud Foundation templates to upgrade GKE to version 1.12+ will throw an error like the following:

ERROR: (gcloud.deployment-manager.deployments.update) Error in Operation [operation-xxx]: errors:
- code: REFERENCE_VALUE_NOT_FOUND
location: /deployments/xxx/resources/xxx->$.properties
message: |-
The reference 'masterAuth.clientCertificate' is not found, reason:
The resource 'xxx' exists, but the reference value does not.

It looks like masterAuth has been deprecated as of June 3rd 2019:
"Basic authentication and client certificate issuance are disabled by default for clusters created with GKE 1.12 and higher. We recommend switching your clusters to use OpenID instead."

@claudiobizzotto claudiobizzotto linked a pull request Jun 6, 2019 that will close this issue
@bohdanyurov-gl
Copy link

Related issue:
#436

@bohdanyurov-gl
Copy link

This was previously fixed, but error is still reproducible if we don't specify cluster version

bohdanyurov-gl added a commit to bohdanyurov-gl/cloud-foundation-toolkit that referenced this issue Jun 18, 2019
GoogleCloudPlatform#110
GoogleCloudPlatform/deploymentmanager-samples#436
GoogleCloudPlatform/deploymentmanager-samples#463

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Removed deprecated "nodeConfig", switch to "nodePools[].config"
- Removed deprecated "initialNodeCount", switch to
"nodePools[].initial_node_count"
- Removed deprecated "privateCluster", "masterIpv4CidrBlock" ->
"privateClusterConfig"
- Updated parameters: "masterAuth", "loggingService",
"monitoringService", "addonsConfig",
"ipAllocationPolicy" and others
- Added support for "nodePools[]", "binaryAuthorization", "autoscaling",
"networkConfig", "defaultMaxPodsConstraint",
"resourceUsageExportConfig", "authenticatorGroupsConfig",
"verticalPodAutoscaling", "tierSettings", "workloadIdentityConfig",
"nodeConfig->diskType,sandboxConfig,shieldedInstanceConfig",
"enableTpu", "databaseEncryption"
- Added uniqueItems: true and additionalProperties: false
ocsig pushed a commit to GoogleCloudPlatform/cloud-foundation-toolkit that referenced this issue Jun 24, 2019
#110
GoogleCloudPlatform/deploymentmanager-samples#436
GoogleCloudPlatform/deploymentmanager-samples#463

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Removed deprecated "nodeConfig", switch to "nodePools[].config"
- Removed deprecated "initialNodeCount", switch to
"nodePools[].initial_node_count"
- Removed deprecated "privateCluster", "masterIpv4CidrBlock" ->
"privateClusterConfig"
- Updated parameters: "masterAuth", "loggingService",
"monitoringService", "addonsConfig",
"ipAllocationPolicy" and others
- Added support for "nodePools[]", "binaryAuthorization", "autoscaling",
"networkConfig", "defaultMaxPodsConstraint",
"resourceUsageExportConfig", "authenticatorGroupsConfig",
"verticalPodAutoscaling", "tierSettings", "workloadIdentityConfig",
"nodeConfig->diskType,sandboxConfig,shieldedInstanceConfig",
"enableTpu", "databaseEncryption"
- Added uniqueItems: true and additionalProperties: false
@gbhojak
Copy link

gbhojak commented Aug 13, 2019

Hi,

Is there a workaround for this issue?
I have specified 'initialClusterVersion' in the template and I still get this error.

Regards,
Giriraj

@nick4fake
Copy link

@gbhojak Are you sure you are using latest version?
I am also not sure if all the changes are present in master now.

@ocsig ^

@dtapia-rdc
Copy link

dtapia-rdc commented Aug 14, 2019

I've just tested with
InitialClusterVersion: '1.12.8-gke.10' and InitialClusterVersion: '1.13.7-gke.8'

Still fails the deployment with

- code: REFERENCE_VALUE_NOT_FOUND
  location: /deployments/dev-gke-deployment/resources/eng-dev-kubernetes->$.properties
  message: |-
    The reference 'masterAuth.clientCertificate' is not found, reason:
    The resource 'eng-dev-kubernetes' exists, but the reference value does not.

Using cft apply

@claudiobizzotto
Copy link
Contributor Author

claudiobizzotto commented Aug 15, 2019

I'm tellin ya dawg, this shis broken.

@ocsig
Copy link
Member

ocsig commented Aug 15, 2019

@dtapia-rdc @claudiobizzotto Can you please confirm which template are you using?
At the other repo, cft-dm-dev branch there is the latest version.

@gbhojak
Copy link

gbhojak commented Aug 15, 2019

HI @nick4fake and @ocsig ,

I have used the template available in master at gke

Regards,
Giriraj

@claudiobizzotto
Copy link
Contributor Author

I'm using the gke.py that I've submitted here (without masterAuth).

ocsig added a commit to GoogleCloudPlatform/cloud-foundation-toolkit that referenced this issue Sep 3, 2019
* [DM] cloud_router: refactoring (#64)

#51

- Added version, links to docs
- Added support for "description"
- Switched to using type provider
- Added support for cross-project resource creation
- Added missing fields:
  - bgp (only asn is supported now)
  - nats
  - bgpPeers
  - interfaces
- Added basic schema unit tests

* [DM] project: refactoring (#59)

#57

- Added version, links to docs
- Added "labels" support
- Added resource name prefix
- Updated compute-beta to compute-v1
- Fixed deprecated gcp-types/compute-v1:compute.subnetworks.setIamPolicy
bindings
- Refactored default resources removal: remove code duplication
- Added usageExportBucket name prefix

* [DM] gcs_bucket: refactoring (#83)

#66

- Added version, links to docs
- Added uniqueItems: true to lists
- Switched to using type provider
- Added cross-project creation support
- Added additionalProperties: false for nested object
- Fixed "bindings" schema
- Added support for "requesterPays"
- Added support for "acl", "billing", "cors", "defaultEventBasedHold", "defaultObjectAcl", "encryption", "iamConfiguration", "retentionPolicy"
- Fixed resource name

* [DM] network: refactoring (#61)

#56

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation (both network and
subnetwork)
- Added oneOf check for subnets: autoCreateSubnetworks should be exclusive
with subnet list
- Fixed network & subnetworks resources names
- Added support for "description", "routingConfig" to network
- Fixed "secondaryIpRanges" definition in subnetwork
- Added basic schema unit tests

* [DM] cloud_sql: refactoring (#62)

#54

- Added version, links to docs
- Switched to using type provider
- Added enum for "databaseVersion", "region", "settings.pricingPlan",
"settings.replicationType"
- Added additionalProperties: false for nested object
- Fixed "users" schema
- Added basic schemas unit tests

* [DM] cloud_spanner: refactoring (#63)

#53

- Added version, links to docs
- Added support for "labels"
- Switched to using type provider
- Made "name" optional, correctly handle it
- Added support for cross-project resource creation
- Updated "instanceConfig" enum with new values
- Added basic schema unit tests
- Added additionalProperties: false for nested objects

* [DM] instance: refactoring (#84)

#70

- Added version, links to docs
- Switched to using type provider
- Added cross-project creation support
- Added additionalProperties: false for nested objects
- Added support for "description", "networkInterfaces[].accessConfigs[]",
"networkInterfaces[].aliasIpRanges[]", "disks", "scheduling", "labels",
"minCpuPlatform", "guestAccelerators", "deletionProtection", "hostname",
"shieldedInstanceConfig", "shieldedInstanceIntegrityPolicy":
[docs](https://cloud.google.com/compute/docs/reference/rest/v1/instances/insert)
- Fixed resource name

* [DM] autoscaler: refactoring (#82)

#67

- Added version, links to docs
- Switched to using type provider
- Added cross-project creation support
- Added additionalProperties: false for nested object
- Fixed resource name

* [DM] cloud_function: refactoring (#65)

#52

- Added version, links to docs
- Switched to using type provider
- Upgraded API version: v1beta2 -> v1
- Added cross-project creation support (including upload.py)
- Added support for "labels", "environmentVariables" fields
- Renamed "region" to "location" with backward compatibility + there is
oneOf check
- Added new runtimes, change default to nodejs10
- Fixed function upload code (it is not redeployed after code upload when
using other project)
- Updated source upload logic:

- If "sourceRepository" field is present, use it as-is
- If "sourceRepositoryUrl" field is provided, change it to
"sourceRepository" format
- If "sourceArchiveUrl" is provided, use it as-is
- If "localUploadPath" is present, create cloudbuild build for function
zip file. Use "sourceArchiveUrl" as target or generate it automatically
(providing generated path via ""sourceArchiveUrl")
- If "sourceUploadUrl" is present, use it as-is
- All other parameter combinations should be restricted

* Fixes #55: DM/folder: refactoring
#55

- added version, links to docs
- fixed folder resource names: use base resource name as a template
- added oneOf check for folderId/orgId + fix incorrect schema for array
- fixed "displayName" regex
- made "name" field optional
- using the same format for parent as in project + fixed name prefix to
plural

* Fixes #69: DM/managed_instance_group: refactoring (#90)

#69

- Added version, links to docs
- Switched to using type provider
- Added cross-project creation support
- Added additionalProperties: false for nested objects
- Fixed resource name

* [DM] instance_template refactoring (#89)

#68

- Added version, links to docs
- Switched to using type provider
- Added cross-project creation support
- Added additionalProperties: false for nested objects
- Added support for "networkInterfaces[].accessConfigs[]", "disks",
"scheduling", "minCpuPlatform", "guestAccelerators",
"shieldedInstanceConfig", "sourceInstance", "sourceInstanceParams"
- Fixed resource name

* Fixes #119: DM/route: refactoring (#120)

#119

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Fixed arrays, objects and required fields (check for routeType + make
old scheme optional)
- Added missing fields: "description", "nextHopInstance",
"nextHopInstance", "nextHopNetwork", "nextHopGateway",
"nextHopVpnTunnel"

* Fixes #119: DM/route: refactoring
#119

Small typo, rechecked tests

* CFT build config to point to the correct license file

* [DM][FIX] Project: SA can not be created ("project_id" field is unknown)

#149

* [DM] iam_member: refactoring (#129)

* Fixes #116: DM/iam_member: refactoring
#116

* [DM] firewall: refactoring (#100)

#99
#91

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Upgraded compute-beta to compute-v1
- Fixed resource names
- Added schema to "rules": "name", "description", "priority",
"sourceRanges", "destinationRanges", "sourceTags", "targetTags",
"sourceServiceAccounts", "targetServiceAccounts", "allowed", "denied",
"direction", "logConfig", "disabled"

* [DM] bastion: refactoring (#102)

#101

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Fixed instance.py outputs (it lacks internalIp/externalIP)
- Fixed endless loops in tests

* [DM] backend_service: refactoring (#104)

#103

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Added new fields: "backends[].maxRatePerEndpoint,
.maxConnectionsPerEndpoint", "iap", "customRequestHeaders[]"
- Changed healthCheck to healthChecks[]
- Added checks for INTERNAL/EXTERNAL LB schemes for all relevant fields
- Added checks for backends[].balancingMode

* [DM] bigquery: refactoring (#106)

#105

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Added missing fields to datasets: "friendlyName",
"defaultPartitionExpirationMs", "labels", "access"
- Added missing fields to tables: "description", "labels", "clustering",
"requirePartitionFilter", "externalDataConfiguration",
"encryptionConfiguration"
- Fixed resource names
- Added uniqueItems: true and additionalProperties: false

* [DM] gke: refactoring (#111)

#110
GoogleCloudPlatform/deploymentmanager-samples#436
GoogleCloudPlatform/deploymentmanager-samples#463

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Removed deprecated "nodeConfig", switch to "nodePools[].config"
- Removed deprecated "initialNodeCount", switch to
"nodePools[].initial_node_count"
- Removed deprecated "privateCluster", "masterIpv4CidrBlock" ->
"privateClusterConfig"
- Updated parameters: "masterAuth", "loggingService",
"monitoringService", "addonsConfig",
"ipAllocationPolicy" and others
- Added support for "nodePools[]", "binaryAuthorization", "autoscaling",
"networkConfig", "defaultMaxPodsConstraint",
"resourceUsageExportConfig", "authenticatorGroupsConfig",
"verticalPodAutoscaling", "tierSettings", "workloadIdentityConfig",
"nodeConfig->diskType,sandboxConfig,shieldedInstanceConfig",
"enableTpu", "databaseEncryption"
- Added uniqueItems: true and additionalProperties: false

* [DM] kms: refactoring (#128)

#117

- Added version, links to docs
- Added support for cross-project resource creation
- Fixed resource names
- Added missing algorithms

* [DM] pubsub: refactoring (#125)

#118

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Added topic fields: "labels"
- Added subscription fields: "pushConfig", "retainAckedMessages",
"messageRetentionDuration", "labels", "expirationPolicy"

* Fixes #115: DM/iam_custom_role: refactoring (#130)

#115

- Added version, links to docs
- Added support for cross-project resource creation
- Added support for "stage" field

* [DM] ip_reservation: refactoring (#133)

#132

- Addde version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Added missing fields: "prefixLength", "networkTier"
- Fixed field checks

* [DM] IAM_member folder and org support (#166)

#162

Added support for folders and organizations:
gcp-types/cloudresourcemanager-v1:virtual.projects.iamMemberBinding
gcp-types/cloudresourcemanager-v2:virtual.folders.iamMemberBinding
gcp-types/cloudresourcemanager-v1:virtual.organizations.iamMemberBinding

* [DM] healthcheck: refactoring (#131)

#124

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Added support for missing fields: "description", "name"

* [DM] nat_gateway: refactoring (#134)

#123

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation

* [DM] ssl_certificate: refactoring (#152)

#148

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names

* [DM] url_map: refactoring (#155)

#153

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names

* [DM] target_proxy: refactoring (#156)

#154

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Upgraded compute api version
- Fixed fields descriptions, add checks to arrays and objects
- Added support for "sslCertificates"

* [DM] forwarding_rule: refactoring (#157)

#141

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Fixed descriptions
- Added support for fields: "serviceLabel", "networkTier",
"allPorts"
- Added strict properties checking

* [DM] external_load_balancer: refactoring (#159)

#140

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names

* [DM] Internal_load_balancer: refactoring (#168)

#143

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names

* [DM] haproxy: refactoring (#169)

#142

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Fixed imports

* [DM] dataproc: refactoring (#170)

#137

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Added missing fields: "labels", "<nodes>.imageUri",
"<nodes>.isPreemptible", "<nodes>.accelerators",
"softwareConfig.optionalComponents", "encryptionConfig"
- Mergeed master, nodes and secondary nodes

* [DM][BugFix] GKE template examples (#172)

#171

* [DM] dns_managed_zone: refactoring #138 (#176)

* [DM] Project Factory readme extension

Adding Service Usage Admin to prerequisites

* [DM] Patch IAM member to projectID (#187)

* [DM] Patch IAM member to projectID

Project ID was forcefully overwritten to context.env['project']

* [DM] CloudDNS - Backwards compatibility and bugfixes (#192)

Added Backward Compatibility with the old property zoneName. Added Backward Compatibility Integration Test. Fixed Identation of integration tests and added project parameter for gcloud calls. Adjusted schema paterns. Added description for all the tests. Updated README

* Fix couple of typographical errors.

* Fix prerequisites target name in docs and Makefile

* [DM] - IAM needs to depends on SA existance (#222)

#175

* [DM] interconnect_attachment: refactoring (#195)

#183

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Added missing fileds: "pairingKey", "vlanTag8021q", "adminEnabled",
"candidateSubnets", "bandwidth", "partnerMetadata", "partnerAsn"

* [DM] runtime_config: refactoring (#201)

#184

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Standardized naming

* [DM] interconnect: refactoring (#196)

#182

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Updateed/added fields: "linkType", "requestedLinkCount",
"interconnectType"

* [DM] backwards compatibility and styling fix

Fixed Backward Compatibility Support. Fixed pydocstyle D210, D202. Restricted dnsName pattern to comply with RFC. 1035 #138 (#194)

* [DM] Cloud DNS - Fix/162 (#165)

* [DM] CloudDNS - Backwards compatibility and bugfixes (#192)

Added Backward Compatibility with the old property zoneName. Added Backward Compatibility Integration Test. Fixed Identation of integration tests and added project parameter for gcloud calls. Adjusted schema paterns. Added description for all the tests. Updated README

* Fixes #162: [DM] IAM_member folder and org support
#162
#151

Added support for folders and organizations:
gcp-types/cloudresourcemanager-v1:virtual.projects.iamMemberBinding
gcp-types/cloudresourcemanager-v2:virtual.folders.iamMemberBinding
gcp-types/cloudresourcemanager-v1:virtual.organizations.iamMemberBinding

Updated tests to be non-interactive + added tests for folders

Fixed removal of mid-list members

* [DM] Refactored dns_records template #139 (#197)

* [DM] vpn: refactoring (#202)

#186

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Added missing router property

* [DM] stackdriver_metric_descriptor: refactoring (#207)

#185

- Added version, links to docs
- Added support for cross-project resource creation
- Fixed resource names
- Added support for "launchStage", deprecated "metadata.launchStage"
- Added checks for "unit"

* [DM] cloudbuild: refactoring (#211)

#180

- Added version, links to docs
- Added support for cross-project resource creation
- Fixed resource names
- Added checks to objects and arrays
- Fixed "artifacts.objects" property, add "options.workerPool, env,
secretEnv, volumes" for cloudbuild
- Added "tags", "github", "triggerTemplate.revision->commitSha" for
trigger

* [DM] cloud_tasks: refactoring (#212)

#179

- Added version
- Fixed resource names

* [DM] network_peering: refactoring (#214)

#145

- Added version, links to docs
- Added support for cross-project resource creation
- Fixed resource names
- Added support for "networkPeering" field

* [DM] Shared VPC Subnet IAM refactoring

Refactored shared_vpc_subnet_iam template. Added bindings and policy syntax tests(in addition to legacy syntax check) (#215)

* [DM] Backend_service update example according to schema validation (#221)

#220

* [DM] cloud_tasks: refactoring (#208)

#179

- Added version
- Fixed resource names

* [DM] logsink: refactoring (#228)

#144

- Added version, links to docs
- Added support for cross-project resource creation
- Fixed resource names

* Enable users to specify network reference in the firewall DM template.

* Enable GKE DM template to support 'latest' initial cluster version.

* Change the logic of checking initial cluster version in the GKE DM template.

* [DM] Org_Policy updates(#231) 

- Added version, links to docs
  - Fixed resource names
  - Fixed pydocstyle warnings
  - Added schema validation against the API documentation
  - Added project parameter to gcloud deployment-manager calls

* [DM] forseti: refactoring (#239)

#181

- Added version, links to docs
- Switched to using type provider

* [DM] Enable cloud_router DM template to support networkURL. (#235)

* Enable cloud_router to support networkURL.

* Update cloud_router DM schema for netowrkURL and networkName.

* Continue to use network instead of networkName so that the CL is not a breaking change.

* Update cloud_router DM schema.

* Update cloud_router.py.schema

* [DM] logsink test fix

Following topic rename in test file

* [DM] Small fixes to templates. (#268)

* [DM] fix healthcheck type property

#270

* [DM] fixing CloudSQL example

* HA proxy example remove unneeded import

* [DM] adding schema validation test

* [DM] bastion bats improve

* [DM] Bastion test disk size correction

* [DM] Fixes #269: DM dev branch quality control (#282)

* Fixes #269: DM dev branch quality control
#269

- Fixed templates/bigquery/tests/integration/bigquery.bats

* Fixes #269: DM dev branch quality control
#269

- Fixed templates/haproxy/tests/integration/haproxy.bats

* Fixes #269: DM dev branch quality control
#269

- Fixed templates/instance_template/tests/integration/instance_template_networks.bats

* Fixes #269: DM dev branch quality control
#269

- Fixed templates/instance/tests/integration/instance.bats

* Fixes #269: DM dev branch quality control
#269

- Fixed templates/instance/tests/integration/instance_template/instance_template.bats

* Fixes #269: DM dev branch quality control
#269

- Fixed templates/shared_vpc_subnet_iam/tests/integration/shared_vpc_subnet_iam.bats

* [DM] Fixing External LB test cleanup

* [DM] Updating changelog (#293)

* Updating changelog

* Adding container images to run tests in CI.

* [DM] warning for bastion host sudoers (#297)

Priorities are default to 1000, not incrementing.

Adding debug messages.

* [DM] Isolate a single template from route DM template. (#257)

* Split route DM template into two parts: a route group and a single route.

* Enable single_route DM template to accept VPN tunnel URL.

* Always use context.env name in single_route DM template.

* Allow users to specify single_route real name in DM template.

* [DM] Enable VPN DM template to support static routing. (#234)

* Enable VPN DM template to support static routing.

* remove two string init, recover comments for address API link.

* recover name and project on the adress resource in VPN DM template.

* Update VPN DM template schema.

* Change routerName back to router.

* Enable VPN template to output an URI of the created VPN tunnel.

* VPN DM schema add uniqItems on selectors.

* [DM] Fixed a path error in an Cloud SQL exampl… (#300)

* farisjarrah/cloud-sql-docs: rebased off of cft-dm-dev to submit to upstream dev branch

* farisjarrah/cloud-sql-docs: fixed postgres version number type, and ensured that the templates matched the cft-dm-dev branch schema for cloud sql
SnowmanSeniorDev added a commit to SnowmanSeniorDev/cloud-foundation-toolkit that referenced this issue Apr 17, 2023
* [DM] cloud_router: refactoring (#64)

GoogleCloudPlatform/cloud-foundation-toolkit#51

- Added version, links to docs
- Added support for "description"
- Switched to using type provider
- Added support for cross-project resource creation
- Added missing fields:
  - bgp (only asn is supported now)
  - nats
  - bgpPeers
  - interfaces
- Added basic schema unit tests

* [DM] project: refactoring (#59)

GoogleCloudPlatform/cloud-foundation-toolkit#57

- Added version, links to docs
- Added "labels" support
- Added resource name prefix
- Updated compute-beta to compute-v1
- Fixed deprecated gcp-types/compute-v1:compute.subnetworks.setIamPolicy
bindings
- Refactored default resources removal: remove code duplication
- Added usageExportBucket name prefix

* [DM] gcs_bucket: refactoring (#83)

GoogleCloudPlatform/cloud-foundation-toolkit#66

- Added version, links to docs
- Added uniqueItems: true to lists
- Switched to using type provider
- Added cross-project creation support
- Added additionalProperties: false for nested object
- Fixed "bindings" schema
- Added support for "requesterPays"
- Added support for "acl", "billing", "cors", "defaultEventBasedHold", "defaultObjectAcl", "encryption", "iamConfiguration", "retentionPolicy"
- Fixed resource name

* [DM] network: refactoring (#61)

GoogleCloudPlatform/cloud-foundation-toolkit#56

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation (both network and
subnetwork)
- Added oneOf check for subnets: autoCreateSubnetworks should be exclusive
with subnet list
- Fixed network & subnetworks resources names
- Added support for "description", "routingConfig" to network
- Fixed "secondaryIpRanges" definition in subnetwork
- Added basic schema unit tests

* [DM] cloud_sql: refactoring (#62)

GoogleCloudPlatform/cloud-foundation-toolkit#54

- Added version, links to docs
- Switched to using type provider
- Added enum for "databaseVersion", "region", "settings.pricingPlan",
"settings.replicationType"
- Added additionalProperties: false for nested object
- Fixed "users" schema
- Added basic schemas unit tests

* [DM] cloud_spanner: refactoring (#63)

GoogleCloudPlatform/cloud-foundation-toolkit#53

- Added version, links to docs
- Added support for "labels"
- Switched to using type provider
- Made "name" optional, correctly handle it
- Added support for cross-project resource creation
- Updated "instanceConfig" enum with new values
- Added basic schema unit tests
- Added additionalProperties: false for nested objects

* [DM] instance: refactoring (#84)

GoogleCloudPlatform/cloud-foundation-toolkit#70

- Added version, links to docs
- Switched to using type provider
- Added cross-project creation support
- Added additionalProperties: false for nested objects
- Added support for "description", "networkInterfaces[].accessConfigs[]",
"networkInterfaces[].aliasIpRanges[]", "disks", "scheduling", "labels",
"minCpuPlatform", "guestAccelerators", "deletionProtection", "hostname",
"shieldedInstanceConfig", "shieldedInstanceIntegrityPolicy":
[docs](https://cloud.google.com/compute/docs/reference/rest/v1/instances/insert)
- Fixed resource name

* [DM] autoscaler: refactoring (#82)

GoogleCloudPlatform/cloud-foundation-toolkit#67

- Added version, links to docs
- Switched to using type provider
- Added cross-project creation support
- Added additionalProperties: false for nested object
- Fixed resource name

* [DM] cloud_function: refactoring (#65)

GoogleCloudPlatform/cloud-foundation-toolkit#52

- Added version, links to docs
- Switched to using type provider
- Upgraded API version: v1beta2 -> v1
- Added cross-project creation support (including upload.py)
- Added support for "labels", "environmentVariables" fields
- Renamed "region" to "location" with backward compatibility + there is
oneOf check
- Added new runtimes, change default to nodejs10
- Fixed function upload code (it is not redeployed after code upload when
using other project)
- Updated source upload logic:

- If "sourceRepository" field is present, use it as-is
- If "sourceRepositoryUrl" field is provided, change it to
"sourceRepository" format
- If "sourceArchiveUrl" is provided, use it as-is
- If "localUploadPath" is present, create cloudbuild build for function
zip file. Use "sourceArchiveUrl" as target or generate it automatically
(providing generated path via ""sourceArchiveUrl")
- If "sourceUploadUrl" is present, use it as-is
- All other parameter combinations should be restricted

* Fixes #55: DM/folder: refactoring
GoogleCloudPlatform/cloud-foundation-toolkit#55

- added version, links to docs
- fixed folder resource names: use base resource name as a template
- added oneOf check for folderId/orgId + fix incorrect schema for array
- fixed "displayName" regex
- made "name" field optional
- using the same format for parent as in project + fixed name prefix to
plural

* Fixes #69: DM/managed_instance_group: refactoring (#90)

GoogleCloudPlatform/cloud-foundation-toolkit#69

- Added version, links to docs
- Switched to using type provider
- Added cross-project creation support
- Added additionalProperties: false for nested objects
- Fixed resource name

* [DM] instance_template refactoring (#89)

GoogleCloudPlatform/cloud-foundation-toolkit#68

- Added version, links to docs
- Switched to using type provider
- Added cross-project creation support
- Added additionalProperties: false for nested objects
- Added support for "networkInterfaces[].accessConfigs[]", "disks",
"scheduling", "minCpuPlatform", "guestAccelerators",
"shieldedInstanceConfig", "sourceInstance", "sourceInstanceParams"
- Fixed resource name

* Fixes #119: DM/route: refactoring (#120)

GoogleCloudPlatform/cloud-foundation-toolkit#119

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Fixed arrays, objects and required fields (check for routeType + make
old scheme optional)
- Added missing fields: "description", "nextHopInstance",
"nextHopInstance", "nextHopNetwork", "nextHopGateway",
"nextHopVpnTunnel"

* Fixes #119: DM/route: refactoring
GoogleCloudPlatform/cloud-foundation-toolkit#119

Small typo, rechecked tests

* CFT build config to point to the correct license file

* [DM][FIX] Project: SA can not be created ("project_id" field is unknown)

GoogleCloudPlatform/cloud-foundation-toolkit#149

* [DM] iam_member: refactoring (#129)

* Fixes #116: DM/iam_member: refactoring
GoogleCloudPlatform/cloud-foundation-toolkit#116

* [DM] firewall: refactoring (#100)

GoogleCloudPlatform/cloud-foundation-toolkit#99
GoogleCloudPlatform/cloud-foundation-toolkit#91

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Upgraded compute-beta to compute-v1
- Fixed resource names
- Added schema to "rules": "name", "description", "priority",
"sourceRanges", "destinationRanges", "sourceTags", "targetTags",
"sourceServiceAccounts", "targetServiceAccounts", "allowed", "denied",
"direction", "logConfig", "disabled"

* [DM] bastion: refactoring (#102)

GoogleCloudPlatform/cloud-foundation-toolkit#101

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Fixed instance.py outputs (it lacks internalIp/externalIP)
- Fixed endless loops in tests

* [DM] backend_service: refactoring (#104)

GoogleCloudPlatform/cloud-foundation-toolkit#103

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Added new fields: "backends[].maxRatePerEndpoint,
.maxConnectionsPerEndpoint", "iap", "customRequestHeaders[]"
- Changed healthCheck to healthChecks[]
- Added checks for INTERNAL/EXTERNAL LB schemes for all relevant fields
- Added checks for backends[].balancingMode

* [DM] bigquery: refactoring (#106)

GoogleCloudPlatform/cloud-foundation-toolkit#105

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Added missing fields to datasets: "friendlyName",
"defaultPartitionExpirationMs", "labels", "access"
- Added missing fields to tables: "description", "labels", "clustering",
"requirePartitionFilter", "externalDataConfiguration",
"encryptionConfiguration"
- Fixed resource names
- Added uniqueItems: true and additionalProperties: false

* [DM] gke: refactoring (#111)

GoogleCloudPlatform/cloud-foundation-toolkit#110
GoogleCloudPlatform/deploymentmanager-samples#436
GoogleCloudPlatform/deploymentmanager-samples#463

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Removed deprecated "nodeConfig", switch to "nodePools[].config"
- Removed deprecated "initialNodeCount", switch to
"nodePools[].initial_node_count"
- Removed deprecated "privateCluster", "masterIpv4CidrBlock" ->
"privateClusterConfig"
- Updated parameters: "masterAuth", "loggingService",
"monitoringService", "addonsConfig",
"ipAllocationPolicy" and others
- Added support for "nodePools[]", "binaryAuthorization", "autoscaling",
"networkConfig", "defaultMaxPodsConstraint",
"resourceUsageExportConfig", "authenticatorGroupsConfig",
"verticalPodAutoscaling", "tierSettings", "workloadIdentityConfig",
"nodeConfig->diskType,sandboxConfig,shieldedInstanceConfig",
"enableTpu", "databaseEncryption"
- Added uniqueItems: true and additionalProperties: false

* [DM] kms: refactoring (#128)

GoogleCloudPlatform/cloud-foundation-toolkit#117

- Added version, links to docs
- Added support for cross-project resource creation
- Fixed resource names
- Added missing algorithms

* [DM] pubsub: refactoring (#125)

GoogleCloudPlatform/cloud-foundation-toolkit#118

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Added topic fields: "labels"
- Added subscription fields: "pushConfig", "retainAckedMessages",
"messageRetentionDuration", "labels", "expirationPolicy"

* Fixes #115: DM/iam_custom_role: refactoring (#130)

GoogleCloudPlatform/cloud-foundation-toolkit#115

- Added version, links to docs
- Added support for cross-project resource creation
- Added support for "stage" field

* [DM] ip_reservation: refactoring (#133)

GoogleCloudPlatform/cloud-foundation-toolkit#132

- Addde version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Added missing fields: "prefixLength", "networkTier"
- Fixed field checks

* [DM] IAM_member folder and org support (#166)

GoogleCloudPlatform/cloud-foundation-toolkit#162

Added support for folders and organizations:
gcp-types/cloudresourcemanager-v1:virtual.projects.iamMemberBinding
gcp-types/cloudresourcemanager-v2:virtual.folders.iamMemberBinding
gcp-types/cloudresourcemanager-v1:virtual.organizations.iamMemberBinding

* [DM] healthcheck: refactoring (#131)

GoogleCloudPlatform/cloud-foundation-toolkit#124

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Added support for missing fields: "description", "name"

* [DM] nat_gateway: refactoring (#134)

GoogleCloudPlatform/cloud-foundation-toolkit#123

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation

* [DM] ssl_certificate: refactoring (#152)

GoogleCloudPlatform/cloud-foundation-toolkit#148

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names

* [DM] url_map: refactoring (#155)

GoogleCloudPlatform/cloud-foundation-toolkit#153

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names

* [DM] target_proxy: refactoring (#156)

GoogleCloudPlatform/cloud-foundation-toolkit#154

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Upgraded compute api version
- Fixed fields descriptions, add checks to arrays and objects
- Added support for "sslCertificates"

* [DM] forwarding_rule: refactoring (#157)

GoogleCloudPlatform/cloud-foundation-toolkit#141

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Fixed descriptions
- Added support for fields: "serviceLabel", "networkTier",
"allPorts"
- Added strict properties checking

* [DM] external_load_balancer: refactoring (#159)

GoogleCloudPlatform/cloud-foundation-toolkit#140

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names

* [DM] Internal_load_balancer: refactoring (#168)

GoogleCloudPlatform/cloud-foundation-toolkit#143

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names

* [DM] haproxy: refactoring (#169)

GoogleCloudPlatform/cloud-foundation-toolkit#142

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Fixed imports

* [DM] dataproc: refactoring (#170)

GoogleCloudPlatform/cloud-foundation-toolkit#137

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Added missing fields: "labels", "<nodes>.imageUri",
"<nodes>.isPreemptible", "<nodes>.accelerators",
"softwareConfig.optionalComponents", "encryptionConfig"
- Mergeed master, nodes and secondary nodes

* [DM][BugFix] GKE template examples (#172)

GoogleCloudPlatform/cloud-foundation-toolkit#171

* [DM] dns_managed_zone: refactoring #138 (#176)

* [DM] Project Factory readme extension

Adding Service Usage Admin to prerequisites

* [DM] Patch IAM member to projectID (#187)

* [DM] Patch IAM member to projectID

Project ID was forcefully overwritten to context.env['project']

* [DM] CloudDNS - Backwards compatibility and bugfixes (#192)

Added Backward Compatibility with the old property zoneName. Added Backward Compatibility Integration Test. Fixed Identation of integration tests and added project parameter for gcloud calls. Adjusted schema paterns. Added description for all the tests. Updated README

* Fix couple of typographical errors.

* Fix prerequisites target name in docs and Makefile

* [DM] - IAM needs to depends on SA existance (#222)

GoogleCloudPlatform/cloud-foundation-toolkit#175

* [DM] interconnect_attachment: refactoring (#195)

GoogleCloudPlatform/cloud-foundation-toolkit#183

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Added missing fileds: "pairingKey", "vlanTag8021q", "adminEnabled",
"candidateSubnets", "bandwidth", "partnerMetadata", "partnerAsn"

* [DM] runtime_config: refactoring (#201)

GoogleCloudPlatform/cloud-foundation-toolkit#184

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Standardized naming

* [DM] interconnect: refactoring (#196)

GoogleCloudPlatform/cloud-foundation-toolkit#182

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Updateed/added fields: "linkType", "requestedLinkCount",
"interconnectType"

* [DM] backwards compatibility and styling fix

Fixed Backward Compatibility Support. Fixed pydocstyle D210, D202. Restricted dnsName pattern to comply with RFC. 1035 #138 (#194)

* [DM] Cloud DNS - Fix/162 (#165)

* [DM] CloudDNS - Backwards compatibility and bugfixes (#192)

Added Backward Compatibility with the old property zoneName. Added Backward Compatibility Integration Test. Fixed Identation of integration tests and added project parameter for gcloud calls. Adjusted schema paterns. Added description for all the tests. Updated README

* Fixes #162: [DM] IAM_member folder and org support
GoogleCloudPlatform/cloud-foundation-toolkit#162
GoogleCloudPlatform/cloud-foundation-toolkit#151

Added support for folders and organizations:
gcp-types/cloudresourcemanager-v1:virtual.projects.iamMemberBinding
gcp-types/cloudresourcemanager-v2:virtual.folders.iamMemberBinding
gcp-types/cloudresourcemanager-v1:virtual.organizations.iamMemberBinding

Updated tests to be non-interactive + added tests for folders

Fixed removal of mid-list members

* [DM] Refactored dns_records template #139 (#197)

* [DM] vpn: refactoring (#202)

GoogleCloudPlatform/cloud-foundation-toolkit#186

- Added version, links to docs
- Switched to using type provider
- Added support for cross-project resource creation
- Fixed resource names
- Added missing router property

* [DM] stackdriver_metric_descriptor: refactoring (#207)

GoogleCloudPlatform/cloud-foundation-toolkit#185

- Added version, links to docs
- Added support for cross-project resource creation
- Fixed resource names
- Added support for "launchStage", deprecated "metadata.launchStage"
- Added checks for "unit"

* [DM] cloudbuild: refactoring (#211)

GoogleCloudPlatform/cloud-foundation-toolkit#180

- Added version, links to docs
- Added support for cross-project resource creation
- Fixed resource names
- Added checks to objects and arrays
- Fixed "artifacts.objects" property, add "options.workerPool, env,
secretEnv, volumes" for cloudbuild
- Added "tags", "github", "triggerTemplate.revision->commitSha" for
trigger

* [DM] cloud_tasks: refactoring (#212)

GoogleCloudPlatform/cloud-foundation-toolkit#179

- Added version
- Fixed resource names

* [DM] network_peering: refactoring (#214)

GoogleCloudPlatform/cloud-foundation-toolkit#145

- Added version, links to docs
- Added support for cross-project resource creation
- Fixed resource names
- Added support for "networkPeering" field

* [DM] Shared VPC Subnet IAM refactoring

Refactored shared_vpc_subnet_iam template. Added bindings and policy syntax tests(in addition to legacy syntax check) (#215)

* [DM] Backend_service update example according to schema validation (#221)

GoogleCloudPlatform/cloud-foundation-toolkit#220

* [DM] cloud_tasks: refactoring (#208)

GoogleCloudPlatform/cloud-foundation-toolkit#179

- Added version
- Fixed resource names

* [DM] logsink: refactoring (#228)

GoogleCloudPlatform/cloud-foundation-toolkit#144

- Added version, links to docs
- Added support for cross-project resource creation
- Fixed resource names

* Enable users to specify network reference in the firewall DM template.

* Enable GKE DM template to support 'latest' initial cluster version.

* Change the logic of checking initial cluster version in the GKE DM template.

* [DM] Org_Policy updates(#231) 

- Added version, links to docs
  - Fixed resource names
  - Fixed pydocstyle warnings
  - Added schema validation against the API documentation
  - Added project parameter to gcloud deployment-manager calls

* [DM] forseti: refactoring (#239)

GoogleCloudPlatform/cloud-foundation-toolkit#181

- Added version, links to docs
- Switched to using type provider

* [DM] Enable cloud_router DM template to support networkURL. (#235)

* Enable cloud_router to support networkURL.

* Update cloud_router DM schema for netowrkURL and networkName.

* Continue to use network instead of networkName so that the CL is not a breaking change.

* Update cloud_router DM schema.

* Update cloud_router.py.schema

* [DM] logsink test fix

Following topic rename in test file

* [DM] Small fixes to templates. (#268)

* [DM] fix healthcheck type property

#270

* [DM] fixing CloudSQL example

* HA proxy example remove unneeded import

* [DM] adding schema validation test

* [DM] bastion bats improve

* [DM] Bastion test disk size correction

* [DM] Fixes #269: DM dev branch quality control (#282)

* Fixes #269: DM dev branch quality control
GoogleCloudPlatform/cloud-foundation-toolkit#269

- Fixed templates/bigquery/tests/integration/bigquery.bats

* Fixes #269: DM dev branch quality control
GoogleCloudPlatform/cloud-foundation-toolkit#269

- Fixed templates/haproxy/tests/integration/haproxy.bats

* Fixes #269: DM dev branch quality control
GoogleCloudPlatform/cloud-foundation-toolkit#269

- Fixed templates/instance_template/tests/integration/instance_template_networks.bats

* Fixes #269: DM dev branch quality control
GoogleCloudPlatform/cloud-foundation-toolkit#269

- Fixed templates/instance/tests/integration/instance.bats

* Fixes #269: DM dev branch quality control
GoogleCloudPlatform/cloud-foundation-toolkit#269

- Fixed templates/instance/tests/integration/instance_template/instance_template.bats

* Fixes #269: DM dev branch quality control
GoogleCloudPlatform/cloud-foundation-toolkit#269

- Fixed templates/shared_vpc_subnet_iam/tests/integration/shared_vpc_subnet_iam.bats

* [DM] Fixing External LB test cleanup

* [DM] Updating changelog (#293)

* Updating changelog

* Adding container images to run tests in CI.

* [DM] warning for bastion host sudoers (#297)

Priorities are default to 1000, not incrementing.

Adding debug messages.

* [DM] Isolate a single template from route DM template. (#257)

* Split route DM template into two parts: a route group and a single route.

* Enable single_route DM template to accept VPN tunnel URL.

* Always use context.env name in single_route DM template.

* Allow users to specify single_route real name in DM template.

* [DM] Enable VPN DM template to support static routing. (#234)

* Enable VPN DM template to support static routing.

* remove two string init, recover comments for address API link.

* recover name and project on the adress resource in VPN DM template.

* Update VPN DM template schema.

* Change routerName back to router.

* Enable VPN template to output an URI of the created VPN tunnel.

* VPN DM schema add uniqItems on selectors.

* [DM] Fixed a path error in an Cloud SQL exampl… (#300)

* farisjarrah/cloud-sql-docs: rebased off of cft-dm-dev to submit to upstream dev branch

* farisjarrah/cloud-sql-docs: fixed postgres version number type, and ensured that the templates matched the cft-dm-dev branch schema for cloud sql
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

6 participants