MLEP C4W3: Canary Releases

Not enough resources. Won’t be able to finish lab in time most likely.
tl;dr: creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.

Full Trace:

efault change: VPC-native is the default mode during cluster creation for versions greater than 1.21.0-gke.1500. To create advanced routes based clusters, please pass the --no-enable-ip-alias flag
Note: Your Pod address range (--cluster-ipv4-cidr) can accommodate at most 1008 node(s).
Creating cluster cluster-1 in us-central1-f… Cluster is being deployed…done.
ERROR: (gcloud.beta.container.clusters.create) Operation [<Operation
clusterConditions: [<StatusCondition
canonicalCode: CanonicalCodeValueValuesEnum(UNAVAILABLE, 15)
code: CodeValueValuesEnum(GCE_STOCKOUT, 1)
message: “Instance ‘gke-cluster-1-default-pool-15af3244-cdp4’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.”>, <StatusCondition
canonicalCode: CanonicalCodeValueValuesEnum(UNAVAILABLE, 15)
code: CodeValueValuesEnum(GCE_STOCKOUT, 1)
message: “Instance ‘gke-cluster-1-default-pool-15af3244-qbhd’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.”>, <StatusCondition
canonicalCode: CanonicalCodeValueValuesEnum(UNAVAILABLE, 15)
code: CodeValueValuesEnum(GCE_STOCKOUT, 1)
message: “Instance ‘gke-cluster-1-default-pool-15af3244-xvd0’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.”>, <StatusCondition
canonicalCode: CanonicalCodeValueValuesEnum(UNAVAILABLE, 15)
code: CodeValueValuesEnum(GCE_STOCKOUT, 1)
message: “Google Compute Engine: Not all instances running in IGM after 29.612212868s. Expected 3, running 0, transitioning 3. Current errors: [GCE_STOCKOUT]: Instance ‘gke-cluster-1-default-pool-15af3244-cdp4’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.; [GCE_STOCKOUT]: Instance ‘gke-cluster-1-default-pool-15af3244-qbhd’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.; [GCE_STOCKOUT]: Instance ‘gke-cluster-1-default-pool-15af3244-xvd0’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.”>]
detail: “Google Compute Engine: Not all instances running in IGM after 29.612212868s. Expected 3, running 0, transitioning 3. Current errors: [GCE_STOCKOUT]: Instance ‘gke-cluster-1-default-pool-15af3244-cdp4’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.; [GCE_STOCKOUT]: Instance ‘gke-cluster-1-default-pool-15af3244-qbhd’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.; [GCE_STOCKOUT]: Instance ‘gke-cluster-1-default-pool-15af3244-xvd0’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.”
endTime: ‘2022-07-12T05:11:18.318149797Z’
error: <Status
code: 14
details:
message: “Instance ‘gke-cluster-1-default-pool-15af3244-cdp4’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.”>
name: ‘operation-1657602376562-e8a1ec82’
nodepoolConditions:
operationType: OperationTypeValueValuesEnum(CREATE_CLUSTER, 1)
progress: <OperationProgress
metrics: [<Metric
intValue: 6
name: ‘CLUSTER_CONFIGURING’>, <Metric
intValue: 6
name: ‘CLUSTER_CONFIGURING_TOTAL’>, <Metric
intValue: 12
name: ‘CLUSTER_DEPLOYING’>, <Metric
intValue: 12
name: ‘CLUSTER_DEPLOYING_TOTAL’>]
stages: >
selfLink: ‘https://container.googleapis.com/v1beta1/projects/368115203954/zones/us-central1-f/operations/operation-1657602376562-e8a1ec82
startTime: ‘2022-07-12T05:06:16.56222433Z’
status: StatusValueValuesEnum(DONE, 3)
statusMessage: “Google Compute Engine: Not all instances running in IGM after 29.612212868s. Expected 3, running 0, transitioning 3. Current errors: [GCE_STOCKOUT]: Instance ‘gke-cluster-1-default-pool-15af3244-cdp4’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.; [GCE_STOCKOUT]: Instance ‘gke-cluster-1-default-pool-15af3244-qbhd’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.; [GCE_STOCKOUT]: Instance ‘gke-cluster-1-default-pool-15af3244-xvd0’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.”
targetLink: ‘https://container.googleapis.com/v1beta1/projects/368115203954/zones/us-central1-f/clusters/cluster-1
zone: ‘us-central1-f’>] finished with error: Google Compute Engine: Not all instances running in IGM after 29.612212868s. Expected 3, running 0, transitioning 3. Current errors: [GCE_STOCKOUT]: Instance ‘gke-cluster-1-default-pool-15af3244-cdp4’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.; [GCE_STOCKOUT]: Instance ‘gke-cluster-1-default-pool-15af3244-qbhd’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.; [GCE_STOCKOUT]: Instance ‘gke-cluster-1-default-pool-15af3244-xvd0’ creation failed: The zone ‘projects/qwiklabs-gcp-03-258be92a9ecc/zones/us-central1-f’ does not have enough resources available to fulfill the request. Try a different zone, or try again later.

Solution: Changed zone & cluster name then re-attempted:

gcloud config set compute/zone us-west1-a
PROJECT_ID=$(gcloud config get-value project)
CLUSTER_NAME=cluster-2
gcloud beta container clusters create $CLUSTER_NAME \
  --project=$PROJECT_ID \
  --addons=Istio \
  --istio-config=auth=MTLS_PERMISSIVE \
  --cluster-version=latest \
  --machine-type=n1-standard-4 \
  --num-nodes=3
1 Like

Just fyi to get “points” for the lab I did have to restart (stop and start a new one) the lab and do cluster-1 because that’s how the lab identified stuff is set up correctly.

gcloud config set compute/zone us-west1-a
PROJECT_ID=$(gcloud config get-value project)
CLUSTER_NAME=cluster-1