C4W4A2 Data Modeling, Transformation and Serving Capstone Project Part 2

Course Q&A Data Engineering Data Modeling, Transformation, and Serving
,
1

Applying Terraform to data_quality module takes a very long time and causes the lab to disconnect. No error output was produced. Unable to debug

image
image1917×809 72.9 KB

EDIT: On second try, applying terraform to data_quality module ends up with this error.

lab id: bruaenxpmtjb

image
image1913×865 165 KB

2

Hello @brian3190,

This error is because the lab rebooted when you used terraform apply without destroying terraform before. You need to delete those resources manually from the AWS console or commands:

  1. de-c4w4a2-glue-role can be found in IAM>roles:
    C4W4A2_role
    C4W4A2_role1252×809 219 KB
  2. de-c4w4a2-rds-connection is in AWS glue>connections
    C4W4A2_connections
    C4W4A2_connections1170×685 133 KB

You could wait a few hours for a new lab session or submit this form since a lab refresh seems to fix it. Hope it helps

3

Hi Georgios,

Thanks for the solution. The instructions didn’t mention anything about destroying resources manually from AWS console. It did mention that the AWS resource is only provisioned for 15 minutes in a span of 2 hours. Will it affect any variables or resource when I reset it (running the block of code generating the AWS console link) ?

4

Hello @brian3190,

You should be able to save time from waiting 2 hours from destroying those resources. Sometimes there are not visible, and you don’t have that option. But otherwise, I suggest trying and it will not affect any variables or the AWS link. In any other case if the issue continues you can ask for a lab refresh. Thank you

1 Like