C4_W4-Capstone Projects: Terraform

Course Q&A Data Engineering Data Modeling, Transformation, and Serving
1

Do we have any issues/restrictions to perform Assignments abroad? Specifically with Terraform? I had no issues in Course 3 Labs and Assignment while I was in the United States, now I’m performing C4_W4-Capstone Projects abroad and I have been experiencing issues (permission, crashes, etc.) with Terraform.

I’m just curious because I would like to know if I have to take something into account while performing these Assignments abroad (with Terraform). BTW-I have filled and sent the “Combined Data Engineering Lab Issue Report” form.

Thanks in advance!!!

2

It is true that some internet assets are blocked in other regions of the world.

Whether this applies to your question is uncertain, due to a lack of details.

3

Thank you for getting back so quickly, @TMosh !
Please let me know if you’d need further details than were filled on the forms I’ve sent.

4

First terraform error/crash I got last Saturday happened when I was performing point “4.2. Transforming Zone”. Then, I tried Reboot and Get latest version and did not work. Today I got the Assignment refresh and noticed the same files unmodified. The error/crash with Terraform along with this freezing status (image attached) still going on. The Assignment does not even let me get pass the point “4.1. Landing Zone” now.

var.catalog_database
  Curated DB name

  Enter a value:

image
image522×163 7.03 KB

Error: creating Glue Connection (de-c4w4a1-connection-rds): operation error Glue: CreateConnection, https response error StatusCode: 400, RequestID: 3f3c7c09-b567-40d6-ad30-8bac0f7fe061, AlreadyExistsException: Connection already exists.

  with module.extract_job.aws_glue_connection.rds_connection,
  on modules/extract_job/glue.tf line 2, in resource "aws_glue_connection" "rds_connection":
   2: resource "aws_glue_connection" "rds_connection" {


Error: creating IAM Role (de-c4w4a1-glue-role): operation error IAM: CreateRole, https response error StatusCode: 409, RequestID: 5076a1f9-84ee-4152-b7e6-4c30bf8fd0cc, EntityAlreadyExists: Role with name de-c4w4a1-glue-role already exists.

  with module.extract_job.aws_iam_role.glue_role,
  on modules/extract_job/iam.tf line 1, in resource "aws_iam_role" "glue_role":
   1: resource "aws_iam_role" "glue_role" {

Please I kindly ask you guys to give me the instructions on how should I proceed.

Lab ID:
jmmkjswqpqlc

I have just sent the require form as well.

Thanks.

5

POV: This worked for me (Terraform)

Never change/open a new terminal since your first ran source scripts/setups.sh. If the terminal crashed or a message like this prompted:

var.catalog_database
  Curated DB name

  Enter a value:

Open a new terminal and run source scripts/setups.sh first!

Then, run the commands from the beginning:

cd terraform
terraform init
terraform plan
terraform apply

It should work.

6

I have absolutly the same problem, but rerun setup.sh and terraform did not help me. Previously, I wrote to support to resolve lake formation issue and now this error. I still could not event start doing lab, because of terraform issues.
I need to run two more commands and it’s not working. Please, help me
terraform apply -target=module.transform_job
terraform apply -target=module.serving

7

At first glance, I could suggest checking carefully the variables script_location on modules/transform_job/glue.tf and --api_url on modules/extract_job/glue.tf. Otherwise, I hope Mentors might give you a proper solution.