C3_W2 Programming Assignment: Assignment 2: Building a Data Lakehouse with AWS Lake Formation and Apache Iceberg- Terraform cant get the variables when run terraform plan/apply

Course Q&A Data Engineering Data Storage and Queries
,
1

Followed the instructions and uncommented the glue.tf lines accordingly, but the terminal run for terraform plan/apply (Step 4.3.3) keeps prompting manual filling in of each var. Skipping them will cause error and have re-executed the setup.sh script but issue happens again still.

Stuck and unable to proceed with the assignment

1 Like
2

image
image2429Ă—1119 368 KB

3

Have tried the steps to restart and delete terraform folder and then re-run and redo everything again but still stuck on the same step with the same terminal crash for many times already

4

Hello @htango,

I tried the lab and followed each step I couldn’t reproduce the issue. Since your issue is at the second time you run the terraform commands, I would check for any None values in step 4.2.3 in terraform/modules/transform_etl/glue.tf file.

In the screenshot you need to rerun source scripts/setup.sh after you restart the terminal or terraform plan will ask for inputs. Also, if you uncomment exactly what is necessary in the outputs.tf and main.tf files.

Finally if there is an issue with your AWS resources you could ask for a lab refresh.

5

I’m currently working on the C3 W2 assignment and I’m stuck at section 4.3 Deployment while running Terraform.

Issue:

When I run:

terraform apply

Terraform keeps prompting me to manually enter a large number of variables (e.g., curated_db_name, data_lake_name, source_host, etc.).

What I expected:

Based on the lab instructions and mentor comments, these values should be automatically populated after running:

source scripts/setup.sh

What I’ve already tried:

  • I ran source scripts/setup.sh before running Terraform

  • I did NOT restart the terminal

  • I uncommented only the required sections in:

    • terraform/main.tf

    • terraform/outputs.tf

  • I replaced all None values in the Terraform files (as required in earlier steps)

Problem:

Despite doing all of the above, Terraform still asks me to input every variable manually.

Additional details:

  • This happens even without restarting the terminal

  • It occurs specifically after enabling the transform_etl module

  • I was able to run earlier sections without this issue

  • Refreshing the lab is not working

Question:

  • Is this expected behavior for this lab?

  • Is there something missing in setup.sh or environment variable setup?

I’ve been stuck on this for a few days now, so any guidance would be really appreciated.

6

@Minit_Chitroda
You have replied on a thread that has been cold for over a year.

It would be better if you start a new thread for your question. A current mentor for that course will be more likely to find it.

7

how do i do it ?

8

Go to the forum topic for your course. You can start from the “Course Q&A” link in the left-side menu.

In this case, it’s the “Data Engineering” - “Data Storage and Queries” topic.

Then use the “Add Topic” button.