Dec4w4 capstone part 1 lab extarct_job/glue.tf error

Course Q&A Data Engineering Data Modeling, Transformation, and Serving
,
1

Can someone look at my below ./modules/extract_job/glue.tf script of dec4w4 capstone part-1 lab 4.2 part of notebook below and then relevant terraform plan error to highlight any mistake…I am unable to find any code mistake.

CODE DELETED

output of TF_LOG=DEBUG TF_LOG_PATH=terraform-debug.log terraform plan

is

2025-05-28T03:27:43.695Z [ERROR] vertex "module.extract_job.aws_glue_job.api_users_ingestion_etl_job" error: Reference to undeclared resource
2025-05-28T03:27:43.695Z [ERROR] vertex "module.extract_job.aws_glue_job.rds_ingestion_etl_job" error: Reference to undeclared resource
2025-05-28T03:27:43.695Z [ERROR] vertex "module.extract_job.aws_glue_job.rds_ingestion_etl_job" error: Reference to undeclared resource
2025-05-28T03:27:43.695Z [ERROR] vertex "module.extract_job.aws_glue_job.api_sessions_ingestion_etl_job" error: Reference to undeclared resource
2025-05-28T03:27:43.702Z [ERROR] vertex "module.extract_job.aws_glue_job.api_sessions_ingestion_etl_job" error: Reference to undeclared resource
2025-05-28T03:27:43.710Z [ERROR] vertex "module.extract_job.aws_glue_job.api_users_ingestion_etl_job" error: Reference to undeclared resource
2025-05-28T03:27:43.718Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = error reading from server: EOF"
2

Hello @hamza_safwan
The script_location keys are wrong. The first part of these keys use a terraform variable and the second part is the script name, which must be hardcoded, like de-c4w4a1-api-extract-job.py for example. Also, please refrain from posting the solutions to the assignment exercises on the public forum.

3

@Amir_Zare noted for future.

Now, In same lab i.e capstone part 1 in transformation module

Both transformation jobs are failing due to the following error:

Insufficient Lake Formation permission(s) on de_c4w4a1_silver_db

It appears that the AWS Glue role doesn’t have the required permissions to access the de_c4w4a1_silver_db database.

I attempted to manually set the permissions but don’t have access to modify them.

image

4

Please, request a lab refresh via this form.