C4 W4 Assignment 2: Terraform apply keeps crashing and AccessDeniedException for Glue jobs

Course Q&A Data Engineering Data Modeling, Transformation, and Serving
,
1

Hi everyone,
I have encountered couple of issues with the assignment. Appreciate any assistance on how to address issue #2 below re AccessDeniedException.

  1. Step 2.2: the terraform apply (3 modules) kept crashing the terminal. Have tried several times but it kept crashing. Then, ran ‘terraform destroy’ and tried to rerun the modules but it continued to crash the terminal. Lastly, have waited for several hours and restarted the lab. It did work eventually. I have included this here as this might have some correlation to the next error.
  2. Step 2.4: Getting an AccessDeniedException when attempting to run the 3 glue jobs. I do not believe I am in position to debug the issue. Error message: ‘An error occurred (AccessDeniedException) when calling the StartJobRun operation: User: arn:aws:sts::741366199435:assumed-role/voclabs/user4111958=orkhmclfnujr is not authorized to perform: glue:StartJobRun on resource: arn:aws:glue:us-east-1:741366199435:job/glue_api_users_extract_job because no identity-based policy allows the glue:StartJobRun action’

Thank you in advance for your help!

2

Can confirm – getting the same error at the same step in the notebook, terraform apply works but then receiving AccessDeniedException when running the initial glue job.

You might want to fill out this form: Combined Data Engineering Lab Issue Report

Hoping that this resolves it…

3

Did filling this resolve the issue for you?

4

Hi, I would recommend reviewing the Terraform output which provides the proper values to use to run the Glue jobs.. There was no need to fill out the form. Thank you!

5

Hi, there was no need to fill out the form. Thank you!