Introduction To Data Engineering : Graded Prog Assignment 1: Glue job failing

Course Q&A Data Engineering Source Systems, Data Ingestion, and Pipelines
,
1

Ran the job in the Cloud 9 terminal using
" aws glue start-job-run --job-name de-c1w2-etl-job | jq -r ‘.JobRunId’
jr_91f5d265e8b9101f9b29320428c752b88c00890a339aeca017aa85def22b5043"
Get this error when running the Glue job
“An error occurred while calling o138.pyWriteDynamicFrame. Insufficient Lake Formation permission(s) on dim_customers (Service: AWSGlue; Status Code: 400; Error Code: AccessDeniedException; Request ID: a50bd197-2efd-437f-9a48-a720ddc2d02e; Proxy: 169.254.76.0)”

2

Hello @anandeep,
Sorry for the inconvenience and the same issue was reported by others posts.
The solution available is to complete this form, choose any option and the team will refresh your lab. It takes two business days though, thanks for your patience

3

Did that yesterday, thanks!

4

There is nothing wrong with the environment - it seems that there are some missing permissions / roles that does not allow glue to run

5

@momar it’s s true the environment is fine and all the files are there. However the issue in the account permissions seems to fix after a lab refresh. I guess something in the lab setup, happy new year