C1W2 -AWS Glue job not succeeded

Course Q&A Data Engineering Introduction to Data Engineering
,
1

Hello,
I am facing problem for completing my graded assignment from Course 1-introduction to Data Engineering Week2 GradedAssignment- An Example of Data Engineering Lifecycle
I am at the stage where I need to perform Glue job to transform the data but as I am attempting in cloud9 the command aws glue start-job-run --job-name de-c1w2-etl-job | jq -r '.JobRunId' it starts the glue job but it is failing again and again. I tried this multiple times but got the same error- An error occurred while calling o138.pyWriteDynamicFrame. Insufficient Lake Formation permission(s) on dim_customers (Service: AWSGlue; Status Code: 400; Error Code: AccessDeniedException; Request ID: d62e68cb-7e1d-44b4-a228-9a98af9fe977; Proxy: 169.254.76.0).
please help me to resolve this.

2

Hello @aayu,
Please complete this form and a staff will refresh your lab. Thank you

3

Thanks, it worked:)

4

I had the same issue and just submitted the form.

5

Hi, I also faced with the same issue and submitted want to submit the form, but I don’t know what to submit here:
Type of issue you encountered with the lab:

6

Hello @JavidM
You can fill this form and choose any option. The staff should be able to refresh your lab, it might take more than two days business days since it’s holidays. Thank you

7

I also received the same error. Just submitted a request using the form mentioned.

An error occurred while calling o138.pyWriteDynamicFrame. Insufficient Lake Formation permission(s) on dim_customers (Service: AWSGlue; Status Code: 400; Error Code: AccessDeniedException; Request ID: cf0af6d1-cfc8-43c1-9ef3-083015a52424; Proxy: 169.254.76.0)
8

Hello @Henry_Tseng ,note it could take two business days since it is weekend. Thank you

9

Hello. Due to failed Glue job I just send the form

An error occurred while calling o138.pyWriteDynamicFrame. Insufficient Lake Formation permission(s) on dim_customers (Service: AWSGlue; Status Code: 400; Error Code: AccessDeniedException; Request ID: 65288b91-bde5-4302-9730-808a25646ab4; Proxy: 169.254.76.0)

10

Hello @konutech,
It seems a lab refresh fixes it. It should take two days for the staff to complete the process. Hope it helps

11

Solved thanks to the Form. Thank you for the help

12

I am having the same issue, but I don’t have permission to access the form to get my lab refreshed.

13

Hey, I have the same issue, and I don’t have permission the form either.

14

@leon.geerdink and @robycat Thank you for reporting the issue. Can you try again now?

15

@hawraa.salami Thank you. I could access the form now :+1:

16

Terraform did not create the glue job in the first lab assignment --week 2

17

Hello @Alex999,
Did you get any errors (a screenshot could help). Maybe after a new lab session it will fix or submit this form for a lab refresh. Thank you

18

Georgios, Hi

I double checked – the glue job was never created – even ran this → terraform state list
hopefully it will work once you guys do a refresh

Thanks

Alex

20

Is there any update on this issue? Mine has an error too. I have filled out and submitted the form yesterday. How can i know if the issue has been fixed?

21

Hello @Umar_007,
Thanks for filling the form. Since it is a manual process this is why it takes two business days for a staff to process. If you submitted yesterday, it might take longer because of the weekend. Hope it helps