C3W2:Assignment 2: Building a Data Lakehouse with AWS Lake Formation and Apache Iceberg

[Namuna]

Dear Coursera Support Team,
I am experiencing a persistent issue with the deployment of glue jobs in section 4.3 of the C3_W2_Assignment 2: Building a Data Lakehouse with AWS Lake Formation and Apache Iceberg. Despite multiple attempts to resolve the error, I have been unable to determine the cause.
Could you please assist me in troubleshooting this issue? Your support would be greatly appreciated.
Thank you!

Namuna

[Namuna]

Please find attached a screenshot from the AWS Glue console for your reference. I am eagerly awaiting your assistance on this matter. Thank you for your prompt attention to this issue.

Best regards,
Namuna

[Georgios]

Hello @Namuna,

Your could check more info about the job failing in the console. You can go to Visual ETL instead of Job run monitoring to find the jobs:

Then click on any job and go to Runs tab:

You could check for any None values the in the .py files in the assets folder terraform/assets/transform_etl_jobs (steps 4.1.1 to 4.2.1) or perhaps you missed to upload the files into the scripts_bucket (step 4.2.5) so make sure you run those cells. Hope it helps

[Namuna]

Hello Georgios,
Thank you for your suggestions. I still

could not troubleshoot the issue. I checked everything according to your suggestions. I have attached the screenshot of the Visual ETL page from the AWS Glue console for your reference. Please help me to figure out this issue and move forward.

[Namuna]

Here are more screenshots.

[Georgios]

Hello @Namuna,

Yes this error is because there are no scripts copied in the scripts bucket. Could you try running the cells in step 4.2.5 to upload them and try again. Thank you

[Namuna]

Hello Georgios,
Thank you for your help. It was very silly mistake.