C4w4 - Capstone Part 2

Course Q&A Data Engineering Data Modeling, Transformation, and Serving
1

This is more of an FYI rather then me being stuck…

When running the glue jobs through the console, I get the following error:

An error occurred (AccessDeniedException) when calling the StartJobRun operation: User: arn:aws:sts::730335290443:assumed-role/VSCodeInstanceRole/i-0dd4d7ea63b8f6442 is not authorized to perform: glue:StartJobRun on resource: arn:aws:glue:us-east-1:730335290443:job/glue_api_users_extract_job because no identity-based policy allows the glue:StartJobRun action
abc@c7b6c0d967b6:~/workspace/terraform$ aws glue start-job-run --job-name glue_api_users_extract_job | jq -r ‘.JobRunId’

Also, the default credentails (admin/admin) don’t work for me on the superset service so I didn’t get to that part of the lab (even though I wanted to).

image
image1891×490 21.1 KB

I managed to run the jobs manully through the aws console and didn’t need to complete the last part for grading, however it would be good to sort these issues out for others involved.

Cheers,
Matt

1 Like
2

Hello @matija.nikic
About Superset, you are right, and there is an issue that we are trying to fix. However, about the error you get in the command line, it’s happening because you put glue_api_users_extract_job as the <JOB_NAME> . You should copy the output named glue_api_users_extract_job from terraform outputs and replace that in the command.

3

You’re right, thanks for the note.