Can not start glue job

Course Q&A Data Engineering Data Modeling, Transformation, and Serving
1

I am unable to start the Glue job in the C4_W4 Assignment 1 (Capstone Project Part 1).

When I run the command:

aws glue start-job-run --job-name <JOB-NAME> | jq -r '.JobRunId'

it either returns NULL or a Job ID. However, the job always fails. When I check the status with:

aws glue get-job-run --job-name <JOB-NAME> --run-id <JobRunID> --output text --query "JobRun.JobRunState"

the output is always FAILED.

Additionally, after rebooting my lab and reattempting the assignment, I encountered the following issues:

  • Terraform shows the error “already connection” when running terraform apply.

  • The system prompts me to provide a “Curated DB name” even though it was already set earlier.

2

Just a small correction. It also asked me Curated DB Name when I run terraform apply or destroy

3

Hello @tansang.hua

Please, request a lab refresh via this form, and try to get everything right on your first try after the lab refresh.

4

Thank you, I will try and report my result later.

5

Hi Amir, the question required me to select a problem I experienced, but none of the listed options applied to me. And this form suggested me to create a question on this forum.

image
image641×382 32.2 KB

6

@tansang.hua You can choose which ever you want. The staff will figure it out.

1 Like
7

Thank you so much, Amir

8

Hey Amir, they told me that they need 2 days to proccess my case. But it’s 4 days since I fill the form. Can you help me in this case?

9

Hello @tansang.hua

Did you try your lab once again? Are you still facing the same issue?

10

Right, I have tried numerous times. Still stuck here.

image
image1539×227 12.9 KB

11

@tansang.hua you need to run source scripts/setup.sh for the terraform values to be initiated. After you run this command, terraform plan won’t ask you to input variables.

12

Thanks Amir, I finished all assignment and got the certificate today. Thank you very much!