I’m trying to run the Glue jobs as prescribed in the lab but getting the below error. First I thought I messed up something in the code, so I got the latest lab version and cleaned all my previous edits, but the same error came up again. I’m pretty confident I did every previous step as directed. What is the issue here?
All previous steps ran fine. Lab id miezokczzvqr. Thanks!
Hi @alshh
There was someone with a similar error, check this
There at the comments @Georgios suggested the following:
—
The issue is that terraform apply didn’t create the glue jobs because de-c3w2a1-rds-connection already exists in step.3.2.2. You could delete the existing connection using aws commands e.g.aws glue delete-connection --de-c3w2a1-rds-connection or the AWS console.
After you delete any existing resources and run terraform apply again, you could continue with the jobs in step 3.2.3 (note the jobs you need to run from the terminal output should be de-c3w2a1-bucket-ingestion-etl-job not glue_bucket_ingestion_job).
—
Hope, it helps.
If not, you can submit this form.
Hi @alshh, just for learning purposes:
You can use the AWS GUI to see if the job was created [alternatively, use your terminal running: aws glue list-jobs ].
You can also inspect the Terraform outputs when you run terraform apply