C3W2 - Assignment 2 - error "Connection already exists"

Course Q&A Data Engineering Data Storage and Queries
, ,
1

In Step 4.3, when trying to run “terraform apply” for executing the three Glue Jobs: glue_csv_transform_job, glue_ratings_transform_job, glue_ratings_to_iceberg_job, I get the following error :

Error: creating Glue Connection (de-c3w2a1-rds-connection): operation error Glue: CreateConnection, https response error StatusCode: 400, RequestID: d3e402d5-c94b-453c-b6d5-b5bda3adb777, AlreadyExistsException: Connection already exists.

2

Hello @Egonzalez
If you still get this error on fresh lab session, please request a lab refresh via this form. I hope it helps.

3

@Egonzalez Filling out the form can help if there’s actually a problem with your AWS account and we’ll refresh your account anyway. Also please make sure to comment back any section you uncommented in your previous session.

If there’s no problem with your AWS account, the error you’re getting could be of the following reason (please correct me if I’m wrong):

When you first went through the lab, in section 3, you uncommented one part and left the other parts commented. Then in section 4, you uncommented another section. When you start again the lab, the terraform configuration files are not automatically reset, so the section you uncommented in section 4 is still uncommented, and you need to comment that again when you restart the lab. If you don’t do that, then when you run terraform apply in section 3, the resources that are supposed to be created in section 4 are being created with those of section 3. This is why, you’re getting the error that the resources already exist in step 4.

So you can do one of these two options:

  • Make sure to comment back the sections you uncommented from the previous sessions

  • Or you can manually reset the lab files as follows:
    1. Create a new folder and move all current lab files to that folder (you can label the folder as old_files)
    2. Click on lab help which is the question mark on the top right
    3. Click on “Get the latest version”.

Please let me know how things will go for you!

1 Like
4

Hello @hawraa.salami
Thanks a lot for your message.
Fortunately, I tried again and was able to complete the assignment.

1 Like