Programming Assignment: Assignment 4: Capstone Project Part 1 - ETL and Data Modeling

I’m really struggling to complete this lab the past few days. Everything was going fine but then the AWS session expired and I’ve been having issues since. The terminal keeps crashing and I’m getting the errors below even though I run terraform destroy:
Error: creating Glue Connection (de-c4w4a1-connection-rds): operation error Glue: CreateConnection, https response error StatusCode: 400, RequestID: 8f593b7c-8522-48fd-87b0-10992298af6d, AlreadyExistsException: Connection already exists.

with module.extract_job.aws_glue_connection.rds_connection,
on modules/extract_job/glue.tf line 2, in resource “aws_glue_connection” “rds_connection”:
2: resource “aws_glue_connection” “rds_connection” {

Error: creating IAM Role (de-c4w4a1-glue-role): operation error IAM: CreateRole, https response error StatusCode: 409, RequestID: b4a5be0e-6d79-44ee-84cb-8768e64371c2, EntityAlreadyExists: Role with name de-c4w4a1-glue-role already exists.

with module.extract_job.aws_iam_role.glue_role,
on modules/extract_job/iam.tf line 1, in resource “aws_iam_role” “glue_role”:
1: resource “aws_iam_role” “glue_role” {

Additionally, I get the following error when I try to run the glue jobs:
ConnectTimeout: HTTPConnectionPool(host=‘ec2-13-216-59-179.compute-1.amazonaws.com’, port=80): Max retries exceeded with url: /sessions?start_date=2020-01-01&end_date=2020-01-31 (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f427b1931f0>, ‘Connection to ec2-13-216-59-179.compute-1.amazonaws.com timed out. (connect timeout=None)’))

Finally, the lab keeps losing connection and asks me to reload the page. But when I reload its a blank VS Code so I restart the lab but keep running into the issues above. Any assistance will be highly appreciated. Thanks

When creating a post, please add:

  • Module # must be added in the tags option of the post. (ex: Module-1)
  • Link to the classroom item you are referring to:
  • Description (include relevant info but please do not post solution code or your entire notebook)

Hello @Freeman
Can you please request a lab refresh via this form?

Just want to add that every time that I run terraform apply, I run into the issue below and it never reconnects.

I was able to hack my way through this and resolve the issues by deleting and recreating the offending resources. I’m all set now. Thanks