C4w4assignment 2 keeps crashing/reconnecting, not functioning in general (even after staff reset for aws console) super frustrated

Course Q&A Data Engineering Data Modeling, Transformation, and Serving
1

Whenc4w4assignment 2

1 Like
2

I have exactly the same issue. The systems crash, the jobs do not run, I had to wait for almost two hours to get the resources recreated in AWS. I have manually deleted/edited the resources, roles, permissions, etc. and nothing work. When I’m about to make some progress then the notebook disconnects.

After the disconnection, when I try to run terraform apply again I got the following:

Error: creating Glue Connection (de-c4w4a2-connection-rds): operation error Glue: CreateConnection, https response error StatusCode: 400, RequestID: 6fcb83a7-d311-4671-be88-3f3d0133ebde, AlreadyExistsException: Connection already exists.

  with module.extract_job.aws_glue_connection.rds_connection,
  on modules/extract_job/glue.tf line 2, in resource "aws_glue_connection" "rds_connection":
   2: resource "aws_glue_connection" "rds_connection" {


Error: creating IAM Role (de-c4w4a2-glue-role): operation error IAM: CreateRole, https response error StatusCode: 409, RequestID: 121755d3-ec14-4c7d-a58e-933274bb0fd3, EntityAlreadyExists: Role with name de-c4w4a2-glue-role already exists.

  with module.extract_job.aws_iam_role.glue_role,
  on modules/extract_job/iam.tf line 1, in resource "aws_iam_role" "glue_role":
   1: resource "aws_iam_role" "glue_role" {
3

same here. if you get anything please do message here

4

@Talg @irlan @kiran14 Could you please send me in a message your lab ids?

And could you explain here:

  1. at what step you’re getting the error?
  2. and the exact steps you followed before to get the error?
5

@hawraa.salami
Same issue for me. I keep getting that error whenever I try to perform the terraform apply by module, so right at the start!
Tried rebooting it and now it fails right at terraform plan. Can you please help?