Permission error when deploying

Course Q&A Data Engineering Data Storage and Queries
,
1

I keeping getting these error and can’t delete the Glue Job I created.

Screenshot_11
Screenshot_111920×1104 187 KB

2

Hello @BonAppetite,

The issue is that terraform apply didn’t create the glue jobs because de-c3w2a1-rds-connection already exists in step.3.2.2. You could delete the existing connection using aws commands e.g.aws glue delete-connection --de-c3w2a1-rds-connection or the AWS console.

After you delete any existing resources and run terraform apply again, you could continue with the jobs in step 3.2.3 (note the jobs you need to run from the terminal output should be de-c3w2a1-bucket-ingestion-etl-job not glue_bucket_ingestion_job).

1 Like
3

Hello @BonAppetite,

If the issue continues with de-c3w2a1-rds-connection, please submit this form. Thank you

4

@Georgios I have the same issue for assignment C4W4_Capstone Part 1

module.transform_job.aws_glue_catalog_database.transform_db: Creating…
╷
│ Error: creating Glue Catalog Database (de_c4w4a1_silver_db): operation error Glue: CreateDatabase, https response error StatusCode: 400, RequestID: 8cfc1af5-0d7b-4b4f-bb6b-cc33c2af464b, AlreadyExistsException: Database already exists.
│
│ with module.transform_job.aws_glue_catalog_database.transform_db,
│ on modules/transform_job/glue.tf line 2, in resource “aws_glue_catalog_database” “transform_db”:
│ 2: resource “aws_glue_catalog_database” “transform_db” {

I followed your instructions about deleting the Glue job but when I run:
aws glue delete-connection --de-c4w4a1-json-transform-job
aws glue delete-connection --de-c4w4a1-songs-transform-job

I get the following error:

aws glue delete-connection --de-c4w4a1-songs-transform-job

usage: aws [options] [ …] [parameters]
To see help text, you can run:

aws help
aws help
aws help

aws: error: the following arguments are required: --connection-name

What is the connection-name in this case?