Capstone Project Part 2: Unable to verify existence of default database error

Course Q&A Data Engineering Data Modeling, Transformation, and Serving
,
1

I am working on the capstone project part 2. The terraform apply command was executed successfully, and it created the jobs as expected.
The first three jobs completed successfully,

glue_api_users_extract_job
glue_sessions_users_extract_job
glue_rds_extract_job

But the other two encountered errors, as shown in the image.

glue_json_transformation_job
glue_songs_transformation_job

image
image1626Ă—814 101 KB

I have already requested a refresh of the AWS resources, but the issue still persists. Please help.

After several attempts, I encountered this issue when running the command. I searched for the database to delete it, but it wasn’t there

terraform apply -target=module.transform_job

Error: creating Glue Catalog Database (de_c4w4a2_silver_db): operation error Glue: CreateDatabase, https response error StatusCode: 400, RequestID: a8fbcb13-1e56-473f-93bc-27d2d15d71a3, AlreadyExistsException: Database already exists.

  with module.transform_job.aws_glue_catalog_database.transform_db,
  on modules/transform_job/glue.tf line 1, in resource "aws_glue_catalog_database" "transform_db":
   1: resource "aws_glue_catalog_database" "transform_db" {
2

I’m facing a very similar issue, and I’ve tried several times, even waiting the two hours so that I get the new values for the variables in AWS. Any solution so far?

3

Not yet. Submit the form to refresh aws resource seem the only thing can do now.

4

After refreshing the AWS resource the second time, it is now working

5

How you did the refresh?

6

There is a form you have to submit to have the DLAI staff refresh your assignment.

You can probably find it by searching the forum for the word “refresh”. It’s a very common topic on the DE course forum.

7

Fill this form and wait 1 - 3 business days

1 Like