When I run: terraform apply -target=module.transform_job
I get: Error: creating Glue Catalog Database (de_c4w4a2_silver_db): operation error Glue: CreateDatabase, https response error StatusCode: 400, RequestID: a18f4b4a-9908-4fa3-a4d7-784b0af82947, AlreadyExistsException: Database already exists.
I deleted de_c4w4a2_silver_db from the aws glue catalog db console and I still get the same error.
Now I’m having a different issue. First, to get past my previous issue, I changed the environment variable value for the catalog db to de_c4w4a2_silver_db1. This got me past my earlier issue. Now, I’m seeing the following when I try to run terraform apply -target=module.transform_job:
AnalysisException: Unable to verify existence of default database: com.amazonaws.services.glue.model.AccessDeniedException: Insufficient Lake Formation permission(s) on default
I modified the IAM role that is executing the glue transformation jobs to include the lakeformation ability to describe the default glue catalog db. Unfortunately, this didn’t fix my issue. I don’t know what else to tell you. Is there any way you reset my whole Programming Assignment: Assignment 5: Capstone Project Part 2 - Data Quality and Orchestration and Visualization environment and let me start over from scratch?
Hello @rfink2024
Please, don’t change anything in the configurations that you are not supposed to, because this leads to permission errors as you have seen. In order to fix the issue you are facing, please fill out this lab refresh form and try again in a few days after your lab has been refreshed.