Hi,
Can someone please completely reset my lab of course 1 week 4?
I cannot use terraform apply because it says that the things that I need to create with terraform already exist in AWS. I tried to search on the forums to debug it, but nothing helped.
I think the issue started when I got disconnected while running an apply command. Then I tried to start over again with the lab, but the AWS account has not reset. I tried to run terraform destroy to start over again, but this did not help either (maybe it made things worse).
Hello @brunotb,
You could ask for a lab refresh but I think it will work if you wait for a new lab session (2 hours). Delete the terraform folder and use get latest version to recreate the folder and start again:
The terraform destroy won’t make things worse but you could check with terraform apply -no-color 2> errors.txt which resources already exist and try to delete them manually from the console. Thank you
1 Like
same excatly i try this unfortunately i try different things from stackoverflow didn’t work
Hello @Muhammad_Hassaan,
I suggest to complete this form, the lab refresh seems to fix things. Hope it helps
1 Like
yes i did same bro thanks :
nice to meet you @Georgios
2 Likes
Hello, can I get some help resetting my course 1 week 4 lab? I am stuck on step 1.11 when running terraform apply. The error messages indicate that a database, connection, and role already exist, but I am unable to proceed further in the lab (step 1.13). When trying to run the Glue job I receive an error stating there is no metadata.
I have tried refreshing my folders with the latest version, but I am repeatedly getting stuck on this step. Any help would be greatly appreciated!
Hello @RG25852,
The metadata error in the job run means your terraform apply or terraform apply -no-color 2> errors.txt are not successfully complete and throw these errors:
Could you check in AWS console and delete them manually:
- de-c1w4-ml-db should be in AWS Glue> databases:
- de-c1w4-rds-connection in AWS Glue > connections
- For de-c1w4-glue-role go to IAM and then Roles:
- It is likely that after you delete them and run
terraform apply -no-color 2> errors.txt you might get an error that the crawler exists. Try to delete that as well and hopefully your terraform apply finally succeds:
- Those resources should clear after a a new lab session (a few hours). If the job fails with an Inusfficient Lake Formation error you could ask for a lab refresh with the form. Thank you
Hi @Georgios,
I successfully deleted the IAM role and AWS Glue connection, but I am still receiving the following error. I am a bit confused because there are no Glue Databases. Am I looking in the wrong place?
Error: creating Glue Catalog Database (de-c1w4-ml-db): operation error Glue: CreateDatabase, https response error StatusCode: 400, RequestID: b41034f0-72a2-4fda-adfe-ee269e74867f, AlreadyExistsException: Database already exists.
with module.etl.aws_glue_catalog_database.ml_database,
on modules/etl/glue.tf line 1, in resource “aws_glue_catalog_database” “ml_database”:
1: resource “aws_glue_catalog_database” “ml_database” {
Hello @RG25852,
Yes, that is the correct place and I see there isn’t de-c1w4-ml-db appearing. Please submit this form for a lab refresh cause I am afraid the issue persists. Note, it takes 2 business days to complete and check this post that @hawraa.salami explains how to start a new lab. Thank you
Thank you @Georgios! I just submitted the form. Thank you for your help.
1 Like
Hello @Georgios,
I am also requesting a lab refresh after trying for a while to solve an issue. My terminal keeps crashing with an “exit 1” code when I enter yes while running the command “terraform apply” in lab 3 of the Last week of Introduction to Data Engineering.
The error file says that there is a ressource that already exist. But despite all my efforts locating it and trying to get terraform to take it into account or deleting it from the console, the problem persists.
Best regards,
Bonaventure.
Hello @Bonaventure,
Probably you can’t find and delete de-c1w4-ml-db from AWS glue Databases. Since you need to clear those resources for terraform apply to complete you need to submit the form to request a lab refresh. That should clear all the resources but it takes 2 business days to complete since it’s a manual process performed by the engineers. Hope it helps
1 Like
Thank you for your response,
I submitted the form but did not find the exact topic that matches my issue. But I selected the closest which is the first one.
I will be moving forward and retry after the deadline.
1 Like
