I got this errors.txt when applying terraform. Cannot find out what is wrong in my code. Anyone can help? I have been stuck here for a long time.
when using terraform destroy, it either says nothing to destroy, or asks to give
var.catalog_database
Curated DB name
Enter a value:
I was working on the landing zone part. After waiting for a day and AWS resource reset, terraform apply did not crash on the landing zone part any longer, and the jobs ran successfully (which shows that there is nothing wrong with my code).
Now I am working on the transformation zone part. And the same crash with the same error message appears again. Can anyone tell me what is going on? Rebooting does not work.
try to do project 2 first, but the same happened again, when running terraform apply -target=module.serving
, it just suddenly disconnects and cannot reconnect
Hello @monsterofmay,
Could you try manually deleting de-c4-w4-a2-connection-rds
from AWS>Data Catalog>Connections and glue> and de-c4-w4-a2-glue-role
from IAM>roles:
If the issue continues and you can’t find them you could ask for a lab refresh with this form. Hope it helps
hi @Georgios
thanks for your reply! Now I got this error (not the first time either):
and when I go to AWS console, there is no such silver_db database. What should I do next?
Hello @monsterofmay,
You could check this post there are some learners with a similar error. Please complete this form for a lab refresh. It should take 2 business days (no weekends) since its a manual process performed by the engineers. Thanks
the same as me.
Hello @hiroaki9342,
I guess you get an error that de-cdw4a1-silver-db
already exists like @monsterofmay when terraform apply
. Have you checked the AWS console to find those resources or perhaps a new lab session clears them. Please submit this form for a lab refresh, it takes 1-2 business days, thanks
Hi @Georgios,
Thank you for your reply. I have submitted my account information through the form. I wiil try again after your cleanup!
Hi, @Georgios
I tried starting over from the beginning today.. but it failed again due to the same errors. Could you please make sure that my lab environment has been properly reset? It seems nothing has changed. I do not want to face the same issue agian..
Error: pq: Schema “deftunes_serving” already exists
with module.serving.redshift_schema.serving_schema,
on modules/serving/redshift.tf line 2, in resource “redshift_schema” “serving_schema”:
2: resource “redshift_schema” “serving_schema” {
Error: pq: Schema “deftunes_transform” already exists
with module.serving.redshift_schema.transform_external_from_glue_data_catalog,
on modules/serving/redshift.tf line 12, in resource “redshift_schema” “transform_external_from_glue_data_catalog”:
12: resource “redshift_schema” “transform_external_from_glue_data_catalog” {
I cannot modify any of these schema status due to the role security.
Hello @hiroaki9342,
On a side note, is that s Pokémon avatar? About your lab, I’m not sure which capstone project you are. Someone had the same issue a couple weeks ago in capstone 2 in this post. That was after your post and he also provided the step as well terraform apply -target=module.serving -no-color 2> errors.txt
and it will be helpful to do the same. Those resources should clear during a new lab session or please submit the lab refresh form. I hope it helps
Hi, @Georgios
Thanks for your info. I tried the same command “terraform apply -target=module.serving -no-color 2> errors.txt”, but it fails.. Everytime, the terminal crashes. I submitted the form.
I am working on Programming Assignment: Assignment 4: Capstone Project Part 1 - ETL and Data Modeling.
I can’t submit assignments and complete the course if I keep getting the same error on this.
Yes, this is pokemon avatar.
Ok @hiroaki9342 I think I understand now that I have more clues. If you are in Capstone Project Part 1 - ETL and Data Modeling
I would skip that command in step 5.1 since my terminal crashed there as well. You should be getting four database schemas in 5.2:
You should be able to pass 100% if you get all the cell outputs at part 5.2 and submit, also I think parts 5.3 and 5.4 are not graded either. If it continues crashing you could wait for the lab refresh to complete. Thanks
I’m stucked with the section 4.1.
As you might know, the grade scoring is based on the cloud status, not the notebook output. Without solving any cloud issues, I won’t be able to pass this assignment..
In my understanding, since this project is to be executed sequentially, what do you think, if 4.1 can’t be done, there should be an error in section 5 as well?
Also, I often lose the connection especially when executing “terraform apply” command.
Fully stucked!
Hello @hiroaki9342,
Yes, losing connection will reboot the lab and create existing resources when you run terraform apply
. I thought your issue was with the command in part 5.1 not in the Landing zone so you need to complete all the parts up to 5. The only thing that can fix this:
- Try to manually delete them from the
errors.txt
file (withterraform apply -no-color 2> errors.txt
) - Wait for a new lab session after a few hours
- Trying too many times the lab will exceed limit and need a lab refresh again
Now you described the issue better that you can’t deploy the Landing module and the three jobs to continue with the other transform jobs. Make sure to change the API Endpoints in steps 2.4 and 4.1.2. And hopefully run the jobs and continue with the other modules. If you manage that and make some progress with terraform apply
you just need to add the correct Pacific dates (two places) in steps 4.2.2. Afterwards you should be able to complete it. Hope it helps
Hi, I have exactly the same problem. Is this problem now solved? If so, how?
I see the same errors after running “terraform apply”. (RDS and Glue role already exist.)
Running “terraform destroy” before did not find nothing to destroy.
I was able to delete the role manually, but I do not have permission to delete the RDS.
Please provide an update or instructions what I should do. Thanks.