C4W4-Project1-terraform apply crash

I got this errors.txt when applying terraform. Cannot find out what is wrong in my code. Anyone can help? I have been stuck here for a long time.

when using terraform destroy, it either says nothing to destroy, or asks to give

var.catalog_database
  Curated DB name

  Enter a value:
1 Like

I was working on the landing zone part. After waiting for a day and AWS resource reset, terraform apply did not crash on the landing zone part any longer, and the jobs ran successfully (which shows that there is nothing wrong with my code).

Now I am working on the transformation zone part. And the same crash with the same error message appears again. Can anyone tell me what is going on? Rebooting does not work.

try to do project 2 first, but the same happened again, when running terraform apply -target=module.serving, it just suddenly disconnects and cannot reconnect

it is the same error again and again, can anyone help

Hello @monsterofmay,

Could you try manually deleting de-c4-w4-a2-connection-rds from AWS>Data Catalog>Connections and glue> and de-c4-w4-a2-glue-role from IAM>roles:


If the issue continues and you can’t find them you could ask for a lab refresh with this form. Hope it helps

hi @Georgios
thanks for your reply! Now I got this error (not the first time either):

and when I go to AWS console, there is no such silver_db database. What should I do next?

Hello @monsterofmay,

You could check this post there are some learners with a similar error. Please complete this form for a lab refresh. It should take 2 business days (no weekends) since its a manual process performed by the engineers. Thanks

1 Like

the same as me.

Hello @hiroaki9342,

I guess you get an error that de-cdw4a1-silver-db already exists like @monsterofmay when terraform apply. Have you checked the AWS console to find those resources or perhaps a new lab session clears them. Please submit this form for a lab refresh, it takes 1-2 business days, thanks

Hi @Georgios,
Thank you for your reply. I have submitted my account information through the form. I wiil try again after your cleanup!

1 Like

Hi, @Georgios

I tried starting over from the beginning today.. but it failed again due to the same errors. Could you please make sure that my lab environment has been properly reset? It seems nothing has changed. I do not want to face the same issue agian..

Error: pq: Schema “deftunes_serving” already exists

with module.serving.redshift_schema.serving_schema,
on modules/serving/redshift.tf line 2, in resource “redshift_schema” “serving_schema”:
2: resource “redshift_schema” “serving_schema” {

Error: pq: Schema “deftunes_transform” already exists

with module.serving.redshift_schema.transform_external_from_glue_data_catalog,
on modules/serving/redshift.tf line 12, in resource “redshift_schema” “transform_external_from_glue_data_catalog”:
12: resource “redshift_schema” “transform_external_from_glue_data_catalog” {

I cannot modify any of these schema status due to the role security.

Hello @hiroaki9342,

On a side note, is that s Pokémon avatar? About your lab, I’m not sure which capstone project you are. Someone had the same issue a couple weeks ago in capstone 2 in this post. That was after your post and he also provided the step as well terraform apply -target=module.serving -no-color 2> errors.txt and it will be helpful to do the same. Those resources should clear during a new lab session or please submit the lab refresh form. I hope it helps

Hi, @Georgios

Thanks for your info. I tried the same command “terraform apply -target=module.serving -no-color 2> errors.txt”, but it fails.. Everytime, the terminal crashes. I submitted the form.

I am working on Programming Assignment: Assignment 4: Capstone Project Part 1 - ETL and Data Modeling.

I can’t submit assignments and complete the course if I keep getting the same error on this.

Yes, this is pokemon avatar.

Ok @hiroaki9342 I think I understand now that I have more clues. If you are in Capstone Project Part 1 - ETL and Data Modeling I would skip that command in step 5.1 since my terminal crashed there as well. You should be getting four database schemas in 5.2:

You should be able to pass 100% if you get all the cell outputs at part 5.2 and submit, also I think parts 5.3 and 5.4 are not graded either. If it continues crashing you could wait for the lab refresh to complete. Thanks

@Georgios

I’m stucked with the section 4.1.
As you might know, the grade scoring is based on the cloud status, not the notebook output. Without solving any cloud issues, I won’t be able to pass this assignment..

In my understanding, since this project is to be executed sequentially, what do you think, if 4.1 can’t be done, there should be an error in section 5 as well?

Also, I often lose the connection especially when executing “terraform apply” command.
Fully stucked! :frowning:

Hello @hiroaki9342,

Yes, losing connection will reboot the lab and create existing resources when you run terraform apply. I thought your issue was with the command in part 5.1 not in the Landing zone so you need to complete all the parts up to 5. The only thing that can fix this:

  1. Try to manually delete them from the errors.txt file (with terraform apply -no-color 2> errors.txt)
  2. Wait for a new lab session after a few hours
  3. Trying too many times the lab will exceed limit and need a lab refresh again

Now you described the issue better that you can’t deploy the Landing module and the three jobs to continue with the other transform jobs. Make sure to change the API Endpoints in steps 2.4 and 4.1.2. And hopefully run the jobs and continue with the other modules. If you manage that and make some progress with terraform apply you just need to add the correct Pacific dates (two places) in steps 4.2.2. Afterwards you should be able to complete it. Hope it helps

1 Like

Hi, I have exactly the same problem. Is this problem now solved? If so, how?
I see the same errors after running “terraform apply”. (RDS and Glue role already exist.)
Running “terraform destroy” before did not find nothing to destroy.
I was able to delete the role manually, but I do not have permission to delete the RDS.
Please provide an update or instructions what I should do. Thanks.

1 Like