Week4# Assignment 3: Building End-to-End Batch and Streaming Data Pipelines Based on Stakeholder Requirements.
Accidently I delete some codes from the terraform /main.tf and /outputs.tf files.
I have rebooted lab and restarted it multiple times but issue still exits. It is not letting me continue lab accurately.
Hello @mdytech67,
Your edited files can be safely deleted and get latest version should recreate them from start. You could go to help (top right corner) and click get latest version:
- Click on lab help which is the question mark on the top right
- Click on “Get the latest version”.
You could also ask for a lab refresh with this form to reset your lab from start. Note, it takes 2 business days to complete, hope it helps
Form is working badly - I cannot write there my issue. Could you reset completely the following excercise for me?:
Programming Assignment: Assignment 3: Building End-to-End Batch and Streaming Data Pipelines Based on Stakeholder Requirements
Terraform password and db hostname is not returning values. I’ve tried several times and I just want to start from scratch. But I cannot because even after reboot lab contain some changes…
Hello @Konrad_Wojciechowski,
If you want to start over you can safely delete the terraform folder then use get latest version. That will allow you to start uncommenting like it says in the instructions. Unless you made any other changes other than the main.tf and outputs.tf files after a new lab session or the lab refresh form you don’t need to do anything else to start fresh.
I am not sure if you had issues in step 2.4 with terraform apply of the vector-db module, from that output you get the Vector_DB_Host allows you to use the terraform output vector_db_master_password. That will allow you to connect to the database, hope it helps:
Hi. Let me check
Error: creating Glue Catalog Database (de-c1w4-ml-db): operation error Glue: CreateDatabase, https response error StatusCode: 400, RequestID: 670df353-7abe-42cc-9b37-71a158bc02d1, AlreadyExistsException: Database already exists.
with module.etl.aws_glue_catalog_database.ml_database,
on modules/etl/glue.tf line 1, in resource “aws_glue_catalog_database” “ml_database”:
1: resource “aws_glue_catalog_database” “ml_database” {
Error: creating Glue Connection (de-c1w4-rds-connection): operation error Glue: CreateConnection, https response error StatusCode: 400, RequestID: 549f28c4-509f-4e6e-a536-6eea688b86e9, AlreadyExistsException: Connection already exists.
with module.etl.aws_glue_connection.rds_connection,
on modules/etl/glue.tf line 6, in resource “aws_glue_connection” “rds_connection”:
6: resource “aws_glue_connection” “rds_connection” {
Error: creating IAM Role (de-c1w4-glue-role): operation error IAM: CreateRole, https response error StatusCode: 409, RequestID: 89796694-209c-4a2d-bea8-9615d8bebf27, EntityAlreadyExists: Role with name de-c1w4-glue-role already exists.
with module.etl.aws_iam_role.glue_role,
on modules/etl/iam_roles.tf line 1, in resource “aws_iam_role” “glue_role”:
1: resource “aws_iam_role” “glue_role” {
odule.etl.aws_iam_role.glue_role: Creating…
module.etl.aws_glue_catalog_database.ml_database: Creating…
module.etl.aws_glue_connection.rds_connection: Creating…
coder@b7f42ef8d505:~/project/terraform$ terraform output vector_db_master_username
“postgres”
coder@b7f42ef8d505:~/project/terraform$ terraform output vector_db_master_password
â•·
│ Error: Output “vector_db_master_password” not found
│
│ The output variable requested could not be found in the state file. If you recently added this to your configuration, be sure to run terraform apply, since the state won’t be updated with new output variables
│ until that command is run.
╵
coder@b7f42ef8d505:~/project/terraform$ terraform output vector_db_host
â•·
│ Error: Output “vector_db_host” not found
│
│ The output variable requested could not be found in the state file. If you recently added this to your configuration, be sure to run terraform apply, since the state won’t be updated with new output variables
│ until that command is run.
╵
Maybe it is just my company laptop - I will try again from my private one…
Hello @Konrad_Wojciechowski,
It seems you have existing resources in AWS console that you could try and delete manually:
- de-c1w4-ml-db should be in AWS Glue> databases:
- de-c1w4-rds-connection in AWS Glue > connections
- For de-c1w4-glue-role go to IAM and then Roles:
- If the issue continues you could wait for a new lab session cleanup (2 hours)
Afterwards try terraform apply again and it should complete without any errors. From the output you get Vector_DB_Host and get the paswrd with terraform output vector_db_master_password since it’s sensitive. Hope it helps
It works now - great - thanks
1 Like