Hi @felipeyamate, I attempted to log in into your account but was unable to delete the glue database. I’m sorry for the delay, as we are working on multiple labs at the sametime, could you attempt to delete the glue database using the AWS CLI?
aws glue delete-database de_c4w4a2_transform_db
I think you should have enough permissions to run this command, we are working to improve the cleanup of resources created with Terraform, always remember to run the command terraform destroy in each run.
ok but I got a problem that I’m not able to access the lab
I sent an email to Vocareum and they replied that you need to get me more time to complete the lab.
Reading their reply, I’m curious whether that means if you leave the lab open for 30 hours (1800 minutes), then the timer expires and you’re locked out?
@felipeyamate could you please submit the following form: Data Engineering Troubleshooting with AWS Issues
I think that I tried 10 times because of the error.
I didn’t knew that had this limit of trials
@esanina I already submited 3 times and still the lab isin’t working
Still not working…
The least you could do is give me more time on the course since my registration ends on the 26th.
15 days guys and counting
@felipeyamate thanks for your patience. I have refreshed you account again - could you please try one more time?
it worked now
Thank you @esanina
HI Dear esanina,
I have had the same problem for three weeks until now. Could you help me with that? I saw the charge on my bank account, but I am still not having access. Here are my lab issues:
Week 1 Assignment: Data Modeling with DBT
Week 4 Assignment 1: Capstone Project Part 1 - ETL and Data Modeling
Week 4 Assignment 2: Capstone Project Part 2 - Data Quality, Orchestration, and Visualization.
Thank you for your understanding and support.
Hello @Leb12 could you please submit the following form: Data Engineering Troubleshooting with AWS Issues
Hello, Esanina! My submission has already been made. I am just waiting on the outcome. Your support is greatly appreciated.
@Leb12 thank you. The lab was updated and should be working now.
Hello,
I also have the same issue with Capstone project part 2 after running :
terraform apply -target=module.data_quality
Error: creating Glue Data Quality Ruleset (songs_dq_ruleset): operation error Glue: CreateDataQualityRuleset, https response error StatusCode: 400, RequestID: 2464f86e-6e24-48ed-a225-eb3232341f7c, InvalidInputException: Entity Not Found (Service: AmazonDataCatalog; Status Code: 400; Error Code: EntityNotFoundException; Request ID: f4e24140-cbce-4df3-88c9-d117a1c950d5; Proxy: null)
with module.data_quality.aws_glue_data_quality_ruleset.songs_dq_ruleset,
on modules/data_quality/glue.tf line 1, in resource “aws_glue_data_quality_ruleset” “songs_dq_ruleset”:
1: resource “aws_glue_data_quality_ruleset” “songs_dq_ruleset” {
Error: creating Glue Data Quality Ruleset (sessions_dq_ruleset): operation error Glue: CreateDataQualityRuleset, https response error StatusCode: 400, RequestID: 24a2f9ea-8749-4a5e-a78b-14e31a21a972, InvalidInputException: Entity Not Found (Service: AmazonDataCatalog; Status Code: 400; Error Code: EntityNotFoundException; Request ID: dad3805a-6fb8-4ce4-b6ac-e3b98e725c22; Proxy: null)
with module.data_quality.aws_glue_data_quality_ruleset.sessions_dq_ruleset,
on modules/data_quality/glue.tf line 10, in resource “aws_glue_data_quality_ruleset” “sessions_dq_ruleset”:
10: resource “aws_glue_data_quality_ruleset” “sessions_dq_ruleset” {
Error: creating Glue Data Quality Ruleset (users_dq_ruleset): operation error Glue: CreateDataQualityRuleset, https response error StatusCode: 400, RequestID: d6eac947-a755-4984-a067-b083146b805c, InvalidInputException: Entity Not Found (Service: AmazonDataCatalog; Status Code: 400; Error Code: EntityNotFoundException; Request ID: 7e3e89b2-2fa2-4fd7-9e62-8d04be05b39a; Proxy: null)
with module.data_quality.aws_glue_data_quality_ruleset.users_dq_ruleset,
on modules/data_quality/glue.tf line 19, in resource “aws_glue_data_quality_ruleset” “users_dq_ruleset”:
19: resource “aws_glue_data_quality_ruleset” “users_dq_ruleset” {
This is what I try :
1- Reboot the Lab
2-clear previous resource created
Since 02 days, I am struggling with this error
Hello @euloge
I guess the problem is with the target_table in the rulesets. These ruleset depend on these tables, and apparently terraform is not able to find these entities. Please, make sure that you complete all the previous steps and that all the extract and transform glue jobs succeed before proceeding to this section.
