Capstone 2: data Quality fails to create

terraform apply -target=module.data_quality

fails with:

Error: creating Glue Data Quality Ruleset (users_dq_ruleset): operation error Glue: CreateDataQualityRuleset, https response error StatusCode: 400, RequestID: b04185cd-d14c-4488-89f9-18b34ff8553e, InvalidInputException: Entity Not Found (Service: AmazonDataCatalog; Status Code: 400; Error Code: EntityNotFoundException; Request ID: 6d0c9078-3692-4ffd-abfc-281d6484ebd9; Proxy: null)
│ 
│   with module.data_quality.aws_glue_data_quality_ruleset.users_dq_ruleset,
│   on modules/data_quality/glue.tf line 19, in resource "aws_glue_data_quality_ruleset" "users_dq_ruleset":
│   19: resource "aws_glue_data_quality_ruleset" "users_dq_ruleset" {

I have no idea what this means.

Hello @dollybastard
I tried the lab, and here are the results. The first time I run terraform apply -target=module.data_quality, the terminal crashes, and I was not able to see the errors. Then, I went to the Databases menu from AWS Glue, deleted the rulesets, and then run terraform apply -target=module.data_quality again, and everything worked smoothly this time. I will try the lab again later to see what was the problem the first time.




I have delete the rulesets but still stuck with the same issue.


I reboot the lab now everything is error!

Hello @BonAppetite
As you can see from the last error, there is a problem parsing the ruleset you have added in line 21. You have removed the open and close brackets. The ruleset must be put inside the brackets instead.

It produces these error when I rerun the terraform apply

@BonAppetite Did you run the jobs in part 2.4, and did they complete successfully before moving on to this section?
Please, share the complete log you get after running terraform apply -target=module.data_quality.

it shows the status RUNNING and i wait a couple minutes. But should it be changing to status SUCCESS afterwards?

Yes, you need to wait for the status to change to succeeded, then proceed to the next steps.