C4W4 Assignment 5 capstone project 2
Both the dag run fails at the ```
task_id=“docker_dbt_command”, after by default going for a retry.
Please let me know if any other details needed
Hi , I am waiting for some assistance . The Dag job" deftunes_songs_pipeline_dag and the second dag job deftunes_api_pipeline_dag, last part of the assignment both are failing.
Both go to re try and then eventually fail at the task
"docker_dbt_command”,tried today too , but ending up having the same issue .
Hello @ami_il
Can you please share the details of the task with us? When you run a DAG, you can select the task that is failing, navigate to its logs, and see the reason the task is failing.
Hi thanks for the response.
Tried to complete again , just to reprduce the error but , whne doing terraform apply , 
terraform apply -target=module.extract_job -no-color 2> errors.txt and terraform apply -target=module.transform_job -no-color 2> errors.txt)
getting below errors, could not proceed ahead
Error: creating Glue Connection (de-c4w4a2-connection-rds): operation error Glue: CreateConnection, https response error StatusCode: 400, RequestID: 0c75c52a-be23-40dd-bd08-38b1bb178e23, AlreadyExistsException: Connection already exists.
with module.extract_job.aws_glue_connection.rds_connection,
on modules/extract_job/glue.tf line 2, in resource “aws_glue_connection” “rds_connection”:
2: resource “aws_glue_connection” “rds_connection” {
Error: creating IAM Role (de-c4w4a2-glue-role): operation error IAM: CreateRole, https response error StatusCode: 409, RequestID: c23116dd-cb89-41cf-8855-18b80723ad21, EntityAlreadyExists: Role with name de-c4w4a2-glue-role already exists.
with module.extract_job.aws_iam_role.glue_role,
on modules/extract_job/iam.tf line 1, in resource “aws_iam_role” “glue_role”:
1: resource “aws_iam_role” “glue_role” {
Error: creating Glue Connection (de-c4w4a2-connection-rds): operation error Glue: CreateConnection, https response error StatusCode: 400, RequestID: 8f15a63b-1185-495e-b662-d0b9e6bd8a72, AlreadyExistsException: Connection already exists.
with module.extract_job.aws_glue_connection.rds_connection,
on modules/extract_job/glue.tf line 2, in resource “aws_glue_connection” “rds_connection”:
2: resource “aws_glue_connection” “rds_connection” {
Error: creating IAM Role (de-c4w4a2-glue-role): operation error IAM: CreateRole, https response error StatusCode: 409, RequestID: 8eb566c3-8b95-48b8-99f2-7de7487346a9, EntityAlreadyExists: Role with name de-c4w4a2-glue-role already exists.
with module.extract_job.aws_iam_role.glue_role,
on modules/extract_job/iam.tf line 1, in resource “aws_iam_role” “glue_role”:
1: resource “aws_iam_role” “glue_role” {
@ami_il Could you please check your completion of the python files for the DAGs and make sure that you are inputting the correct values for <DATA-LAKE-BUCKET>, <SCRIPTS-BUCKET>, and <GLUE-EXECUTION-ROLE>?
Hi ,
Yes they were correct , as i took data lake bucket and script bucket from the cloudformation output and the glue execution role from the output of the terraform apply