ETL job is failed

Course Q&A Data Engineering Introduction to Data Engineering
1

When creating a post, please add:

  • Module # must be added in the tags option of the post. → WEEK 2
  • Link to the classroom item you are referring to: Week 2 First Assignment
  • Description : Whenever I am running apply terraform command I am getting error stating
    Error: creating Glue Connection (de-c1w2-rds-connection): operation error Glue: CreateConnection, https response error StatusCode: 400, RequestID: e199c96e-b337-4da1-801b-35ad1fc332a9, AlreadyExistsException: Connection already exists.
    │
    │ with aws_glue_connection.rds_connection,
    │ on glue.tf line 6, in resource “aws_glue_connection” “rds_connection”:
    │ 6: resource “aws_glue_connection” “rds_connection” {
    │
    ╵
    ╷
    │ Error: creating IAM Role (de-c1w2-glue-role): operation error IAM: CreateRole, https response error StatusCode: 409, RequestID: c13676f2-5b90-4168-ba5e-6337bb9d8d5e, EntityAlreadyExists: Role with name de-c1w2-glue-role already exists.
    │
    │ with aws_iam_role.glue_role,
    │ on iam_roles.tf line 1, in resource “aws_iam_role” “glue_role”:
    │ 1: resource “aws_iam_role” “glue_role” {
    │
    and ETL job failed with error

An error occurred while calling o147.pyWriteDynamicFrame. Insufficient Lake Formation permission(s) on dim_customers (Service: AWSGlue; Status Code: 400; Error Code: AccessDeniedException; Request ID: 0c0dfc09-8480-4830-847e-f9918f9aaa28; Proxy: 169.254.76.0)

2

Hello @AmrutaD,

Unfortunately this error happened to other learners as well in previous post. Please submit this form and a staff will refresh your lab. Note, it takes 2 business days since it’s a manual process performed by the engineers. Hope it helps

job fail
job fail1590×267 56.7 KB

3

Facing the same issue. Have submitted the form. Will I hear through email?

4

Hello @Atif_Hussain1,

Thank you for submitting the form. You should be notified via email when it is resolved in 1-2 business days. Thanks