Hi,
I am stuck in Step 4.1.6. of the C4_W4_Assigment_1. All three glue jobs fail with these error messages:
de-c4w4a1-rds-extract-job:”An error occurred while calling o94.getDynamicFrame. The connection attempt failed."
de-c4w4a1-api-sessions-extract-job and de-c4w4a1-api-users-extract-job: “ConnectTimeout: HTTPConnectionPool(host=‘ec2-44-221-232-29.compute-1.amazonaws.com’, port=80): Max retries exceeded with url: /users?start_date=2020-01-01&end_date=2020-01-31 (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f1890a289a0>, ‘Connection to ec2-44-221-232-29.compute-1.amazonaws.com timed out. (connect timeout=None)’))”
Can this be caused by an error in main.tf? I accidentally deleted the first part “extract_job” and tried to recreate it myself. It looks like this now:
module “extract_job” {
source = “./modules/extract_job”
project = var.project
region = var.region
public_subnet_a_id = var.public_subnet_a_id
db_sg_id = var.db_sg_id
host = var.source_host
database = var.source_database
username = var.source_username
password = var.source_password
scripts_bucket = var.scripts_bucket
data_lake_bucket = var.data_lake_bucket
}
This is part of the default lab configuration. Can someone who did not temper with it please check if my recreation is correct?
Any other ideas why my glue jobs are failing?
Help is very welcome, I am struggling with this for some time now and really want to complete my data engineering course.
Melanie