C4W4 Capstone project Part-1 'ingest_date' format

Course Q&A Data Engineering Data Modeling, Transformation, and Serving
,
1

Hey I am getting the following error while trying to run the following Transformation glue jobs.

aws glue start-job-run --job-name de-c4w4a1-json-transform-job | jq -r ‘.JobRunId’

AnalysisException: Path does not exist: s3://de-c4w4a1-426992998030-us-east-1-data-lake/landing_zone/api/users/yyyy-mm-dd

aws glue start-job-run --job-name de-c4w4a1-songs-transform-job | jq -r ‘.JobRunId’

ValueError: time data ‘yyyy-mm-dd’ does not match format ‘%Y-%m-%d’

Could you please confirm what should be the value of the “–ingest_date =” in the glue.tf file?

2

Hello @cchristyraj
You are supposed to replace the <PACIFIC-TIME-CURRENT-DATE> placeholder in two places in the terraform/modules/transform_job/glue.tf file. The value should be the current pacific datetime in the yyyy-mm-dd format, for example 2024-11-28.

3

I get that but don’t know where I am doing the mistake. Should the value be “yyyy-MM-dd” instead of “yyyy-mm-dd”?

4

I input the today’s date as value and completed the Transformation jobs.