The transformation glue jobs keep failing on the capstone project part 2. I have edited the ingest date on the transform/glue.tf file to “2020-02-01” as stated on the instruction. Should I use the current date rather? I am confused here. The ingest glue jobs ran correctly with the date “2020-02-01”.
Please help.
Hello @chimexis,
Yes, you need to use the same "--ingest_date" for extract_job/glue.tf and transform_job/glue.tf not the current date but 1 day after "--api_end_date". So the ingestion date will need to be the first day of the next month, "2020-02-01" . Note the API_ENDPOINT should be different after a new lab session so update it. Hope it helps