C3w2 a1 4.3

Course Q&A Data Engineering Data Storage and Queries
1

Hi there,

when I run:
4.3.3. Deploy the Glue Jobs following the same steps as in section 3.2. You will need to execute three Glue Jobs: glue_csv_transform_job, glue_ratings_transform_job, glue_ratings_to_iceberg_job (job names de-c3w2a1-csv-transformation-job, de-c3w2a1-ratings-transformation-job and de-c3w2a1-ratings-to-iceberg-job). Each of them should take around 3 minutes, you can run them at the same time.
I got three errors, which looks like these:

image
image1592×591 64.8 KB

image
image1599×795 91.4 KB

image
image1597×800 87.2 KB

What or where can i fix these problems? since I have checked every step many times.

2

Hello @Edwincheng,

I couldn’t reproduce your issue, it seems if you run the extract jobs succesfully you get the corrects output at part 3.2.4. You should be able to see the files read from the 3 transform jobs inside the data lake.

Please if the issue continues submit this form for a lab refresh. It should take 1-2 business days (no weekends) since it is manual process performed by the engineers. Hope it helps