C3W2-Lab2_assigment DataLake house - missing ratingtimestamp col data

When creating a post, please add:



Note I set hardcoded values for col name and type, as glue job gave me key error if not set, its a bit confusing because it looks like it should come from args, but couldn’t find in terraform script where they are set.

btw, debugging glue is a pain, especially not having permissions to see logs, only small error message in the glue UI. Might be there is a cli call that could be used but didn’t check.

Hello @evaldasw,
Yes you are correct it shouldn’t be hardcoded since it comes from the args. I had a similar problem seeing only one version. The solution was a typo in the last query edit to add the third column for the ratings timestamp. I forgot to add a comma between the two columns in the ratings_to_iceberg sql1 transform job. Hope it helps

1 Like