Capstone part 1: Cannot find catalog plugin class

I’ve been working on getting the transformations job runs to work, and I was running into this error but wasn’t sure if my environment was somehow corrupted so I filled out “the form” and had everything reset. Made necessary file updates and ran terraform with no errors, ran extract jobs with no errors, then when running the transform jobs, the songs transform job succeeded, but I got this same error when running (and then re-running) the json transform job. Which seems strange since if it could find the catalog plugin class for the songs transform seems like it should find it for the json transform. Please provide some help!

Nevermind, I had missed setting the “–datalake-formats” = “iceberg” in glue.tf for the json transform job.

2 Likes