Hello Forum, I am having trouble with Section 5.2.3 of the Capstone Project Part 1.
I have reviewed everything multiple times but cannot figure out why the SQL query returns zero rows, which prevents subsequent queries from running. I appreciate any insights any one of you can provide. Thanks a lot!
Here’s the SQL I used:
%sql SHOW TABLES FROM SCHEMA dev.deftunes_transform
Hello @Rocky111,
I couldn’t reproduce the issue, since I was able to get the correct output from terraform apply in step 4.3.6 and all jobs are complete before.
Could you check you get apply is complete in this step and the 2 resources deftunes_serving and deftunes_transform are succesfully deployed, hope it helps:
Hello Georgios,
Thank you for your response. I am unable to resolve the issue. I tried again from the top, and no luck. Also, I’m having trouble proceeding, as Terraform is crashing every time I run it. I have even attempted to use the terraform destroy command, but it hasn’t resolved the issue.
Could you please reset my AWS environment for this assignment? I would like to start over with a clean slate.
Thank you!
Please note: I’ve rebooted the server several times, but it still retains the previous scripts and Glue jobs, which are causing issues. I believe the problems began with the PACIFIC-TIME-CURRENT-DATE setting in terraform/modules/transform_job/glue.tf, which I overlooked in the instructions. Could you please assist me in resetting my AWS server so I can start fresh? Thank you!
@Rocky111 unfortunatelly reboot doesn’t help there. Since the resources are created in AWS and other resources has to be deleted manually or they get cleared after the lab session expires (e.g. etl-jobs, connections, databases).
What you are asking to start from the beginning are those instructions provided under the “Coursera Labs → Refreshing your Workspace”. What it says basically is to delete/rename files edited before and use get latest version to recreate them in their initial state. I am not sure the lab refresh form resets your lab settings not the lab to a previous state.
My question is that the json-songs transform jobs would fail if you didn’t use the correct Pacific-Time-Current_Date. I am not sure what was your mistake if your jobs succeded the first time. Check if your jobs have succeded before moving on and note that the API Endpoint changes every lab session (two places in extract_job/glue.tf). Hope it helps
@Georgios It seems that I have to wait for the AWS session to expire. I attempted to delete the resources in my AWS account, but it wouldn’t let me.
Hello @Rocky111, make sure if you missed the Pacific time in the transform/glue.tf (2 places). Don’t forget to change the API Endpoint as well in the extract/glue.tf after the new lab session is different (2 places) and step 2.4 as well. The other resources should be the same and you need to uncomment the main.tf and outputs.tf files so you can comment the correct blocks for extract/transform/serving. Thank you
Thanks a lot @Georgios! Will follow your tips.
