I am unable to complete C4W4 Part 1 due to so many technical issues.
While working on the lab the terminal was crashing continuously requiring disconnection and reloading while running terraform commands. I rebooted the lab several times which worked temporarily.
However this led to many errors when running terraform apply command such as such as IAM roles already exist. I resolved these errors by removing the IAM roles with the conflict on AWS web interface, at this point I was frustrated. All other errors I used the recommended terraform command to ignore them.
While troubleshooting I removed all my glue scripts I uploaded on AWS since I wanted a clean slate to rerun all the commands in the notebook for ETL. However, since I spent so much time trouble shooting errors it appears that I am unable to access AWS to reupload the glue jobs for transforming and serving hence I am unable to run those jobs and unable to proceed to the dbt section of the lab.
This lab experience has been frustrating and stressful.
Would I be able to reset this lab or regain access to the AWS resources to complete this lab?
First, create a folder (old_lab_files) and move everything to that folder
Second, click on the question ? (help)
On the right bar, click on “get the latest version”
You should start fresh with new lab files.
For all commands, to avoid the terminal from crashing and to print the errrors inline, append || echo "$?" to the command, for example: terraform plan || echo "$?"
When you start a new session, please avoid rebooting the lab in the middle of the 3 hour session, this will make you lose the terraform state (that keeps track of the resources created) and then you will get this error that “resources already exist”.
When you get an error, please tag me here and I’ll help you troubleshoot it.