When creating a post, please add:
Hello @Noddy,
Sorry for the inconvenience you are facing. It seems you are having issues with terraform apply or successfully running extract/transform jobs. There are a few other learners who had those issues with terraform because of existing resources when running terraform apply (you could check the errors.txt file when if you run terraform apply -no-color 2> errors.txt).
If you use the forum search tool you could see people who submitted the lab refresh form, that takes 1-2 business days to complete. This form also helps with Insufficient Lake Formation issues that cause the jobs fail because of metadata. Hope it helps
Hi @Georgios, As Mentioned earlier i have done everything stated in the conversation and refreshing the lab with other ways, Need Your Support atleast the Lab should go back to Zero ground so that i can start again that also is not happening. Solving the Lab is not much of the task but the problem is with infrastructure from last 2 weeks
@Noddy When you try again the lab, the terraform files contain your saved work from a previous session.
The lab asks you first to uncomment first Landing zone in main.tf and outputs.tf and then run the jobs. If you try again the lab and let’s say you have the first two modules uncommented from the previous session, and your run terraform in the first section, all the resources of these two modules will be created. So when you get to the second section and run terraform again, you’ll get that all the resources have been already created.
So when you try the lab again, I’d suggest that you either comment back everything you uncommented from previous sessions (in main.tf and outputs.tf) Or you can retrieve the original lab files as follows:
@Noddy, In order to pass the grader you only need to run the Landing zone jobs (two) and Curated zone jobs (three). In order to do that you need to follow the instructions until step 4.3. If you have any issues with those jobs you could check again at the edited scripts. That’s all you need to do, thank you:
main.tf until line 32 (transform_etl),Uncomment outputs.tf until line 25 (transform_etl)I have Done step 2 you have mentioned, but i when i run the ETL Jobs, the error is appearing, i have uncommented Main.tf & Outputs.tf
@Noddy,
The error like metadata means that after the you ran terraform applythe output is not showing as apply complete. That means there is an issue with existing resources in AWS console. Could you try terraform apply -no-color 2> errors.txt instead of terraform apply and check at the file created errors.txt. Thank you
@Noddy Have you copied your files into the new folder and used get latest version like I suggested so you can edit your files frorm the beginning. What is the error you are getting, in the first terrafrom deployment steps 3.2.2 or after you edited the glue.tf file in step 4.2.3. Please share a screenshot of the issue so I can see it, thank you
Hi @Georgios, I tried the file transfer and “get the latest version” no success still the error comes when i run the script:
coder@2a77305e67e9:~ /project$ source scripts/setup.sh
An error occurred (InvalidClientTokenId) when calling the DescribeDBInstances operation: The security token included in the request is invalid.
An error occurred (AuthFailure) when calling the DescribeSubnets operation: Authorization header or parameters are not formatted correctly.
An error occurred (InvalidClientTokenId) when calling the DescribeDBInstances operation: The security token included in the request is invalid.
An error occurred (InvalidClientTokenId) when calling the DescribeDBInstances operation: The security token included in the request is invalid.
An error occurred (AuthorizationHeaderMalformed) when calling the ListBuckets operation: The authorization header is malformed; a non-empty Access Key (AKID) must be provided in the credential.
An error occurred (InvalidClientTokenId) when calling the DescribeClusters operation: The security token included in the request is invalid.
An error occurred (InvalidClientTokenId) when calling the GetCallerIdentity operation: The security token included in the request is invalid.
An error occurred (InvalidClientTokenId) when calling the GetCallerIdentity operation: The security token included in the request is invalid.
Hello @Noddy,
Sorry but I’ve seen this error before when your lab exceeded limit. After you have tried too many times source scripts/setup.sh fails to load the lab settings and AWS link is empty as well so you need to submit the lab refresh form.
Please follow the instructions for a fresh assignment and provide any details of the steps you have the issue. Hope it helps
Dear Georgios,
I still get the same Metadata error when applying the Job Runs in 4.3.3. I spent hours and hours to fix this problem, and now I am just frustrated. I even deleted all files, downloaded a brand new version and followed all instructions in the lab until this point. Is there any way that you could just mark this assignment as completed? These error messages are really time consuming and frustrating. Its a great course, but too buggy for many users.
I believe there should be another option for such incidences to pass either another exam/quiz.
for last 1.5 months i have been sitting with 2 such labs otherwise my course could have been finished
Same here
Unfortunately mentor Georgios is no longer active in this course.
Perhaps DLAI will assign another mentor to provide support.
@johannes.backer Could you please explain to me the output error you’re getting at 4.3.3?
@Noddy Are you still encountering any issues?
The well known missing Meta data issue
Again and again Lab goes corrupt, twice have filled the lab refresh form