# C4W4 Capstone project 2. Glue ETL jobs throwing access error **URL:** \ **Category:** Data Modeling, Transformation, and Serving\ **Tags:** week-module-4, coursera-platform\ **Created:** [January 18, 2025, 12:31pm UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015 "2025-01-18T12:31:54Z")\ **Posts on this page:** 16\ **Page:** 1
**Author:** ![sahil251298](https://avatars.discourse-cdn.com/v4/letter/s/bb73d2/32.png) [@sahil251298](https://community.deeplearning.ai/u/sahil251298)\ **Post date:** [January 18, 2025, 12:31pm UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/1 "2025-01-18T12:31:54Z")
In the 2nd capstone project, when I run the transform glue etl jobs, this error is thrown AnalysisException: Insufficient Lake Formation permission(s) on de\_c4w4a2\_transform\_db (Service: AWSGlue; Status Code: 400; Error Code: AccessDeniedException; Request ID: 1f805925-459a-469b-a88d-847d090dc658; Proxy: null) Need help in fixing this ---
**Author:** ![Amir\_Zare](https://sea1.discourse-cdn.com/dlai/user_avatar/community.deeplearning.ai/amir_zare/32/95275_2.png) [@Amir\_Zare](https://community.deeplearning.ai/u/Amir_Zare)\ **Post date:** [January 18, 2025, 5:03pm UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/2 "2025-01-18T17:03:05Z")
Hello @sahil251298 Sorry for the inconvenience. Can you please fill out the [lab refresh form](https://forms.gle/Bbc2PqyjYWnS34jF7) and try again after your lab is refreshed? ---
**Author:** ![rrosa](https://avatars.discourse-cdn.com/v4/letter/r/ba8739/32.png) [@rrosa](https://community.deeplearning.ai/u/rrosa)\ **Post date:** [January 21, 2025, 7:26pm UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/3 "2025-01-21T19:26:22Z")
Hi Amir, I’m having the same permission problem, and follow the link you provided. So now I should wait is correct? Thank you ---
**Author:** ![Amir\_Zare](https://sea1.discourse-cdn.com/dlai/user_avatar/community.deeplearning.ai/amir_zare/32/95275_2.png) [@Amir\_Zare](https://community.deeplearning.ai/u/Amir_Zare)\ **Post date:** [January 22, 2025, 5:12am UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/5 "2025-01-22T05:12:45Z")
Hello @rrosa Yes. Please, wait up to 3 business days and try again after. ---
**Author:** ![rrosa](https://avatars.discourse-cdn.com/v4/letter/r/ba8739/32.png) [@rrosa](https://community.deeplearning.ai/u/rrosa)\ **Post date:** [January 28, 2025, 6:26pm UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/6 "2025-01-28T18:26:57Z")
Hi Amir, I hope you’re doing well! I’m not sure if I’ve done something wrong or missed a step, but when running the following command in the Visual Studio Code terminal as instructed in the Jupyter notebook: `aws glue start-job-run --job-name de-c4w4a2-json-transform-job` I encountered the same issue. In the AWS Console, under AWS Glue \> ETL Jobs, the job run has a “Failed” status with the following exception message: ```auto AnalysisException: Insufficient Lake Formation permission(s) on de_c4w4a2_transform_db (Service: AWSGlue; Status Code: 400; Error Code: AccessDeniedException; Request ID: f3e13364-62d8-4273-b96f-32154bc047b8; Proxy: null) ``` Additionally, I noticed that my running user in the AWS Console (top-right corner) is prefixed with `voclabs/`. Could you please help me identify what might be missing so I can successfully complete the project? I’d greatly appreciate any guidance you can provide. Thank you so much in advance! 😊 Best regards, Rui Rosa ---
**Author:** ![Amir\_Zare](https://sea1.discourse-cdn.com/dlai/user_avatar/community.deeplearning.ai/amir_zare/32/95275_2.png) [@Amir\_Zare](https://community.deeplearning.ai/u/Amir_Zare)\ **Post date:** [January 29, 2025, 6:27am UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/7 "2025-01-29T06:27:11Z")
Hello @rrosa The `Insufficient Lake Formation permission` can be fixed via a lab refresh. Please, fill out this [lab refresh form](https://forms.gle/Bbc2PqyjYWnS34jF7) and try again after 3 working days. ---
**Author:** ![Edmund\_Koh](https://avatars.discourse-cdn.com/v4/letter/e/8491ac/32.png) [@Edmund\_Koh](https://community.deeplearning.ai/u/Edmund_Koh)\ **Post date:** [February 11, 2025, 3:03pm UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/8 "2025-02-11T15:03:33Z")
Hi @Amir_Zare Im getting the following error after running the glue start-job-run. Can I get help on this please? An error occurred (AccessDeniedException) when calling the StartJobRun operation: User: arn:aws:sts::471112906237:assumed-role/VSCodeInstanceRole/i-0353661b5af2b206e is not authorized to perform: glue:StartJobRun on resource: arn:aws:glue:us-east-1:471112906237:job/glue\_api\_users\_extract\_job because no identity-based policy allows the glue:StartJobRun action ---
**Author:** ![Amir\_Zare](https://sea1.discourse-cdn.com/dlai/user_avatar/community.deeplearning.ai/amir_zare/32/95275_2.png) [@Amir\_Zare](https://community.deeplearning.ai/u/Amir_Zare)\ **Post date:** [February 11, 2025, 4:50pm UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/9 "2025-02-11T16:50:45Z")
Hello @Edmund_Koh I guess you are using a wrong value for the job name in the glue start job command. Please, provide the full command you use so that we can check it. ---
**Author:** ![Edmund\_Koh](https://avatars.discourse-cdn.com/v4/letter/e/8491ac/32.png) [@Edmund\_Koh](https://community.deeplearning.ai/u/Edmund_Koh)\ **Post date:** [February 12, 2025, 7:24am UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/10 "2025-02-12T07:24:02Z")
Hey @Amir_Zare attached my input ![Screenshot 2025-02-12 at 3.16.48 PM](https://global.discourse-cdn.com/dlai/original/3X/2/9/2911f449f19572113a9c00060f832a8af26a3314.png) ---
**Author:** ![Amir\_Zare](https://sea1.discourse-cdn.com/dlai/user_avatar/community.deeplearning.ai/amir_zare/32/95275_2.png) [@Amir\_Zare](https://community.deeplearning.ai/u/Amir_Zare)\ **Post date:** [February 12, 2025, 2:49pm UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/11 "2025-02-12T14:49:48Z")
@Edmund_Koh As I said, `glue_api_user_extract_job` is not the correct job name. You need to get the value of the output named `glue_api_user_extract_job` from terraform and use that value as the job name in the command. ---
**Author:** ![rrosa](https://avatars.discourse-cdn.com/v4/letter/r/ba8739/32.png) [@rrosa](https://community.deeplearning.ai/u/rrosa)\ **Post date:** [February 16, 2025, 7:54pm UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/13 "2025-02-16T19:54:33Z")
Hi Amir, It took me a little while to retry, but I finally got around to it today, and everything ran smoothly! I just wanted to update you and sincerely thank you for your help—I really appreciate it! Best regards, Rui Rosa ---
**Author:** ![bchibbard](https://avatars.discourse-cdn.com/v4/letter/b/df705f/32.png) [@bchibbard](https://community.deeplearning.ai/u/bchibbard)\ **Post date:** [February 22, 2025, 10:53pm UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/14 "2025-02-22T22:53:28Z")
Hello @Amir_Zare , I am getting a similar exception: `AnalysisException: Insufficient Lake Formation permission(s) on de_c4w4a2_silver_db (Service: AWSGlue; Status Code: 400; Error Code: AccessDeniedException; Request ID: d5bbb718-dbe8-4026-ac11-e8e59703fe2c; Proxy: null)` I tried to use the lab refresh link above that you provided, but it tells me it is no longer accepting responses: ![image](https://global.discourse-cdn.com/dlai/original/3X/f/e/fee20184c0ee52c2cdc35394b8c9c2b8d215d3ee.png) What should I do? Any ideas? ---
**Author:** ![bchibbard](https://avatars.discourse-cdn.com/v4/letter/b/df705f/32.png) [@bchibbard](https://community.deeplearning.ai/u/bchibbard)\ **Post date:** [February 23, 2025, 12:01am UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/15 "2025-02-23T00:01:25Z")
I found a [link](https://docs.google.com/forms/d/e/1FAIpQLSd2EEfKhPusVu_QlVF72tsma-BsWBa8TMgE1uZSmX2efvkYYQ/viewform) in this [article](https://community.deeplearning.ai/t/c4-w4-lab-insufficient-lake-formation-permission-s/762625) that allowed me to submit a refresh. I’m standing by for that! ---
**Author:** ![Amir\_Zare](https://sea1.discourse-cdn.com/dlai/user_avatar/community.deeplearning.ai/amir_zare/32/95275_2.png) [@Amir\_Zare](https://community.deeplearning.ai/u/Amir_Zare)\ **Post date:** [February 23, 2025, 5:09am UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/16 "2025-02-23T05:09:16Z")
Hi @bchibbard The link I added in this post in the past is obsolete. You can use [this link](https://forms.gle/S2gLNzQXZuMhBGwL6) instead. ---
**Author:** ![bchibbard](https://avatars.discourse-cdn.com/v4/letter/b/df705f/32.png) [@bchibbard](https://community.deeplearning.ai/u/bchibbard)\ **Post date:** [February 24, 2025, 5:59pm UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/17 "2025-02-24T17:59:54Z")
Many thanks, @Amir_Zare . They fixed my ticket and I’ve gotten past that. I am now getting these in section 3.1.2: ```auto Error: creating Glue Data Quality Ruleset (songs_dq_ruleset): operation error Glue: CreateDataQualityRuleset, https response error StatusCode: 400, RequestID: e74a4630-31e4-4a4a-87be-5d453217273d, InvalidInputException: Entity Not Found (Service: AmazonDataCatalog; Status Code: 400; Error Code: EntityNotFoundException; Request ID: d0df79ee-c457-4225-bddd-1306eef1245a; Proxy: null) with module.data_quality.aws_glue_data_quality_ruleset.songs_dq_ruleset, on modules/data_quality/glue.tf line 1, in resource "aws_glue_data_quality_ruleset" "songs_dq_ruleset": 1: resource "aws_glue_data_quality_ruleset" "songs_dq_ruleset" { ``` It’s the same error for all three rulesets. The fact that the first ruleset–which we don’t need to modify–isn’t working, seems suspicious. Any ideas? is it something I may have missed? ---
**Author:** ![Amir\_Zare](https://sea1.discourse-cdn.com/dlai/user_avatar/community.deeplearning.ai/amir_zare/32/95275_2.png) [@Amir\_Zare](https://community.deeplearning.ai/u/Amir_Zare)\ **Post date:** [February 25, 2025, 6:33am UTC](https://community.deeplearning.ai/t/c4w4-capstone-project-2-glue-etl-jobs-throwing-access-error/754015/18 "2025-02-25T06:33:04Z")
@bchibbard you are getting the `Entity Not Found` exception. Terraform is probably not finding the table `songs` or the database for which it is supposed to create the ruleset. My guess is that there should have been a problem with the previous steps. Please, make sure that all the previous glue jobs have run completely and succeeded before moving on to this step. You can manually check that the database and table in question exist from the AWS Console.