Capstone Project Part 2 - Data Quality and Orchestration - REDSHIFT

After 3 attempts, each with some issues, I successfully ran 5 jobs: extraction and transformations. I was really glad that I would finally finish the lab where I was stuck. But surprise - the next move, the next obstacle. Amazon Redshift does not see any databases. Here is the output:

postgresql+psycopg2://defaultuser:***@de-c4w4a2-redshift-cluster.c1inzrutizzu.us-east-1.redshift.amazonaws.com:5439/dev
2 rows affected.
database_name    schema_name         schema_owner     schema_type      schema_acl                      source_database    schema_option
dev              information_schema  1                local            rdsdb=UCDA/rdsdb~=U/rdsdb       None               None
dev              public              1                local            rdsdb=UCDA/rdsdb~=UC/rdsdb      None               None

Please help me resolve this issue. Iā€™m really tired and wish to finish this course. Thanks!

Hello @liberty2008
There must have been a issue with one of the jobs. If the issue persists on your next tries with the lab, please fill out this form to request a lab refresh.

Can you please explain how this works? First point: All five jobs ended successfully. I followed all the steps in the instructions. Second point: Iā€™ve already filled out this form twice, and every time it resolves only one issue at a time. How long could it take? Why canā€™t I receive the correct setup after the first form submission?

@liberty2008 I am sorry, but if you are sure that you are doing everything right and it still doesnā€™t work, the problem might be stemming from some residue issue with the previous sessions that could be solved through a lab refresh. It will take about 3 business days for the lab refresh to be handled after you fill out the form.

The form you provided to fill out doesnā€™t address the issue I faced. Iā€™ve tried again and checked if the resources in the AWS account were refreshed. I navigated to Glue jobs and confirmed they were empty.

Next, I completed all the Terraform steps, added the API endpoint, and then ran all jobs in sequence as described in the library. I cannot perform this in the AWS console due to insufficient rights, but I executed them sequentially in the UI. All jobs ended with a success state.

Afterward, I proceeded to the labā€™s Redshift section, added the actual endpoint of the Redshift cluster, and ran the SQL queries from the lab. However, there are no tables present, as specified in the lab instructions. For reference: ā€œThere should be three tables in the deftunes_transform schema in Redshift.ā€

Iā€™m still unsure what I might be doing wrong, how to resolve the issue, and how much time it might take. I want to express my frustration and disappointment; no one has provided support to resolve this issue. I am willing to pay for the Coursera account, but Iā€™m currently stuck for no clear reason.

It doesnā€™t matter exactly how you complete the form. It opens a ticket for the course staff, and they will sort out what is specifically needed.

1 Like

Thank you! Iā€™ll try to fill out the form. Just for the record, the idea that the form wonā€™t help actually comes from the form itself. Hereā€™s a reference from the first page of the form:

**[C] Type of issue you encountered with the lab:

If your issue is not any of these, please create or search for a topic on the Community platform instead of using this form.**

Perhaps both the course and the form need some updates.

Hi, folks. I filled out the form and was informed that the issue had been resolved. However, today I tried again and encountered the same problem. Iā€™m not sure what to do. Can anyone help me? Or do I really need to escalate this matter?

watch the video: Telegram - ā€ŽāØNEXTA Liveā© ā€“ (14617) - 22 March 2025 | Loom

@liberty2008 I watched your video, and the problem seems to be with the ingest date.


Apparently, you are using the current date, while you should be using 2020-02-01.

Amir, thank you! It worked, and Iā€™ve finally finished the course!