C2W4_final lab with grade

Course Q&A Data Engineering Source Systems, Data Ingestion, and Pipelines
1

Hi Guys, please help me.

image
image931×996 22.3 KB

I have passed the assignment with 100% grade with all the instructions. However, at the end, after i copied the Dags to my DAGs Bucket, go to the Airflow UI. Refresh the web interface, i can not see the three recognized DAGs (i have waited for more than 10 minutes). As These are the expected results for each dag id so i want to see it for future job, not just passing:

  • model_trip_duration_alitran: it will notify the model was not deployed.
  • model_trip_duration_easy_destiny: it will deploy the model.
  • model_trip_duration_to_my_place_ai: it will fail the checkpoint in Great Expectations.

what should i do ? I mean the all the tasks run smoothly but i can not see the dags on the UI. Someone got this issue ?

image
image1882×827 32.2 KB

2

Hello @DerekDoan,

It looks like your DAGs are in the correct folder and your airflow has the issue. Could you follow the instructions to restart airflow in steps after 2.2 since an on/off in airflow might fix it. You can follow the instructions to create a restart_airflow.sh file in AWS CloudShell and run it to get an output like this. Hope it helps:

C2W4_airflow_restart
C2W4_airflow_restart412×308 37.6 KB

3

Hi Georgios, thank you for your reply. I followed the instructions step by step, should i run only that 2.2 again at the end ?

4

Hello @DerekDoan,

You could try uploading the DAG’s to the bucket and try again. If you can’t still not find them then follow 2.2 to use CloudShell. Hope it helps