Airflow is not importing DAGs. Initially had some typos in first uploaded script, these were flagged in AirFlow as parsing errors. Corrected them and re-sync src folder with S3. Confirmed new files (timestamp) were uploaded to the dags bucket in S3. Nothing in Airflow - waited over 10 mins. Res…

Hello @pmgriffin , Yes since you uploaded the file there should be at least import errors in the upper left corner of airflow. However could you check that you’ve uploaded to the correct location to see the DAG, you might used: aws s3 sync src s3://de-c2w4lab1-<ACCOUNT_ID>-us-east-1-mwaa-dags ins…

Hi Georgios, thanks for quick response… Yes i believe i have uploaded to the correct bucket. And this is the bucket Airflow was previously reading from to find originaly parsing errors in my script. [image] Paul

No DAGs listed under DAGs view [image] however if i goto Browse->Dag Dependencies and untick “Only show DAGs with dependencies” It appears to show “book_of_the_day” [image]

Hi Paul, There are instructions to restart airflow and use the solution file to re-sync the bucket file to the correct one. Just make sure the file will find changes and get an output from the aws s3 sync src s3://de-c2w4lab1-<ACCOUNT_ID>-us-east-1-mwaa-dags/dags command. I could try to reproduce t…

Hi Georgios, thanks for taking the time again. I had already actually tried those steps, you’ll see in my initial post i had but deleted all S3 contents and sync’d up the solution script. I also restarted AirFlow but no luck. The 2 hour time limit has no expired (so annoying) and i’ll need to re…

I have no idea what’s different this time Georgios but i copied my file contents back in and Airflow Picked Up the DAG first time. :man_shrugging: A classic turn it off / turn it on! Maybe the lab time out was a blessing. THanks for your help anyway

Hi All, I need some support as I am not able to follow {{ dag_name }} instructions. How to replace the {{ dag_name }} is something which is really killing me off. No clues whatsoever. [image]

Hello @amiguel , In part 5.1 of the exercise you create the file template.py. As the name suggests you are supposed to create three different files with three different names with the help of this file. This is done in part 5.1.2 with Jinja template. If you search the file (control+f) for model_tri…

C2 W4 Lab 1 - No DAGs appearing in airflow

Course Q&A Data Engineering Source Systems, Data Ingestion, and Pipelines

Georgios November 24, 2024, 5:08pm 7

Sure @pmgriffin take your time, well I just see the DAG on my airflow just fine. Keep the tips and the solution file and if you need to restart airflow use bash ./scripts/restart_airflow.sh in the beginning. Thank you

Dec2w4a1 assignment issues

Topic		Replies	Views
C2W4 Practice Lab 1 \| DAG not being recognised Source Systems, Data Ingestion, and Pipelines week-module-2 , week-module-4 , coursera-platform	1	55	December 9, 2024
C2W4 Lab 1 No DAG apperring in Airflow Source Systems, Data Ingestion, and Pipelines week-module-2 , week-module-4 , coursera-platform	3	87	June 4, 2025
Course 2 Week 4 Graded Programming Assignment 4: Building an Advanced Data Pipeline With Data Quality Checks no DAGs appear in the Airflow Source Systems, Data Ingestion, and Pipelines week-module-4 , coursera-platform	6	88	November 20, 2024
Import Dags to Airflow Source Systems, Data Ingestion, and Pipelines week-module-4 , assignment , coursera-platform	1	44	March 3, 2025
Airflow not updating DAGs for capstone lab Data Modeling, Transformation, and Serving week-module-4 , coursera-platform	1	90	December 29, 2024

C2 W4 Lab 1 - No DAGs appearing in airflow

Related topics