Hi – just an informational question here. AWS glue triggers can be on a schedule or be event based. Using these, can we create an orchestration of glue jobs just as effectively as with Airflow? Or are there things Airflow does significantly better?
Hello @drl
My knowledge is limited upon this subject. However, I know that Airflow has some functionalities that make it more suitable for specific needs. For instance, you can define task dependencies and see detailed logs for each of the tasks in the DAGs using Airflow UI. Some of these capabilities from the Airflow UI may not be available through AWS glue.