Apache Airflow

  1. Scheduling and Triggers
    1. Schedule Intervals
      1. Cron Expression Basics
        1. Cron Presets
          1. @once
            1. @hourly
              1. @daily
                1. @weekly
                  1. @monthly
                    1. @yearly
                    2. Custom Cron Expressions
                      1. Cron Syntax
                        1. Complex Scheduling Patterns
                        2. Timedelta Objects for Intervals
                          1. None Schedule (Manual Only)
                          2. Timetables
                            1. Timetable Concept
                              1. Built-in Timetables
                                1. CronDataIntervalTimetable
                                  1. DeltaDataIntervalTimetable
                                  2. Custom Timetable Classes
                                    1. Implementing Custom Logic
                                      1. Data Interval Concepts
                                      2. Use Cases for Custom Scheduling
                                      3. Date and Time Handling
                                        1. The start_date Parameter
                                          1. Setting Start Dates
                                            1. Timezone Considerations
                                            2. The end_date Parameter
                                              1. Setting End Dates
                                                1. Automatic DAG Deactivation
                                                2. Execution Date vs Logical Date
                                                  1. Data Interval Concepts
                                                  2. Catchup Behavior
                                                    1. catchup Parameter
                                                      1. Enabling and Disabling Catchup
                                                        1. Impact on Backfilling
                                                          1. Historical Data Processing
                                                          2. Backfilling
                                                            1. Manual Backfilling with CLI
                                                              1. Backfill Command Options
                                                                1. Use Cases and Limitations
                                                                  1. Backfill Performance Considerations
                                                                  2. Trigger Rules
                                                                    1. Default Trigger Rule (all_success)
                                                                      1. Alternative Trigger Rules
                                                                        1. all_failed
                                                                          1. all_done
                                                                            1. one_failed
                                                                              1. one_success
                                                                                1. none_failed
                                                                                  1. none_failed_min_one_success
                                                                                    1. dummy
                                                                                    2. Custom Trigger Rules
                                                                                      1. Trigger Rule Use Cases
                                                                                      2. External Triggers
                                                                                        1. API-based Triggering
                                                                                          1. File-based Triggers
                                                                                            1. Event-driven Scheduling

                                                                                          Previous

                                                                                          7. Managing Workflows with the Airflow UI

                                                                                          Go to top

                                                                                          Next

                                                                                          9. Data Sharing and Communication