Apache Airflow

  1. Comprehensive Guide to Operators
    1. Operator Fundamentals
      1. Operator Base Classes
        1. Operator Inheritance Hierarchy
          1. Common Operator Parameters
            1. Operator Context and Templates
            2. Action Operators
              1. BashOperator
                1. Command Execution
                  1. Environment Variables
                    1. Return Codes and Error Handling
                    2. PythonOperator
                      1. Function Execution
                        1. Argument Passing
                          1. Return Values and XComs
                          2. EmailOperator
                            1. Email Configuration
                              1. HTML and Text Content
                                1. Attachments
                                2. HTTPOperator
                                  1. HTTP Methods
                                    1. Authentication
                                      1. Response Handling
                                      2. DummyOperator
                                        1. Use Cases
                                          1. Placeholder Tasks
                                          2. BranchPythonOperator
                                            1. Conditional Logic
                                              1. Branch Selection
                                              2. ShortCircuitOperator
                                                1. Early Termination Logic
                                              3. Transfer Operators
                                                1. S3ToGCSOperator
                                                  1. MySqlToGoogleCloudStorageOperator
                                                    1. GCSToS3Operator
                                                      1. FTPToS3Operator
                                                        1. LocalFilesystemToS3Operator
                                                          1. Transfer Operator Patterns
                                                          2. Sensors
                                                            1. Sensor Fundamentals
                                                              1. Purpose and Use Cases
                                                                1. Sensor Base Classes
                                                                2. Sensor Modes
                                                                  1. Poke Mode
                                                                    1. Reschedule Mode
                                                                      1. Mode Selection Criteria
                                                                      2. Common Sensors
                                                                        1. FileSensor
                                                                          1. S3KeySensor
                                                                            1. HttpSensor
                                                                              1. SqlSensor
                                                                                1. ExternalTaskSensor
                                                                                  1. TimeSensor
                                                                                    1. DateTimeSensor
                                                                                    2. Sensor Configuration
                                                                                      1. Timeout Settings
                                                                                        1. Poke Interval
                                                                                          1. Soft Fail Options
                                                                                        2. Deferrable Operators
                                                                                          1. Asynchronous Execution Model
                                                                                            1. Triggering Events
                                                                                              1. Deferrable Sensor Examples
                                                                                                1. TimeSensorAsync
                                                                                                  1. S3KeySensorAsync
                                                                                                  2. Benefits over Traditional Sensors
                                                                                                    1. Implementation Considerations
                                                                                                    2. Provider-Specific Operators
                                                                                                      1. Cloud Provider Operators
                                                                                                        1. Database Operators
                                                                                                          1. Messaging System Operators
                                                                                                            1. Container Orchestration Operators

                                                                                                          Previous

                                                                                                          5. Authoring Your First DAG

                                                                                                          Go to top

                                                                                                          Next

                                                                                                          7. Managing Workflows with the Airflow UI