Apache Airflow

6.

Comprehensive Guide to Operators

6.1.

Operator Fundamentals

6.1.1.

Operator Base Classes

6.1.2.

Operator Inheritance Hierarchy

6.1.3.

Common Operator Parameters

6.1.4.

Operator Context and Templates

6.2.

Action Operators

6.2.1.

6.2.1.1.

Command Execution

6.2.1.2.

Environment Variables

6.2.1.3.

Return Codes and Error Handling

6.2.2.

6.2.2.1.

Function Execution

6.2.2.2.

Argument Passing

6.2.2.3.

Return Values and XComs

6.2.3.

6.2.3.1.

Email Configuration

6.2.3.2.

HTML and Text Content

6.2.3.3.

6.2.4.

6.2.4.1.

6.2.4.2.

6.2.4.3.

Response Handling

6.2.5.

6.2.5.1.

6.2.5.2.

Placeholder Tasks

6.2.6.

BranchPythonOperator

6.2.6.1.

Conditional Logic

6.2.6.2.

Branch Selection

6.2.7.

ShortCircuitOperator

6.2.7.1.

Early Termination Logic

6.3.

Transfer Operators

6.3.1.

S3ToGCSOperator

6.3.2.

MySqlToGoogleCloudStorageOperator

6.3.3.

GCSToS3Operator

6.3.4.

FTPToS3Operator

6.3.5.

LocalFilesystemToS3Operator

6.3.6.

Transfer Operator Patterns

6.4.

6.4.1.

Sensor Fundamentals

6.4.1.1.

Purpose and Use Cases

6.4.1.2.

Sensor Base Classes

6.4.2.

6.4.2.1.

6.4.2.2.

Reschedule Mode

6.4.2.3.

Mode Selection Criteria

6.4.3.

6.4.3.1.

6.4.3.2.

6.4.3.3.

6.4.3.4.

6.4.3.5.

ExternalTaskSensor

6.4.3.6.

6.4.3.7.

6.4.4.

Sensor Configuration

6.4.4.1.

Timeout Settings

6.4.4.2.

6.4.4.3.

Soft Fail Options

6.5.

Deferrable Operators

6.5.1.

Asynchronous Execution Model

6.5.2.

Triggering Events

6.5.3.

Deferrable Sensor Examples

6.5.3.1.

TimeSensorAsync

6.5.3.2.

S3KeySensorAsync

6.5.4.

Benefits over Traditional Sensors

6.5.5.

Implementation Considerations

6.6.

Provider-Specific Operators

6.6.1.

Cloud Provider Operators

6.6.2.

Database Operators

6.6.3.

Messaging System Operators

6.6.4.

Container Orchestration Operators

Previous

5. Authoring Your First DAG

Go to top

Next

7. Managing Workflows with the Airflow UI