Apache Airflow

  1. Setting Up an Airflow Environment
    1. Prerequisites and System Requirements
      1. Supported Python Versions
        1. Operating System Requirements
          1. Hardware Recommendations
            1. pip and Virtual Environments
              1. Database Backend Requirements
                1. System Dependencies
                2. Installation Methods
                  1. Installing with pip
                    1. Installing Airflow Core
                      1. Installing Provider Packages
                        1. Constraint Files
                        2. Using the Official Docker Image
                          1. Docker Compose Setup
                            1. Customizing Docker Images
                              1. Volume Mounting
                              2. Installing from Source
                                1. Development Setup
                                  1. Building from Git Repository
                                  2. Kubernetes Deployment
                                    1. Helm Charts
                                      1. Official Kubernetes Operator
                                    2. Initial Configuration
                                      1. The airflow.cfg File
                                        1. Configuration File Structure
                                          1. Key Configuration Sections
                                            1. Modifying Default Settings
                                            2. Setting the AIRFLOW_HOME Environment Variable
                                              1. Configuring Environment Variables
                                                1. Configuration Precedence
                                                2. Database Setup
                                                  1. Initializing the Database
                                                    1. Running airflow db init
                                                      1. Database Migrations
                                                        1. Database Connection Configuration
                                                        2. User Management
                                                          1. Creating an Admin User
                                                            1. Using the CLI to Create Users
                                                              1. User Roles and Permissions
                                                                1. Authentication Backends
                                                                2. Starting Airflow Services
                                                                  1. Starting the Webserver
                                                                    1. Starting the Scheduler
                                                                      1. Starting the Triggerer
                                                                        1. Starting Workers
                                                                          1. Service Management and Monitoring
                                                                          2. Verification and Testing
                                                                            1. Verifying Installation
                                                                              1. Running Test DAGs
                                                                                1. Troubleshooting Common Issues

                                                                              Previous

                                                                              3. Airflow Architecture and Components

                                                                              Go to top

                                                                              Next

                                                                              5. Authoring Your First DAG