Apache Airflow

  1. Testing and Debugging Airflow DAGs
    1. Testing Strategies
      1. Unit Testing Approach
        1. Integration Testing
          1. End-to-End Testing
          2. Unit Testing DAGs
            1. Testing DAG Integrity
              1. Testing Task Dependencies
                1. Testing Custom Operators
                  1. Testing Hooks and Connections
                    1. Mock Objects and Fixtures
                    2. CLI Testing Commands
                      1. airflow tasks test Command
                        1. airflow dags test Command
                          1. Command Syntax and Options
                            1. Interpreting Test Results
                            2. Local Development and Debugging
                              1. Development Environment Setup
                                1. Using Print Statements and Logging
                                  1. Isolating Task Failures
                                    1. Step-by-Step Debugging
                                    2. DebugExecutor
                                      1. Local Debugging Workflow
                                        1. DebugExecutor Configuration
                                          1. Limitations and Use Cases
                                          2. Common Issues and Troubleshooting
                                            1. Import Errors
                                              1. Circular Dependencies
                                                1. Top-level Code Execution
                                                  1. Non-idempotent Tasks
                                                    1. Hardcoded Values
                                                      1. Memory and Performance Issues
                                                      2. Debugging Tools and Techniques
                                                        1. Log Analysis
                                                          1. Task Instance Inspection
                                                            1. Database Query Analysis
                                                              1. Performance Profiling

                                                            Previous

                                                            11. Airflow Providers and Extensibility

                                                            Go to top

                                                            Next

                                                            13. Operational Airflow Management