Data Engineering

  1. Foundational Programming Skills
    1. Python for Data Engineering
      1. Python Fundamentals
        1. Syntax and Language Basics
          1. Variables and Data Types
            1. Control Structures
              1. Functions and Modules
                1. Error Handling and Exceptions
                2. Data Structures and Algorithms
                  1. Lists and List Comprehensions
                    1. Tuples
                      1. Sets
                        1. Dictionaries
                          1. Sorting Algorithms
                            1. Searching Algorithms
                              1. Time Complexity Analysis
                                1. Space Complexity Analysis
                                2. Essential Libraries for Data Engineering
                                  1. Pandas for Data Manipulation
                                    1. NumPy for Numerical Computing
                                      1. SQLAlchemy for Database Interaction
                                        1. Requests for HTTP Operations
                                          1. JSON and CSV Processing
                                            1. DateTime Handling
                                            2. Database Connectivity
                                              1. Database Connection Patterns
                                                1. ODBC Connections
                                                  1. JDBC Connections
                                                    1. Connection Pooling
                                                      1. Transaction Management
                                                      2. API Integration
                                                        1. RESTful API Consumption
                                                          1. Authentication Methods
                                                            1. Rate Limiting and Throttling
                                                              1. Error Handling for API Calls
                                                                1. Data Serialization and Deserialization
                                                              2. SQL Mastery
                                                                1. Basic Query Operations
                                                                  1. SELECT Statements
                                                                    1. FROM Clause Usage
                                                                      1. WHERE Clause Filtering
                                                                        1. ORDER BY Sorting
                                                                          1. LIMIT and OFFSET
                                                                          2. Advanced Filtering and Conditions
                                                                            1. Comparison Operators
                                                                              1. Logical Operators
                                                                                1. Pattern Matching with LIKE
                                                                                  1. NULL Value Handling
                                                                                    1. IN and EXISTS Clauses
                                                                                    2. Joins and Set Operations
                                                                                      1. INNER JOIN
                                                                                        1. LEFT OUTER JOIN
                                                                                          1. RIGHT OUTER JOIN
                                                                                            1. FULL OUTER JOIN
                                                                                              1. CROSS JOIN
                                                                                                1. Self Joins
                                                                                                  1. UNION Operations
                                                                                                    1. UNION ALL Operations
                                                                                                      1. INTERSECT Operations
                                                                                                        1. EXCEPT Operations
                                                                                                        2. Aggregation and Grouping
                                                                                                          1. GROUP BY Clause
                                                                                                            1. HAVING Clause
                                                                                                              1. COUNT Function
                                                                                                                1. SUM Function
                                                                                                                  1. AVG Function
                                                                                                                    1. MIN and MAX Functions
                                                                                                                      1. String Aggregation Functions
                                                                                                                      2. Window Functions
                                                                                                                        1. ROW_NUMBER Function
                                                                                                                          1. RANK Function
                                                                                                                            1. DENSE_RANK Function
                                                                                                                              1. PARTITION BY Clause
                                                                                                                                1. ORDER BY in Window Functions
                                                                                                                                  1. LEAD Function
                                                                                                                                    1. LAG Function
                                                                                                                                      1. Running Totals and Moving Averages
                                                                                                                                      2. Common Table Expressions
                                                                                                                                        1. Basic CTE Syntax
                                                                                                                                          1. Multiple CTEs
                                                                                                                                            1. Recursive CTEs
                                                                                                                                              1. CTE Performance Considerations
                                                                                                                                              2. Data Definition Language
                                                                                                                                                1. CREATE TABLE Statements
                                                                                                                                                  1. ALTER TABLE Operations
                                                                                                                                                    1. DROP Statements
                                                                                                                                                      1. Index Creation and Management
                                                                                                                                                        1. Constraint Definition
                                                                                                                                                        2. Data Manipulation Language
                                                                                                                                                          1. INSERT Statements
                                                                                                                                                            1. UPDATE Statements
                                                                                                                                                              1. DELETE Statements
                                                                                                                                                                1. MERGE Operations
                                                                                                                                                                  1. Transaction Control
                                                                                                                                                                    1. Commit and Rollback
                                                                                                                                                                    2. Query Optimization
                                                                                                                                                                      1. Execution Plan Analysis
                                                                                                                                                                        1. Index Usage Optimization
                                                                                                                                                                          1. Query Rewriting Techniques
                                                                                                                                                                            1. Performance Monitoring
                                                                                                                                                                          2. Shell Scripting and Command Line
                                                                                                                                                                            1. Basic Shell Commands
                                                                                                                                                                              1. File System Navigation
                                                                                                                                                                                1. File and Directory Operations
                                                                                                                                                                                  1. Text Processing Commands
                                                                                                                                                                                    1. Process Management
                                                                                                                                                                                      1. System Information Commands
                                                                                                                                                                                      2. Bash Scripting Fundamentals
                                                                                                                                                                                        1. Script Structure and Syntax
                                                                                                                                                                                          1. Variables and Environment Variables
                                                                                                                                                                                            1. Command Line Arguments
                                                                                                                                                                                              1. Conditional Statements
                                                                                                                                                                                                1. Loops and Iteration
                                                                                                                                                                                                  1. Functions in Bash
                                                                                                                                                                                                  2. File Processing and Automation
                                                                                                                                                                                                    1. Text File Manipulation
                                                                                                                                                                                                      1. CSV Processing
                                                                                                                                                                                                        1. Log File Analysis
                                                                                                                                                                                                          1. Batch File Operations
                                                                                                                                                                                                            1. Regular Expressions in Shell
                                                                                                                                                                                                            2. Task Scheduling
                                                                                                                                                                                                              1. Cron Job Configuration
                                                                                                                                                                                                                1. Cron Syntax and Timing
                                                                                                                                                                                                                  1. Job Monitoring and Logging
                                                                                                                                                                                                                    1. Error Handling in Scheduled Tasks

                                                                                                                                                                                                                Previous

                                                                                                                                                                                                                1. Introduction to Data Engineering

                                                                                                                                                                                                                Go to top

                                                                                                                                                                                                                Next

                                                                                                                                                                                                                3. Computer Science and Software Engineering Foundations