Python for AI

  1. Deep Learning Frameworks
    1. Deep Learning Fundamentals
      1. Neural Network Architecture
        1. Perceptrons
          1. Multi-layer Perceptrons
            1. Deep Neural Networks
              1. Network Topology
              2. Neural Network Components
                1. Neurons and Nodes
                  1. Layers
                    1. Input Layers
                      1. Hidden Layers
                        1. Output Layers
                        2. Weights and Biases
                          1. Connections
                          2. Activation Functions
                            1. Linear Activation
                              1. Sigmoid Function
                                1. Hyperbolic Tangent
                                  1. ReLU Function
                                    1. Leaky ReLU
                                      1. ELU Function
                                        1. Swish Function
                                          1. Softmax Function
                                          2. Loss Functions
                                            1. Mean Squared Error
                                              1. Mean Absolute Error
                                                1. Binary Cross-Entropy
                                                  1. Categorical Cross-Entropy
                                                    1. Sparse Categorical Cross-Entropy
                                                      1. Huber Loss
                                                        1. Custom Loss Functions
                                                        2. Optimization Algorithms
                                                          1. Gradient Descent
                                                            1. Stochastic Gradient Descent
                                                              1. Mini-batch Gradient Descent
                                                                1. Momentum
                                                                  1. AdaGrad
                                                                    1. RMSprop
                                                                      1. Adam Optimizer
                                                                        1. AdamW
                                                                          1. Learning Rate Scheduling
                                                                          2. Backpropagation
                                                                            1. Forward Pass
                                                                              1. Backward Pass
                                                                                1. Chain Rule Application
                                                                                  1. Gradient Computation
                                                                                    1. Weight Updates
                                                                                    2. Regularization Techniques
                                                                                      1. L1 Regularization
                                                                                        1. L2 Regularization
                                                                                          1. Dropout
                                                                                            1. Batch Normalization
                                                                                              1. Layer Normalization
                                                                                                1. Early Stopping
                                                                                              2. TensorFlow and Keras
                                                                                                1. TensorFlow Basics
                                                                                                  1. TensorFlow Architecture
                                                                                                    1. Computational Graphs
                                                                                                      1. Sessions and Eager Execution
                                                                                                        1. TensorFlow 2.x Features
                                                                                                        2. Tensors in TensorFlow
                                                                                                          1. Tensor Creation
                                                                                                            1. Tensor Properties
                                                                                                              1. Tensor Operations
                                                                                                                1. Tensor Manipulation
                                                                                                                  1. Data Types
                                                                                                                  2. Keras High-level API
                                                                                                                    1. Keras Integration with TensorFlow
                                                                                                                      1. Model Building Approaches
                                                                                                                        1. Layer Types
                                                                                                                        2. Building Models
                                                                                                                          1. Sequential API
                                                                                                                            1. Creating Sequential Models
                                                                                                                              1. Adding Layers
                                                                                                                                1. Model Configuration
                                                                                                                                2. Functional API
                                                                                                                                  1. Input and Output Layers
                                                                                                                                    1. Complex Architectures
                                                                                                                                      1. Multi-input Models
                                                                                                                                        1. Multi-output Models
                                                                                                                                          1. Shared Layers
                                                                                                                                          2. Subclassing API
                                                                                                                                            1. Custom Model Classes
                                                                                                                                              1. Custom Layers
                                                                                                                                            2. Model Compilation
                                                                                                                                              1. Optimizer Selection
                                                                                                                                                1. Loss Function Selection
                                                                                                                                                  1. Metrics Configuration
                                                                                                                                                    1. Compilation Parameters
                                                                                                                                                    2. Model Training
                                                                                                                                                      1. Training Data Preparation
                                                                                                                                                        1. Fitting Models
                                                                                                                                                          1. Batch Size Selection
                                                                                                                                                            1. Epochs Configuration
                                                                                                                                                              1. Validation Data
                                                                                                                                                              2. Model Evaluation
                                                                                                                                                                1. Evaluation Metrics
                                                                                                                                                                  1. Model Performance Assessment
                                                                                                                                                                    1. Prediction Generation
                                                                                                                                                                    2. Callbacks
                                                                                                                                                                      1. EarlyStopping
                                                                                                                                                                        1. ModelCheckpoint
                                                                                                                                                                          1. ReduceLROnPlateau
                                                                                                                                                                            1. TensorBoard
                                                                                                                                                                              1. Custom Callbacks
                                                                                                                                                                              2. Model Persistence
                                                                                                                                                                                1. Saving Models
                                                                                                                                                                                  1. Loading Models
                                                                                                                                                                                    1. Model Formats
                                                                                                                                                                                      1. Checkpoint Management
                                                                                                                                                                                      2. Advanced TensorFlow Features
                                                                                                                                                                                        1. Custom Training Loops
                                                                                                                                                                                          1. GradientTape
                                                                                                                                                                                            1. tf.function Decorator
                                                                                                                                                                                              1. AutoGraph
                                                                                                                                                                                                1. Distributed Training
                                                                                                                                                                                              2. PyTorch
                                                                                                                                                                                                1. PyTorch Fundamentals
                                                                                                                                                                                                  1. PyTorch Philosophy
                                                                                                                                                                                                    1. Dynamic Computation Graphs
                                                                                                                                                                                                      1. Pythonic Design
                                                                                                                                                                                                      2. Tensors in PyTorch
                                                                                                                                                                                                        1. Tensor Creation
                                                                                                                                                                                                          1. Tensor Operations
                                                                                                                                                                                                            1. GPU Acceleration
                                                                                                                                                                                                              1. Tensor Manipulation
                                                                                                                                                                                                                1. Autograd System
                                                                                                                                                                                                                2. Automatic Differentiation
                                                                                                                                                                                                                  1. Gradient Computation
                                                                                                                                                                                                                    1. Backward Pass
                                                                                                                                                                                                                      1. Gradient Accumulation
                                                                                                                                                                                                                        1. Gradient Clipping
                                                                                                                                                                                                                        2. Neural Network Modules
                                                                                                                                                                                                                          1. nn.Module Class
                                                                                                                                                                                                                            1. Layer Definitions
                                                                                                                                                                                                                              1. Parameter Management
                                                                                                                                                                                                                                1. Module Composition
                                                                                                                                                                                                                                2. Building Models
                                                                                                                                                                                                                                  1. Sequential Models
                                                                                                                                                                                                                                    1. Custom Model Classes
                                                                                                                                                                                                                                      1. Forward Method Implementation
                                                                                                                                                                                                                                        1. Model Architecture Design
                                                                                                                                                                                                                                        2. Loss Functions
                                                                                                                                                                                                                                          1. Built-in Loss Functions
                                                                                                                                                                                                                                            1. Custom Loss Functions
                                                                                                                                                                                                                                              1. Loss Computation
                                                                                                                                                                                                                                              2. Optimizers
                                                                                                                                                                                                                                                1. SGD Optimizer
                                                                                                                                                                                                                                                  1. Adam Optimizer
                                                                                                                                                                                                                                                    1. Optimizer Configuration
                                                                                                                                                                                                                                                      1. Learning Rate Scheduling
                                                                                                                                                                                                                                                      2. Data Handling
                                                                                                                                                                                                                                                        1. Dataset Classes
                                                                                                                                                                                                                                                          1. DataLoader
                                                                                                                                                                                                                                                            1. Data Transformations
                                                                                                                                                                                                                                                              1. Batch Processing
                                                                                                                                                                                                                                                              2. Training Loop Implementation
                                                                                                                                                                                                                                                                1. Training Mode
                                                                                                                                                                                                                                                                  1. Evaluation Mode
                                                                                                                                                                                                                                                                    1. Forward Pass
                                                                                                                                                                                                                                                                      1. Loss Calculation
                                                                                                                                                                                                                                                                        1. Backward Pass
                                                                                                                                                                                                                                                                          1. Parameter Updates
                                                                                                                                                                                                                                                                          2. Model Evaluation
                                                                                                                                                                                                                                                                            1. Inference Mode
                                                                                                                                                                                                                                                                              1. Performance Metrics
                                                                                                                                                                                                                                                                                1. Model Testing
                                                                                                                                                                                                                                                                                2. Model Persistence
                                                                                                                                                                                                                                                                                  1. State Dictionary
                                                                                                                                                                                                                                                                                    1. Model Saving
                                                                                                                                                                                                                                                                                      1. Model Loading
                                                                                                                                                                                                                                                                                        1. Checkpoint Management
                                                                                                                                                                                                                                                                                        2. Advanced PyTorch Features
                                                                                                                                                                                                                                                                                          1. Custom Datasets
                                                                                                                                                                                                                                                                                            1. Data Augmentation
                                                                                                                                                                                                                                                                                              1. Transfer Learning
                                                                                                                                                                                                                                                                                                1. Model Deployment