Machine Learning

  1. Deep Learning and Neural Networks
    1. Neural Network Fundamentals
      1. Biological Inspiration
        1. Neurons and Synapses
          1. Action Potentials
            1. Learning in Biological Systems
            2. Artificial Neurons
              1. Mathematical Model
                1. Weighted Inputs
                  1. Bias Terms
                    1. Activation Functions
                    2. The Perceptron
                      1. Linear Classifier
                        1. Perceptron Learning Rule
                          1. Limitations
                            1. XOR Problem
                            2. Multi-Layer Perceptrons
                              1. Hidden Layers
                                1. Universal Approximation Theorem
                                  1. Network Architecture
                                    1. Depth vs. Width
                                  2. Activation Functions
                                    1. Linear Activation
                                      1. Identity Function
                                        1. Limitations
                                        2. Sigmoid Functions
                                          1. Logistic Sigmoid
                                            1. Mathematical Properties
                                              1. Vanishing Gradient Problem
                                                1. Output Range
                                                2. Hyperbolic Tangent
                                                  1. Mathematical Definition
                                                    1. Zero-Centered Output
                                                      1. Comparison with Sigmoid
                                                      2. Rectified Linear Unit
                                                        1. ReLU Definition
                                                          1. Advantages
                                                            1. Dead Neuron Problem
                                                            2. ReLU Variants
                                                              1. Leaky ReLU
                                                                1. Parametric ReLU
                                                                  1. Exponential Linear Unit
                                                                    1. Swish
                                                                      1. GELU
                                                                      2. Softmax Function
                                                                        1. Probability Distribution
                                                                          1. Multi-Class Classification
                                                                            1. Temperature Parameter
                                                                          2. Forward Propagation
                                                                            1. Layer-by-Layer Computation
                                                                              1. Matrix Operations
                                                                                1. Vectorization
                                                                                  1. Computational Graphs
                                                                                  2. Training Neural Networks
                                                                                    1. Loss Functions
                                                                                      1. Regression Loss Functions
                                                                                        1. Mean Squared Error
                                                                                          1. Mean Absolute Error
                                                                                            1. Huber Loss
                                                                                            2. Classification Loss Functions
                                                                                              1. Binary Cross-Entropy
                                                                                                1. Categorical Cross-Entropy
                                                                                                  1. Sparse Categorical Cross-Entropy
                                                                                                    1. Hinge Loss
                                                                                                      1. Focal Loss
                                                                                                    2. Backpropagation Algorithm
                                                                                                      1. Chain Rule Application
                                                                                                        1. Gradient Computation
                                                                                                          1. Error Propagation
                                                                                                            1. Weight Update Rules
                                                                                                              1. Computational Efficiency
                                                                                                              2. Optimization Algorithms
                                                                                                                1. Gradient Descent Variants
                                                                                                                  1. Batch Gradient Descent
                                                                                                                    1. Stochastic Gradient Descent
                                                                                                                      1. Mini-Batch Gradient Descent
                                                                                                                      2. Momentum Methods
                                                                                                                        1. Classical Momentum
                                                                                                                          1. Nesterov Accelerated Gradient
                                                                                                                          2. Adaptive Learning Rate Methods
                                                                                                                            1. AdaGrad
                                                                                                                              1. RMSprop
                                                                                                                                1. Adam
                                                                                                                                  1. AdamW
                                                                                                                                    1. Nadam
                                                                                                                                    2. Learning Rate Scheduling
                                                                                                                                      1. Step Decay
                                                                                                                                        1. Exponential Decay
                                                                                                                                          1. Cosine Annealing
                                                                                                                                            1. Warm Restarts
                                                                                                                                          2. Regularization Techniques
                                                                                                                                            1. Weight Decay
                                                                                                                                              1. L2 Regularization
                                                                                                                                                1. Implementation Details
                                                                                                                                                2. Dropout
                                                                                                                                                  1. Random Neuron Deactivation
                                                                                                                                                    1. Training vs. Inference
                                                                                                                                                      1. Dropout Variants
                                                                                                                                                      2. Batch Normalization
                                                                                                                                                        1. Internal Covariate Shift
                                                                                                                                                          1. Normalization Process
                                                                                                                                                            1. Learnable Parameters
                                                                                                                                                              1. Benefits
                                                                                                                                                              2. Layer Normalization
                                                                                                                                                                1. Group Normalization
                                                                                                                                                                  1. Early Stopping
                                                                                                                                                                    1. Validation Monitoring
                                                                                                                                                                      1. Patience and Restoration
                                                                                                                                                                  2. Convolutional Neural Networks
                                                                                                                                                                    1. Convolution Operation
                                                                                                                                                                      1. Mathematical Definition
                                                                                                                                                                        1. Feature Maps
                                                                                                                                                                          1. Kernel/Filter Concepts
                                                                                                                                                                            1. Local Connectivity
                                                                                                                                                                            2. Convolutional Layers
                                                                                                                                                                              1. Multiple Filters
                                                                                                                                                                                1. Stride Parameter
                                                                                                                                                                                  1. Padding
                                                                                                                                                                                    1. Valid Padding
                                                                                                                                                                                      1. Same Padding
                                                                                                                                                                                      2. Dilation
                                                                                                                                                                                      3. Pooling Layers
                                                                                                                                                                                        1. Max Pooling
                                                                                                                                                                                          1. Average Pooling
                                                                                                                                                                                            1. Global Pooling
                                                                                                                                                                                              1. Stride and Window Size
                                                                                                                                                                                              2. CNN Architectures
                                                                                                                                                                                                1. LeNet
                                                                                                                                                                                                  1. AlexNet
                                                                                                                                                                                                    1. VGGNet
                                                                                                                                                                                                      1. ResNet
                                                                                                                                                                                                        1. Inception Networks
                                                                                                                                                                                                          1. DenseNet
                                                                                                                                                                                                            1. EfficientNet
                                                                                                                                                                                                            2. Applications
                                                                                                                                                                                                              1. Image Classification
                                                                                                                                                                                                                1. Object Detection
                                                                                                                                                                                                                  1. Semantic Segmentation
                                                                                                                                                                                                                    1. Style Transfer
                                                                                                                                                                                                                  2. Recurrent Neural Networks
                                                                                                                                                                                                                    1. Sequential Data Processing
                                                                                                                                                                                                                      1. Hidden State Concept
                                                                                                                                                                                                                        1. Vanilla RNN
                                                                                                                                                                                                                          1. Architecture
                                                                                                                                                                                                                            1. Forward Pass
                                                                                                                                                                                                                              1. Backpropagation Through Time
                                                                                                                                                                                                                              2. Vanishing and Exploding Gradients
                                                                                                                                                                                                                                1. Problem Description
                                                                                                                                                                                                                                  1. Gradient Clipping
                                                                                                                                                                                                                                    1. Architectural Solutions
                                                                                                                                                                                                                                    2. Long Short-Term Memory
                                                                                                                                                                                                                                      1. Cell State
                                                                                                                                                                                                                                        1. Forget Gate
                                                                                                                                                                                                                                          1. Input Gate
                                                                                                                                                                                                                                            1. Output Gate
                                                                                                                                                                                                                                              1. LSTM Variants
                                                                                                                                                                                                                                              2. Gated Recurrent Units
                                                                                                                                                                                                                                                1. Reset Gate
                                                                                                                                                                                                                                                  1. Update Gate
                                                                                                                                                                                                                                                    1. Simplified Architecture
                                                                                                                                                                                                                                                    2. Bidirectional RNNs
                                                                                                                                                                                                                                                      1. Forward and Backward Processing
                                                                                                                                                                                                                                                        1. Context from Both Directions
                                                                                                                                                                                                                                                        2. Applications
                                                                                                                                                                                                                                                          1. Language Modeling
                                                                                                                                                                                                                                                            1. Machine Translation
                                                                                                                                                                                                                                                              1. Time Series Prediction
                                                                                                                                                                                                                                                                1. Speech Recognition
                                                                                                                                                                                                                                                              2. Advanced Architectures
                                                                                                                                                                                                                                                                1. Autoencoders
                                                                                                                                                                                                                                                                  1. Encoder-Decoder Structure
                                                                                                                                                                                                                                                                    1. Dimensionality Reduction
                                                                                                                                                                                                                                                                      1. Denoising Autoencoders
                                                                                                                                                                                                                                                                        1. Sparse Autoencoders
                                                                                                                                                                                                                                                                          1. Variational Autoencoders
                                                                                                                                                                                                                                                                          2. Attention Mechanisms
                                                                                                                                                                                                                                                                            1. Attention Concept
                                                                                                                                                                                                                                                                              1. Attention Weights
                                                                                                                                                                                                                                                                                1. Soft vs. Hard Attention
                                                                                                                                                                                                                                                                                  1. Self-Attention
                                                                                                                                                                                                                                                                                  2. Transformer Architecture
                                                                                                                                                                                                                                                                                    1. Multi-Head Attention
                                                                                                                                                                                                                                                                                      1. Positional Encoding
                                                                                                                                                                                                                                                                                        1. Encoder-Decoder Structure
                                                                                                                                                                                                                                                                                          1. Layer Normalization
                                                                                                                                                                                                                                                                                            1. Feed-Forward Networks
                                                                                                                                                                                                                                                                                            2. Generative Adversarial Networks
                                                                                                                                                                                                                                                                                              1. Generator Network
                                                                                                                                                                                                                                                                                                1. Discriminator Network
                                                                                                                                                                                                                                                                                                  1. Adversarial Training
                                                                                                                                                                                                                                                                                                    1. Nash Equilibrium
                                                                                                                                                                                                                                                                                                      1. Training Challenges
                                                                                                                                                                                                                                                                                                        1. GAN Variants
                                                                                                                                                                                                                                                                                                      2. Transfer Learning
                                                                                                                                                                                                                                                                                                        1. Pretrained Models
                                                                                                                                                                                                                                                                                                          1. ImageNet Pretrained Models
                                                                                                                                                                                                                                                                                                            1. Language Model Pretraining
                                                                                                                                                                                                                                                                                                              1. Domain Adaptation
                                                                                                                                                                                                                                                                                                              2. Fine-Tuning Strategies
                                                                                                                                                                                                                                                                                                                1. Feature Extraction
                                                                                                                                                                                                                                                                                                                  1. Full Fine-Tuning
                                                                                                                                                                                                                                                                                                                    1. Layer-Wise Learning Rates
                                                                                                                                                                                                                                                                                                                      1. Gradual Unfreezing
                                                                                                                                                                                                                                                                                                                      2. Domain Adaptation
                                                                                                                                                                                                                                                                                                                        1. Source and Target Domains
                                                                                                                                                                                                                                                                                                                          1. Distribution Shift
                                                                                                                                                                                                                                                                                                                            1. Adaptation Techniques

                                                                                                                                                                                                                                                                                                                        Previous

                                                                                                                                                                                                                                                                                                                        7. Ensemble Methods and Advanced Techniques

                                                                                                                                                                                                                                                                                                                        Go to top

                                                                                                                                                                                                                                                                                                                        Next

                                                                                                                                                                                                                                                                                                                        9. Reinforcement Learning