Generative AI

  1. Mathematical and Technical Foundations
    1. Probability and Statistics
      1. Probability Distributions
        1. Discrete Distributions
          1. Continuous Distributions
            1. Joint and Conditional Distributions
            2. Bayesian Inference
              1. Prior and Posterior Distributions
                1. Bayes' Theorem Applications
                  1. Maximum Likelihood Estimation
                  2. Information Theory
                    1. Entropy and Cross-Entropy
                      1. Mutual Information
                        1. KL Divergence
                      2. Linear Algebra for AI
                        1. Vectors and Vector Spaces
                          1. Vector Operations
                            1. Dot Products and Norms
                              1. Linear Independence
                              2. Matrices and Matrix Operations
                                1. Matrix Multiplication
                                  1. Eigenvalues and Eigenvectors
                                    1. Matrix Decomposition
                                    2. Tensors
                                      1. Tensor Operations
                                        1. Broadcasting
                                          1. Tensor Calculus
                                        2. Optimization Theory
                                          1. Gradient-Based Methods
                                            1. Gradient Descent Variants
                                              1. Stochastic Gradient Descent
                                                1. Momentum and Adaptive Methods
                                                2. Loss Functions
                                                  1. Regression Losses
                                                    1. Classification Losses
                                                      1. Generative Model Losses
                                                      2. Regularization Techniques
                                                        1. L1 and L2 Regularization
                                                          1. Dropout
                                                            1. Batch Normalization