Generative AI

  1. Core Generative Model Architectures
    1. Autoregressive Models
      1. Sequential Generation
        1. Next-Token Prediction
          1. Conditional Independence Assumptions
          2. Language Models
            1. N-gram Models
              1. Neural Language Models
                1. Transformer Language Models
                2. Autoregressive Image Models
                  1. PixelRNN
                    1. PixelCNN
                      1. Image GPT
                    2. Variational Autoencoders
                      1. Encoder-Decoder Framework
                        1. Encoder Architecture
                          1. Decoder Architecture
                            1. Latent Space Representation
                            2. Variational Inference
                              1. Evidence Lower Bound
                                1. Reparameterization Trick
                                  1. Posterior Approximation
                                  2. Loss Function Components
                                    1. Reconstruction Loss
                                      1. KL Divergence Regularization
                                        1. Beta-VAE Variants
                                        2. Applications and Extensions
                                          1. Conditional VAEs
                                            1. Hierarchical VAEs
                                              1. Disentangled Representations
                                            2. Generative Adversarial Networks
                                              1. Adversarial Framework
                                                1. Generator Network
                                                  1. Discriminator Network
                                                    1. Minimax Game Theory
                                                    2. Training Dynamics
                                                      1. Nash Equilibrium
                                                        1. Mode Collapse
                                                          1. Training Instability
                                                          2. GAN Variants
                                                            1. Deep Convolutional GANs
                                                              1. Conditional GANs
                                                                1. Wasserstein GANs
                                                                  1. Progressive GANs
                                                                    1. StyleGAN Family
                                                                      1. CycleGAN
                                                                      2. Evaluation Metrics
                                                                        1. Inception Score
                                                                          1. Fréchet Inception Distance
                                                                            1. Precision and Recall
                                                                          2. Diffusion Models
                                                                            1. Forward Diffusion Process
                                                                              1. Noise Scheduling
                                                                                1. Markov Chain Formulation
                                                                                2. Reverse Diffusion Process
                                                                                  1. Denoising Networks
                                                                                    1. Score-Based Models
                                                                                    2. Training Objectives
                                                                                      1. Denoising Score Matching
                                                                                        1. Variational Lower Bound
                                                                                        2. Sampling Methods
                                                                                          1. DDPM Sampling
                                                                                            1. DDIM Sampling
                                                                                              1. Accelerated Sampling
                                                                                              2. Conditional Generation
                                                                                                1. Classifier Guidance
                                                                                                  1. Classifier-Free Guidance
                                                                                                2. Flow-Based Models
                                                                                                  1. Normalizing Flows
                                                                                                    1. Invertible Transformations
                                                                                                      1. Change of Variables Formula
                                                                                                      2. Coupling Layers
                                                                                                        1. Affine Coupling
                                                                                                          1. Neural Spline Flows
                                                                                                          2. Autoregressive Flows
                                                                                                            1. Masked Autoregressive Flows
                                                                                                              1. Inverse Autoregressive Flows

                                                                                                          Previous

                                                                                                          3. Machine Learning Fundamentals

                                                                                                          Go to top

                                                                                                          Next

                                                                                                          5. Transformer Architecture and Language Models