Natural Language Processing (NLP)

  1. Recurrent Neural Networks
    1. Basic RNN Architecture
      1. Recurrence Relations
        1. Hidden State Dynamics
          1. Sequence Processing
          2. Training Challenges
            1. Vanishing Gradients
              1. Exploding Gradients
                1. Long-term Dependencies
                2. Advanced RNN Variants
                  1. Long Short-Term Memory
                    1. Cell State and Gates
                      1. Forget Gate
                        1. Input Gate
                          1. Output Gate
                          2. Gated Recurrent Units
                            1. Reset Gate
                              1. Update Gate
                                1. Simplified Architecture
                              2. Bidirectional RNNs
                                1. Forward and Backward Processing
                                  1. State Concatenation
                                    1. Applications and Benefits
                                    2. RNN Applications
                                      1. Language Modeling
                                        1. Sequence Classification
                                          1. Sequence-to-Sequence Tasks

                                        Previous

                                        8. Deep Learning Foundations

                                        Go to top

                                        Next

                                        10. Attention Mechanisms and Transformers