Robotics and Autonomous Systems

  1. Machine Learning for Robotics
    1. Supervised Learning Applications
      1. Classification Tasks
        1. Object Recognition
          1. Terrain Classification
            1. Fault Detection
            2. Regression Tasks
              1. State Prediction
                1. Sensor Calibration
                  1. System Identification
                  2. Model Selection and Evaluation
                    1. Cross-Validation
                      1. Performance Metrics
                        1. Overfitting Prevention
                      2. Unsupervised Learning Applications
                        1. Clustering Methods
                          1. K-means Clustering
                            1. Hierarchical Clustering
                              1. DBSCAN
                              2. Dimensionality Reduction
                                1. Principal Component Analysis
                                  1. Independent Component Analysis
                                    1. Manifold Learning
                                    2. Anomaly Detection
                                      1. Statistical Methods
                                        1. Machine Learning Approaches
                                      2. Reinforcement Learning
                                        1. Markov Decision Processes
                                          1. State Space Definition
                                            1. Action Space Definition
                                              1. Reward Function Design
                                                1. Transition Dynamics
                                                2. Value-based Methods
                                                  1. Value Iteration
                                                    1. Policy Iteration
                                                      1. Temporal Difference Learning
                                                        1. Q-Learning
                                                          1. Tabular Q-Learning
                                                            1. Function Approximation
                                                          2. Policy-based Methods
                                                            1. Policy Gradient Theorem
                                                              1. REINFORCE Algorithm
                                                                1. Actor-Critic Methods
                                                                2. Deep Reinforcement Learning
                                                                  1. Deep Q-Networks
                                                                    1. Experience Replay
                                                                      1. Target Networks
                                                                      2. Policy Gradient Methods
                                                                        1. Proximal Policy Optimization
                                                                          1. Trust Region Policy Optimization
                                                                          2. Advanced Architectures
                                                                            1. Dueling DQN
                                                                              1. Rainbow DQN
                                                                          3. Imitation Learning
                                                                            1. Behavioral Cloning
                                                                              1. Direct Policy Learning
                                                                                1. Dataset Aggregation
                                                                                2. Inverse Reinforcement Learning
                                                                                  1. Maximum Entropy IRL
                                                                                    1. Apprenticeship Learning
                                                                                    2. Generative Adversarial Imitation Learning
                                                                                    3. Transfer Learning and Domain Adaptation
                                                                                      1. Sim-to-Real Transfer
                                                                                        1. Domain Randomization
                                                                                          1. Progressive Networks
                                                                                            1. Fine-tuning Strategies
                                                                                            2. Multi-task Learning
                                                                                              1. Meta-learning for Robotics
                                                                                              2. Deep Learning for Robotics
                                                                                                1. Convolutional Neural Networks
                                                                                                  1. Image Processing Applications
                                                                                                    1. Feature Learning
                                                                                                    2. Recurrent Neural Networks
                                                                                                      1. Sequence Modeling
                                                                                                        1. LSTM and GRU
                                                                                                        2. Attention Mechanisms
                                                                                                          1. Transformer Architectures