Python for AI

  1. Machine Learning with Scikit-Learn
    1. Machine Learning Fundamentals
      1. Types of Machine Learning
        1. Supervised Learning
          1. Regression Problems
            1. Classification Problems
            2. Unsupervised Learning
              1. Clustering
                1. Dimensionality Reduction
                  1. Association Rules
                  2. Semi-supervised Learning
                    1. Reinforcement Learning Basics
                    2. Machine Learning Workflow
                      1. Problem Definition
                        1. Data Collection
                          1. Data Exploration
                            1. Data Preprocessing
                              1. Feature Engineering
                                1. Model Selection
                                  1. Model Training
                                    1. Model Evaluation
                                      1. Model Deployment
                                        1. Model Monitoring
                                        2. Bias-Variance Tradeoff
                                          1. Overfitting and Underfitting
                                            1. Cross-Validation Concepts
                                            2. Data Preprocessing
                                              1. Data Cleaning
                                                1. Handling Missing Values
                                                  1. Outlier Detection
                                                    1. Data Quality Assessment
                                                    2. Feature Scaling
                                                      1. StandardScaler
                                                        1. MinMaxScaler
                                                          1. RobustScaler
                                                            1. Normalizer
                                                              1. QuantileTransformer
                                                              2. Encoding Categorical Variables
                                                                1. One-Hot Encoding
                                                                  1. Label Encoding
                                                                    1. Ordinal Encoding
                                                                      1. Target Encoding
                                                                        1. Binary Encoding
                                                                        2. Feature Engineering
                                                                          1. Feature Creation
                                                                            1. Feature Transformation
                                                                              1. Polynomial Features
                                                                                1. Interaction Features
                                                                                2. Feature Selection
                                                                                  1. Univariate Selection
                                                                                    1. Recursive Feature Elimination
                                                                                      1. Feature Importance
                                                                                        1. L1-based Selection
                                                                                          1. Variance Threshold
                                                                                          2. Data Splitting
                                                                                            1. Train-Test Split
                                                                                              1. Train-Validation-Test Split
                                                                                                1. Stratified Splitting
                                                                                                  1. Time Series Splitting
                                                                                                2. Supervised Learning Algorithms
                                                                                                  1. Linear Models
                                                                                                    1. Linear Regression
                                                                                                      1. Ordinary Least Squares
                                                                                                        1. Ridge Regression
                                                                                                          1. Lasso Regression
                                                                                                            1. Elastic Net
                                                                                                            2. Logistic Regression
                                                                                                              1. Binary Classification
                                                                                                                1. Multiclass Classification
                                                                                                                  1. Regularization in Logistic Regression
                                                                                                                2. Tree-based Models
                                                                                                                  1. Decision Trees
                                                                                                                    1. Classification Trees
                                                                                                                      1. Regression Trees
                                                                                                                        1. Tree Pruning
                                                                                                                          1. Feature Importance
                                                                                                                          2. Ensemble Methods
                                                                                                                            1. Random Forest
                                                                                                                              1. Extra Trees
                                                                                                                                1. Gradient Boosting
                                                                                                                                  1. AdaBoost
                                                                                                                                    1. Voting Classifiers
                                                                                                                                      1. Bagging
                                                                                                                                    2. Instance-based Learning
                                                                                                                                      1. K-Nearest Neighbors
                                                                                                                                        1. Distance Metrics
                                                                                                                                          1. Choosing K
                                                                                                                                            1. Weighted KNN
                                                                                                                                          2. Support Vector Machines
                                                                                                                                            1. Linear SVM
                                                                                                                                              1. Non-linear SVM
                                                                                                                                                1. Kernel Functions
                                                                                                                                                  1. SVM for Regression
                                                                                                                                                  2. Naive Bayes
                                                                                                                                                    1. Gaussian Naive Bayes
                                                                                                                                                      1. Multinomial Naive Bayes
                                                                                                                                                        1. Bernoulli Naive Bayes
                                                                                                                                                        2. Neural Networks
                                                                                                                                                          1. Multi-layer Perceptron
                                                                                                                                                            1. Activation Functions
                                                                                                                                                              1. Backpropagation
                                                                                                                                                            2. Unsupervised Learning Algorithms
                                                                                                                                                              1. Clustering Algorithms
                                                                                                                                                                1. K-Means Clustering
                                                                                                                                                                  1. Choosing Number of Clusters
                                                                                                                                                                    1. K-Means++
                                                                                                                                                                      1. Mini-batch K-Means
                                                                                                                                                                      2. Hierarchical Clustering
                                                                                                                                                                        1. Agglomerative Clustering
                                                                                                                                                                          1. Linkage Criteria
                                                                                                                                                                            1. Dendrograms
                                                                                                                                                                            2. Density-based Clustering
                                                                                                                                                                              1. DBSCAN
                                                                                                                                                                                1. OPTICS
                                                                                                                                                                                2. Gaussian Mixture Models
                                                                                                                                                                                  1. Spectral Clustering
                                                                                                                                                                                  2. Dimensionality Reduction
                                                                                                                                                                                    1. Principal Component Analysis
                                                                                                                                                                                      1. PCA Theory
                                                                                                                                                                                        1. Explained Variance
                                                                                                                                                                                          1. PCA for Visualization
                                                                                                                                                                                          2. Linear Discriminant Analysis
                                                                                                                                                                                            1. Independent Component Analysis
                                                                                                                                                                                              1. t-SNE
                                                                                                                                                                                                1. UMAP
                                                                                                                                                                                                  1. Factor Analysis
                                                                                                                                                                                                  2. Association Rule Learning
                                                                                                                                                                                                    1. Market Basket Analysis
                                                                                                                                                                                                      1. Apriori Algorithm
                                                                                                                                                                                                        1. FP-Growth
                                                                                                                                                                                                      2. Model Evaluation and Validation
                                                                                                                                                                                                        1. Evaluation Metrics
                                                                                                                                                                                                          1. Regression Metrics
                                                                                                                                                                                                            1. Mean Absolute Error
                                                                                                                                                                                                              1. Mean Squared Error
                                                                                                                                                                                                                1. Root Mean Squared Error
                                                                                                                                                                                                                  1. R-squared
                                                                                                                                                                                                                    1. Adjusted R-squared
                                                                                                                                                                                                                      1. Mean Absolute Percentage Error
                                                                                                                                                                                                                      2. Classification Metrics
                                                                                                                                                                                                                        1. Accuracy
                                                                                                                                                                                                                          1. Precision
                                                                                                                                                                                                                            1. Recall
                                                                                                                                                                                                                              1. F1-Score
                                                                                                                                                                                                                                1. Specificity
                                                                                                                                                                                                                                  1. Sensitivity
                                                                                                                                                                                                                                    1. Confusion Matrix
                                                                                                                                                                                                                                      1. Classification Report
                                                                                                                                                                                                                                      2. Probability-based Metrics
                                                                                                                                                                                                                                        1. ROC Curve
                                                                                                                                                                                                                                          1. AUC-ROC
                                                                                                                                                                                                                                            1. Precision-Recall Curve
                                                                                                                                                                                                                                              1. Log Loss
                                                                                                                                                                                                                                              2. Multi-class Metrics
                                                                                                                                                                                                                                                1. Macro Averaging
                                                                                                                                                                                                                                                  1. Micro Averaging
                                                                                                                                                                                                                                                    1. Weighted Averaging
                                                                                                                                                                                                                                                  2. Cross-Validation Techniques
                                                                                                                                                                                                                                                    1. K-Fold Cross-Validation
                                                                                                                                                                                                                                                      1. Stratified K-Fold
                                                                                                                                                                                                                                                        1. Leave-One-Out Cross-Validation
                                                                                                                                                                                                                                                          1. Leave-P-Out Cross-Validation
                                                                                                                                                                                                                                                            1. Time Series Cross-Validation
                                                                                                                                                                                                                                                              1. Nested Cross-Validation
                                                                                                                                                                                                                                                              2. Model Selection
                                                                                                                                                                                                                                                                1. Validation Curves
                                                                                                                                                                                                                                                                  1. Learning Curves
                                                                                                                                                                                                                                                                    1. Model Comparison
                                                                                                                                                                                                                                                                      1. Statistical Significance Testing
                                                                                                                                                                                                                                                                    2. Hyperparameter Tuning
                                                                                                                                                                                                                                                                      1. Hyperparameter Optimization Methods
                                                                                                                                                                                                                                                                        1. Grid Search
                                                                                                                                                                                                                                                                          1. Random Search
                                                                                                                                                                                                                                                                            1. Bayesian Optimization
                                                                                                                                                                                                                                                                              1. Genetic Algorithms
                                                                                                                                                                                                                                                                              2. Hyperparameter Tuning Tools
                                                                                                                                                                                                                                                                                1. GridSearchCV
                                                                                                                                                                                                                                                                                  1. RandomizedSearchCV
                                                                                                                                                                                                                                                                                    1. Hyperopt
                                                                                                                                                                                                                                                                                      1. Optuna
                                                                                                                                                                                                                                                                                      2. Advanced Tuning Strategies
                                                                                                                                                                                                                                                                                        1. Early Stopping
                                                                                                                                                                                                                                                                                          1. Successive Halving
                                                                                                                                                                                                                                                                                            1. Multi-fidelity Optimization
                                                                                                                                                                                                                                                                                          2. Model Pipelines and Workflow
                                                                                                                                                                                                                                                                                            1. Scikit-Learn Pipelines
                                                                                                                                                                                                                                                                                              1. Creating Pipelines
                                                                                                                                                                                                                                                                                                1. Pipeline Components
                                                                                                                                                                                                                                                                                                  1. Nested Pipelines
                                                                                                                                                                                                                                                                                                  2. Feature Unions
                                                                                                                                                                                                                                                                                                    1. Combining Features
                                                                                                                                                                                                                                                                                                      1. Parallel Feature Processing
                                                                                                                                                                                                                                                                                                      2. Custom Transformers
                                                                                                                                                                                                                                                                                                        1. Creating Custom Transformers
                                                                                                                                                                                                                                                                                                          1. Transformer Interface
                                                                                                                                                                                                                                                                                                          2. Pipeline Persistence
                                                                                                                                                                                                                                                                                                            1. Saving Pipelines
                                                                                                                                                                                                                                                                                                              1. Loading Pipelines
                                                                                                                                                                                                                                                                                                                1. Version Control for Models