Predictive Analytics

  1. Classification Modeling
    1. Binary Classification
      1. Logistic Regression
        1. Logit Function
          1. Maximum Likelihood Estimation
            1. Odds Ratio Interpretation
              1. Model Diagnostics
              2. Linear Discriminant Analysis
                1. Bayes' Theorem Foundation
                  1. Discriminant Functions
                    1. Assumptions and Limitations
                    2. Quadratic Discriminant Analysis
                      1. Non-linear Decision Boundaries
                        1. Covariance Matrix Estimation
                      2. Multi-class Classification
                        1. Multinomial Logistic Regression
                          1. Softmax Function
                            1. Reference Category Selection
                              1. Parameter Interpretation
                              2. One-vs-Rest Strategy
                                1. Binary Classifier Extension
                                  1. Decision Function Combination
                                  2. One-vs-One Strategy
                                    1. Pairwise Classification
                                      1. Voting Mechanisms
                                    2. Instance-based Learning
                                      1. k-Nearest Neighbors
                                        1. Distance Metrics
                                          1. Euclidean Distance
                                            1. Manhattan Distance
                                              1. Minkowski Distance
                                                1. Cosine Similarity
                                                2. k Parameter Selection
                                                  1. Weighted Voting Schemes
                                                    1. Curse of Dimensionality
                                                  2. Probabilistic Classifiers
                                                    1. Naive Bayes
                                                      1. Conditional Independence Assumption
                                                        1. Gaussian Naive Bayes
                                                          1. Multinomial Naive Bayes
                                                            1. Bernoulli Naive Bayes
                                                              1. Laplace Smoothing
                                                            2. Support Vector Machines
                                                              1. Linear SVM
                                                                1. Maximum Margin Principle
                                                                  1. Support Vector Identification
                                                                    1. Soft Margin Classification
                                                                    2. Non-linear SVM
                                                                      1. Kernel Trick
                                                                        1. Polynomial Kernels
                                                                          1. Radial Basis Function Kernels
                                                                            1. Sigmoid Kernels
                                                                            2. SVM Parameter Tuning
                                                                              1. C Parameter Selection
                                                                                1. Kernel Parameter Optimization
                                                                                  1. Cross-validation Strategies
                                                                                2. Tree-based Classification
                                                                                  1. Decision Trees
                                                                                    1. Splitting Criteria
                                                                                      1. Gini Impurity
                                                                                        1. Entropy and Information Gain
                                                                                          1. Classification Error
                                                                                          2. Tree Construction Algorithms
                                                                                            1. ID3
                                                                                              1. C4.5
                                                                                                1. CART
                                                                                                2. Pruning Techniques
                                                                                                  1. Pre-pruning
                                                                                                    1. Post-pruning
                                                                                                      1. Cost Complexity Pruning
                                                                                                    2. Handling Categorical Features
                                                                                                      1. Binary Splits
                                                                                                        1. Multi-way Splits
                                                                                                          1. Optimal Subset Selection

                                                                                                      Previous

                                                                                                      3. Regression Modeling

                                                                                                      Go to top

                                                                                                      Next

                                                                                                      5. Ensemble Methods