Feature Engineering for Machine Learning

  1. Feature Selection Methods
    1. Selection Rationale
      1. Curse of Dimensionality
        1. Overfitting Prevention
          1. Computational Efficiency
            1. Model Interpretability
              1. Noise Reduction
              2. Filter Methods
                1. Statistical Tests
                  1. Chi-Square Test
                    1. ANOVA F-Test
                      1. Mutual Information
                        1. Information Gain
                        2. Correlation-Based Selection
                          1. Pearson Correlation
                            1. Spearman Correlation
                              1. Distance Correlation
                              2. Variance-Based Selection
                                1. Variance Threshold
                                  1. Coefficient of Variation
                                  2. Univariate Selection
                                    1. SelectKBest
                                      1. SelectPercentile
                                        1. SelectFpr
                                          1. SelectFdr
                                            1. SelectFwe
                                          2. Wrapper Methods
                                            1. Sequential Selection
                                              1. Forward Selection
                                                1. Backward Elimination
                                                  1. Bidirectional Selection
                                                  2. Recursive Feature Elimination
                                                    1. Exhaustive Search
                                                      1. Genetic Algorithms
                                                      2. Embedded Methods
                                                        1. Regularization-Based
                                                          1. L1 Regularization (Lasso)
                                                            1. L2 Regularization (Ridge)
                                                              1. Elastic Net
                                                              2. Tree-Based Importance
                                                                1. Gini Importance
                                                                  1. Permutation Importance
                                                                    1. Drop-Column Importance
                                                                    2. Model-Specific Selection
                                                                      1. Linear Model Coefficients
                                                                        1. Neural Network Weights
                                                                      2. Hybrid Approaches
                                                                        1. Multi-Stage Selection
                                                                          1. Ensemble Selection Methods
                                                                            1. Stability Selection

                                                                          Previous

                                                                          10. Geospatial Feature Engineering

                                                                          Go to top

                                                                          Next

                                                                          12. Dimensionality Reduction