Data Cleaning

  1. Techniques for Correcting Inaccurate Data
    1. Outlier Detection Methods
      1. Statistical Approaches
        1. Z-Score Method
          1. Standard Z-Score
            1. Modified Z-Score
              1. Robust Z-Score
              2. Interquartile Range (IQR) Method
                1. Standard IQR
                  1. Adjusted IQR
                    1. Tukey's Fences
                    2. Grubbs' Test
                      1. Dixon's Test
                        1. Chauvenet's Criterion
                        2. Distribution-Based Methods
                          1. Gaussian Distribution Assumptions
                            1. Non-Parametric Methods
                              1. Quantile-Based Detection
                                1. Percentile Methods
                                2. Machine Learning Approaches
                                  1. Isolation Forest
                                    1. One-Class SVM
                                      1. Local Outlier Factor (LOF)
                                        1. DBSCAN Clustering
                                        2. Multivariate Outlier Detection
                                          1. Mahalanobis Distance
                                            1. Principal Component Analysis (PCA)
                                              1. Minimum Covariance Determinant
                                                1. Robust Covariance Estimation
                                                2. Time Series Outlier Detection
                                                  1. Seasonal Decomposition
                                                    1. ARIMA Residuals
                                                      1. Control Charts
                                                        1. Change Point Detection
                                                        2. Visualization-Based Detection
                                                          1. Box Plots
                                                            1. Scatter Plots
                                                              1. Histogram Analysis
                                                                1. Q-Q Plots
                                                                  1. Parallel Coordinates
                                                                  2. Domain-Specific Methods
                                                                    1. Business Rule Validation
                                                                      1. Expert Knowledge Integration
                                                                        1. Historical Pattern Analysis
                                                                          1. Contextual Validation
                                                                        2. Outlier Treatment Strategies
                                                                          1. Capping and Winsorization
                                                                            1. Percentile Capping
                                                                              1. Standard Deviation Capping
                                                                                1. IQR-Based Capping
                                                                                  1. Asymmetric Winsorization
                                                                                  2. Transformation Techniques
                                                                                    1. Log Transformation
                                                                                      1. Square Root Transformation
                                                                                        1. Box-Cox Transformation
                                                                                          1. Yeo-Johnson Transformation
                                                                                            1. Inverse Transformation
                                                                                            2. Removal Strategies
                                                                                              1. Complete Removal
                                                                                                1. Conditional Removal
                                                                                                  1. Iterative Removal
                                                                                                    1. Cluster-Based Removal
                                                                                                    2. Replacement Methods
                                                                                                      1. Mean Replacement
                                                                                                        1. Median Replacement
                                                                                                          1. Mode Replacement
                                                                                                            1. Interpolated Values
                                                                                                              1. Predicted Values
                                                                                                              2. Robust Methods
                                                                                                                1. Robust Statistics
                                                                                                                  1. Trimmed Means
                                                                                                                    1. Median Absolute Deviation
                                                                                                                      1. Huber Loss Functions
                                                                                                                    2. Error Correction Approaches
                                                                                                                      1. Manual Correction
                                                                                                                        1. Expert Review
                                                                                                                          1. Data Steward Validation
                                                                                                                            1. Crowdsourcing
                                                                                                                              1. Quality Control Processes
                                                                                                                              2. Rule-Based Correction
                                                                                                                                1. Business Logic Rules
                                                                                                                                  1. Validation Rules
                                                                                                                                    1. Constraint-Based Correction
                                                                                                                                      1. Pattern-Based Fixes
                                                                                                                                      2. Reference Data Validation
                                                                                                                                        1. External Database Lookup
                                                                                                                                          1. Master Data Management
                                                                                                                                            1. Authoritative Source Validation
                                                                                                                                              1. Cross-Reference Checking
                                                                                                                                              2. Automated Correction
                                                                                                                                                1. Machine Learning Models
                                                                                                                                                  1. Pattern Recognition
                                                                                                                                                    1. Similarity-Based Correction
                                                                                                                                                      1. Probabilistic Correction
                                                                                                                                                      2. Cross-Validation Methods
                                                                                                                                                        1. Multiple Source Comparison
                                                                                                                                                          1. Consensus-Based Correction
                                                                                                                                                            1. Voting Mechanisms
                                                                                                                                                              1. Confidence Scoring

                                                                                                                                                          Previous

                                                                                                                                                          5. Techniques for Handling Missing Data

                                                                                                                                                          Go to top

                                                                                                                                                          Next

                                                                                                                                                          7. Techniques for Standardization and Consistency