Multivariate Analysis

  1. Principal Component Analysis
    1. Conceptual Foundation
      1. Objectives of PCA
        1. Dimensionality Reduction
          1. Data Visualization
            1. Noise Reduction
            2. Geometric Interpretation
              1. Variance Maximization Principle
              2. Mathematical Derivation
                1. Covariance Matrix Approach
                  1. Correlation Matrix Approach
                    1. Eigenvalue Problem Formulation
                      1. Lagrange Multiplier Method
                      2. PCA Implementation
                        1. Data Preparation
                          1. Centering
                            1. Standardization Decision
                            2. Covariance vs. Correlation Matrix Choice
                              1. Eigenvalue Decomposition
                                1. Principal Component Extraction
                                  1. Component Score Calculation
                                  2. Determining Number of Components
                                    1. Kaiser's Rule (Eigenvalue > 1)
                                      1. Scree Plot Analysis
                                        1. Cumulative Variance Explained
                                          1. Parallel Analysis
                                            1. Cross-Validation Methods
                                            2. Interpretation of Results
                                              1. Component Loadings
                                                1. Loading Interpretation
                                                  1. Loading Plots
                                                    1. Communalities
                                                    2. Component Scores
                                                      1. Score Calculation
                                                        1. Score Plots
                                                        2. Biplot Construction
                                                        3. Component Rotation
                                                          1. Orthogonal Rotations
                                                            1. Varimax Rotation
                                                              1. Quartimax Rotation
                                                                1. Equamax Rotation
                                                                2. Oblique Rotations
                                                                  1. Promax Rotation
                                                                    1. Direct Oblimin
                                                                    2. Rotation Interpretation
                                                                    3. PCA Diagnostics and Validation
                                                                      1. Adequacy Measures
                                                                        1. Stability Assessment
                                                                          1. Cross-Validation