Recommender Systems

  1. Evaluation of Recommender Systems
    1. Importance of Evaluation
      1. Measuring System Effectiveness
        1. Aligning with Business Goals
          1. Comparing Different Approaches
          2. Offline Evaluation
            1. Data Splitting Strategies
              1. Holdout Method
                1. Cross-Validation
                  1. Temporal Splitting
                    1. Leave-One-Out
                    2. Prediction Accuracy Metrics
                      1. Mean Absolute Error
                        1. Root Mean Square Error
                          1. Mean Squared Error
                          2. Ranking and Classification Metrics
                            1. Precision
                              1. Recall
                                1. F1-Score
                                  1. Mean Average Precision
                                    1. Normalized Discounted Cumulative Gain
                                      1. Hit Rate
                                        1. Area Under Curve
                                        2. Beyond Accuracy Metrics
                                          1. Coverage
                                            1. Catalog Coverage
                                              1. User Coverage
                                              2. Diversity
                                                1. Intra-List Diversity
                                                  1. Inter-List Diversity
                                                  2. Novelty
                                                    1. Item Novelty
                                                      1. User Novelty
                                                      2. Serendipity
                                                        1. Unexpected Relevance
                                                    2. Online Evaluation
                                                      1. A/B Testing
                                                        1. Experimental Design
                                                          1. Statistical Significance
                                                            1. Sample Size Determination
                                                            2. Interleaving
                                                              1. Team Draft Interleaving
                                                                1. Probabilistic Interleaving
                                                                2. Multi-Armed Bandit Testing
                                                                  1. Key Business Metrics
                                                                    1. Click-Through Rate
                                                                      1. Conversion Rate
                                                                        1. User Engagement
                                                                          1. Retention Rate
                                                                            1. Revenue Impact
                                                                              1. User Satisfaction
                                                                            2. Evaluation Challenges
                                                                              1. Evaluation Bias
                                                                                1. Temporal Effects
                                                                                  1. User Feedback Quality

                                                                                Previous

                                                                                6. Advanced Recommender Models

                                                                                Go to top

                                                                                Next

                                                                                8. Practical Challenges and System Design