Speech Synthesis and Processing

7.

Evaluation and Quality Assessment

7.1.

Speech Synthesis Evaluation

7.1.1.

Subjective Evaluation

7.1.1.1.

Mean Opinion Score (MOS)

7.1.1.2.

Comparison Mean Opinion Score (CMOS)

7.1.1.3.

AB Testing Protocols

7.1.1.4.

Listener Panel Design

7.1.1.5.

Statistical Significance Testing

7.1.2.

Objective Evaluation Metrics

7.1.2.1.

Mel-Cepstral Distortion (MCD)

7.1.2.2.

Fundamental Frequency Error

7.1.2.3.

Voicing Decision Error

7.1.2.4.

Spectral Distortion Measures

7.1.3.

Perceptual Quality Metrics

7.1.3.1.

Perceptual Evaluation of Speech Quality (PESQ)

7.1.3.2.

Short-Time Objective Intelligibility (STOI)

7.1.3.3.

Composite Measures

7.1.4.

Naturalness and Intelligibility

7.1.4.1.

Naturalness Assessment

7.1.4.2.

Intelligibility Testing

7.1.4.3.

Comprehension Studies

7.2.

Speech Recognition Evaluation

7.2.1.

Word Error Rate (WER)

7.2.1.1.

Substitution Errors

7.2.1.2.

Insertion Errors

7.2.1.3.

Deletion Errors

7.2.1.4.

Alignment Algorithms

7.2.2.

Character Error Rate (CER)

7.2.2.1.

Language-specific Considerations

7.2.2.2.

Unicode Handling

7.2.2.3.

Normalization Issues

7.2.3.

Confidence Measures

7.2.3.1.

Posterior Probability Estimation

7.2.3.2.

Confidence Score Calibration

7.2.3.3.

Rejection Thresholds

7.2.4.

Real-time Factor (RTF)

7.2.4.1.

Computational Efficiency

7.2.4.2.

7.2.4.3.

Latency Measurements

7.3.

Speaker Recognition Evaluation

7.3.1.

Detection Error Tradeoff (DET) Curves

7.3.1.1.

False Acceptance Rate (FAR)

7.3.1.2.

False Rejection Rate (FRR)

7.3.1.3.

Equal Error Rate (EER)

7.3.2.

Receiver Operating Characteristic (ROC)

7.3.2.1.

Area Under Curve (AUC)

7.3.2.2.

Operating Point Selection

7.3.3.

Minimum Detection Cost Function (minDCF)

7.3.3.1.

Cost Function Definition

7.3.3.2.

Prior Probability Settings

7.3.3.3.

Performance Optimization

7.4.

Robustness Evaluation

7.4.1.

Noise Robustness Testing

7.4.1.1.

Additive Noise Conditions

7.4.1.2.

Signal-to-Noise Ratio Variations

7.4.1.3.

Noise Type Diversity

7.4.2.

Channel Robustness

7.4.2.1.

Microphone Variability

7.4.2.2.

Transmission Channel Effects

7.4.2.3.

Codec Distortions

7.4.3.

Cross-domain Evaluation

7.4.3.1.

Domain Mismatch Effects

7.4.3.2.

Adaptation Performance

7.4.3.3.

Generalization Capabilities

Previous

6. Advanced Topics and Applications

Go to top

Back to Start

1. Fundamentals of Sound and Speech