Deep Learning for Audio Processing

  1. Audio Data Representation and Preprocessing
    1. Raw Audio Waveform Processing
      1. Digital Audio Structure
        1. Sample Arrays and Data Types
          1. Mono vs Stereo vs Multi-channel
            1. Memory Layout and Storage
            2. Temporal Segmentation
              1. Fixed-length Windowing
                1. Overlapping Windows
                  1. Hop Length Selection
                    1. Boundary Handling
                    2. Window Functions
                      1. Rectangular Window
                        1. Hann Window
                          1. Hamming Window
                            1. Blackman Window
                              1. Kaiser Window
                                1. Window Selection Criteria
                              2. Time-Frequency Representations
                                1. Short-Time Fourier Transform
                                  1. STFT Computation
                                    1. Window Size vs Time Resolution
                                      1. Frequency Resolution Considerations
                                        1. Overlap-Add Reconstruction
                                        2. Spectrogram Variants
                                          1. Linear Frequency Spectrogram
                                            1. Construction from STFT
                                              1. Magnitude and Phase Information
                                              2. Logarithmic Frequency Spectrogram
                                                1. Log-scale Benefits
                                                  1. Perceptual Relevance
                                                  2. Mel-scale Spectrogram
                                                    1. Mel Filter Bank Design
                                                      1. Perceptual Frequency Scaling
                                                        1. Implementation Details
                                                        2. Bark-scale Spectrogram
                                                          1. Critical Band Theory
                                                            1. Bark Scale Definition
                                                          2. Advanced Time-Frequency Methods
                                                            1. Constant-Q Transform
                                                              1. Variable Time-Frequency Resolution
                                                                1. Musical Applications
                                                                  1. Implementation Considerations
                                                                  2. Gammatone Filterbank
                                                                    1. Auditory Filter Modeling
                                                                      1. Cochlear Frequency Analysis
                                                                      2. Chromagram
                                                                        1. Pitch Class Representation
                                                                          1. Octave Equivalence
                                                                            1. Harmonic Analysis
                                                                        2. Feature Extraction and Engineering
                                                                          1. Low-level Audio Features
                                                                            1. Temporal Features
                                                                              1. Root Mean Square Energy
                                                                                1. Zero-Crossing Rate
                                                                                  1. Spectral Centroid
                                                                                    1. Spectral Bandwidth
                                                                                    2. Spectral Features
                                                                                      1. Spectral Contrast
                                                                                        1. Spectral Flatness
                                                                                          1. Spectral Rolloff
                                                                                            1. Spectral Flux
                                                                                            2. Cepstral Features
                                                                                              1. MFCC Computation Pipeline
                                                                                                1. Delta and Delta-Delta Coefficients
                                                                                                  1. Liftering and Post-processing
                                                                                                2. Mid-level Features
                                                                                                  1. Chroma Features
                                                                                                    1. Pitch Class Profiles
                                                                                                      1. Harmonic Content Analysis
                                                                                                        1. Key and Chord Recognition
                                                                                                        2. Tonnetz Features
                                                                                                          1. Harmonic Network Representation
                                                                                                            1. Tonal Centroid Features
                                                                                                            2. Rhythm Features
                                                                                                              1. Tempo Estimation
                                                                                                                1. Beat Tracking
                                                                                                                  1. Onset Detection
                                                                                                                2. High-level Features
                                                                                                                  1. Structural Features
                                                                                                                    1. Segment Boundaries
                                                                                                                      1. Repetition Analysis
                                                                                                                        1. Form Analysis
                                                                                                                        2. Semantic Features
                                                                                                                          1. Mood and Emotion
                                                                                                                            1. Genre Characteristics
                                                                                                                              1. Instrument Presence
                                                                                                                          2. Data Preprocessing Techniques
                                                                                                                            1. Amplitude Normalization
                                                                                                                              1. Peak Normalization
                                                                                                                                1. RMS Normalization
                                                                                                                                  1. Loudness Normalization
                                                                                                                                    1. Dynamic Range Compression
                                                                                                                                    2. Statistical Normalization
                                                                                                                                      1. Z-score Standardization
                                                                                                                                        1. Min-max Scaling
                                                                                                                                          1. Robust Scaling
                                                                                                                                            1. Per-channel Normalization
                                                                                                                                            2. Silence and Noise Handling
                                                                                                                                              1. Voice Activity Detection
                                                                                                                                                1. Silence Removal Algorithms
                                                                                                                                                  1. Noise Floor Estimation
                                                                                                                                                    1. Signal-to-Noise Ratio Enhancement
                                                                                                                                                    2. Temporal Alignment
                                                                                                                                                      1. Audio Synchronization
                                                                                                                                                        1. Time Stretching
                                                                                                                                                          1. Pitch Shifting
                                                                                                                                                            1. Cross-correlation Alignment
                                                                                                                                                          2. Data Augmentation Strategies
                                                                                                                                                            1. Time-Domain Augmentation
                                                                                                                                                              1. Time Shifting
                                                                                                                                                                1. Time Stretching
                                                                                                                                                                  1. Speed Perturbation
                                                                                                                                                                    1. Polarity Inversion
                                                                                                                                                                    2. Frequency-Domain Augmentation
                                                                                                                                                                      1. Pitch Shifting
                                                                                                                                                                        1. Formant Shifting
                                                                                                                                                                          1. Frequency Masking
                                                                                                                                                                            1. Spectral Subtraction
                                                                                                                                                                            2. Additive Augmentation
                                                                                                                                                                              1. Background Noise Addition
                                                                                                                                                                                1. Reverberation Simulation
                                                                                                                                                                                  1. Echo and Delay Effects
                                                                                                                                                                                    1. Multi-speaker Mixing
                                                                                                                                                                                    2. SpecAugment Techniques
                                                                                                                                                                                      1. Time Masking
                                                                                                                                                                                        1. Frequency Masking
                                                                                                                                                                                          1. Time Warping
                                                                                                                                                                                            1. Adaptive Masking Strategies
                                                                                                                                                                                            2. Advanced Augmentation
                                                                                                                                                                                              1. Room Impulse Response Convolution
                                                                                                                                                                                                1. Codec Simulation
                                                                                                                                                                                                  1. Channel Effects
                                                                                                                                                                                                    1. Mixup and CutMix for Audio

                                                                                                                                                                                                Previous

                                                                                                                                                                                                1. Foundations of Audio and Deep Learning

                                                                                                                                                                                                Go to top

                                                                                                                                                                                                Next

                                                                                                                                                                                                3. Core Deep Learning Architectures for Audio