PyTorch Library

  1. Tensor Operations and Manipulation
    1. Indexing and Slicing
      1. Basic Indexing
        1. Single Element Access
          1. Multi-dimensional Indexing
          2. Slicing Operations
            1. Range Slicing
              1. Step Slicing
                1. Negative Indexing
                2. Advanced Indexing
                  1. Boolean Indexing
                    1. Fancy Indexing
                      1. Index Tensors
                      2. Conditional Selection
                        1. torch.where()
                          1. torch.masked_select()
                        2. Tensor Shape Manipulation
                          1. Reshaping Operations
                            1. torch.reshape()
                              1. view() Method
                                1. Automatic Size Inference
                                2. Dimension Manipulation
                                  1. torch.squeeze()
                                    1. torch.unsqueeze()
                                      1. Adding and Removing Dimensions
                                      2. Transposition and Permutation
                                        1. torch.transpose()
                                          1. torch.permute()
                                            1. Matrix Transposition
                                            2. Flattening Operations
                                              1. torch.flatten()
                                                1. Multi-dimensional Flattening
                                                2. Expansion and Repetition
                                                  1. torch.expand()
                                                    1. torch.repeat()
                                                      1. Broadcasting vs Expansion
                                                    2. Joining and Splitting Tensors
                                                      1. Concatenation Operations
                                                        1. torch.cat()
                                                          1. Concatenation Along Different Axes
                                                          2. Stacking Operations
                                                            1. torch.stack()
                                                              1. Creating New Dimensions
                                                              2. Splitting Operations
                                                                1. torch.split()
                                                                  1. torch.chunk()
                                                                    1. Uneven Splits
                                                                    2. Gathering and Scattering
                                                                      1. torch.gather()
                                                                        1. torch.scatter()
                                                                          1. Index-based Operations
                                                                        2. Mathematical Operations
                                                                          1. Element-wise Arithmetic
                                                                            1. Addition and Subtraction
                                                                              1. Multiplication and Division
                                                                                1. Power and Root Operations
                                                                                  1. Modular Arithmetic
                                                                                  2. Trigonometric Functions
                                                                                    1. Basic Trigonometric Functions
                                                                                      1. Inverse Trigonometric Functions
                                                                                        1. Hyperbolic Functions
                                                                                        2. Exponential and Logarithmic Functions
                                                                                          1. torch.exp()
                                                                                            1. torch.log()
                                                                                              1. torch.log10()
                                                                                                1. torch.log2()
                                                                                                2. Rounding and Ceiling Functions
                                                                                                  1. torch.round()
                                                                                                    1. torch.floor()
                                                                                                      1. torch.ceil()
                                                                                                        1. torch.trunc()
                                                                                                        2. Statistical Functions
                                                                                                          1. torch.abs()
                                                                                                            1. torch.sign()
                                                                                                              1. torch.clamp()
                                                                                                            2. Reduction Operations
                                                                                                              1. Sum Operations
                                                                                                                1. torch.sum()
                                                                                                                  1. Dimension-specific Sums
                                                                                                                    1. Cumulative Sums
                                                                                                                    2. Mean and Average
                                                                                                                      1. torch.mean()
                                                                                                                        1. Weighted Averages
                                                                                                                        2. Variance and Standard Deviation
                                                                                                                          1. torch.var()
                                                                                                                            1. torch.std()
                                                                                                                              1. Bessel's Correction
                                                                                                                              2. Min and Max Operations
                                                                                                                                1. torch.min()
                                                                                                                                  1. torch.max()
                                                                                                                                    1. torch.argmin()
                                                                                                                                      1. torch.argmax()
                                                                                                                                      2. Product Operations
                                                                                                                                        1. torch.prod()
                                                                                                                                          1. torch.cumprod()
                                                                                                                                          2. Norm Calculations
                                                                                                                                            1. torch.norm()
                                                                                                                                              1. Different Norm Types
                                                                                                                                            2. Comparison Operations
                                                                                                                                              1. Element-wise Comparisons
                                                                                                                                                1. torch.eq()
                                                                                                                                                  1. torch.ne()
                                                                                                                                                    1. torch.gt()
                                                                                                                                                      1. torch.ge()
                                                                                                                                                        1. torch.lt()
                                                                                                                                                          1. torch.le()
                                                                                                                                                          2. Logical Operations
                                                                                                                                                            1. torch.logical_and()
                                                                                                                                                              1. torch.logical_or()
                                                                                                                                                                1. torch.logical_not()
                                                                                                                                                                  1. torch.logical_xor()
                                                                                                                                                                  2. Sorting Operations
                                                                                                                                                                    1. torch.sort()
                                                                                                                                                                      1. torch.argsort()
                                                                                                                                                                        1. torch.topk()
                                                                                                                                                                      2. Linear Algebra Operations
                                                                                                                                                                        1. Matrix Multiplication
                                                                                                                                                                          1. torch.matmul()
                                                                                                                                                                            1. @ Operator
                                                                                                                                                                              1. torch.mm()
                                                                                                                                                                                1. Batch Matrix Multiplication
                                                                                                                                                                                2. Vector Operations
                                                                                                                                                                                  1. torch.dot()
                                                                                                                                                                                    1. Cross Product
                                                                                                                                                                                      1. Vector Norms
                                                                                                                                                                                      2. Matrix Decomposition
                                                                                                                                                                                        1. torch.svd()
                                                                                                                                                                                          1. QR Decomposition
                                                                                                                                                                                            1. Cholesky Decomposition
                                                                                                                                                                                            2. Eigenvalue Operations
                                                                                                                                                                                              1. torch.eig()
                                                                                                                                                                                                1. torch.symeig()
                                                                                                                                                                                                2. Linear System Solving
                                                                                                                                                                                                  1. torch.solve()
                                                                                                                                                                                                    1. Matrix Inversion
                                                                                                                                                                                                      1. Determinant Calculation
                                                                                                                                                                                                    2. Broadcasting
                                                                                                                                                                                                      1. Broadcasting Rules
                                                                                                                                                                                                        1. Dimension Compatibility
                                                                                                                                                                                                          1. Size Compatibility
                                                                                                                                                                                                          2. Broadcasting in Practice
                                                                                                                                                                                                            1. Automatic Broadcasting
                                                                                                                                                                                                              1. Manual Broadcasting
                                                                                                                                                                                                              2. Common Broadcasting Patterns
                                                                                                                                                                                                                1. Vector-Matrix Operations
                                                                                                                                                                                                                  1. Batch Operations
                                                                                                                                                                                                                  2. Broadcasting Limitations
                                                                                                                                                                                                                    1. Memory Considerations
                                                                                                                                                                                                                      1. Performance Implications