Queueing Theory and Scheduling

Queueing theory and scheduling is the mathematical study of waiting lines and the strategic allocation of resources to service them. As a core component of systems science, it provides analytical models to understand and predict the behavior of systems where demand for a service contends for limited capacity, focusing on metrics like wait times, queue lengths, and resource utilization. Scheduling, in turn, applies these insights to develop and implement policies and algorithms that determine the order in which tasks or customers are processed, aiming to optimize system performance by minimizing delays, maximizing throughput, or ensuring fairness across diverse applications such as computer networks, manufacturing, and service operations.

  1. Introduction to Queueing Systems
    1. Definition and Purpose of Queueing Systems
      1. Real-World Examples of Queueing Systems
        1. Telecommunication Networks
          1. Computer Systems
            1. Manufacturing Systems
              1. Service Centers
                1. Transportation Systems
                  1. Healthcare Facilities
                  2. Core Components of a Queueing System
                    1. Arrival Process
                      1. Arrival Rate
                        1. Inter-arrival Time Distribution
                          1. Batch Arrivals
                            1. Time-Dependent Arrivals
                              1. Balking and Reneging
                              2. Service Mechanism
                                1. Service Rate
                                  1. Service Time Distribution
                                    1. Service Channels
                                      1. Service Policies
                                        1. Service Interruptions
                                        2. Queue Discipline
                                          1. First-Come First-Served (FCFS)
                                            1. Last-Come First-Served (LCFS)
                                              1. Priority-Based Disciplines
                                                1. Random Selection
                                                  1. Processor Sharing
                                                    1. Service in Random Order (SIRO)
                                                    2. System Capacity
                                                      1. Infinite Capacity
                                                        1. Finite Capacity
                                                          1. Blocking and Loss
                                                            1. Buffer Management
                                                            2. Number of Servers
                                                              1. Single-Server Systems
                                                                1. Multi-Server Systems
                                                                  1. Infinite-Server Systems
                                                                2. Kendall's Notation
                                                                  1. Structure and Interpretation
                                                                    1. Arrival Distribution (A)
                                                                      1. Markovian (M)
                                                                        1. Deterministic (D)
                                                                          1. General (G)
                                                                            1. Erlang (Ek)
                                                                              1. Hyperexponential (H2)
                                                                              2. Service Time Distribution (B)
                                                                                1. Markovian (M)
                                                                                  1. Deterministic (D)
                                                                                    1. General (G)
                                                                                      1. Erlang (Ek)
                                                                                        1. Hyperexponential (H2)
                                                                                        2. Number of Servers (c)
                                                                                          1. System Capacity (K)
                                                                                            1. Calling Population Size (N)
                                                                                              1. Queue Discipline (D)
                                                                                              2. Key Performance Metrics
                                                                                                1. Queue Length Measures
                                                                                                  1. Average Queue Length
                                                                                                    1. Distribution of Queue Length
                                                                                                      1. Variance of Queue Length
                                                                                                      2. Waiting Time Measures
                                                                                                        1. Average Waiting Time
                                                                                                          1. Waiting Time Distribution
                                                                                                            1. Percentiles of Waiting Time
                                                                                                            2. System Time Measures
                                                                                                              1. Average System Time
                                                                                                                1. System Time Distribution
                                                                                                                  1. Response Time Analysis
                                                                                                                  2. Server Utilization
                                                                                                                    1. Definition and Calculation
                                                                                                                      1. Individual Server Utilization
                                                                                                                        1. System Utilization
                                                                                                                          1. Impact on Performance
                                                                                                                          2. Throughput Measures
                                                                                                                            1. Effective Arrival Rate
                                                                                                                              1. Service Rate
                                                                                                                                1. System Throughput
                                                                                                                                2. Probability Measures
                                                                                                                                  1. Probability of Delay
                                                                                                                                    1. Probability of Blocking
                                                                                                                                      1. Probability of Loss
                                                                                                                                        1. Probability of Empty System
                                                                                                                                      2. Little's Law
                                                                                                                                        1. Statement and Mathematical Formulation
                                                                                                                                          1. Proof and Derivation
                                                                                                                                            1. Conditions for Applicability
                                                                                                                                              1. Applications and Implications
                                                                                                                                                1. Extensions and Variations