A state action frequency approach to throughput maximization over uncertain wireless channels
Author(s)Jagannathan, Krishna Prasanna; Mannor, Shie; Menache, Ishai; Modiano, Eytan H.
MetadataShow full item record
We consider scheduling over a wireless system, where the channel state information is not available a priori to the scheduler, but can be inferred from the past. Specifically, the wireless system is modeled as a network of parallel queues. We assume that the channel state of each queue evolves stochastically as an ON/OFF Markov chain. The scheduler, which is aware of the queue lengths but is oblivious of the channel states, has to choose one queue at a time for transmission. The scheduler has no information regarding the current channel states, but can estimate them by using the acknowledgment history. We first characterize the capacity region of the system using tools from Markov Decision Processes (MDP) theory. Specifically, we prove that the capacity region boundary is the uniform limit of a sequence of Linear Programming (LP) solutions. Next, we combine the LP solution with a queue length based scheduling mechanism that operates over long `frames,' to obtain a throughput optimal policy for the system. By incorporating results from MDP theory within the Lyapunov-stability framework, we show that our frame-based policy stabilizes the system for all arrival rates that lie in the interior of the capacity region.
DepartmentMassachusetts Institute of Technology. Department of Aeronautics and Astronautics; Massachusetts Institute of Technology. Laboratory for Information and Decision Systems
Proceedings of the 30th IEEE International Conference on Computer Communications (IEEE INFOCOM 2011)
Institute of Electrical and Electronics Engineers
Jagannathan, Krishna et al. “A state action frequency approach to throughput maximization over uncertain wireless channels.” In Proceedings of the 30th IEEE International Conference on Computer Communications, INFOCOM 2011, IEEE, 2011. 491-495.
Author's final manuscript
INSPEC Accession Number: 12086001