Optimal channel probing in communication systems: The two-channel case
Name
Modiano_Optimal channel.pdf
Size
190.7 KB
Format
Adobe PDF
Checksum (MD5)
4b03901078e1eec98e93df1222b1bae9
Author(s)
Johnston, Matthew Ryan
Modiano, Eytan H.
Date Issued
December 2013
Journal
Proceedings of the 2013 IEEE Global Communications Conference (GLOBECOM)
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Citation
Johnston, Matthew, and Eytan Modiano. “Optimal Channel Probing in Communication Systems: The Two-Channel Case.” 2013 IEEE Global Communications Conference (GLOBECOM) (December 2013).
Version
Author's final manuscript
Abstract
We consider a multi-channel communication system in which a transmitter has access to two channels, but does not know the state of either channel. We model the channel state using an ON/OFF Markovian model, and allow the transmitter to probe one of the channels at predetermined probing intervals to decide over which channel to transmit. For models in which the transmitter must transmit over the probed channel, it has been shown that a myopic policy that probes the channel most likely to be ON is optimal. In this work, we allow the transmitter to select a channel over which to transmit that is not necessarily the one it probed. We show that in the case where the two channels are i.i.d, all probing policies yield equal reward. We extend this problem to dynamically choose when to probe based on the results of previous probes, and characterize the optimal policy, as well as provide a LP in terms of state action frequencies to find the optimal policy.
MIT Department
Massachusetts Institute of Technology. Department of Aeronautics and Astronautics
Massachusetts Institute of Technology. Laboratory for Information and Decision Systems
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1109/GLOCOM.2013.6831336
