Now showing items 1-5 of 5
A CMOS Current-Mode Dynamic Programming Circuit
(Institute of Electrical and Electronics Engineers, 2010-07)
Dynamic programming (DP) is a fundamental algorithm for complex optimization and decision-making in many engineering and biomedical systems. However, conventional DP computation based on digital implementation of the ...
Optimal Channel Probing and Transmission Scheduling for Opportunistic Spectrum Access
(Institute of Electrical and Electronics Engineers and Association for Computing Machinery, 2009-12)
In this study, we consider optimal opportunistic spectrum access (OSA) policies for a transmitter in a multichannel wireless system, where a channel can be in one of multiple states. In such systems, the transmitter typically ...
Universal Reinforcement Learning
(Institute of Electrical and Electronics Engineers, 2010-04)
We consider an agent interacting with an unmodeled environment. At each time, the agent makes an observation, takes an action, and incurs a cost. Its actions can influence future observations and costs. The goal is to ...
(Institute for Operations Research and the Management Sciences, 2009-03)
Virtual advisors often increase sales for those customers who find such online advice to be convenient and helpful. However, other customers take a more active role in their purchase decisions and prefer more detailed data. ...
The capacity of channels with feedback
(Institute of Electrical and Electronics Engineers, 2008-12)
In this paper, we introduce a general framework for treating channels with memory and feedback. First, we prove a general feedback channel coding theorem based on Massey's concept of directed information. Second, we present ...