A Stable On-line Algorithm for Energy Efficient Multi-user Scheduling (2009)
Salodkar, Nitin, Karandikar, Abhay, Borkar, V. S.
In this paper, we consider the problem of energy efficient uplink scheduling with delay constraint for a multi-user wireless system. We address this problem within the framework of constrained Markov...
Verlag, 1980. Supervisory Control of Probabilistic Discrete-Event Systems with Recovery (2009)
A. Arapostathis, V. S. Borkar, E. Fern, M. Ghosh, S. I. Marcus, ...
ergodic control of semi-Markov processes, ” Math. Oper. Res., vol. 20, pp. 923–936, 1995. [3] V. S. Borkar, “On minimum cost per unit time control of Markov chains, ” SIAM J. Contr. Optim.,...
Vacation Policy Optimization with Application to IEEE 802.16e Power Saving Mechanism (2009)
Azad, Amar Prakash, Alouf, Sara, Altman, Eitan, Borkar, V. S., Paschos, Georgios Stavrou
Much research has been devoted to optimizing the power saving mechanism in wireless mobile devices. Recent advances in wireless radio technology facilitate the implementation of various possible...
Vacation Policy Optimization with Application to IEEE 802.16e Power Saving Mechanism (2009)
Azad, Amar Prakash, Alouf, Sara, Altman, Eitan, Borkar, V. S., Paschos, Georgios Stavrou
Much research has been devoted to optimizing the power saving mechanism in wireless mobile devices. Recent advances in wireless radio technology facilitate the implementation of various possible...
Vacation Policy Optimization with Application to IEEE 802.16e Power Saving Mechanism (2009)
Azad, Amar Prakash, Alouf, Sara, Altman, Eitan, Borkar, V. S., Paschos, Georgios Stavrou
Much research has been devoted to optimizing the power saving mechanism in wireless mobile devices. Recent advances in wireless radio technology facilitate the implementation of various possible...
Vacation Policy Optimization with Application to IEEE 802.16e Power Saving Mechanism (2009)
Azad, Amar Prakash, Alouf, Sara, Altman, Eitan, Borkar, V. S., Paschos, Georgios Stavrou
Much research has been devoted to optimizing the power saving mechanism in wireless mobile devices. Recent advances in wireless radio technology facilitate the implementation of various possible...
Design and Implementation of SeTiA: S ecure Multi Auction S ystem (2008)
V. S. Borkar, Mehul S Dave, R. K. Shyamsundar
1 Introduction The Internet has revolutionized exchange mechanisms and large volume of on-line trade has taken place over the Internet for C2C and B2B transactions among others. In fact, one might...
PERFORMANCE ANALYSIS CONDITIONED ON RARE EVENTS: (2008)
An Adaptive, Simulation Scheme, V. S. Borkar, S. Juneja, A. A. Kherani
Dedicated to Sanjoy Mitter on the occasion of his 70th birthday. Abstract. We consider the problem of simulation-based estimation of performance measures for a Markov chain conditioned on a rare...
EQUIVALENCE OF 2D-MULTITOPIC CATEGORY AND (2008)
Abstract. In this paper equivalence of the concepts of ana-bicategory and the 2Dmultitopic category is proved. The equivalence is FOLDS equivalence of the FOLDS-Specifications of the two concepts....
EQUIVALENCE OF 2D-MULTITOPIC CATEGORY AND (2008)
Abstract. In this paper equivalence of the concepts of ana-bicategory and the 2Dmultitopic category is proved. The equivalence is FOLDS equivalence of the FOLDS-Specifications of the two concepts....
Control of Buffer and Energy of a Wireless Device: Closed and Open Loop Approaches (2006)
Borkar, V. S., Kherani, A. A., Prabhu, B. J.
We consider a decision problem faced by an energy limited wireless device that operates in discrete time. There is some external arrival to the device's transmit buffer. The possible decisions are a)...
Control of Buffer and Energy of a Wireless Device: Closed and Open Loop Approaches (2006)
Borkar, V. S., Kherani, A. A., Prabhu, B. J.
We consider a decision problem faced by an energy limited wireless device that operates in discrete time. There is some external arrival to the device's transmit buffer. The possible decisions are a)...
A Simulation-Based Algorithm for Ergodic Control of Markov Chains Conditioned on Rare Events (2006)
S. Bhatnagar, V. S. Borkar, A. Madhukar
We study the problem of long-run average cost control of Markov chains conditioned on a rare event. In a related recent work, a simulation based algorithm for estimating performance measures...
Closed and open loop optimal control of buffer and energy of a wireless device (2005)
Abstract—We study a decision problem faced by an energy limited wireless device that operates in discrete time. There is some external arrival to the device’s transmit buffer. The possible...
Closed and Open Loop Optimal Control of Buffer and Energy of a Wireless Device (2005)
V. S. Borkar, A. A. Kherani, B. J. Prabhu
We study a decision problem faced by an energy limited wireless device that operates in discrete time. There is some external arrival to the device's transmit buffer. The possible decisions are:...
Adaptive importance sampling technique for markov chains using stochastic approximation (2004)
Abstract For a discrete-time finite-state Markov chain, we develop an adaptive importance sampling scheme to estimate the expected total cost before hitting a set of terminal states. This scheme...
Variations on a theme by Neyman and Pearson (2004)
V. S. Borkar, S. K. Mitter, S. R. Venkatesh
A symmetric version of the Neyman-Pearson test is developed for discriminating between sets of hypotheses and is extended to encompass a new formulation of the problem of parameter estimation based...
Dynamic cesaro-wardrop equilibration in networks (2003)
We analyze a routing scheme for a broad class of networks which converges (in the Cesaro sense) with probability one to the set of approximate Cesaro-Wardrop equilibria, an extension of the notion of...
Dynamic cesaro-wardrop equilibration in networks (2003)
We propose and analyze a routing scheme for a broad class of networks which converges (in the Cesaro sense) with probability one to the set of approximate Cesaro-Wardrop equilibria, an extension of...
Dynamic cesaro-wardrop equilibration in networks (2003)
We propose and analyze a routing scheme for a broad class of networks which converges (in the Cesaro sense) with probability one to the set of approximate Cesaro-Wardrop equilibria, an extension of...
Dynamic cesaro-wardrop equilibration in networks (2003)
We analyze a routing scheme for a broad class of networks which converges (in the Cesaro sense) with probability one to the set of approximate Cesaro-Wardrop equilibria, an extension of the notion of...
Improved Temporal Difference Methods with Linear Function Approximation (2003)
D. P. Bertsekas, V. S. Borkar, A. Nedić
by
The O.D.E. Method for Convergence of Stochastic Approximation and Reinforcement Learning (1999)
It is shown here that stability of the stochastic approximation algorithm is implied by the asymptotic stability of the origin for an associated o.d.e. This in turn implies convergence of the...
Risk Sensitive Optimal Control: Existence and Synthesis for Models with Unbounded Cost (1999)
The existence of an optimal feedback law is established for the risk sensitive optimal control problem with denumerable state space and unbounded cost. It is found that a solution can be found...
Learning Algorithms For Markov Decision Processes With Average Cost (1998)
J. Abounadi, D. Bertsekas, V. S. Borkar
This paper gives the first rigorous convergence analysis of analogs of Watkins' Q-learning algorithm, applied to average cost control of finite-state Markov chains. We discuss two algorithms...
Optimal Sequential Vector Quantization of Markov Sources (1997)
Borkar V. S, Mitter S. K, Tatikonda S, V. S. Borkar, Sanjoy K. Mittert, Sekhar Tatikonda
for publication to IEEE Transactions on Information Theory,
Mathematical Programming Embeddings of Logic (1996)
Borkar V. S, Chandru V, Micciancio D, Mitter S. K, Vivek S. Borkar, Vijay Chandru, ...
Serious studies on spatial embeddings of logic were initiated by Robert Jeroslow (cf. [16]) a lit-
REINFORCEMENT LEARNING IN MARKOVIAN EVOLUTIONARY GAMES
A population of agents plays a stochastic dynamic game wherein there is an underlying state process with a Markovian dynamics that also affects their costs. A learning mechanism is proposed which...
On De Finetti coherence and Kolmogorov probability
Borkar, V. S., Konda, V. R., Mitter, S. K.
This article addresses the problem of existence of a countably additive probability measure in the sense of Kolmogorov that is consistent with a probability assignment to a family of sets which is...