First Iteration Policies for Admission Control in Multiaccess Networks

Conference: European Wireless 2013 - 19th European Wireless Conference
04/16/2013 - 04/18/2013 at Guildford, UK

Proceedings: European Wireless 2013

Pages: 6Language: englishTyp: PDF

Personal VDE Members are entitled to a 10% discount on this title

Authors:
Pacheco-Paramo, Diego; Martinez-Bauset, Jorge; Pla, Vicent; Bernal-Mor, Elena (Universitat Politècnica de València, Camino de Vera s/n, 46022, Valencia, Spain)

Abstract:
This work explores approximate methods to solve Markov decision processes for large systems through Policy iteration. Two methods, one using an embedded discrete time Markov chain and the other using time scale separation, are defined and compared with the solution obtained using traditional Policy iteration. First step solutions are found and compared for a radio resource management problem with two radio access technologies and two service types. The approaches proposed considerably reduce the computational cost while closely approximate the optimal solution. The solutions are extended by increasing the number of steps of policy iteration and results show that it is possible to reach the performance of the optimal policy when several steps are required reducing the computational cost.