First Iteration Policies for Admission Control in Multiaccess Networks

Konferenz: European Wireless 2013 - 19th European Wireless Conference
16.04.2013 - 18.04.2013 in Guildford, UK

Tagungsband: European Wireless 2013

Seiten: 6Sprache: EnglischTyp: PDF

Persönliche VDE-Mitglieder erhalten auf diesen Artikel 10% Rabatt

Pacheco-Paramo, Diego; Martinez-Bauset, Jorge; Pla, Vicent; Bernal-Mor, Elena (Universitat Politècnica de València, Camino de Vera s/n, 46022, Valencia, Spain)

This work explores approximate methods to solve Markov decision processes for large systems through Policy iteration. Two methods, one using an embedded discrete time Markov chain and the other using time scale separation, are defined and compared with the solution obtained using traditional Policy iteration. First step solutions are found and compared for a radio resource management problem with two radio access technologies and two service types. The approaches proposed considerably reduce the computational cost while closely approximate the optimal solution. The solutions are extended by increasing the number of steps of policy iteration and results show that it is possible to reach the performance of the optimal policy when several steps are required reducing the computational cost.