Semi-Analytical Solution for Rate Distortion Function and OPTAfor Sources with Arbitrary Distribution
Konferenz: SCC'10 - 8th International ITG Conference on Source and Channel Coding
18.01.2010 - 21.01.2010 in Siegen, Germany
Seiten: 5Sprache: EnglischTyp: PDFPersönliche VDE-Mitglieder erhalten auf diesen Artikel 10% Rabatt
Rüngeler, Matthias; Schotsch, Birgit; Vary, Peter (Institute of Communication Systems and Data Processing, RWTH Aachen University, Germany)
The rate distortion function is a widely used theoretical bound which describes the minimum mean square error (MMSE) distortion for a given number of quantization bits when quantizing a scalar random variable. An analytical solution for this function is only available for a small number of probability density functions (pdf), such as the Gaussian pdf. For arbitrary pdfs, the Blahut-Arimoto algorithm needs to be applied to iteratively estimate the rate distortion function. We propose a novel (semi-)analytical and non-iterative method to calculate the rate distortion function for sources with arbitrary pdfs. This method is based on the Guoâ€“Shamaiâ€“VerdÃº (GSV) theorem. Furthermore, it is possible to apply the proposed method for calculating the Optimum Performance Theoretically Attainable (OPTA) for arbitrarily distributed input symbols observed through an AWGN channel.