Semi-Analytical Solution for Rate Distortion Function and OPTAfor Sources with Arbitrary Distribution
Conference: SCC'10 - 8th International ITG Conference on Source and Channel Coding
01/18/2010 - 01/21/2010 at Siegen, Germany
Pages: 5Language: englishTyp: PDFPersonal VDE Members are entitled to a 10% discount on this title
Rüngeler, Matthias; Schotsch, Birgit; Vary, Peter (Institute of Communication Systems and Data Processing, RWTH Aachen University, Germany)
The rate distortion function is a widely used theoretical bound which describes the minimum mean square error (MMSE) distortion for a given number of quantization bits when quantizing a scalar random variable. An analytical solution for this function is only available for a small number of probability density functions (pdf), such as the Gaussian pdf. For arbitrary pdfs, the Blahut-Arimoto algorithm needs to be applied to iteratively estimate the rate distortion function. We propose a novel (semi-)analytical and non-iterative method to calculate the rate distortion function for sources with arbitrary pdfs. This method is based on the Guoâ€“Shamaiâ€“VerdÃº (GSV) theorem. Furthermore, it is possible to apply the proposed method for calculating the Optimum Performance Theoretically Attainable (OPTA) for arbitrarily distributed input symbols observed through an AWGN channel.