Semi-Analytical Solution for Rate Distortion Function and OPTAfor Sources with Arbitrary Distribution

Conference: SCC'10 - 8th International ITG Conference on Source and Channel Coding
01/18/2010 - 01/21/2010 at Siegen, Germany

Proceedings: SCC'10

Pages: 5Language: englishTyp: PDF

Personal VDE Members are entitled to a 10% discount on this title

Rüngeler, Matthias; Schotsch, Birgit; Vary, Peter (Institute of Communication Systems and Data Processing, RWTH Aachen University, Germany)

The rate distortion function is a widely used theoretical bound which describes the minimum mean square error (MMSE) distortion for a given number of quantization bits when quantizing a scalar random variable. An analytical solution for this function is only available for a small number of probability density functions (pdf), such as the Gaussian pdf. For arbitrary pdfs, the Blahut-Arimoto algorithm needs to be applied to iteratively estimate the rate distortion function. We propose a novel (semi-)analytical and non-iterative method to calculate the rate distortion function for sources with arbitrary pdfs. This method is based on the Guo–Shamai–Verdú (GSV) theorem. Furthermore, it is possible to apply the proposed method for calculating the Optimum Performance Theoretically Attainable (OPTA) for arbitrarily distributed input symbols observed through an AWGN channel.