Publications – Details
Semi-Analytical Solutions for Rate Distortion Bounds and OPTA for Sources with Arbitrary Distributions
- Authors:
- Matthias Rüngeler, Birgit Schotsch, and Peter Vary
- Book Title:
- Proceedings of International ITG Conference on Source and Channel Coding (SCC)
- Venue:
- Siegen
- Organization:
- ITG
- Publisher:
- VDE
- Date:
- Jan. 2010
- ISBN:
- 978-3-80073-211-1
- Language:
- English
Abstract
The rate distortion bound is a widely used theoretical bound which describes the minimum mean square error (MMSE) distortion for a given number of quantization bits when quantizing a scalar random variable. An analytical solution for this bound is only available for a small number of probability density functions (pdf), such as the Gaussian pdf. For arbitrary pdfs, the Blahut-Arimoto algorithm [1], [2] needs to be applied to iteratively estimate the rate distortion bound. We propose a novel method to (semi-)analytically calculate the rate distortion bound for sources with arbitrary pdfs. This method is based on the Guo-Shamai-Verdú (GSV) theorem [3]. Furthermore, it is possible to apply the proposed method for calculating the Optimum Performance Theoretically Attainable (OPTA) for arbitrarily distributed input symbols observed through an AWGN channel.
Download of Publication
Copyright Notice
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.
The following notice applies to all IEEE publications:
© IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.