Data compression and harmonic analysis
- 1 October 1998
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 44 (6), 2435-2476
- https://doi.org/10.1109/18.720544
Abstract
In this paper we review some recent interactions between harmonic analysis and data compression. The story goes back of course to Shannon's R(D) theory in the case of Gaussian stationary processes, which says that transforming into a Fourier basis followed by block coding gives an optimal lossy compression technique; practical developments like transform-based image compression have been inspired by this result. In this paper we also discuss connections perhaps less familiar to the information theory community, growing out of the field of harmonic analysis. Recent harmonic analysis constructions, such as wavelet transforms and Gabor transforms, are essentially optimal transforms for transform coding in certain settings. Some of these transforms are under consideration for future compression standards. We discuss some of the lessons of harmonic analysis in this century. Typically, the problems and achievements of this field have involved goals that were not obviously related to practical data compression, and have used a language not immediately accessible to outsiders. Nevertheless, through an extensive generalization of what Shannon called the "sampling theorem", harmonic analysis has succeeded in developing new forms of functional representation which turn out to have significant data compression interpretations. We explain why harmonic analysis has interacted with data compression, and we describe some interesting recent ideas in the field that may affect data compression in the future.Keywords
This publication has 69 references indexed in Scilit:
- Analysis of low bit rate image transform codingIEEE Transactions on Signal Processing, 1998
- CART and best-ortho-basis: a connectionThe Annals of Statistics, 1997
- A new, fast, and efficient image codec based on set partitioning in hierarchical treesIEEE Transactions on Circuits and Systems for Video Technology, 1996
- Embedded image coding using zerotrees of wavelet coefficientsIEEE Transactions on Signal Processing, 1993
- Best wavelet packet bases in a rate-distortion senseIEEE Transactions on Image Processing, 1993
- Rectifiable sets and the Traveling Salesman ProblemInventiones Mathematicae, 1990
- A theory for multiresolution signal decomposition: the wavelet representationIeee Transactions On Pattern Analysis and Machine Intelligence, 1989
- Ondelettes et bases hilbertiennesRevista Matemática Iberoamericana, 1986
- Decomposition of Hardy Functions into Square Integrable Wavelets of Constant ShapeSIAM Journal on Mathematical Analysis, 1984
- Widths and entropyRussian Mathematical Surveys, 1983