Near lossless data compression onboard a hyperspectral satellite
- 20 November 2006
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Aerospace and Electronic Systems
- Vol. 42 (3), 851-866
- https://doi.org/10.1109/taes.2006.248183
Abstract
To deal with the large volume of data produced by hyperspectral sensors, the Canadian Space Agency (CSA) has developed and patented two near lossless data compression algorithms for use onboard a hyperspectral satellite: successive approximation multi-stage vector quantization (SAMVQ) and hierarchical self-organizing cluster vector quantization (HSOCVQ). This paper describes the two compression algorithms and demonstrates their near lossless feature. The compression error introduced by the two compression algorithms was compared with the intrinsic noise of the original data that is caused by the instrument noise and other noise sources such as calibration and atmospheric correction errors. The experimental results showed that the compression error was not larger than the intrinsic noise of the original data when a test data set was compressed at a compression ratio of 20:1. The overall noise in the reconstructed data that contains both the intrinsic noise and the compression error is even smaller than the intrinsic noise when the data is compressed using SAMVQ. A multi-disciplinary user acceptability study has been carried out in order to evaluate the impact of the two compression algorithms on hyperspectral data applications. This paper briefly summarizes the evaluation results of the user acceptability study. A prototype hardware compressor that implements the two compression algorithms has been built using field programmable gate arrays (FPGAs) and benchmarked. The compression ratio and fidelity achieved by the hardware compressor are similar to those obtained by software simulationKeywords
This publication has 31 references indexed in Scilit:
- Optimized Onboard Lossless and Near-Lossless Compression of Hyperspectral Data Using CALICIEEE Geoscience and Remote Sensing Letters, 2004
- Quantitative evaluation of hyperspectral data compressed by near lossless onboard compression techniquesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- ADPCM for advanced LANDSAT downlink applicationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Near-lossless compression of 3-D optical dataIEEE Transactions on Geoscience and Remote Sensing, 2001
- Efficient spatial-spectral compression of hyperspectral dataIEEE Transactions on Geoscience and Remote Sensing, 2001
- L/sub ∞/ constrained high-fidelity image compression via adaptive context modelingIEEE Transactions on Image Processing, 2000
- Lossy compression of hyperspectral data using vector quantizationRemote Sensing of Environment, 1997
- Filtering random noise from deterministic signals via data compressionIEEE Transactions on Signal Processing, 1995
- Near-lossless compression of medical images through entropy-coded DPCMIEEE Transactions on Medical Imaging, 1994
- Vector Quantization and Signal CompressionPublished by Springer Science and Business Media LLC ,1992