Distributed Recursive Least-Squares: Stability and Performance Analysis
- 9 April 2012
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 60 (7), 3740-3754
- https://doi.org/10.1109/tsp.2012.2194290
Abstract
The recursive least-squares (RLS) algorithm has well-documented merits for reducing complexity and storage requirements, when it comes to online estimation of stationary signals as well as for tracking slowly-varying nonstationary processes. In this paper, a distributed recursive least-squares (D-RLS) algorithm is developed for cooperative estimation using ad hoc wireless sensor networks. Distributed iterations are obtained by minimizing a separable reformulation of the exponentially-weighted least-squares cost, using the alternating-minimization algorithm. Sensors carry out reduced-complexity tasks locally, and exchange messages with one-hop neighbors to consent on the network-wide estimates adaptively. A steady-state mean-square error (MSE) performance analysis of D-RLS is conducted, by studying a stochastically-driven `averaged' system that approximates the D-RLS dynamics asymptotically in time. For sensor observations that are linearly related to the time-invariant parameter vector sought, the simplifying independence setting assumptions facilitate deriving accurate closed-form expressions for the MSE steady-state values. The problems of mean- and MSE-sense stability of D-RLS are also investigated, and easily-checkable sufficient conditions are derived under which a steady-state is attained. Without resorting to diminishing step-sizes which compromise the tracking ability of D-RLS, stability ensures that per sensor estimates hover inside a ball of finite radius centered at the true parameter vector, with high-probability, even when inter-sensor communication links are noisy. Interestingly, computer simulations demonstrate that the theoretical findings are accurate also in the pragmatic settings whereby sensors acquire temporally-correlated data.Keywords
This publication has 30 references indexed in Scilit:
- Mobile Adaptive NetworksIEEE Journal of Selected Topics in Signal Processing, 2011
- Diffusion Least-Mean Squares With Adaptive Combiners: Formulation and Performance AnalysisIEEE Transactions on Signal Processing, 2010
- Distributed Estimation Over an Adaptive Incremental Network Based on the Affine Projection AlgorithmIEEE Transactions on Signal Processing, 2009
- Distributed Consensus Algorithms in Sensor Networks With Imperfect Communication: Link Failures and Channel NoiseIEEE Transactions on Signal Processing, 2008
- Incremental Adaptive Strategies Over Distributed NetworksIEEE Transactions on Signal Processing, 2007
- Agreement in presence of noise: pseudogradients on random geometric networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Distributed compression-estimation using wireless sensor networksIEEE Signal Processing Magazine, 2006
- Fast linear iterations for distributed averagingSystems & Control Letters, 2004
- A unified approach to the steady-state and tracking analyses of adaptive filtersIEEE Transactions on Signal Processing, 2001
- Applications of a Splitting Algorithm to Decomposition in Convex Programming and Variational InequalitiesSIAM Journal on Control and Optimization, 1991