Tuning of Prior Covariance in Generalized Least Squares
Open Access
- 1 January 2021
- journal article
- research article
- Published by Scientific Research Publishing, Inc. in Applied Mathematics
- Vol. 12 (03), 157-170
- https://doi.org/10.4236/am.2021.123011
Abstract
Generalized Least Squares (least squares with prior information) requires the correct assignment of two prior covariance matrices: one associated with the uncertainty of measurements; the other with the uncertainty of prior information. These assignments often are very subjective, especially when correlations among data or among prior information are believed to occur. However, in cases in which the general form of these matrices can be anticipated up to a set of poorly-known parameters, the data and prior information may be used to better-determine (or “tune”) the parameters in a manner that is faithful to the underlying Bayesian foundation of GLS. We identify an objective function, the minimization of which leads to the best-estimate of the parameters and provide explicit and computationally-efficient formula for calculating the derivatives needed to implement the minimization with a gradient descent method. Furthermore, the problem is organized so that the minimization need be performed only over the space of covariance parameters, and not over the combined space of model and covariance parameters. We show that the use of trade-off curves to select the relative weight given to observations and prior information is not a form of tuning, because it does not, in general maximize the posterior probability of the model parameters, and can lead to a different weighting than the procedure described here. We also provide several examples that demonstrate the viability, and discuss both the advantages and limitations of the method.Keywords
This publication has 22 references indexed in Scilit:
- Rationale and geophysical evidence for quasi-geostrophic rapid dynamics within the Earth's outer corePhysics of the Earth and Planetary Interiors, 2011
- Radially anisotropic shear velocity structure of the upper mantle globally and beneath North AmericaJournal of Geophysical Research, 2008
- Two ways to quantify uncertainty in geophysical inverse problemsGeophysics, 2006
- Expanded uncertainty quantification in inverse problems: Hierarchical Bayes and empirical BayesGeophysics, 2004
- A practical regularization for seismic tomographyGeophysical Journal International, 1999
- Three‐dimensional inversion of regional P and S arrival times in the East Aleutians and sources of subduction zone gravity highsJournal of Geophysical Research, 1994
- Computing real square roots of a real matrixLinear Algebra and its Applications, 1987
- Generalized nonlinear inverse problems solved using the least squares criterionReviews of Geophysics, 1982
- Algorithm 432 [C2]: Solution of the matrix equation AX + XB = C [F4]Communications of the ACM, 1972
- Theory of Statistical EstimationMathematical Proceedings of the Cambridge Philosophical Society, 1925