A new approach to parameter estimation of mixture of two normal distributions
- 17 May 2022
- journal article
- research article
- Published by Taylor & Francis Ltd in Communications in Statistics - Simulation and Computation
- Vol. 53 (3), 1161-1187
- https://doi.org/10.1080/03610918.2022.2033776
Abstract
Mixtures of two-component normal distributions (MixN) have various applications in statistical inference with flexibility in density fitting. The best estimation of the five model parameters still represents a challenge. This article proposes more accurate density fittings given a random sample in both the moment-based and likelihood-based estimation frameworks. Motivated by the excellent performance of the Quasi-Monte Carlo method in quantile estimations, we propose an innovative approach to improve the accuracy of parameter estimations by reinforcing the representativeness of observed data via the distribution-free Harrell-Davis quantile estimators. The revision on the penalized maximum likelihood method is also considered due to the unpleasant properties of the original likelihood function under MixN. The bootstrap bias-corrected moment estimators are given as another revision. A sequential algorithm for optimization (SNTO) is conducted in finding numerical solutions for the two types of parameter estimation methods. SNTO is more adapted to MixN and shows strong advantages in the likelihood-based estimation compared to the famous EM algorithm. Simulation results show that our proposed approach can effectively improve estimation accuracy and increase resistance to small sample sizes and/or high percent overlaps between two mixture components. A real data example is given to illustrate the efficiency of our proposed methods.Keywords
This publication has 34 references indexed in Scilit:
- A two-stage mechanism for registration and classification of ECG using Gaussian mixture modelPattern Recognition, 2009
- A study of Gaussian mixture models of color and texture features for image classification and segmentationPattern Recognition, 2006
- Penalized Maximum Likelihood Estimator for Normal MixturesScandinavian Journal of Statistics, 2003
- The overlapping coefficient as a measure of agreement between probability distributions and point estimation of the overlap of two normal densitiesCommunications in Statistics - Theory and Methods, 1989
- Mixture Models, Outliers, and the EM AlgorithmTechnometrics, 1980
- On mle of the parameters of a mixture of two normal distributions when the sample size is smallCommunications in Statistics, 1973
- Some Comparisons of the Method of Moments and the Method of Maximum Likelihood in Estimating Parameters of a Mixture of Two Normal DensitiesJournal of the American Statistical Association, 1972
- Estimation in Mixtures of Two Normal DistributionsTechnometrics, 1967
- Estimation of Parameters for a Mixture of Normal DistributionsTechnometrics, 1966
- Identifiability of Finite MixturesThe Annals of Mathematical Statistics, 1963