Gaussian mixture model with local consistency: a hierarchical minimum message length-based approach

• Impact Factor:4.5
• DOI number:10.1007/s13042-023-01910-w
• Affiliation of Author(s):西南交通大学
• Journal:International Journal of Machine Learning and Cybernetics
• Place of Publication:GERMANY
• Key Words:Gaussian mixture models; Minimum message length criterion; Hierarchical structure; Covariance matrix; Graph Laplacian
• Abstract:Gaussian mixture model (GMM) is widely used in many domains, e.g. data mining. The unsupervised learning of the finite mixture (ULFM) model based on the minimum message length (MML) criterion for mixtures enables adaptive model selection and parameter estimates. However, some datasets have a hierarchical structure. If the MML criterion does not consider the hierarchical structure of the a priori, the a priori coding length in the criterion is inaccurate. It is difficult to achieve a good trade-off between the model’s complexity and its goodness of fitting. Therefore, a locally consistent GMM with the hierarchical MML criterion (GM-HMML) algorithm is proposed. Firstly, the MML criterion determines the mixing probability (annihilation of components). To accurately control the competition between these relative necessary components, a hierarchical MML is proposed. Secondly, the hierarchical MML criterion is regularized using the graph Laplacian. The manifold structure is incorporated into the parameter estimator to avoid possible overfitting problems caused by the fine-grained prior. The presented MML criterion enhances the degree of component annihilation, which not only does not annihilate the necessary components but also reduces the iterations. The proposed approach is testified on the real datasets and achieves good model order and clustering accuracy.
• Co-author:Zeng Yu,Hongjun Wang,Jihong Wan,Tianrui Li
• First Author:Min Li
• Indexed by:SCI
• Correspondence Author:Guoyin Wang
• Discipline:Engineering
• Document Type:J
• Page Number:1-20
• ISSN No.:1868-8071
• Translation or Not:no
• Date of Publication:2023-08-03
• Included Journals:SCI