DC FieldValueLanguage
dc.contributor.authorKalušev, Vladimiren_US
dc.contributor.authorPopović, Branislaven_US
dc.contributor.authorJanev, Markoen_US
dc.contributor.authorBrkljač, Brankoen_US
dc.contributor.authorRalević, Nebojšaen_US
dc.date.accessioned2023-08-18T09:19:08Z-
dc.date.available2023-08-18T09:19:08Z-
dc.date.issued2023-
dc.identifier.issn2075-1680-
dc.identifier.urihttp://researchrepository.mi.sanu.ac.rs/handle/123456789/5138-
dc.description.abstractA novel similarity measure between Gaussian mixture models (GMMs), based on similarities between the low-dimensional representations of individual GMM components and obtained using deep autoencoder architectures, is proposed in this paper. Two different approaches built upon these architectures are explored and utilized to obtain low-dimensional representations of Gaussian components in GMMs. The first approach relies on a classical autoencoder, utilizing the Euclidean norm cost function. Vectorized upper-diagonal symmetric positive definite (SPD) matrices corresponding to Gaussian components in particular GMMs are used as inputs to the autoencoder. Low-dimensional Euclidean vectors obtained from the autoencoder’s middle layer are then used to calculate distances among the original GMMs. The second approach relies on a deep convolutional neural network (CNN) autoencoder, using SPD representatives to generate embeddings corresponding to multivariate GMM components given as inputs. As the autoencoder training cost function, the Frobenious norm between the input and output layers of such network is used and combined with regularizer terms in the form of various pieces of information, as well as the Riemannian manifold-based distances between SPD representatives corresponding to the computed autoencoder feature maps. This is performed assuming that the underlying probability density functions (PDFs) of feature-map observations are multivariate Gaussians. By employing the proposed method, a significantly better trade-off between the recognition accuracy and the computational complexity is achieved when compared with other measures calculating distances among the SPD representatives of the original Gaussian components. The proposed method is much more efficient in machine learning tasks employing GMMs and operating on large datasets that require a large overall number of Gaussian components.en_US
dc.publisherMDPIen_US
dc.relationThis research was supported by the Serbian Ministry of Education, Science and Technological Development through project no. 45103-68 / 2020-14 / 200156: “Innovative Scientific and Artistic Research from the Faculty of Technical Sciences Activity Domain"en_US
dc.relationInternal project of the Faculty of Technical Sciences in 2023: “Research aimed at improving the teaching process and development of scientific and professional areas of the Department of Power, Electronic and Telecommunication engineering“en_US
dc.relation.ispartofAxiomsen_US
dc.rightsAttribution 4.0 International*
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/*
dc.subjectautoencoders | classification | Gaussian mixture models | KL divergence | machine learningen_US
dc.titleMeasure of Similarity between GMMs Based on Autoencoder-Generated Gaussian Component Representationsen_US
dc.typeArticleen_US
dc.identifier.doi10.3390/axioms12060535-
dc.identifier.scopus2-s2.0-85163662359-
dc.contributor.affiliationMechanicsen_US
dc.contributor.affiliationMathematical Institute of the Serbian Academy of Sciences and Artsen_US
dc.relation.firstpage535-
dc.relation.issue6-
dc.relation.volume12-
dc.description.rank~M21-
item.cerifentitytypePublications-
item.openairetypeArticle-
item.grantfulltextopen-
item.openairecristypehttp://purl.org/coar/resource_type/c_18cf-
item.fulltextWith Fulltext-
crisitem.author.orcid0000-0003-3246-4988-
Files in This Item:
File Description SizeFormat
MJanev.pdf612.34 kBAdobe PDFView/Open
Show simple item record

Page view(s)

27
checked on May 9, 2024

Download(s)

9
checked on May 9, 2024

Google ScholarTM

Check

Altmetric

Altmetric


This item is licensed under a Creative Commons License Creative Commons