Authors: | Ilić, Velimir Stanković, Miomir Todorović, Branimir |
Title: | Entropy message passing | Journal: | IEEE Transactions on Information Theory | Volume: | 57 | Issue: | 1 | First page: | 375 | Last page: | 380 | Issue Date: | 1-Jan-2011 | Rank: | M21a | ISSN: | 0018-9448 | DOI: | 10.1109/TIT.2010.2090235 | Abstract: | The paper proposes a new message passing algorithm for cycle-free factor graphs. The proposed "entropy message passing" (EMP) algorithm may be viewed as sum-product message passing over the entropy semiring, which has previously appeared in automata theory. The primary use of EMP is to compute the entropy of a model. However, EMP can also be used to compute expressions that appear in expectation maximization and in gradient-descent algorithms. |
Keywords: | Commutative semiring | entropy | expectation maximization | factor graphs | gradient methods | graphical models | sum-product message passing | Publisher: | IEEE |
Show full item record
SCOPUSTM
Citations
3
checked on Oct 20, 2024
Page view(s)
8
checked on Oct 20, 2024
Google ScholarTM
Check
Altmetric
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.