Authors: Ilić, Velimir 
Stanković, Miomir
Todorović, Branimir
Title: Entropy message passing
Journal: IEEE Transactions on Information Theory
Volume: 57
Issue: 1
First page: 375
Last page: 380
Issue Date: 1-Jan-2011
Rank: M21a
ISSN: 0018-9448
DOI: 10.1109/TIT.2010.2090235
Abstract: 
The paper proposes a new message passing algorithm for cycle-free factor graphs. The proposed "entropy message passing" (EMP) algorithm may be viewed as sum-product message passing over the entropy semiring, which has previously appeared in automata theory. The primary use of EMP is to compute the entropy of a model. However, EMP can also be used to compute expressions that appear in expectation maximization and in gradient-descent algorithms.
Keywords: Commutative semiring | entropy | expectation maximization | factor graphs | gradient methods | graphical models | sum-product message passing
Publisher: IEEE

Show full item record

SCOPUSTM   
Citations

3
checked on Jul 14, 2024

Page view(s)

49
checked on May 9, 2024

Google ScholarTM

Check

Altmetric

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.