De Bruijn identities in different Markovian channels
DOI:
https://doi.org/10.58997/ejde.2023.12Abstract
De Bruijn's identity in information theory states that if u is the solution of the heat equation, then the time derivative of the Shannon entropy for this solution is equal to the amount of Fisher information at u. In this article, we show how this identity changes if we replace the heat channel by the Fokker Planck, or passing from Fokker Planck to Ornstein-Uhlenbeck channels. Through these passages we investigate the different properties of these solutions. We exclusively dissect different properties of Ornstein-Uhlenbeck semigroup given by the Mehler formula expression.
For more information see https://ejde.math.txstate.edu/Volumes/2023/12/abstr.html
References
J.-Ph. Bartier, A. Blanchet, J. Dolbeault, M. Escobedo; Improved intermediate asymptotics for the heat equation. Appl. Math. Lett., 24 (2011), 76-81. https://doi.org/10.1016/j.aml.2010.08.020
T. M. Cover, J. A. Thomas. Elements of information theory. Second edition. Wiley-Interscience , Hoboken, NJ, 2006
E. Nelson; The free Markoff field. J. Funct. Anal., 12 (1973), 211-227. https://doi.org/10.1016/0022-1236(73)90025-6
G. Toscani; The fractional Fisher information and the central limit theorem for stable laws. Ric. Mat., 65 (2016), 71-91.
https://doi.org/10.1007/s11587-015-0253-9
A. J. Stam; Some inequalities satisfied by the quantities of information of Fisher and Shannon. Inf. Contr., 2 (1959), 101-112. https://doi.org/10.1016/S0019-9958(59)90348-1
J. Voigt; Stochastic Operators, Information, and Entropy Commun. Math. Phys., 81 (1981) 31-38. https://doi.org/10.1007/BF01941799
A. Wibisono, V. Jog, P-L. Loh; Information and estimation in Fokker-Plank channels. 2017 IEEE Inter. Symp. on Infor. Theory, arXiv 1702.03656v1. https://doi.org/10.1109/ISIT.2017.8007014
Downloads
Published
License
Copyright (c) 2023 Hassan Emamirad, Arnaud Rougirel
This work is licensed under a Creative Commons Attribution 4.0 International License.
