Equivalence of information production and generalised entropies in complex processes.
Journal
PloS one
ISSN: 1932-6203
Titre abrégé: PLoS One
Pays: United States
ID NLM: 101285081
Informations de publication
Date de publication:
2023
2023
Historique:
received:
08
05
2023
accepted:
15
08
2023
medline:
8
9
2023
pubmed:
6
9
2023
entrez:
6
9
2023
Statut:
epublish
Résumé
Complex systems with strong correlations and fat-tailed distribution functions have been argued to be incompatible with the Boltzmann-Gibbs entropy framework and alternatives, so-called generalised entropies, were proposed and studied. Here we show, that this perceived incompatibility is actually a misconception. For a broad class of processes, Boltzmann entropy -the log multiplicity- remains the valid entropy concept. However, for non-i.i.d. processes, Boltzmann entropy is not of Shannon form, -k∑ipi log pi, but takes the shape of generalised entropies. We derive this result for all processes that can be asymptotically mapped to adjoint representations reversibly where processes are i.i.d. In these representations the information production is given by the Shannon entropy. Over the original sampling space this yields functionals identical to generalised entropies. The problem of constructing adequate context-sensitive entropy functionals therefore can be translated into the much simpler problem of finding adjoint representations. The method provides a comprehensive framework for a statistical physics of strongly correlated systems and complex processes.
Identifiants
pubmed: 37672525
doi: 10.1371/journal.pone.0290695
pii: PONE-D-23-14012
pmc: PMC10482297
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
e0290695Informations de copyright
Copyright: © 2023 Hanel, Thurner. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Déclaration de conflit d'intérêts
The authors have declared that no competing interests exist.
Références
Entropy (Basel). 2018 Nov 01;20(11):
pubmed: 33266562
Int J Neural Syst. 2019 Oct;29(8):1950003
pubmed: 30841769
Phys Rev E Stat Nonlin Soft Matter Phys. 2005 Apr;71(4 Pt 2):046128
pubmed: 15903747
Phys Rev E. 2017 Sep;96(3-1):032124
pubmed: 29346985
Proc Natl Acad Sci U S A. 2005 Oct 25;102(43):15377-82
pubmed: 16230624
Proc Natl Acad Sci U S A. 2014 May 13;111(19):6905-10
pubmed: 24782541
Proc Math Phys Eng Sci. 2013 Oct 8;469(2158):20130408
pubmed: 24101892
Nat Commun. 2021 Feb 18;12(1):1127
pubmed: 33602947
J Chem Phys. 2014 Dec 21;141(23):234903
pubmed: 25527959
Proc Natl Acad Sci U S A. 2015 Apr 28;112(17):5348-53
pubmed: 25870294
J Chem Phys. 2019 Jul 21;151(3):034113
pubmed: 31325924
Phys Rev D Part Fields. 1993 Oct 15;48(8):R3427-R3431
pubmed: 10016675