Equivalence of information production and generalised entropies in complex processes.


Journal

PloS one
ISSN: 1932-6203
Titre abrégé: PLoS One
Pays: United States
ID NLM: 101285081

Informations de publication

Date de publication:
2023
Historique:
received: 08 05 2023
accepted: 15 08 2023
medline: 8 9 2023
pubmed: 6 9 2023
entrez: 6 9 2023
Statut: epublish

Résumé

Complex systems with strong correlations and fat-tailed distribution functions have been argued to be incompatible with the Boltzmann-Gibbs entropy framework and alternatives, so-called generalised entropies, were proposed and studied. Here we show, that this perceived incompatibility is actually a misconception. For a broad class of processes, Boltzmann entropy -the log multiplicity- remains the valid entropy concept. However, for non-i.i.d. processes, Boltzmann entropy is not of Shannon form, -k∑ipi log pi, but takes the shape of generalised entropies. We derive this result for all processes that can be asymptotically mapped to adjoint representations reversibly where processes are i.i.d. In these representations the information production is given by the Shannon entropy. Over the original sampling space this yields functionals identical to generalised entropies. The problem of constructing adequate context-sensitive entropy functionals therefore can be translated into the much simpler problem of finding adjoint representations. The method provides a comprehensive framework for a statistical physics of strongly correlated systems and complex processes.

Identifiants

pubmed: 37672525
doi: 10.1371/journal.pone.0290695
pii: PONE-D-23-14012
pmc: PMC10482297
doi:

Types de publication

Journal Article Research Support, Non-U.S. Gov't

Langues

eng

Sous-ensembles de citation

IM

Pagination

e0290695

Informations de copyright

Copyright: © 2023 Hanel, Thurner. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Déclaration de conflit d'intérêts

The authors have declared that no competing interests exist.

Références

Entropy (Basel). 2018 Nov 01;20(11):
pubmed: 33266562
Int J Neural Syst. 2019 Oct;29(8):1950003
pubmed: 30841769
Phys Rev E Stat Nonlin Soft Matter Phys. 2005 Apr;71(4 Pt 2):046128
pubmed: 15903747
Phys Rev E. 2017 Sep;96(3-1):032124
pubmed: 29346985
Proc Natl Acad Sci U S A. 2005 Oct 25;102(43):15377-82
pubmed: 16230624
Proc Natl Acad Sci U S A. 2014 May 13;111(19):6905-10
pubmed: 24782541
Proc Math Phys Eng Sci. 2013 Oct 8;469(2158):20130408
pubmed: 24101892
Nat Commun. 2021 Feb 18;12(1):1127
pubmed: 33602947
J Chem Phys. 2014 Dec 21;141(23):234903
pubmed: 25527959
Proc Natl Acad Sci U S A. 2015 Apr 28;112(17):5348-53
pubmed: 25870294
J Chem Phys. 2019 Jul 21;151(3):034113
pubmed: 31325924
Phys Rev D Part Fields. 1993 Oct 15;48(8):R3427-R3431
pubmed: 10016675

Auteurs

Rudolf Hanel (R)

Section for Science of Complex Systems, CeMDS, Medical University of Vienna, Vienna, Austria.
Complexity Science Hub Vienna, Vienna, Austria.

Stefan Thurner (S)

Section for Science of Complex Systems, CeMDS, Medical University of Vienna, Vienna, Austria.
Complexity Science Hub Vienna, Vienna, Austria.
Santa Fe Institute, NM, Santa Fe, NM, United States of America.

Articles similaires

Receptor, Cannabinoid, CB1 Ligands Molecular Dynamics Simulation Protein Binding Thermodynamics
Humans Acute Kidney Injury Female Male Retrospective Studies

Comparative assessment of physics-based in silico methods to calculate relative solubilities.

Adiran Garaizar Suarez, Andreas H Göller, Michael E Beck et al.
1.00
Solvents Solubility Quantum Theory Molecular Dynamics Simulation Thermodynamics
1.00
Likelihood Functions Computer Simulation Entropy Models, Statistical Algorithms

Classifications MeSH