Computation noise promotes zero-shot adaptation to uncertainty during decision-making in artificial neural networks.
Journal
Science advances
ISSN: 2375-2548
Titre abrégé: Sci Adv
Pays: United States
ID NLM: 101653440
Informations de publication
Date de publication:
Nov 2024
Nov 2024
Historique:
medline:
30
10
2024
pubmed:
30
10
2024
entrez:
30
10
2024
Statut:
ppublish
Résumé
Random noise in information processing systems is widely seen as detrimental to function. But despite the large trial-to-trial variability of neural activity, humans show a remarkable adaptability to conditions with uncertainty during goal-directed behavior. The origin of this cognitive ability, constitutive of general intelligence, remains elusive. Here, we show that moderate levels of computation noise in artificial neural networks promote zero-shot generalization for decision-making under uncertainty. Unlike networks featuring noise-free computations, but like human participants tested on similar decision problems (ranging from probabilistic reasoning to reversal learning), noisy networks exhibit behavioral hallmarks of optimal inference in uncertain conditions entirely unseen during training. Computation noise enables this cognitive ability jointly through "structural" regularization of network weights during training and "functional" regularization by shaping the stochastic dynamics of network activity after training. Together, these findings indicate that human cognition may ride on neural variability to support adaptive decisions under uncertainty without extensive experience or engineered sophistication.
Identifiants
pubmed: 39475619
doi: 10.1126/sciadv.adl3931
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM