Coherent chaos in a recurrent neural network with structured connectivity.

We present a simple model for coherent, spatially correlated chaos in a recurrent neural network. Networks of randomly connected neurons exhibit chaotic fluctuations and have been studied as a model for capturing the temporal variability of cortical activity. The dynamics generated by such networks,...

Full description

Bibliographic Details
Main Authors: Itamar Daniel Landau, Haim Sompolinsky
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2018-12-01
Series:PLoS Computational Biology
Online Access:https://doi.org/10.1371/journal.pcbi.1006309
id doaj-870e224ca3d9465dbc9bca68f421003c
record_format Article
spelling doaj-870e224ca3d9465dbc9bca68f421003c2021-04-21T15:12:21ZengPublic Library of Science (PLoS)PLoS Computational Biology1553-734X1553-73582018-12-011412e100630910.1371/journal.pcbi.1006309Coherent chaos in a recurrent neural network with structured connectivity.Itamar Daniel LandauHaim SompolinskyWe present a simple model for coherent, spatially correlated chaos in a recurrent neural network. Networks of randomly connected neurons exhibit chaotic fluctuations and have been studied as a model for capturing the temporal variability of cortical activity. The dynamics generated by such networks, however, are spatially uncorrelated and do not generate coherent fluctuations, which are commonly observed across spatial scales of the neocortex. In our model we introduce a structured component of connectivity, in addition to random connections, which effectively embeds a feedforward structure via unidirectional coupling between a pair of orthogonal modes. Local fluctuations driven by the random connectivity are summed by an output mode and drive coherent activity along an input mode. The orthogonality between input and output mode preserves chaotic fluctuations by preventing feedback loops. In the regime of weak structured connectivity we apply a perturbative approach to solve the dynamic mean-field equations, showing that in this regime coherent fluctuations are driven passively by the chaos of local residual fluctuations. When we introduce a row balance constraint on the random connectivity, stronger structured connectivity puts the network in a distinct dynamical regime of self-tuned coherent chaos. In this regime the coherent component of the dynamics self-adjusts intermittently to yield periods of slow, highly coherent chaos. The dynamics display longer time-scales and switching-like activity. We show how in this regime the dynamics depend qualitatively on the particular realization of the connectivity matrix: a complex leading eigenvalue can yield coherent oscillatory chaos while a real leading eigenvalue can yield chaos with broken symmetry. The level of coherence grows with increasing strength of structured connectivity until the dynamics are almost entirely constrained to a single spatial mode. We examine the effects of network-size scaling and show that these results are not finite-size effects. Finally, we show that in the regime of weak structured connectivity, coherent chaos emerges also for a generalized structured connectivity with multiple input-output modes.https://doi.org/10.1371/journal.pcbi.1006309
collection DOAJ
language English
format Article
sources DOAJ
author Itamar Daniel Landau
Haim Sompolinsky
spellingShingle Itamar Daniel Landau
Haim Sompolinsky
Coherent chaos in a recurrent neural network with structured connectivity.
PLoS Computational Biology
author_facet Itamar Daniel Landau
Haim Sompolinsky
author_sort Itamar Daniel Landau
title Coherent chaos in a recurrent neural network with structured connectivity.
title_short Coherent chaos in a recurrent neural network with structured connectivity.
title_full Coherent chaos in a recurrent neural network with structured connectivity.
title_fullStr Coherent chaos in a recurrent neural network with structured connectivity.
title_full_unstemmed Coherent chaos in a recurrent neural network with structured connectivity.
title_sort coherent chaos in a recurrent neural network with structured connectivity.
publisher Public Library of Science (PLoS)
series PLoS Computational Biology
issn 1553-734X
1553-7358
publishDate 2018-12-01
description We present a simple model for coherent, spatially correlated chaos in a recurrent neural network. Networks of randomly connected neurons exhibit chaotic fluctuations and have been studied as a model for capturing the temporal variability of cortical activity. The dynamics generated by such networks, however, are spatially uncorrelated and do not generate coherent fluctuations, which are commonly observed across spatial scales of the neocortex. In our model we introduce a structured component of connectivity, in addition to random connections, which effectively embeds a feedforward structure via unidirectional coupling between a pair of orthogonal modes. Local fluctuations driven by the random connectivity are summed by an output mode and drive coherent activity along an input mode. The orthogonality between input and output mode preserves chaotic fluctuations by preventing feedback loops. In the regime of weak structured connectivity we apply a perturbative approach to solve the dynamic mean-field equations, showing that in this regime coherent fluctuations are driven passively by the chaos of local residual fluctuations. When we introduce a row balance constraint on the random connectivity, stronger structured connectivity puts the network in a distinct dynamical regime of self-tuned coherent chaos. In this regime the coherent component of the dynamics self-adjusts intermittently to yield periods of slow, highly coherent chaos. The dynamics display longer time-scales and switching-like activity. We show how in this regime the dynamics depend qualitatively on the particular realization of the connectivity matrix: a complex leading eigenvalue can yield coherent oscillatory chaos while a real leading eigenvalue can yield chaos with broken symmetry. The level of coherence grows with increasing strength of structured connectivity until the dynamics are almost entirely constrained to a single spatial mode. We examine the effects of network-size scaling and show that these results are not finite-size effects. Finally, we show that in the regime of weak structured connectivity, coherent chaos emerges also for a generalized structured connectivity with multiple input-output modes.
url https://doi.org/10.1371/journal.pcbi.1006309
work_keys_str_mv AT itamardaniellandau coherentchaosinarecurrentneuralnetworkwithstructuredconnectivity
AT haimsompolinsky coherentchaosinarecurrentneuralnetworkwithstructuredconnectivity
_version_ 1714667665690198016