Edmondson, L.R., Jimenez-Rodriguez, A. and Saal, H.P. orcid.org/0000-0002-7544-0196 (2019) Nonlinear scaling of resource allocation in sensory bottlenecks. In: Advances in Neural Information Processing Systems 32 (NIPS 2019). 33rd Conference on Neural Information Processing Systems, 08 Dec - 14 Nov 2019, Vancouver, Canada. Neural Information Processing Systems Foundation, Inc.
Abstract
In many sensory systems, information transmission is constrained by a bottleneck, where the number of output neurons is vastly smaller than the number of input neurons. Efficient coding theory predicts that in these scenarios the brain should allocate its limited resources by removing redundant information. Previous work has typically assumed that receptors are uniformly distributed across the sensory sheet, when in reality these vary in density, often by an order of magnitude. How, then, should the brain efficiently allocate output neurons when the density of input neurons is nonuniform? Here, we show analytically and numerically that resource allocation scales nonlinearly in efficient coding models that maximize information transfer, when inputs arise from separate regions with different receptor densities. Importantly, the proportion of output neurons allocated to a given input region changes depending on the width of the bottleneck, and thus cannot be predicted from input density or region size alone. Narrow bottlenecks favor magnification of high density input regions, while wider bottlenecks often cause contraction. Our results demonstrate that both expansion and contraction of sensory input regions can arise in efficient coding models and that the final allocation crucially depends on the neural resources made available.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2019 Neural Information Processing Systems Foundation, Inc. |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Science (Sheffield) > Department of Psychology (Sheffield) The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
Funding Information: | Funder Grant number Wellcome Trust (The) 209998/Z/17/Z |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 28 Nov 2019 12:14 |
Last Modified: | 28 Nov 2019 12:14 |
Published Version: | https://papers.nips.cc/paper/8972-nonlinear-scalin... |
Status: | Published online |
Publisher: | Neural Information Processing Systems Foundation, Inc. |
Refereed: | Yes |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:153128 |
Download
Filename: Edmondson_NeurIPS19.pdf
