Bias and variance of the Bayesian-mean decoder
Arthur Prat-Carrabin, Michael Woodford
Abstract
Perception, in theoretical neuroscience, has been modeled as the encoding of external stimuli into internal signals, which are then decoded. The Bayesian mean is an important decoder, as it is optimal for purposes of both estimation and discrimination. We present widely-applicable approximations to the bias and to the variance of the Bayesian mean, obtained under the minimal and biologicallyrelevant assumption that the encoding results from a series of independent, though not necessarily identically-distributed, signals. Simulations substantiate the accuracy of our approximations in the small-noise regime. The bias of the Bayesian mean comprises two components: one driven by the prior, and one driven by the precision of the encoding. If the encoding is ‘efficient’, the two components have opposite effects; their relative strengths are determined by the objective that the encoding optimizes. The experimental literature on perception reports both ‘Bayesian’ biases directed towards prior expectations, and opposite, ‘anti-Bayesian’ biases. We show that different tasks are indeed predicted to yield such contradictory biases, under a consistently-optimal encoding-decoding model. Moreover, we recover Wei and Stocker’s “law of human perception” [1], a relation between the bias of the Bayesian mean and the derivative of its variance, and show how the coefficient of proportionality in this law depends on the task at hand. Our results provide a parsimonious theory of optimal perception under constraints, in which encoding and decoding are adapted both to the prior and to the task faced by the observer.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Related papers
- An Information-Theoretic Framework For Optimizing Experimental Design To Distinguish Probabilistic Neural CodesPo-Chen Kuo, Edgar Y. WalkerICLR 2026
- Adaptation Properties Allow Identification of Optimized Neural CodesLuke I. Rast, Jan DrugowitschNeurIPS 2020 · 6 citations
- Inverse decision-making using neural amortized Bayesian actorsDominik Straub, Tobias F. Niehues, Jan Peters, Constantin A. RothkopfICLR 2025
- Impression learning: Online representation learning with synaptic plasticityColin Bredenberg, Benjamin Lyo, Eero P. Simoncelli, Cristina SavinNeurIPS 2021 · 14 citations
- Bias Detection via SignalingYiling Chen, Tao Lin, Ariel D. Procaccia, Aaditya Ramdas et al.NeurIPS 2024 · 1 citation
