BROWSE

Related Scientist

CNIR's photo.

CNIR
뇌과학 이미징 연구단
more info

ITEM VIEW & DOWNLOAD

The role of state uncertainty in the dynamics of dopamine

Cited 0 time in webofscience Cited 0 time in scopus
227 Viewed 0 Downloaded
Title
The role of state uncertainty in the dynamics of dopamine
Author(s)
Mikhael, John G.; HyungGoo R. Kim; Uchida, Naoshige; Gershman, Samuel J.
Publication Date
2022-03
Journal
Current Biology, v.32, no.5, pp.1077 - 1087
Publisher
Cell Press
Abstract
© 2022 Elsevier Inc.Reinforcement learning models of the basal ganglia map the phasic dopamine signal to reward prediction errors (RPEs). Conventional models assert that, when a stimulus predicts a reward with fixed delay, dopamine activity during the delay should converge to baseline through learning. However, recent studies have found that dopamine ramps up before reward in certain conditions even after learning, thus challenging the conventional models. In this work, we show that sensory feedback causes an unbiased learner to produce RPE ramps. Our model predicts that when feedback gradually decreases during a trial, dopamine activity should resemble a “bump,” whose ramp-up phase should, furthermore, be greater than that of conditions where the feedback stays high. We trained mice on a virtual navigation task with varying brightness, and both predictions were empirically observed. In sum, our theoretical and experimental results reconcile the seemingly conflicting data on dopamine behaviors under the RPE hypothesis.
URI
https://pr.ibs.re.kr/handle/8788114/11296
DOI
10.1016/j.cub.2022.01.025
ISSN
0960-9822
Appears in Collections:
Center for Neuroscience Imaging Research (뇌과학 이미징 연구단) > 1. Journal Papers (저널논문)
Files in This Item:
There are no files associated with this item.

qrcode

  • facebook

    twitter

  • Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.
해당 아이템을 이메일로 공유하기 원하시면 인증을 거치시기 바랍니다.

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Browse