BROWSE

Related Scientist

cnir's photo.

cnir
뇌과학이미징연구단
more info

ITEM VIEW & DOWNLOAD

The role of state uncertainty in the dynamics of dopamine

DC Field Value Language
dc.contributor.authorMikhael, John G.-
dc.contributor.authorHyungGoo R. Kim-
dc.contributor.authorUchida, Naoshige-
dc.contributor.authorGershman, Samuel J.-
dc.date.accessioned2022-03-21T07:50:04Z-
dc.date.available2022-03-21T07:50:04Z-
dc.date.created2022-03-02-
dc.date.issued2022-03-
dc.identifier.issn0960-9822-
dc.identifier.urihttps://pr.ibs.re.kr/handle/8788114/11296-
dc.description.abstract© 2022 Elsevier Inc.Reinforcement learning models of the basal ganglia map the phasic dopamine signal to reward prediction errors (RPEs). Conventional models assert that, when a stimulus predicts a reward with fixed delay, dopamine activity during the delay should converge to baseline through learning. However, recent studies have found that dopamine ramps up before reward in certain conditions even after learning, thus challenging the conventional models. In this work, we show that sensory feedback causes an unbiased learner to produce RPE ramps. Our model predicts that when feedback gradually decreases during a trial, dopamine activity should resemble a “bump,” whose ramp-up phase should, furthermore, be greater than that of conditions where the feedback stays high. We trained mice on a virtual navigation task with varying brightness, and both predictions were empirically observed. In sum, our theoretical and experimental results reconcile the seemingly conflicting data on dopamine behaviors under the RPE hypothesis.-
dc.language영어-
dc.publisherCell Press-
dc.titleThe role of state uncertainty in the dynamics of dopamine-
dc.typeArticle-
dc.type.rimsART-
dc.identifier.wosid000775461000002-
dc.identifier.scopusid2-s2.0-85124757296-
dc.identifier.rimsid77765-
dc.contributor.affiliatedAuthorHyungGoo R. Kim-
dc.identifier.doi10.1016/j.cub.2022.01.025-
dc.identifier.bibliographicCitationCurrent Biology, v.32, no.5, pp.1077 - 1087-
dc.relation.isPartOfCurrent Biology-
dc.citation.titleCurrent Biology-
dc.citation.volume32-
dc.citation.number5-
dc.citation.startPage1077-
dc.citation.endPage1087-
dc.type.docTypeArticle-
dc.description.journalClass1-
dc.description.journalClass1-
dc.description.isOpenAccessN-
dc.description.journalRegisteredClassscie-
dc.description.journalRegisteredClassscopus-
dc.relation.journalResearchAreaBiochemistry & Molecular Biology-
dc.relation.journalResearchAreaLife Sciences & Biomedicine - Other Topics-
dc.relation.journalResearchAreaCell Biology-
dc.relation.journalWebOfScienceCategoryBiochemistry & Molecular Biology-
dc.relation.journalWebOfScienceCategoryBiology-
dc.relation.journalWebOfScienceCategoryCell Biology-
dc.subject.keywordPlusREWARD-PREDICTION ERRORS-
dc.subject.keywordPlusMIDBRAIN DOPAMINE-
dc.subject.keywordPlusNEURONS-
dc.subject.keywordPlusSIGNALS-
dc.subject.keywordPlusTIME-
dc.subject.keywordPlusREPRESENTATION-
dc.subject.keywordPlusBISECTION-
dc.subject.keywordPlusFRAMEWORK-
dc.subject.keywordPlusRESPONSES-
dc.subject.keywordPlusSTRIATUM-
dc.subject.keywordAuthorstate value-
dc.subject.keywordAuthorbumps-
dc.subject.keywordAuthordopamine-
dc.subject.keywordAuthorramps-
dc.subject.keywordAuthorreinforcement learning-
dc.subject.keywordAuthorreward prediction error-
dc.subject.keywordAuthorsensory feedback-
dc.subject.keywordAuthorstate uncertainty-
Appears in Collections:
Center for Neuroscience Imaging Research (뇌과학 이미징 연구단) > 1. Journal Papers (저널논문)
Files in This Item:
There are no files associated with this item.

qrcode

  • facebook

    twitter

  • Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.
해당 아이템을 이메일로 공유하기 원하시면 인증을 거치시기 바랍니다.

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Browse