guest ::
| Home > Publications database > Distinct plasticity mechanisms in the basal ganglia and their functional role in reinforcement learning > print |
| Home > Publications database > Distinct plasticity mechanisms in the basal ganglia and their functional role in reinforcement learning > print |
| 001 | 186281 | ||
| 005 | 20240313094953.0 | ||
| 037 | _ | _ | |a FZJ-2015-00365 |
| 100 | 1 | _ | |a Jitsev, Jenia |0 P:(DE-Juel1)158080 |b 0 |e Corresponding Author |u fzj |
| 111 | 2 | _ | |a 9th European Forum of Neuroscience |g FENS 2014 |c Milano |d 2014-07-05 - 2014-07-09 |w Italy |
| 245 | _ | _ | |a Distinct plasticity mechanisms in the basal ganglia and their functional role in reinforcement learning |
| 260 | _ | _ | |c 2014 |
| 336 | 7 | _ | |a Conference Paper |0 33 |2 EndNote |
| 336 | 7 | _ | |a Other |2 DataCite |
| 336 | 7 | _ | |a INPROCEEDINGS |2 BibTeX |
| 336 | 7 | _ | |a conferenceObject |2 DRIVER |
| 336 | 7 | _ | |a LECTURE_SPEECH |2 ORCID |
| 336 | 7 | _ | |a Conference Presentation |b conf |m conf |0 PUB:(DE-HGF)6 |s 1489584633_27798 |2 PUB:(DE-HGF) |x After Call |
| 520 | _ | _ | |a Aiming towards a minimal realistic circuitry model of learning from both appetitive and aversive outcomes, we implemented a spiking actor-critic network model of the basal ganglia that incorporates different plasticity mechanisms and segregates both the dorsal and ventral striatum into populations of D1 and D2 medium spiny neurons (MSNs). This segregation allows explicit, separate representation of both positive and negative expected outcome of a given environmental state by the respective population of D1 or D2 MSNs that we hypothesize to reside in the shell region of Nucleus Accumbens. Based on experimental evidence, D1 and D2 MSN populations were assumed to have distinct, opposing dopamine-modulated bidirectional synaptic plasticity.We implemented the network in the NEST simulator and performed experiments involving the application of delayed reward and punishment in a grid world setting, in which a moving agent must reach a goal state while maximizing the total reward obtained. We demonstrate that the network can learn both to approach the delayed positive reward and to consequently avoid punishment. The model highlights thus the functional role of D1/D2 MSN segregation within the striatum in implementing appropriate temporal difference(TD)-like learning from both reward and punishment and explains necessity for opponent direction of DA-dependent plasticity found at synapses converging on distinct striatal MSN types. The approach can be further extended to study how abnormal D1/D2 plasticity may lead to a reorganization of the basal ganglia network towards pathological, dysfunctional states, like for instance those observed in Parkinson disease under condition of progressive dopamine depletion. |
| 536 | _ | _ | |a 331 - Signalling Pathways and Mechanisms in the Nervous System (POF2-331) |0 G:(DE-HGF)POF2-331 |c POF2-331 |f POF II |x 0 |
| 536 | _ | _ | |a 89572 - (Dys-)function and Plasticity (POF2-89572) |0 G:(DE-HGF)POF2-89572 |c POF2-89572 |f POF II T |x 1 |
| 536 | _ | _ | |a SMHB - Supercomputing and Modelling for the Human Brain (HGF-SMHB-2013-2017) |0 G:(DE-Juel1)HGF-SMHB-2013-2017 |c HGF-SMHB-2013-2017 |f SMHB |x 2 |
| 536 | _ | _ | |a RL-BRD-J - Neural network mechanisms of reinforcement learning (BMBF-01GQ1343) |0 G:(DE-Juel1)BMBF-01GQ1343 |c BMBF-01GQ1343 |x 3 |
| 536 | _ | _ | |a W2Morrison - W2/W3 Professorinnen Programm der Helmholtzgemeinschaft (B1175.01.12) |0 G:(DE-HGF)B1175.01.12 |c B1175.01.12 |x 4 |
| 700 | 1 | _ | |a Tittgemeyer, Marc |0 P:(DE-HGF)0 |b 1 |
| 700 | 1 | _ | |a Morrison, Abigail |0 P:(DE-Juel1)151166 |b 2 |u fzj |
| 773 | _ | _ | |y 2014 |
| 856 | 4 | _ | |u http://fens2014.meetingxpert.net/FENS_427/poster_102760/program.aspx/anchor102760 |
| 909 | C | O | |o oai:juser.fz-juelich.de:186281 |p VDB |
| 910 | 1 | _ | |a Forschungszentrum Jülich GmbH |0 I:(DE-588b)5008462-8 |k FZJ |b 0 |6 P:(DE-Juel1)158080 |
| 910 | 1 | _ | |a Forschungszentrum Jülich GmbH |0 I:(DE-588b)5008462-8 |k FZJ |b 2 |6 P:(DE-Juel1)151166 |
| 913 | 2 | _ | |a DE-HGF |b Key Technologies |l Decoding the Human Brain |1 G:(DE-HGF)POF3-570 |0 G:(DE-HGF)POF3-572 |2 G:(DE-HGF)POF3-500 |v (Dys-)function and Plasticity |x 0 |
| 913 | 1 | _ | |a DE-HGF |b Gesundheit |l Funktion und Dysfunktion des Nervensystems |1 G:(DE-HGF)POF2-330 |0 G:(DE-HGF)POF2-331 |2 G:(DE-HGF)POF2-300 |v Signalling Pathways and Mechanisms in the Nervous System |x 0 |4 G:(DE-HGF)POF |3 G:(DE-HGF)POF2 |
| 913 | 1 | _ | |a DE-HGF |0 G:(DE-HGF)POF2-89572 |v (Dys-)function and Plasticity |x 1 |4 G:(DE-HGF)POF |1 G:(DE-HGF)POF3-890 |3 G:(DE-HGF)POF3 |2 G:(DE-HGF)POF3-800 |b Programmungebundene Forschung |l ohne Programm |
| 914 | 1 | _ | |y 2014 |
| 920 | _ | _ | |l yes |
| 920 | 1 | _ | |0 I:(DE-Juel1)INM-6-20090406 |k INM-6 |l Computational and Systems Neuroscience |x 0 |
| 920 | 1 | _ | |0 I:(DE-Juel1)IAS-6-20130828 |k IAS-6 |l Theoretical Neuroscience |x 1 |
| 980 | _ | _ | |a conf |
| 980 | _ | _ | |a VDB |
| 980 | _ | _ | |a I:(DE-Juel1)INM-6-20090406 |
| 980 | _ | _ | |a I:(DE-Juel1)IAS-6-20130828 |
| 980 | _ | _ | |a UNRESTRICTED |
| 981 | _ | _ | |a I:(DE-Juel1)IAS-6-20130828 |
| 981 | _ | _ | |a I:(DE-Juel1)IAS-6-20130828 |
| Library | Collection | CLSMajor | CLSMinor | Language | Author |
|---|