English  |  Français 

CO6 course

Lecturers

Tutor

Time & Place

Every Tuesday, 17:00-19:00, Salle Prestige 1 'Ribot', 29, rue d'Ulm

Literature

Textbook: Dayan & Abbott. Theoretical Neuroscience. MIT Press 2001.


1. Quantitative Models of Behavior (Lecturer: Boris Gutkin)

1.1 The Rescorla-Wagner Learning Rule, Boris Gutkin

MathReminder-Lecture1.1


1.2 The Exploration-Exploitation and Reinforcement Learning, Boris Gutkin

Mathreminder-Lecture1.2 (Expectation Values)

1.3 Reinforcement Learning Continued, Boris Gutkin

1.4 Reinforcement Learning Seminar, Boris Gutkin

Homework

1.1 HW1, due March 14 at 17:00
1.2 HW2, due March 21 at 17:00.

Solutions

1.1 HW1 solution
1.2 HW2 solution

Literature

Chapter 9 of Dayan & Abbott.

Background Literature:

  • Sutton & Barto: Chapter 1-6 Highly readable introduction to reinforcement learning
  • Schneiderman et al (1962). Science 136:650--652 Article on rabbit eye-blink conditioning
  • Real (1991). Science 253:980--986 Article on bumblee behavior
  • Schultz et al (1997). Science 275:1593--1599 Dopamine, conditioning, and reinforcement learning brought together
  • Daw et al (2006). Nature 441: 876--879 Reinforcement learning applied to fMRI.
  • Doya (2008). Nature Neuroscience 11: 410-416 Recent review of the literature.

 

 


2. Neural Mechanisms: Neurons and Networks (Lecturer: Gregory Dumont)

2.1 Binary Neurons and Networks, Gregory Dumont
2.2 Biophysics of Neurons, Gregory Dumont
2.3 The Hodgkin-Huxley model, Gregory Dumont

MathReminder2.1

Homework

2.1 HW3 due April, 4 at 17:00
2.2 HW4 due April, 18 at 17:00

Solutions

2.1 HW3 Solution
2.2 HW4 Solution

Literature

Chapter I1-- 5,6; III-- 8 of Dayan & Abbott

3. Neural Correlates of Behavior (Lecturer: Matthew Chalk)

3.1 Neural Decoding, Matthew Chalk
3.2 Population Coding, Matthew Chalk
3.3 Decision-Making, Matthew Chalk
3.4 Neural Encoding, Matthew Chalk

3.5 Seminar, Sophie Deneve

Homework

3.1 HW5, due May, 2 at 17:00
3.2 HW6 due TBA at 17:00
 

Solutions

2.1 HW5 Solution
2.2 HW6 Solution
 

Literature

Chapter 1--3, 7.3, 8.4 (pg36-38) of Dayan & Abbott

Background Literature:

  • David Marr (1980). Vision. MIT Press. Introduction Must read 
  • Parker & Newsome (1998). Annual Review of Neurosciences Nice review on detection and discrimination experiments
  • Hubel (1988). Eye, Brain, and Vision. Scientific American. Chapters 2-4.

Further reading suggestions:

 

4.  Exam

Written exam 2 hours, June 6 17:00 - 19:00

Notes allowed. Lecture Slides allowed. Questions on the lecture and homework topics.

Exam will count as 20% of grade.

 

 

 

Attached documents

INSERM ENS