English  |  Français 

CO6 course

Lecturers

Tutor

  • Dani Martí daniel-dot-marti-at-ens-dot-fr

Time & Place

Every Tuesday, 17:00-19:00, Salle Prestige 1 'Ribot', 29, rue d'Ulm

Literature

Textbook: Dayan & Abbott. Theoretical Neuroscience. MIT Press 2001.


1. Quantitative Models of Behavior (Lecturer: Johann Lussange)

1.1 The Rescorla-Wagner Learning Rule, Johann Lussange
1.2 The Exploration-Exploitation Dilemma, Johann Lussange
1.3 Reinforcement Learning, Johann Lussange

Homework

1.1 HW1, due March 15th at 17:00
1.2 HW2, due April 5th at 17:00.

Solutions

1.1 HW1 solution
1.2 HW2 solution

Literature

Chapter 9 of Dayan & Abbott.

Background Literature:

  • Sutton & Barto: Chapter 1-6 Highly readable introduction to reinforcement learning
  • Schneiderman et al (1962). Science 136:650--652 Article on rabbit eye-blink conditioning
  • Real (1991). Science 253:980--986 Article on bumblee behavior
  • Schultz et al (1997). Science 275:1593--1599 Dopamine, conditioning, and reinforcement learning brought together
  • Daw et al (2006). Nature 441: 876--879 Reinforcement learning applied to fMRI.
  • Doya (2008). Nature Neuroscience 11: 410-416 Recent review of the literature.

2. Neural Correlates of Behavior (Lecturer: Sophie Denève)

2.1 Neural Decoding, Alireza Alemi
2.2 Population Coding, Matthew Chalk
2.3 Decision-Making, Matthew Chalk
2.4 Neural Encoding, Boris Gutkin

Homework

2.1 HW3, due April 12th at 17:00
2.2 HW4 due April 19 at 17:00
2.3 HW5 due May 3 at 17:00

Solutions

2.1 HW3 Solution
2.2 HW4 Solution
2.3 HW5 Solution

Literature

Chapter 1--3, 7.3, 8.4 (pg36-38) of Dayan & Abbott

Background Literature:

  • David Marr (1980). Vision. MIT Press. Introduction Must read 
  • Parker & Newsome (1998). Annual Review of Neurosciences Nice review on detection and discrimination experiments
  • Hubel (1988). Eye, Brain, and Vision. Scientific American. Chapters 2-4.

Further reading suggestions:

 

No lecture on 21st April.

 


3. Neural Mechanisms: Neurons and Networks (Lecturer: Dani Martí and Boris Gutkin)

3.1 Modeles binaires et apprentissage, Dani Martí
3.2 Biophysics of Neurons, Gregory Dumont
3.3 The Hodgkin-Huxley model, Gregory Dumont

 

Homework

3.1 HW6 due May 10th at 17:00
3.2 Biophysics of neurons

Solutions

3.1 No solution sheet for Exercise 6.
3.2 HW2 Solution

Literature

Chapter I1-- 5,6; III-- 8 of Dayan & Abbott


4.  Exam NOTE FORMAT CHANGE

Written exam 2 hours, June 7 17:00 - 19:00

Notes allowed. Lecture Slides allowed. Questions on the lecture and homework topics.

Exam will count as 1 HW.

 

 

 

Attached documents

INSERM ENS