Model-based analysis of decision variables

Kenji Doya, Makoto Ito and Kazuyuki Samejima

in Decision Making, Affect, and Learning

Published in print March 2011 | ISBN: 9780199600434
Published online May 2011 | e-ISBN: 9780191725623 | DOI:

Series: Attention and Performance

Model-based analysis of decision variables

Show Summary Details


When determining the neural correlates of decision making, a major difficulty is the non-stationarity of the brain's response. The evaluation of the same action should vary over time depending on the subject's choice and reward history. The speed at which such subjective evaluations changes should differ among subjects, or even in the same subject in different sessions. A recently emerging paradigm for coping with this difficulty is to estimate the time course of the internal variables of a mathematical model of decision making from each subject's sequence of stimuli, actions, and obtained rewards in each experimental session, and use that as a marker for detecting the neurons or brain regions implicated. This chapter reviews mathematical models describing the adaptive process of decision making, computational methods for estimating the model variables from observed data, and examples of applications of such model-based analysis to behavioural tests, neural recording, and functional brain imaging.

Keywords: mathematical models; decision making; computational methods; behavioural tests; neural recording; functional brain imaging

Chapter.  6136 words.  Illustrated.

Subjects: Cognitive Psychology

Full text: subscription required

How to subscribe Recommend to my Librarian

Buy this work at Oxford University Press »

Users without a subscription are not able to see the full content. Please, subscribe or login to access all content.