Cookies on this website
We use cookies to ensure that we give you the best experience on our website. If you click 'Continue' we'll assume that you are happy to receive all cookies and you won't see this message again. Click 'Find out more' for information on how to change your cookie settings.

Most reinforcement learning models of animal conditioning operate under the convenient, though fictive, assumption that Pavlovian conditioning concerns prediction learning whereas instrumental conditioning concerns action learning. However, it is only through Pavlovian responses that Pavlovian prediction learning is evident, and these responses can act against the instrumental interests of the subjects. This can be seen in both experimental and natural circumstances. In this paper we study the consequences of importing this competition into a reinforcement learning context, and demonstrate the resulting effects in an omission schedule and a maze navigation task. The misbehavior created by Pavlovian values can be quite debilitating; we discuss how it may be disciplined.

Original publication

DOI

10.1016/j.neunet.2006.03.002

Type

Journal article

Journal

Neural networks : the official journal of the International Neural Network Society

Publication Date

10/2006

Volume

19

Pages

1153 - 1160

Addresses

Gatsby Computational Neuroscience Unit, UCL, 17 Queen Square, London, UK. dayan@gatsby.ucl.ac.uk

Keywords

Animals, Humans, Association Learning, Avoidance Learning, Conditioning, Classical, Conditioning, Operant, Reinforcement (Psychology), Reinforcement Schedule, Time Factors