Affect and Learning: a computational analysis

Doctoral Thesis

In this thesis we have studied the influence of emotion on learning. We have used computational modelling techniques to do so, more specifically, the reinforcement learning paradigm. Emotion is modelled as artificial affect, a measure that denotes the positiveness versus negativeness of a situation to an artificial agent in a reinforcement learning setting. We have done a range of different experiments to study the effect of affect on learning, including the effect on learning if affect is used to control the exploration behaviour of the agent and the effect on learning when affect is communicated by a human (though real-time analysis of that human__s facial expressions) to a simulated robot. We conclude that affect is a useful concept to consider in adaptive agents that learn based on reinforcement learning and that in some cases affect can indeed help the learning process. Further, affective modelling in this way can help understand the psychological processes that underlie...Show moreIn this thesis we have studied the influence of emotion on learning. We have used computational modelling techniques to do so, more specifically, the reinforcement learning paradigm. Emotion is modelled as artificial affect, a measure that denotes the positiveness versus negativeness of a situation to an artificial agent in a reinforcement learning setting. We have done a range of different experiments to study the effect of affect on learning, including the effect on learning if affect is used to control the exploration behaviour of the agent and the effect on learning when affect is communicated by a human (though real-time analysis of that human__s facial expressions) to a simulated robot. We conclude that affect is a useful concept to consider in adaptive agents that learn based on reinforcement learning and that in some cases affect can indeed help the learning process. Further, affective modelling in this way can help understand the psychological processes that underlie influences of affect on cognition. Finally, we have developed a formal notation for a specific type of emotion theory, i.e., cognitive appraisal theory.Show less

Cognitive psychology

Adaptive behavior

Artificial intelligence

Affective computing

Reinforcement learning

Instrumental conditioning

Human-computer interaction

Human-robot interaction

Formalisms

Appraisal theory