Analysis of Human Computer Interaction Behavior for Assessment of Affect, Cognitive Load, and Credibility

Persistent Link:
http://hdl.handle.net/10150/556821
Title:
Analysis of Human Computer Interaction Behavior for Assessment of Affect, Cognitive Load, and Credibility
Author:
Grimes, George Mark
Issue Date:
2015
Publisher:
The University of Arizona.
Rights:
Copyright © is held by the author. Digital access to this material is made possible by the University Libraries, University of Arizona. Further transmission, reproduction or presentation (such as public display or performance) of protected items is prohibited except with permission of the author.
Embargo:
Release after 15-May-2016
Abstract:
This dissertation presents three studies consisting of seven experiments that investigate the relationship between human-computer interaction (HCI) behavior and changes in cognitive states by using keystroke dynamics (KD) and mouse dynamics (MD) as physiological indicators of cognitive change. The first two chapters discuss the importance of being able to detect changes in affect, cognitive load, and deception and provide a theoretical base for this research, pulling heavily from cognitive science, psychology and communication literature. We also discuss the current state of the art in keystroke and mouse dynamics and what makes the techniques presented here different. Chapters three and four present five experiments that explore the influence of affect and cognitive load on KD and MD. The results of these experiments suggest that many features of typing and mouse movement behavior including transition time, rollovers, duration, number of direction changes, and distance traveled are influenced by changes in affect and cognitive load. In chapter five we operationalize these findings in a credibility assessment context and describe two experiments in which participants behave deceptively in computer mediated interactions. In both experiments, we find significant differences in typing behavior, in line with the findings of the first two studies. Chapter six summarizes the results and provides a way forward for future research in human computer interaction. The work presented in this dissertation describes a novel approach to inferring cognitive changes using low cost, non-invasive, and transparent monitoring of HCI behavior with important implications for both research and practice.
Type:
text; Electronic Dissertation
Keywords:
Cognitive Load; Human Computer Interaction; Keystroke Dynamics; Mouse Dynamics; Typing; Management Information Systems; Affect
Degree Name:
Ph.D.
Degree Level:
doctoral
Degree Program:
Graduate College; Management Information Systems
Degree Grantor:
University of Arizona
Advisor:
Nunamaker, Jay F., Jr.

Full metadata record

DC FieldValue Language
dc.language.isoen_USen
dc.titleAnalysis of Human Computer Interaction Behavior for Assessment of Affect, Cognitive Load, and Credibilityen_US
dc.creatorGrimes, George Marken
dc.contributor.authorGrimes, George Marken
dc.date.issued2015en
dc.publisherThe University of Arizona.en
dc.rightsCopyright © is held by the author. Digital access to this material is made possible by the University Libraries, University of Arizona. Further transmission, reproduction or presentation (such as public display or performance) of protected items is prohibited except with permission of the author.en
dc.description.releaseRelease after 15-May-2016en
dc.description.abstractThis dissertation presents three studies consisting of seven experiments that investigate the relationship between human-computer interaction (HCI) behavior and changes in cognitive states by using keystroke dynamics (KD) and mouse dynamics (MD) as physiological indicators of cognitive change. The first two chapters discuss the importance of being able to detect changes in affect, cognitive load, and deception and provide a theoretical base for this research, pulling heavily from cognitive science, psychology and communication literature. We also discuss the current state of the art in keystroke and mouse dynamics and what makes the techniques presented here different. Chapters three and four present five experiments that explore the influence of affect and cognitive load on KD and MD. The results of these experiments suggest that many features of typing and mouse movement behavior including transition time, rollovers, duration, number of direction changes, and distance traveled are influenced by changes in affect and cognitive load. In chapter five we operationalize these findings in a credibility assessment context and describe two experiments in which participants behave deceptively in computer mediated interactions. In both experiments, we find significant differences in typing behavior, in line with the findings of the first two studies. Chapter six summarizes the results and provides a way forward for future research in human computer interaction. The work presented in this dissertation describes a novel approach to inferring cognitive changes using low cost, non-invasive, and transparent monitoring of HCI behavior with important implications for both research and practice.en
dc.typetexten
dc.typeElectronic Dissertationen
dc.subjectCognitive Loaden
dc.subjectHuman Computer Interactionen
dc.subjectKeystroke Dynamicsen
dc.subjectMouse Dynamicsen
dc.subjectTypingen
dc.subjectManagement Information Systemsen
dc.subjectAffecten
thesis.degree.namePh.D.en
thesis.degree.leveldoctoralen
thesis.degree.disciplineGraduate Collegeen
thesis.degree.disciplineManagement Information Systemsen
thesis.degree.grantorUniversity of Arizonaen
dc.contributor.advisorNunamaker, Jay F., Jr.en
dc.contributor.committeememberValacich, Joseph S.en
dc.contributor.committeememberBurgoon, Judee K.en
dc.contributor.committeememberNunamaker, Jay F., Jr.en
All Items in UA Campus Repository are protected by copyright, with all rights reserved, unless otherwise indicated.