DECISION SUPPORT FOR RAPID ASSESSMENT OF TRUTH AND DECEPTION USING AUTOMATED ASSESSMENT TECHNOLOGIES AND KIOSK-BASED EMBODIED CONVERSATIONAL AGENTS

Persistent Link:
http://hdl.handle.net/10150/194290
Title:
DECISION SUPPORT FOR RAPID ASSESSMENT OF TRUTH AND DECEPTION USING AUTOMATED ASSESSMENT TECHNOLOGIES AND KIOSK-BASED EMBODIED CONVERSATIONAL AGENTS
Author:
Patton, Mark
Issue Date:
2009
Publisher:
The University of Arizona.
Rights:
Copyright © is held by the author. Digital access to this material is made possible by the University Libraries, University of Arizona. Further transmission, reproduction or presentation (such as public display or performance) of protected items is prohibited except with permission of the author.
Abstract:
A pressing need exists for effective decision support systems to facilitate the rapid and accurate screening of large volumes of people. Millions of travelers transit through international borders and secure areas on an annual basis. Humans are exceptionally poor at detecting lying and deception and perform, on average, no better than chance. This research study focuses on the development, design and implementation of a Kiosk for Rapid Assessment of Deception (K-RAD) that integrates questioning with response processing and deception detection. An exploratory pilot study (N=68) and a primary study (N=225) were executed.The K-RAD was designed to have a three-dimensional figure, an "Embodied Conversational Agent" (ECA), deliver the questions through speech. This delivery mechanism was chosen because human subjects have been shown in the past to react emotionally to ECAs during conversational interactions, and emotional arousal is one of the cues to deception. Responses were analyzed for deception cues, focusing on kinesic, linguistic, and vocalic characteristics that can be captured for automated processing and which would be unique to this setting.The results show unique subject behaviors. Subjects exhibited minimal movement and had very little tendency to change posture. Some subjects (6%) referred to the ECA as an authority figure, using "sir" when responding. Subjects positioned themselves at varying distances from the ECA, with significant gender differences. Post-experiment surveys indicated a gender difference in overall stress, with female subjects reporting significantly higher levels, independent of the experimental condition.Postural-based logistic regression created significant classification models for the pilot (59.1% classification accuracy) and primary (57.2% & 62.8% classification accuracies) studies. Movement analysis had varying and conflicting results. A robust deception index with a 68.1% classification accuracy was achievable in the pilot study based on high-frequency movement and arm placement. Primary study deception indices were not significant.The results include a comprehensive set of observations and lessons learned regarding kiosk design, deception technologies, detection effectiveness, and future considerations to take into account when creating a next-generation K-RAD system. Many challenges remain, but the concept is functional, promising, and could revolutionize security screening and deception detection in a variety of settings.
Type:
text; Electronic Dissertation
Keywords:
Avatar; Deception; Decision Support; ECA; Kiosk
Degree Name:
Ph.D.
Degree Level:
doctoral
Degree Program:
Management Information Systems; Graduate College
Degree Grantor:
University of Arizona
Advisor:
Nunamaker, Jr., Jay F.
Committee Chair:
Nunamaker, Jr., Jay F.; Burgoon, Judee K.

Full metadata record

DC FieldValue Language
dc.language.isoENen_US
dc.titleDECISION SUPPORT FOR RAPID ASSESSMENT OF TRUTH AND DECEPTION USING AUTOMATED ASSESSMENT TECHNOLOGIES AND KIOSK-BASED EMBODIED CONVERSATIONAL AGENTSen_US
dc.creatorPatton, Marken_US
dc.contributor.authorPatton, Marken_US
dc.date.issued2009en_US
dc.publisherThe University of Arizona.en_US
dc.rightsCopyright © is held by the author. Digital access to this material is made possible by the University Libraries, University of Arizona. Further transmission, reproduction or presentation (such as public display or performance) of protected items is prohibited except with permission of the author.en_US
dc.description.abstractA pressing need exists for effective decision support systems to facilitate the rapid and accurate screening of large volumes of people. Millions of travelers transit through international borders and secure areas on an annual basis. Humans are exceptionally poor at detecting lying and deception and perform, on average, no better than chance. This research study focuses on the development, design and implementation of a Kiosk for Rapid Assessment of Deception (K-RAD) that integrates questioning with response processing and deception detection. An exploratory pilot study (N=68) and a primary study (N=225) were executed.The K-RAD was designed to have a three-dimensional figure, an "Embodied Conversational Agent" (ECA), deliver the questions through speech. This delivery mechanism was chosen because human subjects have been shown in the past to react emotionally to ECAs during conversational interactions, and emotional arousal is one of the cues to deception. Responses were analyzed for deception cues, focusing on kinesic, linguistic, and vocalic characteristics that can be captured for automated processing and which would be unique to this setting.The results show unique subject behaviors. Subjects exhibited minimal movement and had very little tendency to change posture. Some subjects (6%) referred to the ECA as an authority figure, using "sir" when responding. Subjects positioned themselves at varying distances from the ECA, with significant gender differences. Post-experiment surveys indicated a gender difference in overall stress, with female subjects reporting significantly higher levels, independent of the experimental condition.Postural-based logistic regression created significant classification models for the pilot (59.1% classification accuracy) and primary (57.2% & 62.8% classification accuracies) studies. Movement analysis had varying and conflicting results. A robust deception index with a 68.1% classification accuracy was achievable in the pilot study based on high-frequency movement and arm placement. Primary study deception indices were not significant.The results include a comprehensive set of observations and lessons learned regarding kiosk design, deception technologies, detection effectiveness, and future considerations to take into account when creating a next-generation K-RAD system. Many challenges remain, but the concept is functional, promising, and could revolutionize security screening and deception detection in a variety of settings.en_US
dc.typetexten_US
dc.typeElectronic Dissertationen_US
dc.subjectAvataren_US
dc.subjectDeceptionen_US
dc.subjectDecision Supporten_US
dc.subjectECAen_US
dc.subjectKiosken_US
thesis.degree.namePh.D.en_US
thesis.degree.leveldoctoralen_US
thesis.degree.disciplineManagement Information Systemsen_US
thesis.degree.disciplineGraduate Collegeen_US
thesis.degree.grantorUniversity of Arizonaen_US
dc.contributor.advisorNunamaker, Jr., Jay F.en_US
dc.contributor.chairNunamaker, Jr., Jay F.en_US
dc.contributor.chairBurgoon, Judee K.en_US
dc.contributor.committeememberZeng, Danielen_US
dc.contributor.committeememberKoput, Kenen_US
dc.identifier.proquest10632en_US
dc.identifier.oclc659753372en_US
All Items in UA Campus Repository are protected by copyright, with all rights reserved, unless otherwise indicated.