Establishing a foundation for automated human credibility screening

ISI 2012 - 2012 IEEE International Conference on Intelligence and Security Informatics: Cyberspace, Border, and Immigration Securities

Volumn , Issue , 2012, Pages 202-211

  Nunamaker, Jay F ^a   Burgoon, Judee K ^a   Twyman, Nathan W ^a   Proudfoot, Jeffrey Gainer ^a   Schuetzler, Ryan ^a   Giboney, Justin Scott ^a  

^a UNIVERSITY OF ARIZONA   (United States)

Author keywords

automated deception detection; automated detection of concealed information; automated human credibility Screening

Indexed keywords

NATIONAL SECURITY;

ASSESSMENT PRACTICES; AUTOMATED DECEPTION DETECTIONS; AUTOMATED DETECTION OF CONCEALED INFORMATIONS; AUTOMATED HUMAN CREDIBILITY SCREENINGS; AUTOMATED SYSTEMS; CREDIBILITY ASSESSMENT; FRAUD DETECTION; HIGH IMPACT; IN-FIELD; RESEARCH AREAS;

AUTOMATION;

EID: 84867384311     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISI.2012.6284309     Document Type: Conference Paper

References (84)

1. P. V. Trovillo, "A history of lie detection," Journal of Criminal Law and Criminology, vol. 29, pp. 848-881, 1939.
2. K. Alder, "To Tell the Truth: The Polygraph Exam and the Marketing of American Expertise," Historical Reflections, vol. 24, no. 3, pp. 487-525, 1998.
3. J. F. Nunamaker, D. C. Derrick, A. C. Elkins et al., "Embodied Conversational Agent-Based Kiosk for Automated Interviewing," Journal of Management Information Systems, vol. 28, no. 1, pp. 17-48, 2011.
4. A. C. Elkins, and J. K. Burgoon, "Validating Vocal Analysis Software to Assess Credibility in Interpersonal Interaction: A Multilevel Factor Analytic Approach."
5. M. Gamer, H. G. Rill, G. Vossel et al., "Psychophysiological and vocal measures in the detection of guilty knowledge," International Journal of Psychophysiology, vol. 60, no. 1, pp. 76-87, 2006.
6. J. D. Harnsberger, H. Hollien, C. A. Martin et al., "Stress and Deception in Speech: Evaluating Layered Voice Analysis," Journal of Forensic Sciences, vol. 54, no. 3, pp. 642-650, May, 2009.
7. C. M. Fuller, D. P. Biros, and R. L. Wilson, "Decision support for determining veracity via linguistic-based cues," Decision Support Systems, vol. 46, no. 3, pp. 695-703, Feb, 2009.
8. L. M. Vizer, L. Zhou, and A. Sears, "Automated stress detection using keystroke and linguistic features: An exploratory study," International Journal of Human-Computer Studies, vol. 67, no. 10, pp. 870-886, Oct, 2009.
9. L. Zhou, and D. Zhang, "Following linguistic footprints: Automatic deception detection in online communication," Communications of the Acm, vol. 51, no. 9, pp. 119-122, Sep, 2008.
10. K. Fukuda, "Eye blinks: New indices for the detection of deception," International Journal of Psychophysiology, vol. 40, no. 3, pp. 239-245, 2001.
11. D. B. Osher, "Multimethod assessment of deception: Oculomotor movement, pupil size, and response time measures.," Department of Educational Psychology, University of Utah, Salt Lake City, Utah, USA, 2007.
12. N. W. Twyman, "Automated Human Screening for Detecting Concealed Information," Department of Management Information Systems, University of Arizona, Tucson, AZ, 2012.
13. I. Pavlidis, N. L. Eberhardt, and J. A. Levine, "Seeing through the face of deception," Nature, vol. 415, no. 6867, pp. 35-35, 2002.
14. I. Pavlidis, and J. Levine, "Thermal facial screening for deception detection." pp. 1143-1144.
15. T. O. Meservy, M. L. Jensen, J. Kruse et al., "Deception detection through automatic, unobtrusive analysis of nonverbal behavior," IEEE Intelligent Systems, vol. 20, no. 5, pp. 36-43, 2005.
16. N. W. Twyman, A. Elkins, and J. K. Burgoon, "A Rigidity Detection System for the Guilty Knowledge Test."
17. C. F. Bond, and B. M. DePaulo, "Accuracy of deception judgments," Personality and Social Psychology Review, vol. 10, no. 3, pp. 214-234, 2006.
18. M. Gamer, T. Bauermann, P. Stoeter et al., "Covariations among fMRI, skin conductance, and behavioral data during processing of concealed information," Human Brain Mapping, vol. 28, no. 12, pp. 1287-1301, 2007.
19. D. C. Derrick, A. C. Elkins, J. K. Burgoon et al., "Border Security Credibility Assessments via Heterogeneous Sensor Fusion," IEEE Intelligent Systems, vol. 25, no. 3, pp. 41-49, 2010.
20. M. Gamer, B. Verschuere, G. Crombez et al., "Combining physiological measures in the detection of concealed information," Physiology & Behavior, vol. 95, no. 3, pp. 333-340, 2008.
21. K. Moffitt, Elkins, A. C., Burgoon, J. K., Nunamaker, J. F., Jr., "Rapid Noncontact Credibility Assessment via Linguistic/Vocalic Analyses."
22. B. Verschuere, G. Crombez, T. Degrootte et al., "Detecting Concealed Information with Reaction Times: Validity and Comparison with the Polygraph," Applied Cognitive Psychology, vol. 24, no. 7, pp. 991-1002, Oct, 2010.
23. M. L. Jensen, P. B. Lowry, J. K. Burgoon et al., "Technology dominance in complex decision making: The case of aided credibility assessment," Journal of Management Information Systems, vol. 27, no. 1, pp. 181-207, 2010.
24. E. Elaad, and G. Ben-Shakhar, "Countering Countermeasures in the Concealed Information Test Using Covert Respiration Measures," Applied Psychophysiology and Biofeedback, vol. 34, no. 3, pp. 197-208, 2009.
25. D. T. Lykken, "THE VALIDITY OF THE GUILTY KNOWLEDGE TECHNIQUE - THE EFFECTS OF FAKING," Journal of Applied Psychology, vol. 44, no. 4, pp. 258-262, 1960, 1960.
26. J. P. Rosenfeld, and E. Labkovsky, "New P300-based protocol to detect concealed information: Resistance to mental countermeasures against only half the irrelevant stimuli and a possible ERP indicator of countermeasures, " Psychophysiology, vol. 47, no. 6, pp. 1002-1010, Nov, 2010.
27. L. Zhou, J. K. Burgoon, D. P. Twitchell et al., "A comparison of classification methods for predicting deception in computer-mediated communication," Journal of Management Information Systems, vol. 20, no. 4, pp. 139-165, 2004.
28. J. Masip, M. Bethencourt, G. Lucas et al., "Deception detection from written accounts," Scandinavian Journal of Psychology, vol. 53, no. 2, pp. 103-111, 2012.
29. S. L. Sporer, and B. Schwandt, "Moderators of nonverbal indicators of deception," Psychology, Public Policy, and Law, vol. 13, no. 1, pp. 1-34, 2007.
30. M.-A. Reinhard, and S. L. Sporer, "Listening, not watching: Situational familiarity and the ability to detect deception," Journal of Personality and Social Psychology, vol. 101, no. 3, pp. 467-484, 2011.
31. B. M. DePaulo, J. J. Lindsay, B. E. Malone et al., "Cues to deception," Psychological Bulletin, vol. 129, no. 1, pp. 74-118, Jan, 2003.
32. M. Hartwig, and C. F. Bond, "Why do lie-catchers fail? A lens model meta-analysis of human lie judgments," Psychological Bulletin, vol. 137, no. 4, pp. 643-659, 2011.
33. M. Zuckerman, B. M. DePaulo, and R. Rosenthal, "Verbal and nonverbal communication of deception," Advances in Experimental Social Psychology, vol. 14, no. 1, pp. 1-59, 1981.
34. P. Ekman, and W. V. Friesen, "Nonverbal Leakage and Clues to Deception," Psychiatry, vol. 32, no. 1, pp. 88-&, 1969.
35. D. B. Buller, and J. K. Burgoon, "Interpersonal deception theory," Communication Theory, vol. 6, no. 3, pp. 203-242, 1996.
36. I. P. Pavlov, Condition Reflex, Oxford, England: Clarendon Press, 1927.
37. E. N. Sokolov, "Higher Nervous Functions - Orienting Reflex," Annual Review of Physiology, vol. 25, no. 1, pp. 545-580, 1963.
38. J. G. Proudfoot, N. W. Twyman, and J. K. Burgoon, "Familiarity recognition in automated screening environments: Utilizing eye-tracking technology as an intelligence-gathering tool."
39. D. C. Raskin, and C. R. Honts, "The Comparison Question Test," Handbook of Polygraph Testing, M. Kleiner, ed., Academic Press, 2002, pp. 1-47.
40. F. Horvath, J. P. Blair, and J. P. Buckley, "The Behavioral Analysis Interview: Clarifying the Practice, Theory, and Understanding of its use and effectiveness," International Journal of Police Science & Management, vol. 10, no. 1, pp. 101-118, 2008.
41. Author ed.∧eds., "Practical Use of the Concealed Information Test for Criminal Investigation in Japan," Handbook of Polygraph Testing, San Diego, CA, USA: Academic Press, 2002, p.∧pp. Pages.
42. D. T. Lykken, "The GSR in the Detection of Guilt," Journal of Applied Psychology, vol. 43, no. 6, pp. 385-388, 1959.
43. A. Vrij, Detecting Lies and Deceit: Pitfalls and Opportunities, Second ed., West Sussex, England: John Wiley & Sons, Ltd, 2008.
44. B. Verschuere, G. Crombez, A. D. Clercq et al., "Autonomic and behavioral responding to concealed information: Differentiating orienting and defensive responses," Psychophysiology, vol. 41, no. 3, pp. 461-466, 2004.
45. W. G. Iacono, "Encouraging the use of the Guilty Knowledge Test (GKT): what the GKT has to offer law enforcement," Memory Detection: Theory and Application of the Concealed Information Test, B. Verschuere, G. Ben-Shakhar and E. Meijer, eds., New York, NY, USA: Cambridge University Press, 2011.
46. K. R. Scherer, "Vocal affect expression: A review and a model for future research," Psychological Bulletin, vol. 99, no. 2, pp. 143-165, 1986.
47. R. Banse, and K. R. Scherer, "Acoustic profiles in vocal emotion expression," Journal of Personality and Social Psychology, vol. 70, no. 3, pp. 614-636, 1996.
48. P. Boersma, "Accurate short-term analysis of the fundamental frequency and the harmonics-to-noise ratio of a sampled sound." pp. 97-110.
49. A. C. Elkins, D. C. Derrick, and M. Gariup, "The Voice and Eye Gaze Behavior of an Imposter: Automated Interviewing and Detection for Rapid Screening at the Border."
50. W. E. Hockley, "Analysis of response time distributions in the study of cognitive processes," Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 10, no. 4, pp. 598-615, 1984.
51. A. Vrij, S. A. Mann, R. P. Fisher et al., "Increasing cognitive load to facilitate lie detection: The benefit of recalling an event in reverse order," Law and Human Behavior, vol. 32, no. 3, pp. 253-265, Jun, 2008.
52. A. Vrij, G. R. Semin, and R. Bull, "Insight into behavior displayed during deception," Human Communication Research, vol. 22, no. 4, pp. 544-562, Jun, 1996.
53. D. P. Dionisio, E. Granholm, W. A. Hillix et al., "Differentiation of deception using pupillary responses as an index of cognitive processing," Psychophysiology, vol. 38, no. 2, pp. 205-211, 2001.
54. D. B. Buller, and R. K. Aune, "Nonverbal cues to deception among intimates, friends, and strangers," Journal of Nonverbal Behavior, vol. 11, no. 4, pp. 269-290, 1987.
55. A. Vrij, "Behavioral Correlates of Deception in a Simulated Police Interview," Journal of Psychology, vol. 129, no. 1, pp. 15-28, Jan, 1995.
56. J. C. Nunnally, P. D. Knott, A. Duchnowski et al., "Pupillary response as a general measure of activation," Attention, Perception, & Psychophysics, vol. 2, no. 4, pp. 149-155, 1967.
57. S. Nieuwenhuis, E. J. De Geus, and G. Aston-Jones, "The anatomical and functional relationship between the P3 and autonomic components of the orienting response," Psychophysiology, vol. 48, no. 2, pp. 162-175, 2011.
58. B. C. Goldwater, "Psychological significance of pupillary movements," Psychological Bulletin, vol. 77, no. 5, pp. 340-355, 1972.
59. J. Beatty, and B. L. Wagoner, "Pupillometric signs of brain activation vary with level of cognitive processing," Science, vol. 199, no. 4334, pp. 1216-1218, 1978.
60. D. Kahneman, and J. Beatty, "Pupil diameter and load on memory," Science, vol. 154, no. 3756, pp. 1583-1585, 1966.
61. D. Kahneman, Attention and Effort, Englewood Cliffs, NJ: Prentice-Hall Inc., 1973.
62. H. D. Ellis, J. W. Shepherd, and G. M. Davies, "Identification of familiar and unfamiliar faces from internal and external features," Perception, vol. 8, no. 4, pp. 431-439, 1979.
63. R. R. Althoff, and N. J. Cohen, "Eye-movement-based memory effect: A reprocessing effect in face perception," Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 25, no. 4, pp. 997-1010, 1999.
64. P. C. Stacey, S. Walker, and J. D. M. Underwood, "Face processing and familiarity: Evidence from eye-movement data," British Journal of Psychology, vol. 96, no. 4, pp. 407-422, 2005.
65. N. W. Twyman, K. Moffitt, J. K. Burgoon et al., "Using Eye Tracking Technology as a Concealed Information Test ".
66. C. Schwedes, and D. Wentura, "The revealing glance: Eye gaze behavior to concealed information," Memory & Cognition, pp. 1-10, 2011.
67. J. D. Ryan, D. E. Hannula, and N. J. Cohen, "The obligatory effects of memory on eye movements," Memory, vol. 15, no. 5, pp. 508-525, 2007.
68. D. C. Derrick, K. Moffitt, and J. F. Nunamaker, "Eye Gaze Behavior as a Guilty Knowledge Test: Initial Exploration for Use in Automated, Kiosk-based Screening."
69. G. H. Barland, and D. C. Raskin, "An evaluation of field techniques in detection of deception," Psychophysiology, vol. 12, pp. 321-330, 1975.
70. R. J. Cutrow, "The objective use of multiple psychological indices in the detection of deception," Psychophysiology, vol. 9, pp. 578-588, 1972.
71. D. C. Derrick, A. C. Elkins, and J. K. Burgoon, "Cardiovascular responses during mock crime interviews: Assessment using Laser Doppler Vibrometry."
72. E. Elaad, and G. Ben-Shakar, "Covert respiration measures for the detection of concealed information," Biological Psychology, vol. 77, no. 3, pp. 284-291, 2008.
73. C. Puri, L. Olson, I. Pavlidis et al., "StressCam: non-contact measurement of users' emotional states through thermal imaging." pp. 1725-1728.
74. Z. Zhen, P. Tsiamyrtzis, and I. Pavlidis, "Forehead thermal signature extraction in lie detection." pp. 243-246.
75. J. M. C. Vendemia, "Detection of Deception," Polygraph, vol. 32, no. 2, pp. 97-106, 2003.
76. A. Vrij, and P. A. Granhag, "Interviewing to Detect Deception," Offenders' Memories of Violent Crimes, pp. 279-304: John Wiley & Sons, 2008.
77. P. H. Tu, G. Doretto, N. O. Krahnstoever et al., "An intelligent video framework for homeland protection," The International Society for Optical Engineering, vol. 6562, 2007.
78. P. Tsiamyrtzis, J. Dowdall, D. Shastri et al., "Imaging facial physiology for the detection of deceit," International Journal of Computer Vision, vol. 71, no. 2, pp. 197-214, 2007.
79. A. Vrij, "Detecting Deception," Practical Psychology for Forensic Investigations and Prosecutions, pp. 89-102: John Wiley & Sons, 2008.
80. G. Ganis, J. P. Rosenfeld, J. Meixner et al., "Lying in the scanner: Covert countermeasures disrupt deception detection by functional magnetic resonance imaging," Neuroimage, vol. 55, no. 1, pp. 312-319, 2011.
81. J. Hahm, H. K. Ji, J. Y. Jeong et al., "Detection of Concealed Information: Combining a Virtual Mock Crime with a P300-based Guilty Knowledge Test," Cyberpsychology & Behavior, vol. 12, no. 3, pp. 269-275, 2009.
82. D. D. Langleben, L. Schroeder, J. A. Maldjian et al., "Brain activity during simulated deception: An event-related functional magnetic resonance study," Neuroimage, vol. 15, no. 3, pp. 727-732, Mar, 2002.
83. M. Schneider, B. Varcuti, A. A. Karim et al., "Neuroimaging of Deception in a Free-Choice Guilty Knowledge Test (GKT) after a Mock Crime Scenario," Psychophysiology, vol. 46, no. 1, pp. S75-S75, Sep, 2009.
84. A. R. Hevner, S. T. March, J. Park et al., "Design Science in Information Systems Research," MIS Quarterly, vol. 28, no. 1, pp. 75-105, 2004.