Fusion paradigms in cognitive technical systems for human-computer interaction

Neurocomputing

Volumn 161, Issue , 2015, Pages 17-37

  Glodek, Michael ^a   Honold, Frank ^a   Geier, Thomas ^a   Krell, Gerald ^b   Nothdurft, Florian ^a   Reuter, Stephan ^a   Schüssel, Felix ^a   Hörnle, Thilo ^a   Dietmayer, Klaus ^a   Minker, Wolfgang ^a   Biundo, Susanne ^a   Weber, Michael ^a   Palm, Günther ^a   Schwenker, Friedhelm ^a  

^a UNIVERSITY OF ULM   (Germany)

^b OTTO VON GUERICKE UNIVERSITY   (Germany)

Author keywords

Cognitive technical systems; Human computer interaction; Scene understanding

Indexed keywords

COGNITIVE SYSTEMS; COMPUTER OPERATING SYSTEMS; INFORMATION FUSION; KNOWLEDGE BASED SYSTEMS;

APPLICATION LEVEL; COGNITIVE TECHNICAL SYSTEMS; HUMAN COMPUTER INTERACTION (HCI); KNOWLEDGE BASED FUSION; LOGICAL INFERENCE; OPERATING PRINCIPLES; SCENE UNDERSTANDING; TIME GRANULARITIES;

HUMAN COMPUTER INTERACTION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; CLASSIFIER; COGNITIVE TECHNICAL SYSTEM; COMPUTER SYSTEM; FUSION ALGORITHM; HUMAN COMPUTER INTERACTION; INFORMATION PROCESSING; PRIORITY JOURNAL; SENSOR;

EID: 84929046814     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2015.01.076     Document Type: Article

References (144)

1. Wendemuth A., Biundo S. A companion technology for cognitive technical systems. Cognitive Behavioural Systems, Lecture Notes in Computer Science 2012, vol. 7403:89-103. Springer, Berlin, Heidelberg. 10.1007/978-3-642-34584-5_7.
2. Palm G., Glodek M. Towards emotion recognition in human computer interaction. Neural Nets and Surroundings, Smart Innovation Systems and Technologies 2013, vol. 19:323-336. Springer, Berlin, Heidelberg. 10.1007/978-3-642-35467-0_32.
3. Schmidt A. Implicit human computer interaction through context. Pers. Technol. 2000, 4(2-3):191-199. 10.1007/BF01324126.
4. Scherer S., Glodek M., Layher G., Schels M., Schmidt M., Brosch T., Tschechne S., Schwenker F., Neumann H., Palm G. A generic framework for the inference of user states in human computer interaction. how patterns of low level behavioral cues support complex user states in HCI. J. Multimodal User Interfaces 2012, 6(3-4):117-141. 10.1007/s12193-012-0093-9.
5. Dey A.K., Abowd G.D. Towards a better understanding of context and context-awareness. Proceedings of the International Symposium on Handheld and Ubiquitous Computing, Lecture Notes in Computer Science 1999, vol. 1707:304-307. Springer, London, UK. 10.1007/3-540-48157-5_29.
6. M. Glodek, M. Schels, G. Palm, F. Schwenker, Multi-modal fusion based on classifiers using reject options and Markov fusion networks, in: Proceedings of the International Conference on Pattern Recognition (ICPR), IEEE, 2012, pp. 1084-1087.
7. N. Kumar, A.C. Berg, P.N. Belhumeur, S.K. Nayar, Attribute and simile classifiers for face verification, in: Proceedings of the IEEE International Conference on Computer Vision (ICCV), IEEE, 2009, pp. 365-372. doi:10.1109/ICCV.2009.5459250.
8. Glodek M., Layher G., Schwenker F., Palm G. Recognizing human activities using a layered Markov architecture. Proceedings of the International Conference on Artificial Neural Networks and Machine Learning (ICANN), Lecture Notes in Computer Science 2012, vol. 7552:677-684. Springer, Berlin, Heidelberg. 10.1007/978-3-642-33269-2_85.
9. T. Geier, S. Reuter, K. Dietmayer, S. Biundo, Track-person association using a first-order probabilistic model, in: Proceedings of the IEEE International Conference on Tools with Artificial Intelligence (ICTAI), vol. 1, IEEE, 2012, pp. 844-851. doi:10.1109/ICTAI.2012.118.
10. F. Honold, F. Schüssel, M. Weber, Adaptive probabilistic fission for multimodal systems, in: Proceedings of the Australian Computer-Human Interaction Conference (OzCHI), ACM, New York, NY, 2012, pp. 222-231. doi:10.1145/2414536.2414575.
11. Buss M., Beetz M. CoTeSys-Cognition for technical systems. Kunstl. Intell. 2010, 24(4):323-327. 10.1007/s13218-010-0061-z.
12. Moravec H.P. The stanford cart and the CMU rover. Proc. IEEE 1983, 71(7):872-884. 10.1109/PROC.1983.12684.
13. Laird J., Newell A., Rosenbloom P. SOAR. an architecture for general intelligence. Artif. Intell. 1987, 33(1):1-64. 10.1016/0004-3702(87)90050-6.
14. Anderson J.R., Matessa M., Lebiere C. A theory of higher level cognition and its relation to visual attention. Hum. Comput. Interact. 1997, 12(4):439-462. 10.1207/s15327051hci1204_5.
15. R. Sun, A Tutorial on CLARION 5.0, Cognitive Science Department, Rensselaer Polytechnic Institute, URL 〈〉, 2003 (last visited 01/10/2013). http://www.cogsci.rpi.edu/~rsun/clarion.html.
16. Newell A. Unified Theories of Cognition 1994, Harvard University Press.
17. Anderson J.R., Lebiere C. The Newell test for a theory of cognition. Behav. Brain Sci. 2003, 26(5):587-639. 10.1017/S0140525X0300013X.
18. Vernon D., Metta G., Sandini G. A survey of artificial cognitive systems. implications for the autonomous development of mental capabilities in computational agents. IEEE Trans. Evol. Comput. 2007, 11(2):151-180. 10.1109/TEVC.2006.890274.
19. Granlund G.H. The complexity of vision. Signal Process. 1999, 74(1):101-126. 10.1016/S0165-1684(98)00204-7.
20. Mohammad Y., Nishida T. Controlling gaze with an embodied interactive control architecture. Appl. Intell. 2010, 32(2):148-163. 10.1007/s10489-009-0180-0.
21. Anderson J.R. ACT. a simple theory of complex cognition. Am. Psychol. 1996, 51(4):355-365. 10.1037/0003-066X.51.4.355.
22. Ball J. Explorations in ACT-R based language analysis-memory chunk activation. Proceedings of the International Conference on Cognitive Modeling 2012, 131-136. Universitätsverlag der TU, Berlin. N. Rußwinkel, U. Drewitz, H. van Rijn (Eds.).
23. G. Fink, N. Jungclaus, F. Kummert, H. Ritter, G. Sagerer, A distributed system for integrated speech and image understanding, in: Proceedings of the International Symposium on Artificial Intelligence (ISAI/IFIS) Collaboration in Intelligent Systems Technologies, 1996, pp. 117-126.
24. Jungclaus N., Heyde M.v.d., Ritter H., Sagerer G. An architecture for distributed visual memory. Z. Naturforschung C (A Journal of Biosciences) 1998, 53(7/8):550-559.
25. W. Wahlster, SmartKom: Symmetric multimodality in an adaptive and reusable dialogue shell, in: R.Krahl, D. Günther (Eds.), Proceedings of the Status Conference "Human Computer Interaction", DLR, 2003, pp. 47-62.
26. Herzog G., Reithinger N. The SmartKom architecture. a framework for multimodal dialogue systems. SmartKom: Foundations of Multimodal Dialogue Systems, Cognitive Technologies 2006, 55-70. Springer, Berlin, Heidelberg. 10.1007/3-540-36678-4_4. W. Wahlster (Ed.).
27. C. Burghart, R. Mikut, R. Stiefelhagen, T. Asfour, H. Holzapfel, P. Steinhaus, R. Dillmann, A cognitive architecture for a humanoid robot: a first approach, in: Proceedings of the IEEE-RAS International Conference on Humanoid Robots, IEEE, 2005, pp. 357-362. doi:10.1109/ICHR.2005.1573593.
28. Kuncheva L.I. Combining Pattern Classifiers: Methods and Algorithms 2004, John Wiley & Sons, Inc., http://dx.doi.org/10.1002/0471660264.
29. Dietrich C., Palm G., Riede K., Schwenker F. Classification of bioacoustic time series based on the combination of global and local decisions. Pattern Recognit. 2004, 37(12):2293-2305. 10.1016/j.patcog.2004.04.004.
30. Dietrich C., Palm G., Schwenker F. Decision templates for the classification of bioacoustic time series. Inf. Fusion 2003, 3(2):101-109. 10.1016/S1566-2535(03)00017-4.
31. Wallbott H., Scherer K. Cues and channels in emotion recognition. J. Personal. Social Psychol. 1986, 51(4):690-699.
32. A. Vinciarelli, M. Pantic, H. Bourlard, A. Pentland, Social signal processing: State-of-the-art and future perspectives of an emerging domain, in: Proceedings of the International ACM Conference on Multimedia (MM), ACM, New York, NY2008, pp. 1061-1070. doi:10.1145/1459359.1459573.
33. Scherer S., Glodek M., Schwenker F., Campbell N., Palm G. Spotting laughter in natural multiparty conversations. a comparison of automatic online and offline approaches using audiovisual data. ACM Trans. Interact. Intell. Syst. (Special Issue on Affective Interaction in Natural Environments) 2012, 2(1):4:1-4:31. 10.1145/2133366.2133370.
34. A. Panning, I. Siegert, A. Al-Hamadi, A. Wendemuth, D. Rösner, J. Frommer, G. Krell, B. Michaelis, Multimodal affect recognition in spontaneous HCI environment, in: Proceedings of the IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC), ACM , New York, NY, 2012, pp. 430-435. doi:10.1109/ICSPCC.2012.6335662.
35. Krell G., Glodek M., Panning A., Siegert I., Michaelis B., Wendemuth A., Schwenker F. Fusion of fragmentary classifier decisions for affective state recognition. Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction, Lecture Notes in Computer Science 2012, vol. 7742:116-130. Springer, Berlin, Heidelberg. 10.1007/978-3-642-37081-6_13.
36. Ekman P., Friesen W.V. Facial Action Coding System: A Technique for the Measurement of Facial Movement 1978, Consulting Psychologists Press.
37. Ekman P. Facial expression and emotion. Am. Psychol. 1993, 48(4):384-392. 10.1037/0003-066X.48.4.384.
38. R. Niese, A. Al-Hamadi, M. Heuer, B. Michaelis, B. Matuszewski, Machine vision based recognition of emotions using the circumplex model of affect, in: Proceedings of the International Conference on Multimedia Technology (ICMT), IEEE, 2011, pp. 6424-6427. doi:10.1109/ICMT.2011.6001887.
39. G. Littlewort, J. Whitehill, T. Wu, I. Fasel, M. Frank, J. Movellan, M. Bartlett, The computer expression recognition toolbox (CERT), in: Proceedings of the International Conference IEEE on Automatic Face Gesture Recognition and Workshops (FG), IEEE, 2011, pp. 298-305. doi:10.1109/FG.2011.5771414.
40. Douglas-Cowie E., Campbell N., Cowie R., Roach P. Emotional speech. towards a new generation of databases. Speech Commun. 2003, 40(1-2):33-60. 10.1016/S0167-6393(02)00070-5.
41. Glodek M., Reuter S., Schels M., Dietmayer K., Schwenker F. Kalman filter based classifier fusion for affective state recognition. Multiple Classifier Systems (MCS), Lecture Notes in Computer Science 2013, vol. 7872:85-94. Springer, Berlin, Heidelberg. 10.1007/978-3-642-38067-9_8.
42. Breiman L. Bagging predictors. Mach. Learn. 1996, 24(2):123-140. 10.1007/BF00058655.
43. Glodek M., Schels M., Schwenker F. Ensemble Gaussian mixture models for probability density estimation. Comput. Stat. 2013, 28(1):127-138. 10.1007/s00180-012-0374-5.
44. Dahlbäck N., Jönsson A., Ahrenberg L. Wizard of Oz studies-why and how. Knowl. Based Syst. 1993, 6(4):258-266. special issue: Intelligent User Interfaces. 10.1016/0950-7051(93)90017-N.
45. D. Rösner, J. Frommer, R. Friesen, M. Haase, J. Lange, M. Otto, LAST MINUTE: a multimodal corpus of speech-based user-companion interactions, in: N. Calzolari, K. Choukri, T. Declerck, M.U. Doğan, B. Maegaard, J. Mariani, J. Odijk, S. Piperidis (Eds.), Proceedings of the International Conference on Language Resources and Evaluation Conference (LREC), European Language Resources Association (ELRA), 2012, pp. 23-25.
46. North D.O. An analysis of the factors which determine signal/noise discrimination in pulsed-carrier systems. Proc. IEEE 1963, 51(7):1016-1027. 10.1109/PROC.1963.2383.
47. G. Krell, R. Niese, A. Al-Hamadi, B. Michaelis, Suppression of uncertainties at emotional transitions-facial mimics recognition in video with 3-D model, in: P. Richard, J. Braz (Eds.), Proceedings of the International Conference on Computer Vision Theory and Applications (VISAPP), vol. 2, 2010, pp. 537-542.
48. Kittler J., Hatef M., Duin R.P., Matas J. On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 1998, 20(3):226-239. 10.1109/34.667881.
49. Ruta D., Gabrys B. An overview of classifier fusion methods. Comput. Inf. Syst. 2000, 7(1):1-10.
50. C. Thiel, Multiple Classifier Systems Incorporating Uncertainty, Verlag Dr. Hut, 2010.
51. Ho T., Hull J., Srihari S. Decision combination in multiple classifier systems. IEEE Trans. Pattern Anal. Mach. Intell. 1994, 16(1):66-75. 10.1109/34.273716.
52. Jeon B., Landgrebe D.A. Decision fusion approach for multitemporal classification. IEEE Trans. Geosci. Remote Sens. 1999, 37(3):1227-1233. 10.1109/36.763278.
53. Kuncheva L.I., Bezdek J.C., Duin R.P.W. Decision templates for multiple classifier fusion: an experimental comparison. Pattern Recognit. 2001, 34(2):299-314. 10.1016/S0031-3203(99)00223-X.
54. Bloch I., Hunter A., Appriou A., Ayoun A., Benferhat S., Besnard P., Cholvy L., Cooke R., Cuppens F., Dubois D., et al. Fusion. general concepts and characteristics. Int. J. Intell. Syst. 2001, 16(10):1107-1134. 10.1002/int.1052.
55. G. Giacinto, F. Roli, Design of multiple classifier systems, in: Hybrid Methods in Pattern Recognition, vol. 47, World Scientific Publishing, 2002, pp. 199-226 (Chapter 8). doi:10.1142/9789812778147_0008.
56. Sanderson C., Paliwal K.K. Identity verification using speech and face information. Digit. Signal Process. 2004, 14(5):449-480.
57. F. Bach, G. Lanckriet, M. Jordan, Multiple kernel learning, conic duality, and the SMO algorithm, in: Proceedings of the International Conference on Machine Learning (ICML), ACM, New York, NY, 2004, pp. 321-327. doi:10.1145/1015330.1015424.
58. N. Poh, J. Kittler, Multimodal information fusion, in: Multimodal Signal Processing, Academic Press, 2010, pp. 153-169 (Chapter 8).
59. Schwenker F., Dietrich C.R., Thiel C., Palm G. Learning of decision fusion mappings for pattern recognition. J. Artif. Intell. Mach. Learn. 2006, 17-21. (Special issue: Multiple Classifier Systems).
60. M. Schels, M. Glodek, G. Palm, F. Schwenker, Revisiting AVEC 2011-an information fusion architecture, in: A. Esposito, S. Squartini, G. Palm, B. Apolloni, S. Bassis, A. Esposito, F.C. Morabito (Eds.), Neural Nets and Surroundings, Smart Innovation, Systems and Technologies, vol. 19, Springer, Berlin, Heidelberg, 2013, pp. 385-393. doi:10.1007/978-3-642-35467-0_38.
61. Glodek M., Tschechne S., Layher G., Schels M., Brosch T., Scherer S., Kächele M., Schmidt M., Neumann H., Palm G., Schwenker F. Multiple classifier systems for the classification of audio-visual emotional states. Affective Computing and Intelligent Interaction, Lecture Notes in Computer Science 2011, vol. 6975:359-368. Springer, Berlin, Heidelberg. 10.1007/978-3-642-24571-8_47.
62. Schels M., Scherer S., Glodek M., Kestler H., Palm G., Schwenker F. On the discovery of events in EEG data utilizing information fusion. Comput. Stat. 2013, 28(1):5-18. 10.1007/s00180-011-0292-y.
63. M. Schels, M. Glodek, S. Meudt, S. Scherer, M. Schmidt, G. Layher, S. Tschechne, T. Brosch, D. Hrabal, S. Walter, G. Palm, H. Neumann, H. Traue, F. Schwenker, Multi-modal classifier-fusion for the recognition of emotions, in: Coverbal synchrony in Human-Machine Interaction, CRC Press, 2013, pp. 73-97.
64. Bishop C.M. Pattern Recognition and Machine Learning 2006, Springer, New York, NY.
65. C. Thiel, F. Schwenker, G. Palm, Using Dempster-Shafer theory in MCF systems to reject samples, in: N. Oza, R. Polikar, J. Kittler, F. Roli (Eds.), Multiple Classifier Systems, Lecture Notes in Computer Science, vol. 3541, 2005, pp. 118-127. doi:10.1007/11494683_12.
66. Kalman R.E. A new approach to linear filtering and prediction problems. Trans. ASME-J. Basic Eng. 1960, 82(Series D):35-45.
67. Schuller B., Valstar M., Eyben F., McKeown G., Cowie R., Pantic M. AVEC 2011-The first international audio visual emotion challenges. Proceedings of the International Conference on Affective Computing and Intelligent Interaction (ACII), Lecture Notes in Computer Science 2011, vol. 6975:415-424. Springer, Berlin, Heidelberg. 10.1007/978-3-642-24571-8_53.
68. G. McKeown, M. Valstar, R. Cowie, M. Pantic, The SEMAINE corpus of emotionally coloured character interactions, in: Proceedings of the International Conference on Multimedia and Expo (ICME), IEEE, 2010, pp. 1079-1084. doi:10.1109/ICME.2010.5583006.
69. M. Glodek, M. Schels, G. Palm, F. Schwenker, Multiple classifier combination using reject options and Markov fusion networks, in: Proceedings of the International ACM Conference on Multimodal Interaction (ICMI), ACM, New York, NY, 2012, pp. 465-472. doi:10.1145/2388676.2388778.
70. Glodek M., Schels M., Schwenker F., Palm G. Combination of sequential class distributions from multiple channels using Markov fusion networks. J. Multimodal User Interfaces 2014, 8(3):257-272. 10.1007/s12193-014-0149-0.
71. J. Dinsmore, D.J. Chalmers, F. Adams, K. Aizawa, G. Fuller, J. Schwartz, B. Douglas S, L.A. Meeden, J.B. Marshall, J.A. Barnden, C.-D. Lee, M. Gasser, S.C. Kwasny, K.A. Faisal, T.E. Lange, The Symbolic and Connectionist Paradigms: Closing the Gap, Lawrence Erlbaum Associates, Inc., Hillsdale, New Jersey, 1992.
72. Möller R., Neumann B. Ontology-based reasoning techniques for multimedia interpretation and retrieval. Semantic Multimedia and Ontologies, Part II 2008, 55-98. Springer, London. 10.1007/978-1-84800-076-6_3. Y. Kompatsiaris, P. Hobson (Eds.).
73. Richardson M., Domingos P. Markov logic networks. Mach. Learn. 2006, 62(1-2):107-136. 10.1007/s10994-006-5833-1.
74. Müller F., Späth C., Geier T., Biundo S. Exploiting expert knowledge in factored POMDPs. Proceedings of the European Conference on Artificial Intelligence (ECAI) 2012, vol. 242:606-611. IOS Press. 10.3233/978-1-61499-098-7-606.
75. Shafer G. The Dempster-Shafer theory. Encyclopedia of Artificial Intelligence 1992, 330-331. Wiley, Hershey, PA. second ed. S.C. Shapiro (Ed.).
76. F. Smarandache, D. Han, A. Martin, Comparative study of contradiction measures in the theory of belief functions, in: Proceedings of the International Conference on Information Fusion (FUSION), IEEE, 2012, pp. 271-277.
77. Fahlman S.E., Hinton G.E. Connectionist architectures for artificial intelligence. Computer 1987, 20(1):100-109. 10.1109/MC.1987.1663364.
78. Shastri L. A connectionist approach to knowledge representation and limited inference. Cogn. Sci. 1988, 12(3):331-392. 10.1207/s15516709cog1203_2.
79. S. Wrede, J. Fritsch, C. Bauckhage, G. Sagerer, An XML based framework for cognitive vision architectures, in: Proceedings of the International Conference on Pattern Recognition (ICPR), vol. 1, 2004, pp. 757-760. doi:10.1109/ICPR.2004.1334304.
80. R. Biswas, S. Thrun, K. Fujimura, Recognizing activities with multiple cues, in: Proceedings of the International Conference on Human Motion: Understanding, Modeling, Capture and Animation, Lecture Notes in Computer Science, vol. 4814, Springer, Berlin, Heidelberg, 2007, pp. 255-270. doi:10.1007/978-3-540-75703-0_18.
81. Tran S., Davis L. Event modeling and recognition using Markov logic networks. Proceeding of the European Conference on Computer Vision (ECCV), Lecture Notes in Computer Science 2008, vol. 5303:610-623. Springer, Berlin, Heidelberg. 10.1007/978-3-540-88688-4_45.
82. M. Tenorth, M. Beetz, KnowRob-Knowledge processing for autonomous personal robots, in: Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS), IEEE, 2009, pp. 4261-4266. doi:10.1109/IROS.2009.5354602.
83. Kembhavi A., Yeh T., Davis L. Why did the person cross the road (there)? Scene understanding using probabilistic logic models and common sense reasoning. Proceedings of the European Conference on Computer Vision (ECCV), Lecture Notes in Computer Science 2010, vol. 6312:693-706. Springer, Berlin, Heidelberg. 10.1007/978-3-642-15552-9_50.
84. D. Gehrig, P. Krauthausen, L. Rybok, H. Kuehne, U. Hanebeck, T. Schultz, R. Stiefelhagen, Combined intention, activity, and motion recognition for a humanoid household robot, in: Proceedings of the International IEEE Conference on Intelligent Robots and Systems (IROS), IEEE, 2011, pp. 4819-4825. doi:10.1109/IROS.2011.6095118.
85. Oliver N., Garg A., Horvitz E. Layered representations for learning and inferring office activity from multiple sensory channels. Comput. Vis. Image Underst. 2004, 96(2):163-180. (Special issue: Event Detection in Video). 10.1016/j.cviu.2004.02.004.
86. Raedt L.D. Logical and Relational Learning, Cognitive Technologies 2008, vol. XVI. Springer Science & Business Media.
87. Getoor L., Taskar B. Introduction to Statistical Relational Learning 2007, The MIT press.
88. Mahler R.P. Statistical Multisource-Multitarget Information Fusion 2007, Artech House Inc., Norwood, MA.
89. S. Reuter, K. Dietmayer, Pedestrian tracking using random finite sets, in: Proceedings of the International Conference on Information Fusion (FUSION), IEEE, 2011, pp. 1-8.
90. S. Reuter, K. Dietmayer, S. Handrich, Real-time implementation of a random finite set particle filter, in: H.-U. Heiß, P. Pepper, B.-H. Schlingloff, J. Schneider (Eds.), Sensor Data Fusion: Trends, Solutions, Applications (SDF), Lecture Notes in Informatics, vol. 192, Gesellschaft für Informatik, Berlin, 2011.
91. S. Reuter, B. Wilking, K. Dietmayer, Methods to model the motion of extended objects in multi-object Bayes filters, in: Proceedings of the International Conference on Information Fusion (FUSION), IEEE, 2012, pp. 527-534.
92. Musicki D., Evans R. Joint integrated probabilistic data association. JIPDA. IEEE Trans. Aerosp. Electron. Syst. 2004, 40(3):1093-1099. 10.1109/TAES.2004.1337482.
93. Ristic B., Vo B.-N., Clark D., Vo B.-T. A metric for performance evaluation of multi-target tracking algorithms. IEEE Trans. Signal Process. 2011, 59(7):3452-3457. 10.1109/TSP.2011.2140111.
94. Viola P., Jones M. Robust real-time face detection. Int. J. Comput. Vis. 2004, 57(2):137-154. 10.1023/B:VISI.0000013087.49260.fb.
95. Munz M., Mahlisch M., Dietmayer K. Generic centralized multi sensor data fusion based on probabilistic sensor and environment models for driver assistance systems. IEEE Intell. Transp. Syst. Mag. 2010, 2(1):6-17. 10.1109/MITS.2010.937293.
96. M. Munz, K. Dietmayer, Using Dempster-Shafer-based modeling of object existence evidence in sensor fusion systems for advanced driver assistance systems, in: IEEE Intelligent Vehicles Symposium (IV), 2011, pp. 776-781. doi:10.1109/IVS.2011.5940463.
97. Biundo S., Bercher P., Geier T., Müller F., Schattenberg B. Advanced user assistance based on AI planning. Cognit. Syst. Res. 2011, 12(3-4):219-236. (Special issue: Complex Cognition). 10.1016/j.cogsys.2010.12.005.
98. Müller F., Biundo S. HTN-style planning in relational POMDPs using first-order FSCs. Proceedings of the Annual German Conference on Künstliche Intelligenz (KI), Lecture Notes in Computer Science 2011, vol. 7006:216-227. Springer. 10.1007/978-3-642-24455-1_20.
99. McDermott D. The 1998 AI planning systems competition. AI Mag. 2000, 21(2):35-55.
100. S. Sanner, Relational Dynamic Influence Diagram Language (RDDL): Language Description, Technical Report, NICTA and the Australian National University, 2011.
101. Milch B., Russell S. First-order probabilistic languages. into the unknown. Proceedings of the International Conference on Inductive Logic Programming (ILP), Lecture Notes in Computer Science 2007, vol. 4455:10-24. Springer, Berlin, Heidelberg. 10.1007/978-3-540-73847-3_3.
102. de Salvo Braz R., Amir E., Roth D. A survey of first-order probabilistic models. Innovations in Bayesian Networks Studies in Computational Intelligence 2008, vol. 156. Springer, Berlin, Heidelberg, http://dx.doi.org/10.1007/978-3-540-85066-3_12.
103. Domingos P., Lowd D. Markov logic. an interface layer for artificial intelligence. Synth. Lect. Artif. Intell. Mach. Learn. 2009, 3(1):1-155. 10.2200/S00206ED1V01Y200907AIM007.
104. T. Geier, S. Reuter, K. Dietmayer, S. Biundo, Goal-based person tracking using a first-order probabilistic model, in: A. Nicholson, J.M. Agosta, M.J. Flores (Eds.), Proceedings of the UAI Bayesian Modeling Applications Workshop (UAI-AW), vol. 962 CEUR-WS.org, CEUR-WS, 2012.
105. M. Glodek, S. Scherer, F. Schwenker, Conditioned hidden Markov model fusion for multimodal classification, in: Proceedings of the Annual Conference of the International Speech Communication Association (Interspeech), ISCA, 2011, pp. 2269-2272.
106. Glodek M., Schwenker F., Palm G. Detecting actions by integrating sequential symbolic and sub-symbolic information in human activity recognition. Proceedings of the International Conference on Machine Learning and Data Mining (MLDM), Lecture Notes in Computer Science 2012, vol. 7376:394-404. Springer, Berlin, Heidelberg. 10.1007/978-3-642-31537-4_31.
107. S. Ultes, R. ElChabb, A. Schmitt, W. Minker, JaCHMM: A Java-based conditioned hidden Markov model library, in: Proceeding of the International IEEE conference on Acoustics, Speech, and Signal Processing (ICASSP), 2013, pp. 3213-3217.
108. M. Glodek, T. Geier, S. Biundo, F. Schwenker, G. Palm, Recognizing user preferences based on layered activity recognition and first-order logic, in: Proceedings of the International IEEE Conference on Tools with Artificial Intelligence (ICTAI), IEEE, 2013, pp. 648-653.
109. Sharma R., Pavlovic V., Huang T. Toward multimodal human-computer interface. Proc. IEEE 1998, 86(5):853-869. 10.1109/5.664275.
110. J.R. Carbonell, Mixed-initiative man-computer instructional dialogues (Ph.D. thesis), Department of Electrical Engineering of the Massachusetts Institute of Technology, URL 〈〉, 1970 (last visited 01/10/2013). http://dspace.mit.edu/handle/1721.1/13801.
111. Bolt R.A. "Put-that-there". voice and gesture at the graphics interface. Comput. Graph. 1980, 14(3):262-270.
112. Neal J.G., Shapiro S.C. Intelligent multi-media interface technology. ACM SIGCHI Bull. 1988, 20(1):11-41. 10.1145/49103.1046407.
113. Wahlster W. User and discourse models for multimodal communication. Readings in Intelligent User Interfaces 1991, 45-67. ACM Press. 10.1145/107215.128691. J.W. Sullivan, S.W. Tyler, J.W. Sullivan, S.W. Tyler (Eds.).
114. S. Bangalore, M. Johnston, Integrating multimodal language processing with speech recognition, in: Proceedings of the Annual Conference of the International Speech Communication Association (Interspeech), vol. 2, 2000, pp. 126-129.
115. E. Kaiser, A. Olwal, D. McGee, H. Benko, A. Corradini, X. Li, P. Cohen, S. Feiner, Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality, in: Proceedings of the International Conference on Multimodal Interfaces (ICMI), ACM, New York, NY, 2003, pp. 12-19. doi:10.1145/958432.958438.
116. S. Oviatt, Mutual disambiguation of recognition errors in a multimodel architecture, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, 1999, pp. 576-583. doi:10.1145/302979.303163.
117. Larsson S., Traum D.R. Information state and dialogue management in the TRINDI dialogue move engine toolkit. Nat. Lang. Eng. 2000, 6(3-4):323-340. 10.1017/S1351324900002539.
118. N. Nguyen, D. Phung, S. Venkatesh, H. Bui, Learning and detecting activities from movement trajectories using the hierarchical hidden Markov models, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, IEEE, 2005, pp. 955-960. doi:10.1109/CVPR.2005.203.
119. Williams J.D., Young S. Partially observable Markov decision processes for spoken dialog systems. Comput. Speech Lang. 2007, 21(2):393-422. 10.1016/j.csl.2006.06.008.
120. Lee C., Jung S., Kim K., Lee D., Lee G.G. Recent approaches to dialog management for spoken dialog systems. J. Comput. Sci. Eng. 2010, 4(1):1-22.
121. S. Young, J. Schatzmann, K. Weilhammer, H. Ye, The hidden information state approach to dialog management, in: Proceedings of the International IEEE Conference on Acoustics, Speech and Signal Processing (ICASSP), vol. 4, IEEE, 2007, pp. 149-152. doi:10.1109/ICASSP.2007.367185.
122. A. Nguyen, W. Wobcke, An agent-based approach to dialogue management in personal assistants, in: Proceedings of the International Conference on Intelligent User Interfaces (IUI), ACM, New York, NY, 2005, pp. 137-144. doi:10.1145/1040830.1040865.
123. D. Costa, C. Duarte, Adapting multimodal fission to user[U+05F3]s abilities, in: Proceedings of the International Conference on Universal Access in Human-Computer Interaction (UAHCI): Design for all and eInclusion-Part I, Lecture Notes in Computer Science, vol. 6765, Springer, Berlin, Heidelberg, 2011, pp. 347-356. doi:10.1007/978-3-642-21672-5_38.
124. M.E. Foster, State of the Art Review: Multimodal Fission, Public Deliverable 6.1, University of Edinburgh, URL 〈〉, 2002 (last visited 01/10/2013). http://groups.inf.ed.ac.uk/comic/documents/deliverables/Del6-1.pdf.
125. Rousseau C., Bellik Y., Vernier F., Bazalgette D. A framework for the intelligent multimodal presentation of information. Signal Process. 2006, 86(12):3696-3713. 10.1016/j.sigpro.2006.02.041.
126. B. Dumas, D. Lalanne, S. Oviatt, Multimodal interfaces: A survey of principles, models and frameworks, in: D. Lalanne, J. Kohlas (Eds.), Human Machine Interaction-Research Results of the MMI Program, Lecture Notes in Computer Science, vol. 5440, Springer, Berlin, Heidelberg, 2009, pp. 3-26. doi:10.1007/978-3-642-00437-7_1.
127. M.D. Hina, C. Tadj, A. Ramdane-Cherif, N. Levy, A multi-agent based multimodal system adaptive to the user[U+05F3]s interaction context, in: Multiagent Systems, InTech, 2011, pp. 29-56 (Chapter 2). doi:10.5772/14692.
128. D. Roscher, M. Blumendorf, S. Albayrak, A meta user interface to control multimodal interaction in smart environments, in: Proceedings of the International Conference on Intelligent User Interfaces (IUI), ACM, New York, NY, 2009, pp. 481-482. doi:10.1145/1502650.1502725.
129. P. Smets, Data fusion in the transferable belief model, in: Proceedings of the International Conference on Information Fusion (FUSION), vol. 1, IEEE, 2000, pp. PS21-PS33. doi:10.1109/IFIC.2000.862713.
130. F. Schüssel, F. Honold, M. Weber, Using the transferable belief model for multimodal input fusion in companion systems, in: F. Schwenker, S. Scherer, L.-P. Morency (Eds.), Proceeding of the ICPR 2012 Satellite Workshop on Multimodal Pattern Recognition of Social Signals in Human Computer Interaction (MPRSS), Lecture Notes in Computer Science, vol. 7742, Springer, Berlin, Heidelberg, 2013, pp. 100-115. doi:10.1007/978-3-642-37081-6_12.
131. U. Brandes, M. Eiglsperger, I. Herman, M. Himsolt, M. Marshall, GraphML progress report: structural layer proposal, in: P. Mutzel, M. Jünger, S. Leipert (Eds.), Proceedings of the International Symposium on Graph Drawing (GD), Lecture Notes in Computer Science, vol. 2265, Springer, Berlin, Heidelberg, 2002, pp. 501-512. doi:10.1007/3-540-45848-4_59.
132. F. Nothdurft, G. Bertrand, T. Heinroth, W. Minker, GEEDI-Guards for emotional and explanatory dialogues, in: Proceedings of the International Conference on Intelligent Environments (IE), 2010, pp. 90-95. doi:10.1109/IE.2010.24.
133. F. Nothdurft, G. Bertrand, H. Lang, W. Minker, Adaptive explanation architecture for maintaining human-computer trust, in: Proceedings of the IEEE Computer Software and Applications Conference (COMPSAC), 2012, pp. 176-184. doi:10.1109/COMPSAC.2012.28.
134. R. Barták, Constraint programming: In pursuit of the holy grail, in: Proceedings of the Week of Doctoral Students (WDS), vol. IV, MatFyzPress, 1999, pp. 555-564.
135. Fernández A.J., Hortalá-González T., Sáenz-Pérez F., Del Vado-Vírseda R. Constraint functional logic programming over finite domains. Theory Practice Logic Program. 2007, 7(5):537-582. 10.1017/S1471068406002924.
136. G. Bertrand, F. Nothdurft, W. Minker, "What do you want to do next?" providing the user with more freedom in adaptive spoken dialogue systems, in: Proceedings of the International Conference on Intelligent Environments (IE), 2012, pp. 290-296. doi:10.1109/IE.2012.27.
137. F. Honold, F. Schüssel, M. Weber, F. Nothdurft, G. Bertrand, W. Minker, Context models for adaptive dialogs and multimodal interaction, in: Proceedings of the International Conference on Intelligent Environments (IE), IEEE, 2013. doi:10.1109/IE.2013.54.
138. F. Honold, F. Schüssel, M. Weber, The automated interplay of multimodal fission and fusion in adaptive HCI, in: 2014 10th International Conference on Intelligent Environments (IE), IEEE, Shanghai, China, 2014, pp. 170-177. doi:10.1109/IE.2014.32.
139. P. Bercher, S. Biundo, T. Geier, T. Hoernle, F. Nothdurft, F. Richter, B. Schattenberg, Plan, repair, execute, explain-how planning helps to assemble your home theater, in: Proceedings of the 24th International Conference on Automated Planning and Scheduling (ICAPS), AAAI Press, 2014, pp. 386-394.
140. Schüssel F., Honold F., Weber M. Influencing factors on multimodal interaction during selection tasks. J. Multimodal User Interfaces 2013, 7(4):299-310. 10.1007/s12193-012-0117-5.
141. Britton C., Bye P. IT Architectures and Middleware: Strategies for Building Large 2004, Integrated Systems, Addison-Wesley Professional.
142. Myerson J.M. The Complete Book of Middleware 2002, Auerbach Publications.
143. A. Puder, K. Römer, F. Pilhofer, Distributed Systems Architecture: A Middleware Approach, The MK/OMG Press Series, Morgan Kaufmann, 2006.
144. Schröder M. The SEMAINE API. towards a standards-based framework for building emotion-oriented systems. Adv. Hum. Comput. Interact. 2010, 2010:1-21. 10.1155/2010/319406.