Mining the home environment

Journal of Intelligent Information Systems

Volumn 43, Issue 3, 2014, Pages 503-519

  Cook, Diane J ^a   Krishnan, Narayanan ^a  

^a WASHINGTON STATE UNIVERSITY   (United States)

Author keywords

Activity recognition; Data mining; Smart homes

Indexed keywords

AUTOMATION; BEHAVIORAL RESEARCH; INTELLIGENT BUILDINGS;

ACTIVITY RECOGNITION; DAILY BEHAVIORS; DAILY ROUTINES; GAIN INSIGHT; HOME ENVIRONMENT; SMART ENVIRONMENT; SMART HOMES; SOCIETY AND TECHNOLOGIES;

DATA MINING;

EID: 84925463474     PISSN: 09259902     EISSN: 15737675     Source Type: Journal    
DOI: 10.1007/s10844-014-0341-4     Document Type: Article

References (120)

1. Abowd, G., & Mynatt, E.D. (2005). “Designing for the human experience in smart environments,” in Smart Environments: Technologies, Protocols and Applications, pp. 153–174.
2. Agrawal, R., & Srikant, R. (1995). “Mining sequential patterns,” in Proceedings of the International Conference on Data Engineering, pp. 3–14.
3. Alon, J., Athitsos, V., Yuan, Q., & Sclaroff, S. (2008). A unified framework for gesture recognition and spatiotemporal gesture segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 1685–1699.
4. Ambady, N., & Rosenthal, R. (1992). Thin slices of expressive behavior as predictors of interpersonal consequences: a meta-analysis. Psychological Bulletin, 2, 256–275.
5. Aztiria, A., Augusto, J., & Cook, D. (2012). Discovering frequent user-environment interactions in intelligent environments. Personal Ubiquitous Computing, 16(1), 91–103.
6. Baker, W. (2000). Achieving success through social capital. Wiley.
7. Bao, L., & Intille, S. (2004) “Activity recognition from user annotated acceleration data,” in Pervasive, pp. 1–17.
8. Barger, T., Brown, D., & Alwan, M. (2005). Health status monitoring through analysis of behavioral patterns. IEEE Transaction. System Man, Cybernetics. Part A, 35(1), 22–27.
9. Barker, S.K., Mishra, A., Irwin, D., Shenoy, P., Albrecht, J.R. (2012). “SmartCap: flattening peak electricity demand in smart homes,” in IEEE International Conference on Pervasive Computing and Communications.
10. Benerjee, T., Keller, M.J., Skubic, M. (2012). “Resident identification using Kinect depth image data and fuzzy clustering techniques,” in International Conference of the IEEE Engineering in Medicine and Biology Society
11. Brand, M., Oliver, N., Pentland, A. (1997). “Coupled hidden Markov models for complex action recognition,” in International Conference on Computer Vision and Pattern Recognition, pp. 994–999.
12. Brdiczka, O., Crowley, J.L., Reignier, P. (2009). “Learning situation models in a smart home,” IEEE Trans. Syst. Man, Cybern. Part B, vol. 39, no. 1.
13. Buettner, M., Prasad, R., Philipose, M., Wetherall, D. (2009). “Recognizing daily activities with RFID-based sensors,” in International Conference on Ubiquitous Computing, pp. 51–60.
14. Chen, L., Nugent, C. D., & Wang, H. (2012a). A knowledge-driven approach to activity recognition in smart homes. IEEE Transactions on Knowledge and Data Engineering, 24(6), 961–974.
15. Chen, C., Cook, D.J., Crandall, A. (2012). “The user side of sustainability: Modeling behavior and energy usage in the home,” Pervasive Mob. Comput.
16. Chen, D., Irwin, D., Shenoy, P., Albrecht, J. (2014). “Combined heat and privacy: preventing occupancy detection from smart meters,” in IEEE International Conference on Pervasive Computing and Communications.
17. Cheng, S.Y., &Trivedi, M.M. (2007). “Articulated human body pose inference from voxel data using a kinematically constrained Gaussian mixture model,” in Workshop on Evaluation of Articulated Human Motion and Pose Estimation
18. Choe, E.K., Consolvo, S., Jung, J., Harrison, B., Kientz, J. A. (2011). “Living in a glass house: A survey of private moments in the home,” in International Conference on Ubiquitous Computing.
19. Cohn, G., Gupta, S., Lee T., Morris, D., Smith, J.R., Reynolds, M.S., Tan, D.S., Patel, S.N. (2012). “An ultra-low-power human body motion sensor using static electric field sensing,” in ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 99–102.
20. Cook, D. “Learning setting-generalized activity models for smart spaces,” IEEE Intell. Syst.
21. Cook, D.J. & Das, S. K. (2005). Smart Environments: Technologies, Protocols, and Applications. Wiley.
22. Cook, D.J., Crandall, A., Thomas, B., Krishnan, N. (2012). “CASAS: A smart home in a box,” IEEE Comput.
23. Cook, D. J., Krishnan, N., & Rashidi, P. (2013). Activity discovery and activity recognition: a new partnership. IEEE Transaction System Man, Cybernetics Part B, 43(3), 820–828.
24. Costanza, E., Ramchurcn, S., Jennings, N. (2012). “Understanding domestic energy consumption through interactive visualisation: a field study,” in International Conference on Ubiquitous Computing.
25. Dawadi, P., Cook, D.J., Parsey, C., Schmitter-Edgecombe, M., Schneider, M. (2011). “An approach to cognitive assessment in smart homes,” in KDD Workshop on Medicine and Healthcare
26. Dawadi, P.,Cook, D.J., Schmitter-Edgecombe, M. (2012). “Automated cognitive health assessment using smart home monitoring of complex tasks,” IEEE Trans. Syst. Man, Cybern. Part B.
27. Deleawe, S., Kusznir, J., Lamb, B., & Cook, D. J. (2010). Predicting air quality in smart environments. Journal of Ambient Intelligence and Smart Environments, 2(2), 145–154.
28. Demiris, G., Oliver, D. P., Dickey, G., Skubic, M., & Rantz, M. (2008). Findings from a participatory evaluation of a smart home application for older adults. Technology Health Care, 16, 111–118.
29. Department of Health. (2007). “Speech by the Rt Hon Patricia Hewitt MP, Secretary of State for Health,” in Long-term Conditions Alliance Annual Conference.
30. Derbach, S., Das, B., Krishnan, N., Thomas, B., Cook, D. (2012). “Simple and complex activity recognition through smart phones,” in International Conference on Intelligent Environments
31. Diel, M., Marsiske, M., Horgas, A., Rosenberg, A., Saczynski, J., & Willis, S. (2005). The revised observed tasks of daily living: a performance-based assessment of everyday problem solving in older adults. Journal Application Gerontechnology, 24, 211–230.
32. Do, J.-H., Jung, S. H., Jang, H., Yang, S.-E., Jung, J.-W., & Bien, Z. (2006). Gesture-based interface for home appliance control in smart home. Smart Homes and Beyond - Proceedings of the 4th International Conference On Smart homes and health Telematics (ICOST2006), 19, 23–30.
33. Farias, S., Mungas, D., Reed, B., Harvey, D., Cahn-Weiner, D., & DeCarli, C. (2006). MCI is associated with deficits in everyday functioning. Alzheimer Disease & Associated Disorders, 20, 217–223.
34. Foerster, F., Smeja, M., & Fahrenberg, J. (1999). Detection of posture and motion by accelerometry: a validation study in ambulatory monitoring. Computer Human Behavior, 15, 571–583.
35. Fratiglioni, L., Wang, H., Ericsson, K., Maytan, M., & Winblad, B. (2000). Influence of social network on occurrence of dementia: a community-based longitudinal study. Lancet, 335, 1315–1319.
36. Froehlich, J., Larson, E., Gupta, S., Cohn, G., Reynolds, M., & Patel, S. N. (2011). Disaggregated end-use energy sensing for the smart grid. IEEE Pervasive Computing, 10(1), 28–39.
37. Gritai, A., Sheikh, Y., Rao, C., & Shah, M. (2009). Matching trajectories of anatomical landmarks under viewpoint, anthropometric and temporal transforms. International Journal of Computer Vision, 84(3), 325–343.
38. Gu, T., Chen, S., Tao, X., & Lu, J. (2010). An unsupervised approach to activity recognition and segmentation based on object-use fingerprints. Data & Knowledge Engineering, 69(6), 533–544.
39. Gyorbiro, N., Fabian, A., & Homanyi, G. (2008). An activity recognition system for mobile phones. Mobile Networks Application, 14, 82–91.
40. Hagras, H., Doctor, F., Lopez, A., Callaghan, V. (2007). “An incremental adaptive life long learning approach for type-2 fuzzy embedded agents in ambient intelligent environments,” IEEE Trans. Fuzzy Syst.
41. Hayes, G., Poole, E., Iachello, G., Patel, S., Graimes, A., Abowd, G., & Truong, K. (2007). Physical, social, and experimental knowledge of privacy and security in a pervasive computing environment. IEEE Pervasive Computing, 6(4), 56–63.
42. Heierman, E.O., & Cook, D.J. (2003). “Improving home automation by discovering regularly occurring device usage patterns,” in IEEE International Conference on Data Mining, pp. 537–540.
43. Helal, A., Mann, W., El-Zabadani, H., King, J., Kaddoura, Y., & Jansen, E. (2005). The gator tech smart house: a programmable pervasive space. IEEE Computer, 38(3), 50–60.
44. Helal, A., Cook, D. J., & Schmalz, M. (2009). Smart home-based health platform for behavioral monitoring and alteration of diabetes patients. Journal of Diabetes Science and Technology, 3(1), 1–8.
45. Hensel, B. K., Demiris, G., & Courtney, K. L. (2006). Defining obtrusiveness in home telehealth technologies: a conceptual framework. Journal American Medical Informatics Association, 13(4), 428–431.
46. Hill, K. (2013). “When ‘smart homes’ get hacked: I haunted a complete stranger’s house via the Internet,” Forbes.
47. Hodges, M., Kirsch, N., Newman, N.,Pollack, M. (2010). “Automatic assessment of cognitive impairment through electronic observation of object usage,” in International Conference on Pervasive Computing, pp. 192–209.
48. Hollosi, D., Schroder, J., Goetze, S., Appell, J. (2010). “Voice activity detection driven acoustic event classification for monitoring in smart homes,” in International Symposium on Applied Sciences in Biomedical and Communication Technologies, pp. 1–5.
49. Hongeng, S., Nevatia, R., & Bremond, F. (2004). Video-based event recognition: activity representation and probabilistic recognition methods. Computer Vision and Image Understanding, 96(2), 129–162.
50. Hu, D.H., & Yang, Q. (2011). “Transfer learning for activity recognition via sensor mapping,” in International Joint Conference on Artificial Intelligence, pp. 1962–1967.
51. Hu, D. H., Zheng, V. W., & Yang, Q. (2011b). Cross-domain activity recognition via transfer learning. Pervasive and Mobile Computing, 7(3), 344–358.
52. Huynh, T., Fritz, M., Schiele, B. (2008). “Discovery of activity patterns using topic models,” in International Conference on Ubiquitous Computing, pp. 10–19.
53. Jakkula, V., & Cook, D. J. (2008). Anomaly detection using temporal data mining in a smart home environment. Methods of Information in Medicine, 47(1), 70–75.
54. Jarafi, R. Sastry, S. Bajcsy, R. (2009). “Distributed recognition of human actions using wearable motion sensor networks,” J. Ambient Intell. Smart Environ.
55. Jiang, Y., Li, K., Tian, L., Piedrahita, R., Yun, X., Mansata, O., Lv, Q., Dick, R.P., Hannigan, M., Shang, L. (2011). “MAQS: apersonalized mobile sensing system for indoor air quality monitoring,” in International Conference on Ubiquitous Computing.
56. Junker, H., Amft, O., Lukowicz, P., & Groster, G. (2008). Gesture spotting with body-worn inertial sensors to detect user activities. Pattern Recognition, 41, 2010–2024.
57. Kan, P., Huq, R., Hoey, J., Mihailidis, A. (2011). “The development of an adaptive upper-limb stroke rehabilitation robotic system,” J. Neuroeng. Rehabil., vol. 8, no. 33.
58. Kjergarrd, M. B.,Wirz, M., Roggen, D., Troster, G. (2012). “Mobile sensing of pedestrian flocks in indoor environments using WiFi signals,” in IEEE International Conference on Pervasive Computing and Communication.
59. Komatsuzaki, M., Tsukada, K., Siio, L., Verronen P., Luimula, M., Pieska, S. (2011). “IteMinder: Finding items in a room using passive RFID and an autonomous robot,” in International Conference on Ubiquitous Computing.
60. Krishnan, N., & Cook, D.J. (2012). “Activity recognition on streaming sensor data,” Pervasive Mob. Comput.
61. Krishnan, N., & Panchanathan, S. (2008). “Analysis of low resolution accelerometer data for human activity recognition,” in International Conference on Acoustic Speech and Signal Processing.
62. Krishnan, N.C., Colbry, D., Juillard, C., Panchanathan, S. (2008). “Real time human activity recognition using tri-axial accelerometers,” in Sensors Signals and Information Processing Workshop.
63. Kwapisz,J., Weiss, G., Moore, S. (2010). “Activity recognition using cell phone accelerometers,” in International Workshop on Knowledge Discovery from Sensor Data, pp. 10–18.
64. Larson, S. (2013). “Privacy at home: 5 things the connected home can learn from social media,” readwrite, [Online]. Available: http://readwrite.com/2013/11/15/five-things-the-connected-home-can-learn-from-social-media#feed=/series/home&awesm=~osmE1DqUR9mSt4.
65. Larson, E., Froehlich, J., Campbell, T., Haggerty, C., Fogarty, J., Patel, S.N. (2012). “Disaggregated water sensing from a single, pressure-based sensor,” Pervasive Mob. Comput.
66. Laszlo, M. (2005). Minimum spanning tree partitioning algorithm for microaggregation. IEEE Transactions on Knowledge and Data Engineering, 17(7), 902–911.
67. Lee, A. “Hacking the connected home: When your house watches you,” readwrite. [Online]. Available: http://readwrite.com/2013/11/13/hacking-the-connected-home-when-your-house-watches-you#feed=/tag/connected-home&awesm=~osmDA6o9bkgx84.
68. Lee, M.L., & Dey, A.K. (2010). “Embedded assessment of aging adults: A concept validation with stake holders,” in International Conference on Pervasive Computing Technologies for Healthcare, pp. 22–25.
69. Lester, J., Choudhury, T., Kern, N., Borriello, G., Hannaford, B. (2005). “A hybrid discriminative/generative approach for modeling human activities,” in International Joint Conference on Artificial Intelligence, pp. 766–772.
70. Li, Y., Ho, K. C., & Popescu, M. (2012a). A microphone array system for automatic fall detection. IEEE Transactions on Biomedical Engineering, 59, 1291–1301.
71. Li, F., Zhao, C., Zhao, F., Ding, G., Gong, J.,Liu, C., Jian, S., Hsu, F.-H. (2012). “A reliable and accurate indoor localization method using phone inertial sensors,” in ACM International Conference on Ubiquitous Computing
72. Liao, L., Patterson, D. J., Fox, D., & Kautz, H. (2007). Learning and inferring transportation routines. Artificial Intelligence, 171(5–6), 311–331.
73. Logan, B., Healey, J., Philipose, M., Tapia, E.M., Intille, S. (2007). “A long-term evaluation of sensing modalities for activity recognition,” in Proceedings of the 9th International Conference on Ubiquitous Computing.
74. Lu, H., Rabbi, M., Chittaranjan, G.T., Frauendorfer, D., Schmid Mast, M., Campbell, A.T., Gatica-Perez, D., Choudhury, T. (2012). “StressSense: detecting stress in unconstrained acoustic environments using smartphones,” in ACM International Conference on Ubiquitous Computing.
75. Lyons, P., Tran, A., Marsland, S., Dietric, J., Guesgen, H. (2010). “Use cases for abnormal behavior detection in smart homes,” in International Conference on Smart Homes and Health Telematics, pp. 144–151.
76. Maurer, U., Smailagic, A., Siewiorek, D., Deisher, M. (2006). “Activity recognition and monitoring using multiple sensors on different body positions,” in Proceedings of the International Workshop on Wearable and Implantable Body Sensor Networks, pp. 113–116.
77. Mozer, M. (1998). “The neural network house: an environment that adapts to its inhabitants,” in Proceedings of the AAAI Spring Symposium on Intelligent Environments, pp. 110–114.
78. Munguia Tapia, E., Choudhury, T., Philipose, M. (2006). “Building reliable activity models using hierarchical shrinkage and mined ontology,” in Pervasive, pp. 17–32.
79. Natarajan, P., & Nevatia, R. (2007). “Coupled hidden semi Markov models for activity recognition,” in Workshop on Motion and Video Computing.
80. Niebles, J. C., Wang, H., & Fei-Fei, L. (2008). Unsupervised learning of human action categories using spatial-temporal words. International Journal of Computer Vision, 79(3), 299–318.
81. Orsini, L. (2013). “Connected home invasion: you’ve seen the madness, here are the methods,” readwrite.
82. Pavel, M., Adami, A., Morris, M., Lundell, J., Hayes, T.L., Jimison, H., Kaye, J.A. (2006). “Mobility assessment using event-related responses,” in Transdisciplinary Conference on Distributed Diagnosis and Home Healthcare, pp. 71–74.
83. Pei, J., Han, J., & Wang, W. (2007). Constraint-based sequential pattern mining: the pattern-growth methods. Journal of Intelligent Information Systems, 28(2), 133–160.
84. Perneczky, R., Sorg, C., Hartmann, J., Tosic, N., Grimmer, T., Heitele, S., & Kurz, A. (2006). Impairment of activities of daily living requiring memory or complex reasoning as part of the MCI syndrome. International Journal of Geriatric Psychiatry, 21, 158–162.
85. Philipose, M., Fishkin, K. P., Perkowitz, M., Patterson, D. J., Hahnel, D., Fox, D., & Kautz, H. (2004). Inferring activities from interactions with objects. IEEE Pervasive Computing, 3(4), 50–57.
86. Rahal, Y., Pigot, H., Mabilleau, P. (2008). “Location estimation in a smart home: System implementation and evaluation using experimental data,” Int. J. Telemed. Appl., p. 4.
87. Rashidi, P., Cook, D., Holder, L., & Schmitter-Edgecombe, M. (2011). Discovering activities to recognize and track in a smart environment. IEEE Transactions on Knowledge and Data Engineering, 23(4), 527–539.
88. Ravi, N., Dandekar, N., Mysore, P., Littman, M.L. (2005). “Activity recognition from accelerometer data,” in Innovative Applications of Artificial Intelligence, pp. 1541–1546.
89. Rialle, V., Ollivet, C., Guigui, C., & Herve, C. (2008). What do family caregivers of Alzheimer’s disease patients desire in smart home technologies? Methods of Information in Medicine, 47, 63–69.
90. Ruotsalainen, A., & Ala-Kleemola, T. (2007). “Gais: A method for detecting discontinuous sequential patterns from imperfect data,” in Proceedings of the International Conference on Data Mining, pp. 530–534.
91. Ryoo, M.S.,& Aggarwal, J.K. (2006). “Recognition of composite human activities through context-free grammar based representation,” in IEEE Conference on Computer Vision and Pattern Recognition.
92. Sahaf, Y., Krishnan, N., Cook, D.J. (2011). “Defining the complexity of an activity,” in AAAI Workshop on Activity Context Representation: Techniques and Languages.
93. Schmitter-Edgecombe, M., Woo, E., & Greeley, D. (2009). Characterizing multiple memory deficits and their relation to everyday functioning in individuals with mild cognitive impairment. Neuropsychology, 23, 168–177.
94. Scott, J., Brush, A.J.B., Krumm, J.,Meyers, B., Hazas, M., Hodges, S., Villar, N. (2011). “PreHeat: Controlling home heating using occupancy prediction,” in International Conference on Ubiquitous Computing.
95. Seryak, J., & Kissock, K. (2003). “Occupancy and behavioral effects on residential energy use,” Sol. Conf., pp. 717–722.
96. Song, C., Koren, T., Wang, P., & Barabasi, A. L. (2010). Modeling the scaling properties of human mobility. Nature Physics, 7, 713–718.
97. Starner, T., & Pentland, A. (1998). Real-time American sign language recognition from video using hidden Markov models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(12), 1371–1375.
98. Su, B.Y., Ho, K.C., Skubic, M., Rosales, L. (2012). “Pulse rate estimation using hydraulic bed sensor,” in International Conference of the IEEE Engineering in Medicine and Biology Society
99. Suk, M., Ramadass, A., Jim, Y., Prabhakaran, B. (2012). “Video human motion recognition using a knowledge-based hybrid method based on a hidden Markov model,” ACM Trans. Intell. Syst. Technol., vol. 3, no. 3.
100. Teixeira, T., Jung, D., Dublon, G., Savvides, A. (2009). “Recognizing activities from context and arm pose using finite state machines,” in ACM/IEEE International Conference on Distributed Smart Cameras
101. Tukey, J. (1977). Exploratory Data Analysis. Addison-Wesley, 1977.
102. U. Nations. (2012). “World population ageing: 1950–2050,” [Online]. Available: www.un.org/esa/population/publications/worldageing19502050/.
103. van Kasteren T., & Krose, B. (2007). “Bayesian activity recognition in residence for elders,” in Proceedings of the IET International Conference on Intelligent Environments pp. 209–212.
104. Vergara,I., Mendez, D., Labrador, M. A. (2013). “On the interactions between privacy-preserving, incentive, and inerence mechanisms in participatory sensing systems,” in International Conference on Network and System Security.
105. Vergara-Laurens, I., Mendez, D., Labrador, M.A. (2014). “Privacy, quality of information, and energy consumption in participatory sensing systems,” in IEEE International Conference on Pervasive Computing and Communications.
106. Vincent, G., & Velkoff, V. (2010). “The next four decades - the older population in the United States: 2010 to 2050”.
107. Vines, J., Lindsay, S., Pritchard, G.W., Lie, M., Greathead, D., Olivier, P., Brittain, K. (2013). “Making family care work: dependence, privacy and remote home monitoring,” in ACM International Joint Conference on Pervasive and Ubiquitous Computing
108. Waltz, E. (2012). “How I quantified myself,” IEEE Spectr., vol. September, pp. 43–47.
109. Wang, J. (2009). “A survey on privacy preserving data mining,” in International Workshop on Database Technology and Applications, pp. 111–114.
110. Wang, S., Pentney, W., Popescu, A.M., Choudhury, T., Philipose, M. (2007). “Common sense based joint training of human activity recognizers,” in International Joint Conference on Artificial Intelligence, pp. 2237–2242.
111. Wang, S., Skubic, M., Zhu, Y., Galambos, C. (2011). “Using passive sensing to estimate relative energy expenditure for eldercare monitoring,” in PerCom Workshop on Smart Environments to Enhance Health Care.
112. Wang, L., Gu, T., Tao, X., & Lu, J. (2012). A hierarchical approach to real-time activity recognition in body sensor networks. Pervasive and Mobile Computing, 8(1), 115–130.
113. Wbcsd. (2012). “Energy efficiency in buildings,” [Online]. Available: www.wbcsd.org.
114. Wightman,P., Zulbaran, M., Rodriguez, M., Labrador, M.A. (2013). “MaPIR: Mapping-based private information retrieval for location privacy in LBS,” in IEEE Local Computer Networks Conference.
115. Wilson, D., & Atkeson, C. (2005). “Simultaneous tracking and activity recognition (STAR) using many anonymous, binary sensors,” in Pervasive, pp. 62–79.
116. Wyatt, D., Philipose, M., Choudhury, T. (2005). “Unsupervised activity recognition using automatically mined common sense,” in National Conference on Artificial Intelligence, pp. 21–27.
117. Yatani, K., & Truong, K. (2012). “BodyScope: A wearable acoustic sensor for activity recognition,” in ACM International Conference on Ubiquitous Computing.
118. Yin, J., Yang, Q., & Pan, J. J. (2008). Sensor-based abnormal human-activity detection. IEEE Transactions on Knowledge and Data Engineering, 20(8), 1082–1090.
119. York, E., & White, L. (2009). Social disconnectedness, perceived isolation, and health among older adults. Journal of Health and Social Behavior, 50(1), 31–48.
120. Youngblood, G. M., & Cook, D. J. (2007). Data mining for hierarchical model creation. IEEE Transaction System Man, Cybernetics Part C, 37(4), 1–12.