RF-sensing of activities from non-cooperative subjects in device-free recognition systems using ambient and local signals

IEEE Transactions on Mobile Computing

Volumn 13, Issue 4, 2014, Pages 907-920

  Sigg, Stephan ^a   Scholz, Markus ^b   Shi, Shuyu ^a   Ji, Yusheng ^a   Beigl, Michael ^b  

^a NATIONAL INSTITUTE OF INFORMATICS   (Japan)

^b KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

Author keywords

and processing; location dependent and sensitive; Pervasive computing; signal analysis; signal processing; synthesis

Indexed keywords

ACTIVITY RECOGNITION; ENVIRONMENTAL CHANGE; LOCATION-DEPENDENT AND SENSITIVE; RADIO FREQUENCY CHANNELS; RECOGNITION SYSTEMS; SOFTWARE-DEFINED RADIOS; TRANSMISSION CHANNELS; TWO-STAGE CLASSIFIERS;

SIGNAL ANALYSIS; SIGNAL PROCESSING; SYNTHESIS (CHEMICAL);

UBIQUITOUS COMPUTING;

EID: 84897864141     PISSN: 15361233     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMC.2013.28     Document Type: Article

References (70)

1. T. Li and L. Chen, "Internet of Things: Principles, Frameworks and Applications," Proc. Future Wireless Networks and Information Systems, pp. 477-842, 2008.
2. S. Haller, "The Things in the Internet of Things," Proc. Internet of Things Conf., 2010.
3. S. Sigg, P. Jakimovski, and M. Beigl, "Calculation of Functions on the RF-Channel for IoT," Proc. Third Int'l Conf. Internet of Things (IoT '12), 2012.
4. M. Beigl, A. Krohn, T. Zimmer, and C. Decker, "Typical Sensors Needed in Ubiquitous and Pervasive Computing," Proc. First Int'l Workshop Networked Sensing Systems (INSS), vol. 4, pp. 153-158, June 2004.
5. K. Woyach, D. Puccinelli, and M. Haenggi, "Sensorless Sensing in Wireless Networks: Implementation and Measurements," Proc. Second Int'l Workshop Wireless Network Measurement, 2006.
6. K. Muthukrishnan, M. Lijding, N. Meratnia, and P. Havinga, "Sensing Motion Using Spectral and Spatial Analysis of WLAN RSSI," Proc. Second European Conf. Smart Sensing and Context, 2007.
7. M. Youssef, M. Mah, and A. Agrawala, "Challenges: Device-Free Passive Localisation For Wireless Environments," Proc. ACMMobiCom '07, pp. 222-229, 2007.
8. M. Seifeldin, A. Saeed, A. Kosba, A. El-Keyi, and M. Youssef, "Nuzzer: A Large-Scale Device-Free Passive Localization System for Wireless Environments," IEEE Trans. Mobile Computing (TMC), vol. 12, no. 7, 2013.
9. M. Scholz, S. Sigg, H.R. Schmidtke, and M. Beigl, "Challenges for Device-Free Radio-Based Activity Recognition," Proc. Third Workshop Context Systems, Design, Evaluation and Optimisation, in Conjunction with MobiQuitous 2011, 2011.
10. S. Shi, S. Sigg, and Y. Ji, "Passive Detection of Situations from Ambient FM-Radio Signals," Proc. Int'l Workshop Situation, Activity and Goal Awareness, in Conjunction with UbiComp 2012, 2012.
11. S. Shi, S. Sigg, and Y. Ji, "Activity Recognition from Radio Frequency Data: Multi-Stage Recognition and Features," Proc. IEEE Fifth Conf. Context Awareness for Proactive Systems (CAPS '12), 2012.
12. M. Reschke, J. Starosta, S. Schwarzl, and S. Sigg, "Situation Awareness Based On Channel Measurements," Proc. Fourth Conf. Context Awareness for Proactive Systems (CAPS), 2011.
13. M. Reschke, S. Schwarzl, J. Starosta, S. Sigg, and M. Beigl, "Context Awareness Through The RF-Channel," Proc. Second Workshop for Context Systems Design and Evaluation (CoSDEO '11), 2011.
14. M. Scholz, S. Sigg, D. Shihskova, G. von Zengen, G. Bagshik, T. Guenther, M. Beigl, and Y. Ji, "Sensewaves: Radiowaves for Context Recognition," Proc. Video Proc. Ninth Int'l Conf. Pervasive Computing (Pervasive '11), 2011.
15. N. Ravi, N. Dandekar, P. Mysore, and M.L. Littman, "Activity Recognition from Accelerometer Data," Proc. 17th Conf. Innovative Applications of Artificial Intelligence, pp. 1541-1546, 2005. (Pubitemid 43006650)
16. H. Cao, M.N. Nguyen, C.C.W. Phua, S. Krishnaswamy, and X. Li, "An Integrated Framework for Human Activity Classification," Proc. 14th ACM Int'l Conf. Ubiquitous Computing, 2012.
17. S. Sigg, D. Gordon, G.v. Zengen, M. Beigl, S. Haseloff, and K. David, "Investigation of Context Prediction Accuracy for Different Context Abstraction Levels," IEEE Trans. Mobile Computing, vol. 11, no. 6, pp. 1047-1059, June 2012.
18. L. Bao and S.S. Intille, "Activity Recognition from User-Annotated Acceleration Data," Proc. Second Int'l Conf. Pervasive Computing (PERVASIVE '04), 2004.
19. T. Ploetz, N.Y. Hammerla, A. Rozga, A. Reavis, N. Call, and G.D. Abowd, "Automatic Assessment of Problem Behavior in Individuals With Developmental Disabilities," Proc. 14th ACM Int'l Conf. Ubiquitous Computing (Ubicomp '12), 2012.
20. S. Abdullah, N.D. Lane, and T. Choudhury, "Towards Population Scale Activity Recognition: A Scalable Framework for Handling Data Diversity," Proc. 26th Conf. Artificial Intelligence, 2012.
21. R. Chavarriaga, H. Bayati, and J. del R. Millan, "Unsupervised Adaptation for Acceleration-Based Activity Recognition: Robustness to Sensor Displacement And Rotation," Personal and Ubiquitous Computing, vol. 17, pp. 479-490, 2011.
22. G. Cohn, D. Morris, S.N. Patel, and D.S. Tan, "Humantenna: Using the Body as an Antenna for Real-Time Whole-Body Interaction," Proc. ACM SIGCHI Conf. Human Factors in Computing Systems (CHI '12), 2012.
23. K. Patridge and P. Golle, "On Using Existing Time-Use Study Data For Ubiquitous Computing Applications," Proc. 10th Int'l Conf. Ubiquitous Computing (UbiComp '08), pp. 144-153, 2008.
24. A. Varshavsky and S.N. Patel, Location in Ubiquitous Computing, (series Ubiquitous Computing Fundamentals) pp. 285-319, Taylor and Francis Group, 2008.
25. N.D. Lane, E. Miluzzo, H. Lu, D. Peebles, T. Choudhury, and A.T. Campbell, "A Survey of Mobile Phone Sensing," IEEE Comm. Magazine, vol. 48, no. 9, pp. 140-150, Sept. 2010.
26. A.K. Dey, K. Wac, D. Ferreira, K. Tassini, J.-H. Hong, and J. Ramos, "Getting Closer: An Empirical Investigation of the Proximity of User to Their Smart Phones," Proc. 13th Int'l Conf. Ubiquitous Computing (UbiComp), 2011.
27. S.N. Patel, J.A. Kientz, G.R. Hayes, S. Bhat, and G.D. Abowd, "Farther Than You May Think: An Empirical Investigation of the Proximity of Users to their Mobile Phones," Proc. Eighth Int'l Conf. Ubiquitous Computing (Ubicomp '06), pp. 123-140, 2006. (Pubitemid 44618969)
28. S. Hongeng, R. Nevatia, and F. Bremond, "Video Based Event Recognition: Activity Representation and Probabilistic Recognition Methods," Computer Vision and Image Understanding, vol. 96, pp. 129-162, 2004.
29. D. Bannach, P. Lukowicz, and O. Amft, "Rapid Prototyping of Activity Recognition Applications," IEEE Pervasive Computing, vol. 7, no. 2, pp. 22-31, Apr.-June 2008. (Pubitemid 351575119)
30. S.N. Patel, T. Robertson, J.A. Kientz, M.S. Reynolds, and G.D. Abowd, "At the Flick of a Switch: Detecting and Classifying Unique Electrical Events on the Residential Power Line," Proc. Ninth Int'l Conf. Ubiquitous Computing, pp. 271-288, 2007.
31. S. Gupta, M.S. Reynolds, and S.N. Patel, "ElectriSense: Single-Point Sensing Using EMI for Electrical Event Detection and Classificaiton in the Home," Proc. 13th Int'l Conf. Ubiquitous Computing, 2010.
32. S. Gupta, K.-Y. Chen, M.S. Reynolds, and S.N. Patel, "Lightwave: Using Compact Fluorescent Lights as Sensors," Proc. 13th Int'l Conf. Ubiquitous Computing (UbiComp '11), 2011.
33. A.T. Campbell, E. Larson, G. Cohn, J. Froehlich, R. Alcaide, and S.N. Patel, "WATTR: A Method for Self-Prowered Wireless Sensing of Water Activity in the Home," Proc. 12th Int'l Conf. Ubiquitous computing (UbiComp), 2010.
34. E. Thomaz, V. Bettadapura, G. Reyes, M. Sandesh, G. Schindler, T. Ploetz, G.D. Abowd, and I. Essa, "Recognizing Water-Based Activities in the Home Through Infrastructure-Mediated Sensing," Proc. 14th ACM Int'l Conf. Ubiquitous Computing, 2012.
35. G. Cohn, E. Stuntebeck, J. Pandey, B. Otis, G.D. Abowd, and S.N. Patel, "SNUPI: Sensor Nodes Utilizing Powerline Infrastructure," Proc. 12th Int'l Conf. Ubiquitous Computing, 2010.
36. P. Bahl and V. Padmanabhan, "Radar: An In-Building Rf-Based User Location and Tracking System," Proc. IEEE INFOCOM, 2000.
37. V. Otsason, A. Varshavsky, A. LaMarca, and E. de Lara, "Accurate GSM Indoor Localisation," Proc. ACM Seventh Int'l Conf. Ubiquitous Computing (Ubicomp '05), 2005.
38. A. Varshavsky, E. de Lara, J. Hightower, A. LaMarca, and V. Otsason, "GSM Indoor Localization," Pervasive and Mobile Computing, vol. 3, pp. 698-720, 2007. (Pubitemid 350030641)
39. J. Krumm and G. Cermak, "Rightspot: A Novel Sense of Location for a Smart Personal Object," Proc. ACM Fifth Int'l Conf. Ubiquitous Computing (Ubicomp '03), 2003.
40. A. Youssef, J. Krumm, E. Miller, G. Cermak, and E. Horvitz, "Computing Location from Ambient FM Radio Signals," Proc. IEEE Wireless Comm. and Networking Conf., 2005.
41. S.P.E.P. Stuntebeck, T. Robertson, M. Reynolds, and G. Abowd, "Wideband Powerline Positioning for Indoor Localization," Proc. ACM 10th Int'l Conf. Ubiquitous Computing, 2008.
42. Y. Jiang, X. Pan, K. Li, Y. Lv, R.P. Dick, M. Hannigan, and L. Shang, "Ariel: Automatic Wi-Fi Based Room Fingerprinting for Indoor Localization," Proc. ACM 14th Int'l Conf. Ubiquitous Computing, 2012.
43. T. Pulkkinen and P. Nurmi, "AWESOM: Automatic Discrete Partitioning of Indoor Spaces for Wifi Fingerprinting," Proc. 10th Int'l Conf. Pervasive Computing (Pervasive '12), 2012.
44. K.R. Schougaard, K. Gronbaek, and T. Scharling, "Indoor Pedestrian Navigation Based on Hybrid Route Planning and Location Modelling," Proc. 10th Int'l Conf. Pervasive Computing, 2012.
45. H. Wang, S. Sen, A. Elgohary, M. Farid, M. Youssef, and R.R. Choudhury, "No Need to War-Drive-Unsupervised Indoor Localization," Proc. 10th Int'l Conf. Mobile Systems, Applications and Services (Mobisys), 2012.
46. Y. Chen, D. Lymberopoulos, J. Liu, and B. Priyantha, "FM-Based Indoor Localisation," Proc. 10th Int'l Conf. Mobile Systems, Applications and Services (Mobisys), 2012.
47. I. Anderson and H. Muller, "Context Awareness via GSM Signal Strength Fluctuation," Proc. Fourth Int'l Conf. Pervasive Computing, Late Breaking Results, 2006.
48. T. Sohn, A. Varshavsky, A. LaMarca, M.Y. Chen, T. Choudhury, I. Smith, S. Consolvo, J. Hightower, W.G. Grisworld, and E. de Lara, "Mobility Detection Using Everyday GSM Traces," Proc. Eight Int'l Conf. Ubiquitous Computing (UbiComp '06), 2006.
49. S. Sen, B. Radunovic, R.R. Choudhury, and T. Minka, "You are Facing the Mona Lisa-Spot Localization Using PHY Layer Information," Proc. 10th Int'l Conf. Mobile Systems, Applications and Services (Mobisys), 2012.
50. A. Kosba and M. Youssef, "Rasid Demo: A Robust WLAN Device-Free Passive Motion Detection System," Proc. 2012 IEEE Int'l Conf. Pervasive Computing and Comm. Workshops (PERCOM Workshops), pp. 531-533, Mar. 2012.
51. J. Wilson and N. Patwari, "See-Through Walls: Motion Tracking Using Variance-Based Radio Tomography Networks," IEEE Trans. Mobile Computing, vol. 10, no. 5, pp. 612-621, May 2011.
52. D. Zhang and L. Ni, "Dynamic Clustering for Tracking Multiple Transceiver-Free Objects," Proc. IEEE Seventh Int'l Conf. Pervasive Computing and Comm. (PerCom '09), 2009.
53. D. Zhang, Y. Liu, and L. Ni, "RASS: A Real-Time, Accurate and Scalable System for Tracking Transceiver-Free Objects," Proc. IEEE Ninth Int'l Conf. Pervasive Computing and Comm., 2011.
54. J. Wilson and N. Patwari, "Radio Tomographic Imaging with Wireless Networks," IEEE Trans. Mobile Computing, vol. 9, no. 5, pp. 621-632, May. 2010.
55. P.W.Q. Lee, W.K.G. Seah, H.-P. Tan, and Z. Yao, "Wireless Sensing without Sensors-An Experimental Study of Motion/Intrusion Detection Using RF Irregularity," Measurement Science and Technology, vol. 21, p. 124007, 2010.
56. N. Patwari and J. Wilson, "Spatial Models for Human Motion-Induced Signal Strength Variance on Static Links," IEEE Trans. Information Forensics and Security, vol. 6, no. 3, pp. 791-802, Sept. 2011.
57. D. Zhang, Y. Liu, X. Guo, M. Gao, and L.M. Ni, "On Distinguishing the Multiple Radio Paths in RSS-Based Ranging," Proc. IEEE INFOCOM, 2012.
58. N. Patwari, J. Wilson, S. Ananthanarayanan, S.K. Kasera, and D.R. Westenskow, "Monitoring Breathing via Signal Strength in Wireless Networks," CoRR, vol. abs/1109.3898, 2011.
59. S. Sigg, M. Beigl, and B. Banitalebi, "Efficient Adaptive Communication From Multiple Resource Restricted Transmitters," Organic Computing-A Paradigm Shift for Complex Systems, (Autonomic Systems Series) chapter 5.4, Springer, 2011.
60. W.-Z. Song, R. Huang, M. Xu, B. Shirazi, and R. LaHusen, "Design and Deployment of Sensor Network for Real-Time High-Fidelity Volcano Monitoring," IEEE Trans. Parallel and Distributed Systems, vol. 21, no. 11, pp. 1658-1674, Nov. 2010.
61. N. Palmer, R. Kemp, T. Kielmann, and H. Bal, "The Case for Smart-Phones as an Urgent Computing Client Platform," Proc. Int'l Conf. Computational Science (ICCS'12), vol. 9, pp. 1667-1676, 2012.
62. L. Ramirez, T. Dyrks, J. Gerwinski, M. Betz, M. Scholz, and V. Wulf, "Landmarke: An Ad Hoc Deployable Ubicomp Infrastructure to Support Indoor Navigation of Firefighters," Personal and Ubiquitous Computing, vol. 16, no. 8, pp. 1025-1038, 2012.
63. "Home and Leisure Accident Surveillance System," Royal Soc. for the Prevention of Accidents (RoSPA), http://www.hassandlass.org.uk/query/index. htm, 2002.
64. N. Noury, A. Fleury, P. Rumeau, A. Bourke, G. Laighin, V. Rialle, and J. Lundy, "Fall Detection-Principles and Methods," Proc. 29th Ann. Int'l Conf. IEEE Eng. in Medicine and Biology Soc., pp. 1663-1666, Aug. 2007.
65. R. Cucchiara, A. Prati, and R. Vezzani, "A Multi-Camera Vision System for Fall Detection and Alarm Generation," Expert Systems, vol. 24, no. 5, pp. 334-345, http://dx.doi.org/10.1111/j.1468-0394.2007.00438.x, 2007. (Pubitemid 47613143)
66. C.-W. Lin and Z.-H. Ling, "Automatic Fall Incident Detection in Compressed Video for Intelligent Homecare," Proc. 16th Int'l Conf. Computer Comm. and Networks (ICCCN), pp. 1172-1177, Aug. 2007. (Pubitemid 351403606)
67. N. Noury, J. Poujaud, A. Fleury, R. Nocua, T. Haddidi, and P. Rumeau, "Smart Sweet Home⋯ A Pervasive Environment for Sensing Our Daily Activity?," Activity Recognition in Pervasive Intelligent Environments, L. Chen, C.D. Nugent, J. Biswas, J. Hoey, and I. Khalil, eds., series Atlantis Ambient and Pervasive Intelligence vol. 4, pp. 187-208, Atlantis Press, 2011.
68. M. Vacher, D. Istrate, F. Portet, T. Joubert, T. Chevalier, S. Smidtas, B. Meillon, B. Lecouteux, M. Sehili, P. Chahuara, and S. Meniard, "The Sweet-Home Project: Audio Technology in Smart Homes to Improve Well-Being and Reliance," Proc. 33rd Ann. Int'l Conf. IEEE Eng. in Medicine and Biology Soc. (EMBC '11), 2011.
69. P. Lukowicz, S. Pentland, and A. Ferscha, "From Context Awareness to Socially Aware Computing," IEEE Pervasive Computing, vol. 11, no. 1, pp. 32-41, Jan. 2012.
70. I. Kononenko and I. Bratko, "Information-Based Evaluation Criterion for Classifier's Performance," Machine Learning, vol. 6, pp. 67-80, 1991. (Pubitemid 21727226)