Active visual object search in unknown environments using uncertain semantics

IEEE Transactions on Robotics

Volumn 29, Issue 4, 2013, Pages 986-1002

  Aydemir, Alper ^a,b   Pronobis, Andrzej ^a,c   Gobelbecker, Moritz ^d   Jensfelt, Patric ^a  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^b NASA HEADQUARTERS   (United States)

^c University of Washington   (United States)

^d UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Active vision; semantic mapping; visual object search

Indexed keywords

ACTIVE VISION; BUILDING FLOORS; KNOWN ENVIRONMENTS; PROBABILISTIC MODELING; SEARCH STRATEGIES; SEMANTIC MAPPING; TRAJECTORY LENGTH; VISUAL OBJECTS;

ELECTRICAL ENGINEERING; ROBOTICS;

SEMANTICS;

EID: 84882315603     PISSN: 15523098     EISSN: None     Source Type: Journal    
DOI: 10.1109/TRO.2013.2256686     Document Type: Article

References (57)

1. A. Pronobis and P. Jensfelt, "Large-scale semantic mapping and reasoning with heterogeneous modalities," in Proc. IEEE Int. Conf. Robot. Autom. , May 2012, pp. 3515-3522.
2. A. Andreopoulos, S. Hasler, H. Wersing, H. Janssen, J. K. Tsotsos, and E. Korner, "Active 3D object localization using a humanoid robot," IEEE Trans. Robot. , vol. 27, no. 1, pp. 47-64, Feb. 2011.
3. G. Hollinger, D. Ferguson, and S. Srinivasa, S. Singh, "Combining search and action for mobile robots," in Proc. IEEE Int. Conf. Robot. Autom. , May 2009, pp. 800-805.
4. K. Sjöö, D. Gálvez Ĺopez, C. Paul, P. Jensfelt, and D. Kragic, "Object search and localization for an indoor mobile robot," J. Comput. Inf. Technol. , vol. 17, no. 1, pp. 67-80, 2009.
5. K. Sjöö, A. Aydemir, and P. Jensfelt, "Topological spatial relations for active visual search," Robot. Auton. Syst. , vol. 60, no. 9, pp. 1093-1107, 2012.
6. K. Shubina and J. Tsotsos, "Visual search for an object in a 3Denvironment using a mobile robot," Comput. Vis. Imag. Understand. , vol. 114, no. 5, pp. 535-547, 2010.
7. T. Kollar and N. Roy, "Utilizing object-object and object-scene context when planning to find things," in Proc. IEEE Int. Conf. Robot. Autom. , May 2009, pp. 4116-4121.
8. P. Viswanathan, D. Meger, T. Southey, J. J. Little, and A. K. Mackworth, "Automated spatial-semantic modeling with applications to place labeling and informed search," in Proc. Can. Conf. Comput. Robot Vis. ,May 2009, pp. 284-291.
9. S. Chen, Y. Li, and N. M. Kwok, "Active vision in robotic systems: A survey of recent developments," Int. J. Robot. Res. , vol. 30, no. 11, pp. 1343-1377, 2011.
10. T. H. Chung, G. Hollinger, and V. Isler, "Search and pursuit-evasion in mobile robotics A survey," Auton. Robot. , vol. 31, no. 4, pp. 299-316, 2011.
11. S. D. Roy, S. Chaudhury, and S. Banerjee, "Active recognition through next view planning: A survey," Pattern Recognit. , vol. 37, no. 3, pp. 429-446, 2004. (Pubitemid 38003083)
12. R. Bajcsy, "Active perception," Proc. IEEE, vol. 76, no. 8, pp. 966-1005, Aug. 1988.
13. J. Tsotsos, "On the relative complexity of active vs. passive visual search," Int. J. Comput. Vis. , vol. 7, no. 2, pp. 127-141, 1992. (Pubitemid 23621969)
14. J. Tsotsos and Y. Ye, "A complexity-level analysis of the sensor planning task for object search," Comput. Int. , vol. 17, no. 4, pp. 605-620, Nov. 2001. (Pubitemid 33143598)
15. T. Garvey, "Perceptual strategies for purposive vision," Artif. Intell. Center, SRI Int. , Menlo Park, CA, USA, Tech. Rep. 117, Sep 1976.
16. L. Wixson and D. Ballard, "Using intermediate objects to improve the efficiency of visual search," Int. J. Comput. Vis. , vol. 12, no. 2-3, pp. 209-230, 1994.
17. Y. Ye and J. Tsotsos, "Sensor planning for 3D object search," Comput. Vis. Imag. Understand. , vol. 73, no. 2, pp. 145-168, 1999.
18. J. Ma, T. H. Chung, and J. Burdick, "A probabilistic framework for object search with 6-DOF pose estimation," Int. J. Robot. Res. , vol. 30, no. 10, pp. 1209-1228, 2011.
19. S. Ekvall, D. Kragic, and P. Jensfelt, "Object detection and mapping for service robot tasks," Robotica, vol. 25, no. 2, pp. 175-187, 2007. (Pubitemid 46486608)
20. P.-E. Forsśen, D. Meger, K. Lai, S. Helmer, J. Little, and D. Lowe, "Informed visual search: Combining attention and object recognition," in Proc. IEEE Int. Conf. Robot. Autom. , May 2008, pp. 935-942.
21. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Conf. Comp. Vis. Pattern Recognit. , Jun. 2007, pp. 1-8.
22. S. D. Roy, S. Chaudhury, and S. Banerjee, "Active recognition through next view planning: A survey," Pattern Recognit. , vol. 37, no. 3, pp. 429-446, 2004. (Pubitemid 38003083)
23. T. C. Shermer, "Recent results in art galleries [geometry]," Proc. IEEE, vol. 80, no. 9, pp. 1384-1399, Sep. 1992.
24. B. J. Nilsson, Guarding Art Galleries Methods forMobile Guards. Ph. D. dissertation, Lund Univ. , Lund, Sweden, 1995.
25. H. González-Banos, "Arandomized art-gallery algorithm for sensor placement," in Proc. 17th Annu. Symp. Comput. Geom. , 2001, pp. 232-240. (Pubitemid 32865867)
26. S. M. LaValle, D. Lin, L. J. Guibas, J.-C. Latombe, and R. Motwani, "Finding an unpredictable target in a workspace with obstacles," in Proc. IEEE Int. Conf. Robot. Autom. , Apr. 1997, vol. 1, pp. 737-742.
27. A. Sarmiento, R. Murrieta, and S. A. Hutchinson, "An efficient strategy for rapidly finding an object in a polygonal world," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst. , Oct. 2003, vol. 2, pp. 1153-1158.
28. A. Sarmiento, R. Murrieta-Cidz, and S. Hutchinson, "A Sample-based convex cover for rapidly finding an object in a 3-D environment. in Proc. IEEE Int. Conf. Robot. Autom. , Apr. 2005, pp. 3486-3491. (Pubitemid 46084324)
29. M. Sridharan, J. L. Wyatt and R. Dearden, "Planning to see:Ahierarchical approach to planning visual actions on a robot using POMDPs," Artif. Intell. , vol. 174, no. 11, pp. 704-725, 2010.
30. H. Masuzawa and J. Miura, "Observation planning for efficient environment information summarization," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst. , Oct. 2009, pp. 5794-5800.
31. M. Boussard and J. Miura, "Object search: A constrained MDP approach," presented at theWorkshop Active Percept. Object Search RealWorld, San Francisco, CA, USA, 2011.
32. D. Joho, M. Senk, andW. Burgard, "Learning search heuristics for finding objects in structured environments," Robot. Auton. Syst. , vol. 59, no. 5, pp. 319-328, May 2011.
33. T. Deyle, H. Nguyen, M. Reynolds, and C. Kemp, "RF vision: RFID receive signal strength indicator (RSSI) images for sensor fusion and mobile manipulation," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst. , Oct. 2009, pp. 5553-5560.
34. L. Kunze, M. Beetz, M. Saito, H. Azuma, K. Okada, and M. Inaba, "Searching objects in large-scale indoor environments: A decisiontheoretic approach," in Proc. IEEE Int. Conf. Robot. Autom. , May 2012, pp. 4385-4390.
35. A. Aydemir, K. Sjöö, J. Folkesson, and P. Jensfelt, "Search in the real world: Active visual object search based on spatial relations," in Proc. IEEE Int. Conf. Robot. Autom. , May 2011, pp. 2818-2824.
36. A. Aydemir, M. Göbelbecker, A. Pronobis, K. Sjöö, and P. Jensfelt, "Planbased object search and exploration using semantic spatial knowledge in the real world," in Proc. Eur. Conf. Mobile Robot. , Sep. 2011, pp. 13-18.
37. Y. Ye and J. K. Tsotsos, Sensor Planning for Object Search. Ph. D. dissertation, Dept. Comput. Sci, Univ. Toronto, Toronto, ON, Canada, 1997.
38. K. Sjöö, "Semantic map segmentation using function-based energy maximization," in Proc. IEEE Int. Conf. Robot. Autom. , May 2012, pp. 4066-4073.
39. S. Vasudevan and R. Siegwart, "Bayesian space conceptualization and place classification for semantic maps in mobile robotics," Robot. Auton. Syst. , vol. 56, no. 6, pp. 522-537, Jun. 2008.
40. H. Zender, O. M. Mozos, P. Jensfelt, G. M. Kruijff, andW. Burgard, "Conceptual spatial representations for indoor mobile robots," Robot. Auton. Syst. , vol. 56, no. 6, pp. 493-502, Jun. 2008.
41. A. Pronobis, O. M. Mozos, B. Caputo, and P. Jensfelt, "Multi-modal semantic place classification," Int. J. Robot. Res. , vol. 29, no. 2-3, pp. 298-320, Feb. 2010.
42. J. L Wyatt, A. Aydemir, M. Brenner, M. Hanheide, N. Hawes, P. Jensfelt, K. Matej, G. M Kruijff, Pierre Lison, A. Pronobis, K. Sjöö, D. Skocaj A. Vrecko, H. Zender, and M. Zillich, "Self-understanding and self-extension: A systems and representational approach," IEEE Trans. Autom. Mental Develop. , vol. 2, no. 4, pp. 282-303, Dec. 2010.
43. B. Yamauchi, "A frontier-based approach for autonomous exploration," in Proc. IEEE Int. Symp. Comput. Intell. Robot. Autom. , pp. 146-151, Jul. 1997.
44. S. L. Lauritzen and T. S. Richardson, "Chain graphmodels and their causal interpretations," J. Roy. Statist. Soc. Series B, vol. 64, no. 3, pp. 321-348, 2002.
45. A. Pronobis and B. Caputo, "Confidence-based cue integration for visual place recognition," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst. , Oct. 2007, pp. 2394-2401.
46. M. M. Ullah, A. Pronobis, B. Caputo, J. Luo, P. Jensfelt, and H. I. Christensen, "Towards robust place recognition for robot localization," in Proc. IEEE Int. Conf. Robot. Autom. , May 2008, pp. 530-537.
47. M. Hanheide, C. Gretton, R. W. Dearden, N. A. Hawes, J. L. Wyatt, A. Pronobis, A. Aydemir, M. Göbelbecker, and H. Zender, "Exploiting probabilistic knowledge under uncertain sensing for efficient robot behaviour," in Proc. 22nd Int. Joint Conf. Artif. Intell. , Jul. 2011, pp. 2442-2449.
48. M. Göbelbecker, C. Gretton, and R. Dearden, "A switching planner for combined task and observation planning," in Proc. 22nd Int. Joint Conf. Artif. Intell. , Aug. 2011.
49. M. Brenner and Bernhard Nebel, "Continual planning and acting in dynamic multiagent environments," J. Auton. Agents Multiagent Syst. , vol. 19, no. 3, pp. 297-331, 2009.
50. H. Younes and M. Littmann, "PPDDL1. 0: An extension to PDDL for expressing planning domains with probabilistic effects," Carnegie Mellon Univ. , Pittsburgh, PA, USA, Tech. Rep. CMU-CS-04-167, 2004.
51. M. Helmert, "The fast downward planning system," J. Artif. Intell. Res. , vol. 26, pp. 191-246, 2006. (Pubitemid 44452211)
52. S. W. Yoon, A. Fern, and R. Givan, "FF-replan:Abaseline for probabilistic planning," presented at the 17th Int. Conf. Autom. Planning Scheduling, Providence, RI, USA, 2007.
53. T. Mörwald, J. Prankl, A. Richtsfeld, M. Zillich, and M. Vincze, "BLORT the blocks world robotic vision toolbox," in Proc. Workshop Best Practice 3D Percept. Model. Mobile Manipulat. , 2010.
54. N. Hawes and J. Wyatt, "Engineering intelligent information- processing systems with CAST," Adv. Eng. Informat. , vol. 24, no. 1, pp. 27-39, 2010.
55. J. Folkesson, P. Jensfelt, and H. Christensen, "The m-space feature representation for SLAM," IEEE Trans. Robot. , vol. 23, no. 5, pp. 1024-1035, Oct. 2007. (Pubitemid 47577978)
56. A. Aydemir and P. Jensfelt, "Exploiting and modeling local 3D structure for predicting object locations," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst. , Oct. 2012, pp. 3885-3892.
57. A. Aydemir, P. Jensfelt, and J. Folkesson, "What can we learn from 38,000 rooms? reasoning about unexplored space in indoor environments," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst. , Oct. 2012, pp. 4675-4682.