Social haystack: Dynamic quality assessment of citizen-generated content during emergencies

ACM Transactions on Computer-Human Interaction

Volumn 22, Issue 4, 2015, Pages

  Ludwig, Thomas ^a   Reuter, Christian ^a   Pipek, Volkmar ^a  

^a UNIVERSITY OF SIEGEN   (Germany)

Author keywords

Citizen generated content; Design case study; Emergency management; Information quality; Quality assessment; Social media

Indexed keywords

QUALITY OF SERVICE; RISK MANAGEMENT; SOCIAL NETWORKING (ONLINE);

CITIZEN-GENERATED CONTENT; DESIGN CASE STUDIES; EMERGENCY MANAGEMENT; INFORMATION QUALITY; QUALITY ASSESSMENT; SOCIAL MEDIA;

EMERGENCY SERVICES;

EID: 84934756581     PISSN: 10730516     EISSN: 15577325     Source Type: Journal    
DOI: 10.1145/2749461     Document Type: Article

References (78)

1. F. Abel, C. Hauff, and R. Stronkman. 2012a. Semantics + Filtering + Search = Twitcident exploring information in social web streams categories and subject descriptors. In Proc. Hypertext. Milwaukee, USA, 5-8.
2. F. Abel, C. Hauff, and R. Stronkman. 2012b. Twitcident: Fighting fire with information from social web streams. In Proc. WWW. New York, 5-8.
3. E. Agichtein, C. Castillo, and D. Donato. 2008. Finding high-quality content in social media. In Proc. WSDM. Atlanta, USA, 183-193.
4. M. Baroni, S. Bernardini, A. Ferraresi, and E. Zanchetta. 2009. The WaCky wide web: A collection of very large linguistically processed web-crawled corpora. Language Resources and Evaluation 43, 3, 209-226.
5. N. Bharosa, M. Janssen, and J. Lee. 2008. Adaptive information orchestration: Architectural principles improving information quality.. In Proc. ISCRAM Washington, 556-565.
6. N. Bharosa, J. Lee, and M. Janssen. 2009. Challenges and obstacles in sharing and coordinating information during multi-agency disaster response: Propositions from field exercises. Information Systems Frontiers 12, 1, 49-65. DOI:10.1007/s10796-009-9174-z.
7. S. K. Card, G.G. Robertson, and J.D.Mackinlay. 1991. The information visualizer: An informationworkspace. In Proc. CHI. ACM New York, NY, USA, 181-186.
8. R. Chen, R. Sharman, H. R. Rao, and S. J. Upadhyaya. 2008. Coordination in emergency response management. Communications of the ACM 51, 5, 66-73. DOI:http://dx.doi.org/10.1145/1342327.1342340.
9. D. Christofzik and C. Reuter. 2013. The aggregation of information qualities in collaborative software. International Journal of Entrepreneurial Venturing (IJEV) 5, 3, 257-271.
10. G. Convertino, H.M.Mentis, A. Slavkovic, M. B. Rosson, and J.M. Carroll. 2011. Supporting common ground and awareness in emergency management planning. ToCHI 18, 4, 1-34.
11. M. J. Eppler. 2006. Managing Information Quality. Springer, Berlin, Heidelberg, New York.
12. M. Faruqui and S. Pad. 2010. Training and evaluating a German named entity recognizer with semantic generalization at Stuttgart. In Proc. KONVENS. Saarbrücken, Germany, 129-133.
13. C. Fisher, E. Lauria, S. Chengalur-Smith, and R. Wang. 2011. Introduction to information quality. Author- House, Bloomington, Indiana, USA.
14. C. W. Fisher and B. R. Kingma. 2001. Criticality of data quality as exemplified in two disasters. Information & Management 39, 2, 109-116. DOI:http://dx.doi.org/10.1016/S0378-7206(01)00083-0.
15. T. Friberg, S. Prödel, and R. Koch. 2010. Analysis of information quality criteria in a crisis situation as a characteristic of complex situations. In Proc. IQ. Little Rock, AR.
16. T. Friberg, S. Prödel, and R. Koch. 2011. Information quality criteria and their importance for experts in crisis situations. In Proc. ISCRAM. Lisbon, Portugal.
17. H. Gao, G. Barbier, and R. Goolsby. 2011. Harnessing the crowdsourcing power of social media for disaster relief. IEEE Intelligent Systems 26, 3, 10-14. DOI:http://dx.doi.org/10.1109/MIS.2011.52.
18. R. Gaspar, S. Gorjão, B. Seibt, L. Lima, J. Barnett, A. Moss, and J.Wills. 2014. Tweeting during food crises: A psychosocial analysis of threat coping expressions in Spain, during the 2011 European EHEC outbreak. IJHCS 72, 2, 239-254. DOI:10.1016/j.ijhcs.2013.10.001.
19. S. Ha and J. Ahn. 2011. Why are you sharing others' Tweets?: The impact of argument quality and source credibility on information sharing behavior. In Proc. ICIS. Shanghai, China, 1-11.
20. G. R. Hayes. 2011. The relationship of action research to human-computer interaction. ToCHI 18, 3, 1-20. DOI:http://dx.doi.org/10.1145/1993060.1993065.
21. G. N. Hearn, J. A. Tacchi, M. Foth, and J. Lennie. 2008. Action research and new media: Concepts, Methods and Cases. Hampton Press, New York, USA.
22. A. Hevner and S. Chatterjee. 2010. Design Research in Information Systems: Theory and Practice. Springer, New York, USA.
23. A. Hevner, S. T. March, J. Park, and S. Ram. 2004. Design science in information systems research. MIS Quarterly 28, 1, 75-105.
24. S. R. Hiltz, P. Diaz, and G. Mark. 2011. Introduction: Social media and collaborative systems for crisis management. ToCHI 18, 4, 1-6.
25. Homeland Security. 2013. Lessons learned: Social media and Hurricane Sandy - virtual socialmedia working group and group DHS first responders. Retrieved June 7, 2015 from http://www.ghinternational.com/docs/DHS-VSMWG-Lessons-Learned-Social-Media-and-Hurricane-Sandy-Formatted-June-2013-FINAL.pdf.
26. M. E. Jennex. 2012. Social media - Truly viable for crisis response? In Proc. ISCRAM. Vancouver, Canada, 1-5.
27. G. Kane and S. Ransbotham. 2012. Codification and collaboration: Information quality in social media. In Proc. ICIS. Orlando, Florida, USA, 1-16.
28. A. Kao and S. R. Poteet. 2007. Natural Language Processing and Text Mining. Springer, London.
29. A. M. Kaplan and M. Haenlein. 2010. Users of the world, unite! The challenges and opportunities of Social Media. Business Horizons 53, 1, 59-68. DOI:http://dx.doi.org/10.1016/j.bushor.2009.09.003.
30. M. Kyng, E. T. Nielsen, and M. Kristensen. 2006. Challenges in designing interactive systems for emergency response. In Proc. DISp. 301. ACM Press, New York, USA, p. 301. DOI:http://dx.doi.org/10.1145/1142405.1142450.
31. K. Lewin. 1958. Group Decision and Social Change. Holt, Rinehart and Winston, New York, USA.
32. B. Ley, T. Ludwig, V. Pipek, D. Randall, C. Reuter, and T. Wiedenhoefer. 2014. Information and expertise sharing in inter-organizational crisis management. JCSCW 23, 4-6, 347-387.
33. S. B. Liu and L. Palen. 2010. The new cartographers: crisismap mashups and the emergence of neogeographic practice. Cartography and Geographic Information Science 37, 1, 69-90.
34. P. H. Longstaff. 2005. Security, Resilience and Communication in Unpredictable Environments such as Terrorism, Natural Disasters and Complex Technology. Harvard University, Cambridge, UK.
35. T. Ludwig, C. Reuter, and V. Pipek. 2013. What you see is what I need: Mobile reporting practices in emergencies. In Proc. ECSCW (181-206). Springer, Paphos, Cyprus.
36. T. Ludwig, C. Reuter, T. Siebigteroth, and V. Pipek. 2015. CrowdMonitor: Mobile crowd sensing for assessing physical and digital activities of citizens during emergencies. In Proc. CHI. ACM Press, Seoul, Korea.
37. N. Luhmann. 1996. Social Systems (1st. ed.). Stanford University Press, Stanford, California, USA.
38. A. Marcus, M. Bernstein, and O. Badar. 2011. Twitinfo: Aggregating and visualizing microblogs for event exploration. In Proc. CHI. Vancouver, Canada.
39. T. B. Marino, B. S. do Nascimento, and M. R. S. Borges. 2012. GIS supporting data gathering and fast decision making in emergencies situations. In Proc. ISCRAM. Vancouver, Canada.
40. I. Mulder, H. de Poot, C. Verwij, R. Janssen, and M. Bijlsma. 2006. An information overload study: Using design methods for understanding. In Proc. OZCHI. 245-252.
41. J. Nielsen. 1993. Usability engineering. Morgan Kaufmann, San Francisco, California, USA. DOI:http://dx.doi.org/10.1145/1508044.1508050.
42. M. Normark and D. Randall. 2005. Local expertise at an emergency call centre. In H. Gellersen, K. Schmidt, M. Beaudouin-Lafon, and W. Mackay (Eds.), Proc. ECSCW. Springer, Paris, France, 347-366.
43. C. A. O'Reilly. 1980. Individuals and information overload in organizations: Is more necessarily better? Academy of Management Journal 23, 4, 684-696. DOI:http://dx.doi.org/10.2307/255556.
44. O. Okolloh. 2008. Ushahidi, or "testimony": Web 2.0 tools for crowdsourcing crisis information. Participatory Learning and Action 59 (January), 65-70.
45. L. Palen and S. B. Liu. 2007. Citizen communications in crisis: Anticipating a future of ICT-supported public participation. In Proc. CHI. San Jose, ACM Press, USA.
46. L. Palen, S. Vieweg, and K. M. Anderson. 2011. Supporting "Everyday Analysts" in safety- And time-critical situations. The Information Society 27, 1, 52-62. DOI:http://dx.doi.org/10.1080/01972243.2011.534370.
47. H. Purohit, A. Hampton, S. Bhatt, V. L. Shalin, A. P. Sheth, and J. M. Flach. 2014. Identifying seekers and suppliers in social media communities to support crisis coordination. JCSCW 23, 4-6, 513-545.
48. Y. Qu, P. F. Wu, and X. Wang. 2009. Online community response to major disaster: A study of Tianya forum in the 2008 Sichuan earthquake. In Proc. HICSS. Waikoloa, USA.
49. C. Reuter, O. Heger, and V. Pipek. 2013. Combining real and virtual volunteers through social media. In Proc. ISCRAM. Baden-Baden, Germany, 780-790.
50. C. Reuter, T. Ludwig, M.-A. Kaufhold, and V. Pipek. 2015. XHELP: Design of a cross-platform social-media application to support volunteer moderators in disasters. In Proc. CHI. ACM Press, Seoul, Korea.
51. C. Reuter, T. Ludwig, and V. Pipek. 2014. Ad hoc participation in situation assessment: Supporting mobile collaboration in emergencies. ToCHI 21, 5, 26:1-26:26.
52. C. Reuter, A.Marx, and V. Pipek. 2012. Crisis management 2.0: Towards a systematization of social software use in crisis situations. IJISCRAM 4, 1, 1-16.
53. A. Ritter, S. Clark, and O. Etzioni. 2011. Named entity recognition in tweets: An experimental study. In Conference on Empirical Methods in Natural Language Processing. Edinburgh, UK, 1524-1534.
54. A. Robinson, A. Savelyev, S. Pezanowski, and A. M. MacEachren. 2013. Understanding the utility of geospatial information in social media. In Proc. ISCRAM. Baden-Baden, Germany, 918-922.
55. K. Schmidt. 2014. The concept of "Practice": What's the point? In Proc. COOP. 427-444. Nice, France.
56. A. Shamoug, R. Juric, and S. Paurobally. 2012. Ontological reasoning as a tool for humanitarian decision making. In Proc. ISCRAM. Vancouver, Canada.
57. G. Shankaranarayanan, B. Iyer, and D. Stoddard. 2012. Quality of social media data and implications of social media for data quality. In Proc. ICIQ. Paris, France, 311-325.
58. C. Shirky. 2008. Here Comes Everybody: The Power of Organizing Without Organizations. Penguin Books, London, UK.
59. R. A. Stallings and E. L. Quarantelli. 1985. Emergent citizen groups and emergency management. Public administration review 45 (Special Issue), 93-100.
60. K. Starbird, G. Muzny, and L. Palen. 2012. Learning from the crowd: Collaborative filtering techniques for identifying on-the-ground twitterers during mass disruptions. In Proc. ISCRAM. Vancouver, Canada.
61. K. Starbird, L. Palen, A. L. Hughes, and S. Vieweg. 2010. Chatter on the red: What hazards threat reveals about the social life of microblogged information. In Proc. CSCW. 241-250.
62. K. Starbird and J. Stamberger. 2010. Tweak the Tweet: Leveraging microblogging proliferation with a prescriptive syntax to support citizen reporting. In Proc. ISCRAM. Seattle, USA.
63. A. L. Strauss. 1987. Qualitative Analysis for Social Scientists. Cambridge Press, Cambridge, UK.
64. A. H. Tapia and K. Moore. 2014. Good enough is good enough: Overcoming disaster response organizations' slow social media data adoption. JCSCW 23, 4-6, 483-512.
65. T. Terpstra, A. de Vries, R. Stronkman, and G. L. Paradies. 2012. Towards a realtime Twitter analysis during crises for operational crisis management. In Proc. ISCRAM. Vancouver, Canada, 1-9.
66. M. Turoff, M. Chumer, B. van de Walle, and X. Yao. 2004. The design of a dynamic emergency response management information system (DERMIS). JITTA 5, 4, 1-35.
67. M. Turoff, S. R. Hiltz, C. White, L. Plotnick, A. Hendela, and X. Yao. 2009. The past as the future for emergency planning and response. IJISCRAM 1, 1, 12-28.
68. M. Twidale, D. Randall, and R. Bentley. 1994. Situated evaluation for cooperative systems. In Proc. CSCW. Chapel Hill, North Carolina, USA, 441-452.
69. Twitter. 2014. TweetDeck. Retrieved July 23, 2014 from https://about.twitter.com/products/tweetdeck.
70. I. Uysal and W. B. Croft. 2011. User oriented tweet ranking: A filtering approach to microblogs. In Proc. CIKM. Glasgow, Great Britain, 2261-2264.
71. T. Wachtendorf and J. M. Kendra. 2006. Improvising disaster in the city of Jazz: Organizational response to Hurricane Katrina. Retrieved March 25, 2015 from http://understandingkatrina.ssrc.org/Wachtendorf-Kendra/.
72. R. Wang and D. Strong. 1996. Beyond accuracy: What data quality means to data consumers. JMIS 12, 4, 5-33.
73. B. van de Walle and M. Turoff. 2008. Decision support for emergency situations. ISeB 6, 3, 295-316.
74. A. Wexelblat and P. Maes. 1999. Footprints: History-rich tools for information foraging. In Proc. CHI. 270- 277.
75. A. Wu, G. Convertino, C. H. Ganoe, J. M. Carroll, and X. L. Zhang. 2013. Supporting collaborative sense-making in emergency management through geo-visualization. IJHCS 71, 1, 4-23. DOI:http://dx.doi.org/10.1016/j.ijhcs.2012.07.007.
76. V.Wulf, M. Rohde, V. Pipek, and G. Stevens. 2011. Engaging with practices: Design case studies as a research framework in CSCW. In Proc. CSCW. ACM Press, Hangzhou, China.
77. D. Yates and S. Paquette. 2011. Emergency knowledge management and social media technologies: A case study of the 2010 Haitian earthquake. IJIM 31, 1, 6-13. DOI:http://dx.doi.org/10.1016/j.ijinfomgt.2010.10.001.
78. J. Yin, S. Karimi, B. Robinson, and M. Cameron. 2012. ESA : Emergency situation awareness via microbloggers. In Proc. CIKM. 1-3.