Automated quality control for mobile data collection

Proceedings of the 2nd ACM Symposium on Computing for Development, DEV 2012

Volumn , Issue , 2012, Pages

  Birnbaum, Benjamin ^a   Derenzi, Brian ^a   Flaxman, Abraham D ^b   Lesh, Neal ^c  

^a University of Washington   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

^c DIMAGI INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATED DATA; COMMUNITY OUTREACH PROGRAMS; EAST AFRICA; FIELD OPERATION; HEALTH SURVEYS; HIGH SENSITIVITY; LABELED DATA; LANGUAGE BARRIERS; MIDDLE-INCOME COUNTRIES; MOBILE DATA; UNLABELED DATA;

ALGORITHMS; AUTOMATION; DATA ACQUISITION; QUALITY ASSURANCE; SOFTWARE TESTING; SURVEYS;

QUALITY CONTROL;

EID: 84859882993     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2160601.2160603     Document Type: Conference Paper

References (46)

1. P. P. Biemer and L. E. Lyberg. Introduction to Survey Quality. Wiley-Interscience, 2003.
2. P. P. Biemer and S. L. Stokes. The optimal design of quality control samples to detect interviewer cheating. J. Official Statistics, 5(1):23-39, 1989.
3. S. Bredl et al. A statistical approach to detect cheating interviewers. Technical report, 2008.
4. L. Breiman. Random forests. Machine Learning, 45:5-32, October 2001. (Pubitemid 32933532)
5. J. M. Bushery et al. Using date and time stamps to detect interviewer falsification. ASA Section on Survey Research Methods, pages 316-320, 1999.
6. V. Chandola et al. Anomaly detection: A survey. ACM Comput. Surv., 41:15:1-15:58, July 2009.
7. K. Chen et al. Designing adaptive feedback for improving data entry accuracy. In UIST, 2010.
8. K. Chen et al. Usher: Improving data quality with dynamic forms. In TKDE, 2010.
9. K. Chen et al. Data in the first mile. In CIDR, 2011.
10. E. K. Chiteri et al. Quality control on HDSS automated application systems. http://groups.google.com/group/ict4chw/browse- thread/thread/ 688fe36f845d56a5/, Acc. 20 Oct. 2011.
11. G. F. Cooper and E. Herskovits. A Bayesian method for the induction of probabilistic networks from data. Machine Learning, 9(4):309-347, 1992.
12. L. P. Crespi. The cheater problem in polling. Public Opinion Quarterly, 9(4):431-445, 1945.
13. B. DeRenzi. Technology for Workforce Performance Improvement of Community Health Programs. PhD thesis, University of Washington, 2011.
14. B. Derenzi et al. Mobile phone tools for field-based health care workers in low-income countries. The Mount Sinai J. Medicine, 78(3):406-18, 2011.
15. B. DeRenzi et al. Improving community health worker performance through automated SMS reminders. In ICTD, 2012.
16. eMocha, http://emocha.org/. Acc. 20 Oct. 2011.
17. EpiSurveyor, http://www.episurveyor.org/. Acc. 20 Oct. 2011.
18. T. Fawcett. An introduction to ROC analysis. Pattern Recogn. Lett., 27:861-874, June 2006.
19. M. Hall et al. The WEKA data mining software: An update. SIGKDD Explorations, 11(1), 2009.
20. C. Hartung et al. Open Data Kit: Tools to build information services for developing regions. In ICTD, 2010.
21. J. M. Hellerstein. Quantitative data cleaning for large databases. Technical report, 2008.
22. T. P. Hill. The difficulty of faking data. Chance Magazine, 12(3):31-37, 1999.
23. C. C. Hood and J. M. Bushery. Getting more bang from the reinterview buck: Identifying "at risk" interviewers. ASA Section on Survey Research Methods, pages 820-824, 1997.
24. P. J. Huber. Robust Statistics. Wiley, 1981.
25. S. L. James et al. Performance of the Tariff method: validation of a simple additive algorithm for analysis of verbal autopsies. Population Health Metrics, 9(1):31, 2011.
26. G. Judge and L. Schechter. Detecting problems in survey data using Benford's law. J. Human Resources, 44(1):1-24, 2009.
27. R. Khan. ClickDiagnostics experiences from Bangladesh. http://groups.google.com/group/ ict4chw/browse-thread/thread/96dd344a921f124e, Acc. 20 Oct. 2011.
28. E. A. Krejsa et al. Evaluation of the quality assurance falsification interview used in the census 2000 dress rehearsal. ASA Section on Survey Research Methods, pages 635-640, 1999.
29. S. le Cessie and J. C. van Houwelingen. Ridge estimators in logistic regression. Applied Statistics, 41(1):191-201, 1997.
30. U. Lehmann and D. Sanders. Community health workers: What do we know about them? Technical report, World Health Organization, 2007.
31. J. Li et al. Using statistical models for sample design of a reinterview program. ASA Section on Survey Research Methods, pages 4681-4695, 2009.
32. G. Mhila et al. Using mobile applications for community-based social support for chronic patients. In HELINA, 2009.
33. J. Murphy et al. A system for detecting interview falsification. In Am. Assoc. for Public Opinion Research, 2004.
34. C. J. L. Murray and J. Frenk. Health metrics and evaluation: strengthening the science. Lancet, 371(9619):1191-9, Apr. 2008. (Pubitemid 351458525)
35. T. Parikh et al. Mobile phones and paper documents: Evaluating a new approach for capturing microfinance data in rural india. In CHI, 2006.
36. S. Patnaik et al. Evaluating the accuracy of data collection on mobile phones: A study of forms, SMS, and voice. In ICTD, pages 74-84, 2009.
37. J. Porras and N. English. Data-driven approaches to identifying interviewer data falsification: The case of health surveys. ASA Section on Survey Research Methods, pages 4223-4228, 2004.
38. A. L. Ratan et al. Managing microfinance with paper, pen and digital slate. In ICTD, 2010.
39. J.-P. Schraepler and G. G. Wagner. Identification, characteristics and impact of faked interviews in surveys. All. Stat. Archive, 89(1):7-20, 2005.
40. I. Schreiner et al. Interviewer falsification in census bureau surveys. ASA Section on Survey Research Methods, pages 491-496, 1988.
41. B. Settles. Active learning literature survey. Comp. Sci. Tech. Report 1648, University of Wisconsin-Madison, 2009.
42. C. Shäafer et al. Automatic identification of faked and fraudulent interviews in surveys by two different methods. ASA Section on Survey Research Methods, pages 4318-4325, 2004.
43. D. Swanson et al. Detecting possibly fraudulent or error-prone survey data using Benford's law. ASA Section on Survey Research Methods, pages 4172-4177, 2003.
44. C. F. Turner et al. Falsification in epidemiologic surveys: Detection and remediation. Technical Report 53, Research Triangle Institute, 2002.
45. P. Yu et al. The development and evaluation of a PDA-based method for public health surveillance data collection in developing countries. Int. J. of Med. Informatics, 78(8):532-42, 2009.
46. M. Zimic et al. Can the power of mobile phones be used to improve tuberculosis diagnosis in developing countries? Trans. Roy. Soc. of Tropical Medicine and Hygiene, 103(6):638-40, 2009.