New ways of specifying data edits

Journal of the Royal Statistical Society. Series A: Statistics in Society

Volumn 167, Issue 2, 2004, Pages 249-274

  Petrakos, George ^a,c   Conversano, Claudio ^b   Farmakis, Gregory ^c   Mola, Francesco ^d   Siciliano, Roberta ^e   Stavropoulos, Photis ^c  

^a PANTEION UNIVERSITY   (Greece)

^b UNIVERSITY OF CASSINO AND SOUTHERN LAZIO   (Italy)

^c Agilis SA   (Greece)

^d UNIVERSITY OF CAGLIARI   (Italy)

^e UNIVERSITY OF NAPLES FEDERICO II   (Italy)

Author keywords

Classification and regression trees; Data editing; Data quality; Fast partitioning algorithm; Object oriented analysis; Total quality management; TREEVAL

Indexed keywords

EID: 2342663181     PISSN: 09641998     EISSN: None     Source Type: Journal    
DOI: 10.1046/j.1467-985X.2003.00745.x     Document Type: Review

References (36)

1. Bankier, M. (1999) Experience with the new imputation methodology used in the 1996 Canadian Census with extensions for future censuses. In United Nations-Economic Commission for Europe Wrk Sessn Statistical Data Editing, Rome, June 2nd-4th, working paper 24.
2. Bankier, M., Lachance, M. and Poirier, P. (2000) 2001 Canadian Census minimum change donor imputation methodology. In United Nations-Economic Commission for Europe Wrk Sessn Statistical Data Editing, Cardiff Oct. 18th-20th, working paper 17.
3. Barnett, V. and Lewis, T. (1994) Outliers in Statistical Data, 3rd edn. New York: Wiley.
4. Booch, G. (1993) Object-oriented Analysis and Design with Applications, 2nd edn. Boston: Addison-Wesley.
5. Breiman, L., Friedman, J. H., Olshen, R. A. and Stone, C. J. (1984) Classification and Regression Trees. Belmont: Wadsworth.
6. Cappelli, C., Mola, F. and Siciliano, R. (2002) A statistical approach to growing a reliable honest tree. Comput. Statist. Data Anal., 38, 285-299.
7. Chen, B. C. (1998) Set covering algorithms in edit generation. Statistical Research Report 98/06. Statistical Research Division, US Bureau of the Census, Washington DC. (Available from http://www.census.gov/srd/www/byyear.html.)
8. Conversano, C., Mola, F. and Siciliano, R. (2001) Partitioning and combined model integration for data mining. J. Comput. Statist., 16, 323-339.
9. Daalmans, J. (2000) Automatic error localization of categorical data. Technical Report. Statistics Netherlands, Voorburg.
10. De Giacomo, G. and Naggar, P. (1996) Conceptual data model with structured objects for statistical databases. In Proc. 8th Int. Conf. Scientific and Statistical Data Base Management, pp. 168-175. Stockholm: Institute of Electrical and Electronic Engineers Computer Society Press.
11. Deming, W. E. (1982) Quality, Productivity and Competitive Position. Cambridge: Massachusetts Institute of Technology.
12. De Waal, T (2000) An optimality proof of Statistics Netherlands' new algorithm for automatic editing of mixed data. Technical Report. Statistics Netherlands, Voorburg.
13. De Waal, T. (2002) Algorithms for automatic error localization and modification. Technical Report. Statistics Netherlands, Voorburg.
14. Draper, L. R. and Winkler, W. E. (1997) Balancing and ratio editing with the new SPEER system. Statistical Research Report 97/05. Statistical Research Division. US Bureau of the Census, Washington DC. (Available from http://www.census.gov/srd/www/byyear.html.)
15. Engstrom, P. and Granquist, L. (1999) Improving quality by modern editing. In United Nations-Economic Commission for Europe Wrk Sessn Statistical Data Editing, Rome, June 2nd-4th, working paper 23.
16. Fellegi, I. P. and Holt, D. (1976) A systematic approach to automatic edit and imputation. J. Am. Statist. Ass., 71, 17-35.
17. Filion, J. M. and Schopiu-Kratina, I. (1993) On the use of Cherinkova's algorithm for error localization. Technical Report. Statistics Canada, Ottawa.
18. Garfinkel, R. S., Kunnathur, A. S. and Liepins, G. E. (1986) Optimal imputation of erroneous data: categorical data, general edits. Ops. Res., 34, 744-751.
19. Granquist, L. (1997) The new view on editing. Int. Statist. Rev., 65, 381-387.
20. Hadi, A. S. (1992) Identifying multiple outliers in multivariate data. J. R. Statist. Soc. B, 54, 761-771.
21. Hand, D. J. (1998) Construction and Assessment of Classification Rules. London: Wiley.
22. Michalsky, R. S. and Chilausky, R. L. (1980) Knowledge acquisition by encoding expert rules versus computer induction from examples: a case study involving soybean pathology. Int. J. Man Mach. Stud., 12, 63-87.
23. Mola, F. and Siciliano, R. (1997) A fast splitting algorithm for classification trees. Statist. Comput., 7, 209-216.
24. Nordbotten, S. (1999) Strategies for improving statistical quality. In United Nations-Economic Commission for Europe Wrk Sessn Statistical Data Editing, Rome, June 2nd-4th, working paper 4.
25. Petrakos, G. and Farmakis, G. (2000) A declarative approach to data validation of statistical data sets, based on metadata. Statist. Appl., 12, 395-405.
26. Quere, R. (2000) Automatic editing of numerical data. Technical Report. Statistics Netherlands, Voorburg.
27. Quere, R. and De Waal, T. (2000) Error localization in mixed data sets. Technical Report. Statistics Netherlands, Voorburg.
28. Quinlan, J. R. (1987) Simplifying decision tree. Int. J. Man Mach. Stud., 27, 221-234.
29. Sande, G. (1979) Numerical edit and imputation. Proc. 42nd Sessn Int. Statist. Inst.
30. Schopiu-Kratina, I. and Kovar, J. G. (1989) Use of Chernikova's algorithm in the Generalized Edit and Imputation System. Working Paper BSMD 89-001E. Methodology Branch, Statistics Canada, Ottawa.
31. Siciliano, R. (1998) Exploratory versus decision trees. In Proc. 13th Symp. Computational Statistics (eds R. Payne and P. Green), pp. 113-124. Heidelberg: Physica.
32. Siciliano, R. and Mola, F. (2000) Multivariate data analysis through classification and regression trees. Comput. Statist. Data Anal., 32, 285-301.
33. Sundgren, B. (1995) Guidelines for the Modelling of Statistical Data and Metadata. New York: United Nations.
34. Winkler, W. E. (1998) Set covering and editing discrete data. Statistical Research Report 98/01. Statistical Research Division, US Bureau of the Census, Washington DC. (Available from http.//www.census.gov/srd/www/byyear.html.)
35. Winkler, W. E. (1999) State of statistical data editing and current research problems. In United Nations-Economic Commission for Europe Wrk Sessn Statistical Data Editing, Rome, June 2nd-4th, working paper 29.
36. Winkler, W. E. and Chen, B. C. (2002) Extending the Fellegi-Holt model of statistical data editing. Statistical Research Report 2002/02. Statistical Research Division, US Bureau of the Census, Washington DC. (Available from http://www.census.gov/srd/www/byyear.html.)