Discriminant function analyses in archaeology: Are classification rates too good to be true?

Journal of Archaeological Science

Volumn 38, Issue 11, 2011, Pages 3006-3018

  Kovarovic, Kris ^a   Aiello, Leslie C ^b   Cardini, Andrea ^c,d,e   Lockwood, Charles A ^f  

^a DURHAM UNIVERSITY   (United Kingdom)

^b Wenner Gren Foundation for Anthropological Research   (United States)

^c UNIVERSITY OF MODENA AND REGGIO EMILIA   (Italy)

^d UNIVERSITY OF YORK   (United Kingdom)

^e UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

^f UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Classification accuracy; Cross validation; Discriminant function analysis; Over fitting; Resampling

Indexed keywords

ARCHAEOLOGY; CLASSIFICATION; DATA SET; DISCRIMINANT ANALYSIS; NUMERICAL MODEL; PRIMATE; PROBABILITY; SKULL; STATISTICAL ANALYSIS;

BOVIDAE;

EID: 80053448090     PISSN: 03054403     EISSN: 10959238     Source Type: Journal    
DOI: 10.1016/j.jas.2011.06.028     Document Type: Article

References (65)

1. Abbott D.R., Watts J. Identical rock types with different chemistry: sourcing phyllite-tempered Hohokam pottery from the Phoenix basin, Arizona. J. Archaeol. Sci. 2010, 37:1612-1622.
2. Adams D.C., Rohlf F.J., Slice D.E. Geometric morphometrics: ten years of progress following the 'revolution'. Ital. J. Zool. 2004, 71:5-16.
3. Albrecht G. Assessing the affinities of fossils using canonical variates and generalized distances. J. Hum. Evol. 1992, 7:49-69.
4. Bell S., Croson C. Artificial neural networks as a tool for archaeological data analysis. Archaeometry 1997, 40:139-151.
5. Berge C., Penin X. Ontogenetic allometry, heterochrony, and interspecific differences in the skull of African apes, using tridimensional Procrustes analysis. Am. J. Phys. Anthropol. 2004, 124:124-138.
6. Bescoby D.J., Cawley G.C., Chroston P.N. Enhanced interpretation of magnetic survey data from archaeological sites using artificial neural networks: a case study from Butrint, Southern Albania. Archaeological Prospection 2004, 11:189-199.
7. Bignon O., Baylac M., Vigne J.-D., Eisenmann V. Geometric morphometrics and the population diversity of Late Glacial horses in Western Europe (Equus caballus arcelini): phylogenetic and anthropological implications. J. Archaeol. Sci. 2005, 32:375-391.
8. Brace N., Kemp R., Snelgar R. SPSS for Psychologists 2006, Palgrave Macmillan, London. third ed.
9. Buck T.J., Strand Vidarsdóttir U. A proposed method for the identification of race in sub-adult skeletons: a geometric morphometric analysis of mandibular morphology. J. Forensic Sci. 2004, 49:1159-1164.
10. Cardini A., Elton S. Variation in guenon skulls I: species divergence, ecological and genetic differences. J. Hum. Evol. 2008, 54:615-637.
11. Cardini A., Elton S. Variation in guenon skulls II: sexual dimorphism. J. Hum. Evol. 2008, 54:638-647.
12. Cardini A., Elton S. - Does the skull carry a phylogenetic signal? Evolution and modularity in the guenons. Biol. J. Linn. Soc. Lond 2008, 93:813-834.
13. Cardini A., Diniz Filho J.A.F., Polly P.D., Elton S. Biogeographic analysis using geometric morphometrics: clines in skull size and shape in a widespread African arboreal monkey. Morphometrics for Nonmorphometricians, Lecture Notes in Earth Sciences 2010, vol. 124:191-218. Springer-Verlag Publishers, Berlin. A.M.T. Elewa (Ed.).
14. Carrano J.L., Girty G.H., Carrano C.J. Re-examining the Egyptian colonial encounter in Nubia through a compositional, mineralogical, and textural comparison of ceramics. J. Archaeol. Sci. 2009, 36:785-797.
15. Daniels M.R., Darcy R. Notes on the use and interpretation of discriminant analysis. Am. J. Pol Sci. 1983, 27:359-381.
16. DeGusta D., Vrba E. A method for inferring paleohabitats from the functional morphology of bovid astragali. J. Archaeol. Sci. 2003, 30:1009-1022.
17. DeGusta D., Vrba E. Methods for inferring paleohabitats from the functional morphology of bovid phalanges. J. Archaeol. Sci. 2005, 32:1099-1113.
18. DeGusta D., Vrba E. Methods for inferring paleohabitats from discrete traits of the bovid postcranial skeleton. J. Archaeol. Sci. 2005, 32:1115-1123.
19. Delicado P. Statistics in archaeology: new directions. New Techniques for Old Times, Computer Applications and Quantitative Methods in Archaeology, Proceedings of the CAA98 Conference 2000, 29-37. ArcheoPress (BAR International Series 757), Oxford. J.A. Barcelo, I. Briz, A. Vila (Eds.).
20. Morphometrics for Nonmorphometricians, Lecture Notes in Earth Sciences 2010, vol. 124. Springer-Verlag Publishers, Berlin. A.M.T. Elewa (Ed.).
21. Elton S. Locomotor and habitat classifications of cercopithecoid postcranial material from Sterkfontein member 4, Bolt's farm and Swartkrans members 1 and 2, South Africa. Palaeontologia Africana 2001, 37:115-126.
22. Escudé E., Montuire S., Desclaux E., Quéré J.-P., Renvoisé E., Jeannet M. Reappraisal of 'chronospecies' and the use of Arvicola (Rodential, Mammalia) for biochronology. J. Archaeol. Sci. 2008, 35:1867-1879.
23. Everitt B., Howell D. Encyclopedia of Statistics in Behavioral Science 2005, Wiley & Sons, Chichester, Sussex.
24. Felsenstein J. Phylogenies and the comparative method. Am. Nat. 1985, 125:1-15.
25. Garland T., Bennett A.F., Rezende E.L. Phylogenetic approaches in comparative physiology. J. Exp. Biol. 2005, 208:3015-3035.
26. Germonpré M., Sablin M.V., Stevens R.E., Hedges R.E.M., Hofreiter M., Stiller M., Després V.R. Fossil dogs and wolves from Palaeolithic sites in Belgium, the Ukraine and Russia: osteometry, ancient DNA and stable isotopes. J. Archaeol. Sci. 2009, 36:473-490.
27. Hair J.F., Anderson R.E., Tatham R.L., Black W.C. Multivariate Data Analysis 1998, Prentice Hall, New Jersey.
28. Hammer Ø, Harper D.A.T., Ryan P.D. PAST: Paleontological statistics software Package for Education and data analysis. Palaeontol Electronica 2001, 4:9. http://palaeo-electronica.org/2001_1/past/issue1_01.htm.
29. Harvey P.H., Pagel M.D. The Comparative Method in Evolutionary Biology 1991, Oxford University Press, Oxford.
30. Hjulström B., Isaksson S. Identification of activity area signatures in a reconstructed Iron Age house by combining element and lipid analyses of sediments. J. Archaeol. Sci. 2009, 36:174-183.
31. Huberty C.J., Hussein M.H. Some problems in reporting use of discriminant analyses. J. Exp. Educ. 2003, 71:177-191.
32. Huberty C.J. Issues in the use and interpretation of discriminant analysis. Psychol. Bull. 1984, 95:156-171.
33. Jain A.K., Waller W.G. On the optimal number of features in the classification of multivariate Gaussian data. Pattern Recognit 1978, 10:365-374.
34. Kappelman J. The palaeoenvironment of Kenyapithecus at Fort Ternan. J. Hum. Evol. 1991, 20:95-129.
35. Kappelman J., Plummer T., Bishop L., Duncan A., Appleton S. Bovids as indicators of Plio-Pleistocene palaeoenvironments in East Africa. J. Hum. Evol. 1997, 32:229-256.
36. Klein R.G., Franciscus R.G., Steele T.E. Morphometric identification of bovid metapodials to genus and implications for taxon-free habitat reconstruction. J. Archaeol. Sci. 2010, 37:389-401.
37. Klingenberg C.P., Monteiro L.R. Distances and directions in multidimensional shape spaces: implications for morphometric applications. Syst. Biol. 2005, 54:678-688.
38. Kovarovic K., Andrews P. Bovid postcranial ecomorphological survey of the Laetoli paleoenvironment. J. Hum. Evol. 2007, 52:663-680.
39. Larson G., Cucchi T., Fujita M., Matisoo-Smith E., Robins J., Anderson A., Rolett B., Spriggs M., Dolman G., Kim T.H., Thuy N.T., Randi E., Doherty M., Due R.A., Bollt R., Djubiantono T., Griffin B., Intoh M., Keane E., Kirch P., Li K.T., Morwood M., Pedriña L.M., Piper P.J., Rabett R.J., Shooter P., Van den Bergh G., West E., Wickler S., Yuan J., Cooper A., Dobney K. Phylogeny and ancient DNA of Sus provides insights into Neolithic expansion in Island Southeast Asia and Oceania. Proc. Natl. Acad. Sci. U.S.A 2007, 104:4834-4839.
40. Marcus L.E. Traditional morphometrics. Proceedings of the Michigan Morphometrics Workshop 1990, 95-130. University of Michigan Museum of Zoology Special Publication 1. F.J. Rohlf, F. Bookstein (Eds.).
41. McGarigal K., Cushman S., Stafford S. Multivariate Statistics for Wildlife and Ecology Research 2000, Springer-Verlag, New York.
42. Mendoza M., Palmqvist P. Characterizing adaptive morphological patterns related to habitat use and body mass in Bovidae. Acta Zool. Sin 2006, 52:971-987.
43. Naylor G.J.P., Marcus L.F. Identifying isolated shark teeth of the genus Carcharhinus to species: relevance for tracking phyletic change through the fossil record. Am. Mus. Novit 1994, 3109:1-53.
44. Neff N.A., Marcus L.F. A Survey of Multivariate Methods for Systematics 1980, Privately published.
45. Palmqvist P., Pérez-Claros J.A., Janis C.M., Figueirido B., Torregrosa V., Gröcke D.R. Biogeochemical and ecomorphological inferences on prey selection and resource partitioning among mammalian carnivores in an early Pleistocene community. Palaios 2008, 23:724-737.
46. Plummer T.W., Bishop L.C. Hominid paleoecology at Olduvai Gorge, as indicated by antelope remains. J. Hum. Evol. 1994, 27:47-75.
47. Plummer T.W., Bishop L.C., Hertel F. Habitat preference of extant African bovids based on astragalus morphology: operationalizing ecomorphology for palaeoenvironmental reconstruction. J. Archaeol. Sci. 2008, 35:3016-3027.
48. Rohlf F.J., Marcus L.F. Geometric morphometrics: reply to M. Corti. Trends Ecol. Evol. 1993, 8:339.
49. Rohlf F.J. Comparative methods for the analysis of continuous variables: geometric interpretations. Evolution 2001, 55:2143-2160.
50. Rohlf F.J. NTSYSpc, Version 2.21c 2009, Exeter Software, Setauket, New York.
51. Sanchez P.M. The unequal group size problem in discriminant analysis. J. Acad. Market. Sci. 1974, 2:629-633.
52. Sanfilippo P., Cardini A., Mackey D., Hewitt A., Crowston J. Optic disc morphology - rethinking shape. Prog. Retin. Eye Res. 2009, 28:227-248.
53. Sapir-Hen L., Bar-Oz G., Khalaily H., Dayan T. Gazelle exploitation in the early Neolithic site of Motza, Israel: the last of the gazelle hunters in the southern Levant. J. Archaeol. Sci. 2009, 36:1538-1546.
54. Sheets H.D., Covino K.M., Panasiewicz J.M., Morris S.R. Comparison of geometric morphometric outline methods in the discrimination of age-related differences in feather shape. Front. Zool. 2006, 3:15.
55. Sneath P.H.A., Sokal R.R. Numerical Taxonomy 1973, Freeman, San Francisco.
56. Sponheimer M., Reed K.E., Lee-Thorp J.A. Combining isotopic and ecomorphological data to refine bovid palaeodietary reconstruction: a case study from the Makapansgat limeworks hominin locality. J. Hum. Evol. 1999, 36:705-718.
57. Strand Vidarsdóttir U., O'Higgins P., Stringer C.B. A geometric morphometric study of regional differences in the ontogeny of the modern human facial skeleton. J. Anat. 2002, 201:211-229.
58. Strauss R.E. Discriminating groups of organisms. Morphometrics for Nonmorphometricians 2010, 73-91. Springer-Verlag Publishers, Berlin. E. Ashraf (Ed.).
59. Tabachnick B.G., Fidell L.S. Using Multivariate Statistics 2007, Allyn & Bacon, Boston. fifth ed.
60. Titus K., Mosher J.A., Williams B.K. Chance-corrected classification for use in discriminant analysis. Am. Midl. Nat. 1984, 111:1-7.
61. Wallace S.C. Differentiating Microtus xanthognathus and Microtus pennsylvanicus lower first molars using discriminant analysis of landmark data. J. Mammal 2006, 87:1261-1269.
62. Weinand D.C. A study of parametric versus non-parametric methods for predicting paleohabitat from Southeast Asian Bovid astragali. J. Archaeol. Sci. 2007, 34:1774-1783.
63. White J.W., Ruttenberg B.I. Discriminant function analysis in marine ecology: some oversights and their solutions. Mar. Ecol. Prog. Ser. 2007, 329:301-305.
64. Williams B.K. Some observations of the use of discriminant analysis in ecology. Ecology 1983, 64:1283-1291.
65. Wilson C.A., Davidson D.A., Cresser M.S. An evaluation of the site specificity of soil elemental signatures for identifying and interpreting former functional areas. J. Archaeol. Sci. 2009, 36:2327-2334.