Ambiguity in child language: The problem of interobserver reliability in ambiguous observation data

First Language

Volumn 23, Issue 3, 2003, Pages 259-284

  Van Geert, Paul ^a   Van Dijk, Marijn ^a  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

Ambiguity; Cohen's kappa; Dynamic systems theory; Fuzzy logic; Inter observer reliability; Spatial prepositions

Indexed keywords

EID: 18344366486     PISSN: 01427237     EISSN: 17402344     Source Type: Journal    
DOI: 10.1177/01427237030233001     Document Type: Article

References (56)

1. Bornstein, M., Haynes, O., Painter, K. M. & Genevro, J. L. (2000). Child language with mother and with stranger at home and in the laboratory: a methodological study. Journal of Child Language, 27, 407-20.
2. Bouldin, P., Bavin, E. L. & Pratt, C. (2002). An investigation of the verbal abilities of children with imaginary companions. First Language, 22, 249-64.
3. Braine, M. (1963). The ontogeny of English phrase structure: the first phase. Language, 39, 1-13. [Reprinted in C. A. Fergusson & D. I. Slobin (eds) (1973). Studies of Child Language Development (New York: Holt, Rinehart & Winston)].
4. Brown, R. (1973). A First Language: The Early Stages (London: Allen & Unwin).
5. Cicchetti, D. V. & Feinstein, A. R. (1990). High agreement but low kappa: II. Resolving the paradoxes. Journal of Clinical Epidemiology, 43 (6), 551-8.
6. Cook, R. J. (1998). Kappa and its dependence on marginal rates. In P. Armitage & T. Colton (eds), The Encyclopaedia of Biostatistics (New York: Wiley), 2166-8.
7. Courtney, E. H. (2002). Child acquisition of Quechua causatives. First Language, 22, 29-71.
8. Dolitsky, M. (1983). The birth of grammatical morphemes. Journal of Psycholinguistic Research, 12, 353-60.
9. Farrar, M. J. & Maag, L. (2002). Early language development and the emergence of theory of mind. First Language, 22, 197-213.
10. Feinstein, A. R. & Cicchetti, D. V. (1990). High agreement but low kappa: I. The problems of two paradoxes [see comments]. Journal of Clinical Epidemiology, 43 (6), 543-9.
11. Fletcher, P. (1985). A Child's Learning of English (Oxford: Blackwell).
12. Goldfield, B. A. (2000). Nouns before verbs in comprehensive vs. production: the view from pragmatics. Journal of Child Language, 27, 501-20.
13. Green, D. M. & Swets, J. A. (1966). Signal Detection Theory and Psychophysics (New York: Wiley).
14. Grinstead, J. (2000). Case, inflection and subject licensing in child Catalan and Spanish. Journal of Child Language, 27, 119-35.
15. Guggenmoos-Holzmann, I. (1996). The meaning of kappa: probabilistic concepts of reliability and validity revisited. Journal of Clinical Epidemiology, 49, 775-82.
16. Guidetti, M. (2002). The emergence of pragmatics: forms and functions of conventional gestures in young French children. First Language, 22, 265-85.
17. Gwet, K. (2001). Handbook of Inter-Rater Reliability (Gaithersburg, MD: STATAXIS Publishing Co.).
18. Gwet, K. (2002). Inter-rater reliability: dependency on trait prevalence and marginal homogeneity. Statistical Methods for Inter-Rater Reliability Assessment, 2, 1-9.
19. Hood, G. (2001). Poptools [Computer software]. Pest Animal Control Co-operative research Centre (CSIRO), Canberra, Australia.
20. Huang, C. (2000). Temporal reference in Chinese mother-child conversations: morphosyntactic and discourse-pragmatic resources. Journal of Child Language, 27, 421-35.
21. Jagielska, I., Matthews, C. & Whitfort, T. (1999). An investigation into the application of neural networks, fuzzy logic, genetic algorithms, and rough sets to automated knowledge acquisition for classification problems. Neurocomputing, 24, 37-54.
22. Joseph, K. L., Serratrice, L. & Conti-Ramsden, G. (2002). Development of copula and auxiliary BE in children with Specific Language Impairment and younger unaffected controls. First Language, 22, 137-72.
23. Kilani-Schoch, M. & Dressler, W. U. (2000). Are fillers as precursors relevant for morphological theory? In W. U. Dressler, O. E. Pfeiffer, M. Pöchtragter & J. R. Rennison (eds), Morphological Analysis in Comparison, Current Issues in Linguistic Theory, Vol. 201 (Amsterdam/ Philadelphia: John Benjamins).
24. Kosko, B. (1993). Fuzzy Thinking: The New Science of Fuzzy Logic (New York: Hyperion).
25. Kosko, B. (1997). Fuzzy Engineering (Upper Saddle River, NJ: Prentice Hall).
26. Kunnari, S. (2002). Word length in syllables: evidence from early word production in Finnish. First Language, 22, 119-35.
27. Lacroix, V., Pomerleau, A. & Malcuit, G. (2002). Properties of adult and adolescent mothers' speech, children's verbal performance and cognitive development in different socioeconomic groups: a longitudinal study. First Language, 22, 173-96.
28. Leonard, L., Caselli, M. C. & Devescovi, A. (2002). Italian children's use of verb and noun morphology during the preschool years. First Language, 22, 287-304.
29. Mac Whinney, B. (1991). The Childes Project, Tools for Analyzing Talk (Hillsdale, NJ: Lawrence Erlbaum Associates).
30. Maratsos, M. (2000). More overregularisations after all: new data and discussion on Marcus, Pinker, Ullman, Hollander, Rosen & Xu. Journal of Child Language, 27, 183-212.
31. McNeill, D. & Freiberger, P. (1993). Fuzzy Logic (New York: Simon & Schuster).
32. Nguyen, H. T. & Walker, E. A. (1997). A First Course in Fuzzy Logic (Boca Raton: CRC Press).
33. O'Neill, D. K. & Holmes, A. C. (2002). Young preschoolers' ability to reference story characters: the contribution of gestures and character speech. First Language, 22, 73-103.
34. Parisse, C. & Le Normand, M. (2000). How children build their morphosyntax: the case of French. Journal of Child Language, 27, 267-92.
35. Peters, A. M. (1990). From phonology to morphology: the transformation of filler syllables. Paper presented at the Fifth International Congress for the Study of Child Language, Budapest, Hungary.
36. Prat-Sala, M., Shillcock, R. & Sorace, A. (2000). Animacy effects on the production of object dislocated descriptions by Catalan-speaking children. Journal of Child Language, 27, 97-117.
37. Rescorla, L., Dahlgaard, K. & Roberts, J. (2000). Late-talking toddlers: MLU and IPSyn outcomes at 3;0 and 4;0. Journal of Child Language, 27, 643-64.
38. Ross, T. J. (1995). Fuzzy Logic with Engineering Applications (New York: McGrawHill).
39. Rowland C. F. & Pine, J. M. (2000). Subject-auxiliary inversion error and wh-question acquisition: what children do know. Journal of Child Language, 27, 157-81.
40. Scarpa, E. (1993). Filler sounds and the acquisition of prosody: sound and syntax. Paper presented at the Sixth International Congress for the study of Child Language, Trieste, Italy.
41. Schiff, R. (2002). They look similar, but they are different: reading two morphological structures of Hebrew nouns. First Language, 22, 305-22.
42. Serratrice, L. (2000). Book review on the CHILDES project: tools for analyzing talk. First Language, 20, 331-7.
43. Shaffer, D. (1985). Developmental Psychology, Childhood and Adolescence (Pacific Grove, CA: Brooks/Cole Publishing Co.).
44. Simmonsen, H. G. (1993). Models for the description of phonological acquisition. Paper presented at the Sixth International Congress for the study of Child Language, Trieste, Italy.
45. Stockman, I. J. & Vaughn-Cooke, F. (1992). Lexical elaborations in children's locative action expressions. Child Development, 63, 1104-25.
46. Thelen, E. & Smith, L. B. (1993). A Dynamic Systems Approach to the Development of Cognition and Action (Cambridge, MA: MIT Press).
47. Uebersax, J. S. (1987). Diversity of decision-making models and the measurement of interrater agreement. Psychological Bulletin, 101, 140-6.
48. Uebersax, J. S. (1988). Validity inferences from interobserver agreement Psychological Bulletin, 104, 405-16.
49. Uebersax, J. S. (2001). Statistical methods for rater agreement. Website http:// ourworld.compuserve.com/homepages/jsuebersax/agree.htm
50. van Dijk, M. & van Geert, P. (submitted). Disentangling behaviour in early child development; interpretability of early child language and the problem of filler syllables and growing utterance length. Submitted for publication.
51. Veneziano, E. & Sinclair, H. (2000). The changing status of filler syllables on the way to grammatical morphemes. Journal of Child Language, 27, 461-500.
52. Veneziano, E., Sinclair, H. & Berthoud, I. (1990). From one word to two words: repetition patterns on the way to structured speech. Journal of Child Language, 17, 633-50.
53. von Altrock, C. (1995). Fuzzy Logic and Neurofuzzy Applications Explained (Upper Saddle River, NJ: Prentice Hall).
54. Winsler, A., Carlton, M. P. & Barry, M. J. (2000). Age-related changes in preschool children's systematic use of private speech in a natural setting. Journal of Child Language, 27, 665-87.
55. Yairi, E. (1982). Longitudinal studies of disfluencies in two-year-old children. Journal of Speech and Hearing Research, 25 (1), 155-60
56. Zwick, R. (1988). Another look at interrater agreement. Psychological Bulletin, 103 (3), 374-8.