Dynamic assessment of school-age children's narrative ability: An experimental investigation of classification accuracy

Journal of Speech, Language, and Hearing Research

Volumn 49, Issue 5, 2006, Pages 1037-1057

  Peña, Elizabeth D ^a   Gillam, Ronald B ^a,b   Malek, Melynn ^a,d   Ruiz Felter, Roxanna ^a,e   Resendiz, Maria ^a   Fiestas, Christine ^a   Sabel, Tracy ^a,c  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^b UTAH STATE UNIVERSITY   (United States)

^c Texas Early Childhood Intervention   (United States)

^d DeTar Hospital   (United States)

^e Richardson Independent School District   (United States)

Author keywords

Assessment; Bias; Children; Multicultural; Narratives

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; CASE CONTROL STUDY; CHILD; DOCUMENTATION; ETHNIC GROUP; FEMALE; HUMAN; LANGUAGE DISABILITY; LANGUAGE TEST; MALE; PATHOPHYSIOLOGY; REPRODUCIBILITY; STATISTICAL MODEL; STUDENT; VERBAL BEHAVIOR; VERBAL COMMUNICATION;

ABSTRACTING AND INDEXING; ANALYSIS OF VARIANCE; CASE-CONTROL STUDIES; CHILD; ETHNIC GROUPS; FEMALE; HUMANS; LANGUAGE DEVELOPMENT DISORDERS; LANGUAGE TESTS; LIKELIHOOD FUNCTIONS; MALE; NARRATION; REPRODUCIBILITY OF RESULTS; STUDENTS; VERBAL BEHAVIOR;

EID: 35148863885     PISSN: 10924388     EISSN: None     Source Type: Journal    
DOI: 10.1044/1092-4388(2006/074)     Document Type: Article

References (88)

1. Allen, M., & Yen, W. (1979). Introduction to measurement theory. Belmont, CA: Wadsworth.
2. Baddeley, A., Gathercole, S., & Papagno, C. (1998). The phonological loop as a language learning device. Psychological Review, 105, 158-173.
3. Bain, B., & Olswang, L. (1995). Examining readiness for learning two-word utterances by children with specific expressive language impairment: Dynamic assessment validation. American Journal of Speech-Language Pathology, 4, 81-92.
4. Berman, R. A., & Slobin, D. I. (1994). Relating events in narrative: A crosslinguistic developmental study. Hillsdale, NJ: Erlbaum.
5. Bishop, D. V. M. (1992). The underlying nature of specific language impairment. Journal of Child Psychology and Psychiatry, 33, 3-66.
6. Bishop, D. V. M., North, T., & Donlan, C. (1996). Nonword repetition as a behavioural marker for inherited language impairment: Evidence from a twin study. Journal of Child Psychology and Psychiatry, 37, 391-403.
7. Bracken, B. A. (1988). Ten psychometric reasons why similar tests produce dissimilar results. Journal of School Psychology, 26, 155-166.
8. Campbell, T., Dollaghan, C., Needleman, H., & Janosky, J. (1997). Reducing bias in language assessment: Processingdependent measures. Journal of Speech and Hearing Research, 40, 519-525.
9. Carrow-Woolfolk, E. (1999). Comprehensive assessment of spoken language. Circle Pines, MN: AGS.
10. Conti-Ramsden, G. (2003). Processing and linguistic markers in young children with specific language impairment (SLI). Journal of Speech, Language, and Hearing Research, 46, 1029-1037.
11. Davies, P., Shanks, B., & Davies, K. (2004). Improving narrative skills in young children with delayed language development. Educational Review, 56, 271-286.
12. Demsky, Y. I., Mittenberg, W., Quintar, B., Katell, A. D., & Golden, C. J. (1998). Bias in the use of standard American norms with Spanish translations of the Wechsler Memory Scale-Revised. Assessment, 5, 115-121.
13. DeVellis, R. (1991). Scale development: Theory and applications (Vol. 26). Newbury Park, CA: Sage.
14. Dollaghan, C., & Campbell, T. F. (1998). Nonword repetition and child language impairment. Journal of Speech, Language, and Hearing Research, 41, 1136-1146.
15. Dunn, M., Flax, J., Sliwinski, M., & Aram, D. (1996). The use of spontaneous language measures as criteria for identifying children with specific language impairment: An attempt to reconcile clinical and research incongruence. Journal of Speech and Hearing Research, 39, 643-654.
16. Ellis Weismer, S., Tomblin, J. B., Zhang, X., Buckwalter, P., Chynoweth, J. G., & Jones, M. (2000). Nonword repetition performance in school-age children with and without language impairment. Journal of Speech, Language, and Hearing Research, 43, 865-878.
17. Feuerstein, R. (1979). The dynamic assessment of retarded performers: The learning potential assessment device, theory, instruments, and techniques. Baltimore: University Park Press.
18. Feuerstein, R., Miller, R., Rand, Y., & Jensen, M. (1981). Can evolving techniques better measure cognitive change? Journal of Special Education, 15, 201-219.
19. Gardner, M. F. (1979). Expressive One-Word Picture Vocabulary Test. Novato, CA: Academic Therapy Publications.
20. Gathercole, S. E., & Baddeley, A. D. (1990). The role of phonological memory in vocabulary acquisition: A study of young children learning new names. British Journal of Psychology, 81, 439-454.
21. Geist, E., & Aldridge, J. (2002). The developmental progression of children's oral story inventions. Journal of Instructional Psychology, 29, 33-39.
22. Gillam, R. B., Cowan, N., & Marler, J. A. (1998). Information processing by school-age children with specific language impairment: Evidence from a modality effect paradigm. Journal of Speech, Language, and Hearing Research, 41, 913-926.
23. Gillam, R. B., & McFadden, T. U. (1994). Redefining assessment as a holistic discovery process. Journal of Childhood Communication Disorders, 16, 36-40.
24. Gillam, R. B., McFadden, T., & van Kleeck, A. (1995). Improving the narrative abilities of children with language disorders: Whole language and language skills approaches. In M. Fey, J. Windsor, & J. Reichle (Eds.), Communication intervention for school-age children (pp. 145-182). Baltimore: Brookes.
25. Gillam, R. B., Peña, E. D., & Miller, L. (1999). Dynamic assessment of narrative and expository discourse. Topics in Language Disorders, 20(1), 33-47.
26. Gutierrez-Clellen, V. F., & Peña, E. (2001). Dynamic assessment of diverse children: A tutorial. Language, Speech, and Hearing Services in Schools, 32, 212-224.
27. Gutierrez-Clellen, V. F., Peña, E. D., & Quinn, R. (1995). Accommodating cultural differences in narrative style: A multicultural perspective. Topics in Language Disorders, 15(4), 54-67.
28. Gutierrez-Clellen, V. F., & Quinn, R. (1993). Assessing narratives in diverse cultural / linguistic populations: Clinical implications. Language, Speech, and Hearing Services in Schools, 24, 2-9.
29. Hayward, D., & Schneider, P. (2000). Effectiveness of teaching story grammar knowledge to preschool children with language impairment: An exploratory study. Child Language Teaching and Therapy, 16, 255.
30. Haywood, H. C., & Tzuriel, D. (1992). Interactive assessment. New York: Springer-Verlag.
31. Haywood, H. C., & Wingenfeld, S. A. (1992). Interactive assessment as a research tool. Journal of Special Education, 26, 253-268.
32. Hewitt, L. E., Hammer, C. S., Yont, K. M., & Tomblin, J. B. (2005). Language sampling for kindergarten children with and without SLI: Mean length of utterance, IPSYN, and NDW. Journal of Communication Disorders, 38, 197.
33. Hoffman, L. M., & Gillam, R. B. (2004). Verbal and spatial information processing constraints in children with specific language impairment. Journal of Speech, Language, and Hearing Research, 47, 114-125.
34. Iglesias, A. (1985). Cultural conflict in the classroom: The communicatively different child. In D. N. Ripich & F. M. Spinelli (Eds.), School discourse problems (pp. 79-96). San Diego, CA: College-Hill.
35. Iglesias, A., & Gutierrez-Clellen, V. (1988). The cultural linguistic minority student. In D. Yoder & R. Kent (Eds.), Decision making in speech-language pathology (pp. 119-120). Hamilton, Ontario, Canada: B. C. Decker.
36. Jensen, M., & Feuerstein, R. (1987). The learning potential assessment device: From theory to practice. In C. S. Lidz (Ed.), Dynamic assessment: An interactional approach to evaluating learning potential (pp. 379-402). New York: Guilford Press.
37. Jordan, G. E., Snow, C. E., & Porche, M. V. (2000). Project ease: The effect of a family literacy project on kindergarten students' early literacy skills. Reading Research Quarterly, 35, 524-546.
38. Kozulin, A. (2002). Sociocultural theory and the mediated learning experience. School Psychology International, 23, 7-35.
39. Laing, S. P., & Kamhi, A. (2003). Alternative assessment of language and literacy in culturally and linguistically diverse populations. Language, Speech, and Hearing Services in Schools, 34, 44-55.
40. Lidz, C. S. (1987). Dynamic assessment: An interactional approach to evaluating learning potential. New York: Guilford Press.
41. Lidz, C. S. (1991). Practitioner's guide to dynamic assessment. New York: Guilford Press.
42. Lidz, C. S. (1996). Dynamic assessment and the legacy of L.S. Vygotsky. School Psychology International, 16, 143-154.
43. Lidz, C. S. (1997). Dynamic assessment: Psychoeducational assessment with cultural sensitivity. Journal of Social Distress and the Homeless, 6, 95-111.
44. Lidz, C. S. (2002). Mediated learning experience (MLE) as a basis for an alternative approach to assessment. School Psychology International, 23, 68-84.
45. Lidz, C. S., & Peña, E. D. (1996). Dynamic assessment: The model, its relevance as a non-biased approach and its application to Latino American preschool children. Language, Speech, and Hearing Services in Schools, 27, 367-372.
46. Lidz, C. S., & Thomas, S. (1987). The preschool learning assessment device: Extension of a static approach. In C. S. Lidz (Ed.), Dynamic assessment: An interactional approach to evaluating learning potential (pp. 288-326). New York: Guilford Press.
47. Loban, W. (1976). Language development: Kindergarten through grade twelve. Urbana IL: National Council of Teachers of English.
48. Mayer, M., & Mayer, M. (1975). One frog too many. New York: Penguin Books.
49. McCartney, E., Boyle, J., Bannatyne, S., Jessiman, E., Campbell, C., Kelsey, C., et al. (2004). Becoming a manual occupation? The construction of a therapy manual for use with language impaired children in mainstream primary schools. International Journal of Language and Communication Disorders, 39, 135-148.
50. McCauley, R., & Swisher, L. (1984a). Psychometric review of language and articulation tests for preschool children. Journal of Speech and Hearing Disorders, 49, 34-42.
51. McCauley, R., & Swisher, L. (1984b). Use and misuse of norm-referenced tests in clinical assessment: A hypothetical case. Journal of Speech and Hearing Disorders, 49, 338-348.
52. McFadden, T. U. (1998). The immediate effects of pictographic representation on children's narratives. Child Language Teaching and Therapy, 14, 51-67.
53. Miller, J., & Chapman, R. S. (1983). Using microcomputers to advance research in language disorders. Theory Into Practice, 22, 301-307.
54. Miller, J., & Chapman, R. S. (2002). SALT for Windows-Research version 7.0. Madison: University of Wisconsi-Madison, Waisman Center, Language Analysis Laboratory.
55. Miller, L. (2000a). Bird and his ring. Austin, TX: Neon Rose Productions.
56. Miller, L. (2000b). Two friends. Austin, TX: Neon Rose Productions.
57. Miller, L., Gillam, R. B., & Peña, E. D. (2001). Dynamic assessment and intervention: Improving children's narrative skills. Austin, TX: Pro-Ed.
58. Newcomer, P., & Hammill, D. (1997). Test of Language Development-Primary, Third Edition. Austin, TX: Pro-Ed.
59. Norbury, C. F., & Bishop, D. V. M. (2003). Narrative skills of children with communication impairments. International Journal of Language and Communication Disorders, 38, 287-313.
60. Olswang, L., & Bain, B. (1996). Assessment information for predicting upcoming change in language production. Journal of Speech and Hearing Research, 39, 414-423.
61. Patterson, S., & Gillam, R. B. (1995). Team collaboration in the evaluation of language in students above the primary grades. In D. Tibbits (Ed.), Language intervention: Beyond the primary grades (pp. 137-181). Austin, TX: Pro-Ed.
62. Peña, E. D. (2000). Measurement of modifiability in children from culturally and linguistically diverse backgrounds. Communication Disorders Quarterly, 21(2), 87-97.
63. Peña, E. D., & Gillam, R. B. (2000). Dynamic assessment of children referred for speech and language evaluations. In C. S. Lidz & J. Elliott (Eds.), Dynamic assessment: Prevailing models and applications (Vol. 6). Oxford, England: Elsevier Science.
64. Peña, E., Gillam, R., & Miller, L. (2003). Dynamic Assessment of Narratives: Revised Scripts. Retrieved from http://www.neonrose.net/dynamicassessment/script.pdf
65. Peña, E. D., Iglesias, A., & Lidz, C. S. (2001). Reducing test bias through dynamic assessment of children's word learning ability. American Journal of Speech-Language Pathology, 10, 138-154.
66. Peña, E. D., & Quinn, R. (1997). Task familiarity: Effects on the test performance of Puerto Rican and African American children. Language, Speech, and Hearing Services in Schools, 28, 323-332.
67. Peña, E. D., Quinn, R., & Iglesias, A. (1992). The application of dynamic methods to language assessment: A nonbiased procedure. Journal of Special Education, 26, 269-280.
68. Peña, E. D., Spaulding, T. J., & Plante, E. (2006). The composition of normative groups and diagnostic decision making: Shooting ourselves in the foot. American Journal of Speech-Language Pathology, 15, 247-254.
69. Peterson, C., Jesso, B., & McCabe, A. (1999). Encouraging narratives in preschoolers: An intervention study. Journal of Child Language, 26, 49-67.
70. Plante, E., & Vance, R. (1994). Selection of preschool language tests: A data-based approach. Language, Speech, and Hearing Services in Schools, 25, 15-24.
71. Riding, R. J., & Tite, H. C. (1985). The use of computer graphics to facilitate story telling in young children. Educational Studies, 11, 203-210.
72. Rodekohr, R. K., & Haynes, W. O. (2001). Differentiating dialect from disorder: A comparison of two processing tasks and a standardized language test. Journal of Communication Disorders, 34, 255-272.
73. Scheffner-Hammer, C., Pennock-Roman, M., Rzasa, S., & Tomblin, J. B. (2002). An analysis of the Test of Language Development-Primary for item bias. American Journal of Speech-Language Pathology, 11, 274-284.
74. Schoenbrodt, L., Kerins, M., & Gesell, J. (2003). Using narrative language intervention as a tool to increase communicative competence in Spanish-speaking children. Language, Culture and Curriculum, 16, 48-59.
75. Spaulding, T. J., Plante, E., & Farinella, K. A. (2006). Eligibility criteria for language impairment: Is the low end of normal always appropriate? Language, Speech, and Hearing Services in Schools, 37, 61-72.
76. Sternberg, R. J. (2002). Raising the achievement of all students: Teaching for successful intelligence. Educational Psychology Review, 14, 383-393.
77. Sternberg, R. J., & Grigorenko, E. L. (2002a). Difference scores in the identification of children with learning disabilities: It's time to use a different method. Journal of School Psychology, 40, 65-83.
78. Sternberg, R. J., & Grigorenko, E. L. (2002b). Dynamic testing: The nature and measurement of learning potential. New York: Cambridge University Press.
79. Sternberg, R. J., Grigorenko, E. L., Ngorosho, D., Tantufuye, E., Mbise, A., Nokes, C., et al. (2002). Assessing intellectual potential in rural Tanzanian school children. Intelligence, 30, 141-162.
80. Stiegler, L. N., & Hoffman, P. R. (2001). Discourse-based intervention for word finding in children. Journal of Communication Disorders, 34, 277-303.
81. Tomblin, J. B., Records, N. L., Buckwalter, P., Zhang, X., Smith, E., & O'Brien, M. (1997). Prevalence of specific language impairment in kindergarten children. Journal of Speech and Hearing Research, 40, 1245-1260.
82. Tomblin, J. B., Records, N. L., & Zhang, X. (1996). A system for the diagnosis of specific language impairment in kindergarten children. Journal of Speech and Hearing Research, 39, 1284-1294.
83. Tzuriel, D. (2000). Dynamic assessment of young children: Educational and intervention perspectives. Educational Psychology Review, 12, 385-435.
84. Ukrainetz, T. A. (1998). Stickwriting stories: A quick and easy narrative representation strategy. Language, Speech, and Hearing Services in Schools, 29, 197-207.
85. Ukrainetz, T. A., Harpell, S., Walsh, C., & Coyle, C. (2000). A preliminary investigation of dynamic assessment with Native American kindergartners. Language, Speech, and Hearing Services in Schools, 31, 142-154.
86. Valencia, R., & Rankin, R. J. (1985). Evidence of content bias on the McCarthy scales with Mexican American children: Implications for test translation and nonbiased assessment. Journal of Educational Psychology, 77, 197-207.
87. Valencia, R., & Suzuki, L. (2001). Intelligence testing and minority students: Foundations, performance factors, and assessment issues. Thousand Oaks, CA: Sage.
88. Vygotsky, L. S. (1986). Thought and language. Cambridge, MA: MIT Press.