On the adequacy of verbal protocols in examining an underlying construct of a test

Studies in Educational Evaluation

Volumn 31, Issue 1, 2005, Pages 1-26

  Alavi, Sayyed Mohammad ^a  

^a UNIVERSITY OF TEHRAN   (Iran)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 19744378220     PISSN: 0191491X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.stueduc.2005.02.004     Document Type: Article

References (90)

1. Abelen E. Redeker G. & Thompson S.A. The rhetorical structure of US-American and Dutch fund-raising letters Text 13 3 1993 323-350
2. Afflerbach P. & Johnston P. On the use of verbal report in reading research Journal of Reading Behaviour 16 1984 307-322
3. Alavi S.M. 1997 Unpublished Ph.D. dissertation An examination of the usefulness of rhetorical structure theory (RST) in testing reading comprehension Department of Linguistics and Modern Languages, University of Lancaster
4. Alavi S.M. Exploring rhetorical relations of texts: Using writer and co-author Pazhuhesh -e Zabahha -ye Khareji (A research journal of faculty of foreign languages) 10 2001 University of Tehran UK
5. Alderson J.C. Scoring procedures for use on cloze tests in: CA. Yorio K. Yorio & J. Schachter (eds.) On TESOL '79 1979 TESOL Washington, DC 193-205
6. Alderson J.C. Native and non-native speaker performance on cloze tests Language Learning 30 1980 59-76
7. Anderson N. Individual differences in strategy use in second language reading and testing Modern Language Journal 75 1991 460-472
8. Bachman L.F. The trait structure of cloze test scores TESOL Quarterly 16 4 1982 561-570
9. Bachman L.F. Performance on cloze tests with fixed-ratio and rational deletions TESOL Quarterly 19 3 1985 535-556
10. Bachman L.F. Fundamental considerations in language testing 1991 OUP Oxford
11. Bensoussan M. & Laufer B. Lexical guessing in context in EFL reading comprehension Journal of Research in Reading 7 1984 15-32
12. Block E. The comprehension strategies of second language learners TESOL Quarterly 20 3 1986 463-491
13. Boring E.G. A history of introspection Psychological Bulletin 50 1953 169-189
14. Bormuth J.R. Experimental applications of cloze tests International Reading Association Conference Proceedings 9 1964 303-306
15. Bridge C.A. & Winograd P.N. Readers' awareness of cohesive relationship during cloze comprehension Journal of Reading Behaviour 14 1982 299-312
16. Chavanachart P. The effect of explicitly and implicitly presented rhetorical functions on the comprehension of scientific discourse: A multitrait-multimethod construct validation of EST reading comprehension 1984 Unpublished Ph.D. dissertation University of Illinois
17. Clarke M. Reading in Spanish and English: Evidence from adult ESL students In: S. Hudelson (Ed.) Learning to read in different languages 1981 Center for Applied Linguistics Washington 69-92
18. Cohen A.D. On taking language tests: What the students report Language Testing 1 1 1984 70-81
19. Cohen A.D. Verbal report on learning strategies TESOL Quarterly 28 4 1994 678-682
20. Cohen A.D. Verbal reports as a source of insight on learner strategies Paper presented at the colloquium on issues in assessment of L2 learner strategies, AAAA Annual Conference Long Beach, CA, March 25-28 1995
21. Cui S. Comparing structure of essays in Chinese and English 1985 Unpublished Master's thesis University of California
22. Cziko G.A. Differences in first and second language reading: The use of syntactic, semantic, and discourse constraints Canadian Modern Language Review 39 1978 473-489
23. Cziko G.A. Language proficiency and academic achievement In: J.W. Oller Jr. (Ed.) Issues in language testing research 1983 Newbury House Rowley, MA
24. Darnell D.K. Clozentropy: A procedure for testing English language proficiency of foreign students Speech Monographs 37 1970 36-46
25. Dorbin D.N. Protocol once more College English 48 1986 713-725
26. Ericsson K.A. & Simon H.A. Verbal report as data Psychological Review 87 1980 215-251
27. Ericsson K.A. & Simon H.A. Protocol analysis: Verbal report as data 1984 MIT Press Cambridge, MA
28. Ericsson K.A. & Simon H.A. Protocol analysis: Verbal report as data 1993 MIT Press Cambridge, MA
29. Faerch C. & Kasper G. (Eds.) Introspection in second language research 1987 Multilingual Matters Clevedon, UK
30. Faerch C. & Kasper G. From product to process: Introspective methods in second language research In: C. Faerch & G. Kasper (Eds.) Introspection in second language research 1987 Multilingual Matters Clevedon, UK 5-23
31. Fox B. Discourse structure and anaphora in written and conversational English 1987 Cambridge University Press Cambridge, UK
32. Gamarra & A.G. Jonz J. 1987 Cloze procedure and the sequence of the text In: J.E. Readence R.S. Balwin (Eds.) Research in literacy: Merging perspectives (Thirty-sixth Yearbook of the National Reading Conference) National Reading Conference Rochester, NY 17-24
33. Haastrup K. Using thinking aloud and retrospection to uncover learners' lexical inferencing procedures In: C. Faerch & G. Kasper (Eds.) Introspection in second language research 1987 Multilingual Matters Clevedon, UK 197-212
34. Haastrup K. Developing learners' procedural knowledge in comprehension In: R. Phillipson E. Kellerman L. Selinker M. Sharwood Smith & M. Swain (Eds.) Foreign/second language pedagogy research 1990 Multilingual Matters Clevedon, UK 120-133
35. Haastrup K. Lexical inferencing procedures or talking about words 1991 Gunter Narr Tübingen
36. Halliday M.A.K. & Hassan R. Cohesion in English 1976 Longman London
37. Halliday M.A.K. & Hassan R. Language, context and text: A social semiotic perspective 1989 Oxford University Press Oxford
38. Hayes J.R. & Flower L.S. Uncovering cognitive processes in writing: An introduction to protocol analysis In: P. Mosenthal L. Tamor S.A. & Walmsley (Eds.) Research on writing: Principles and methods 1983 Longman New York, NY 207-220
39. Haynes M. Patterns and perils of guessing in second language reading In: T. Huckin M. Haynes & J. Coady (Eds.) Second language reading and vocabulary learning 1993 Ablex Norwood, NJ 46-62
40. (Thirty-fourth Yearbook of the National Reading Conference) Henk W.A. Helfeldt J.P. & Rinehart S.D. A metacognitive approach to estimating intersentential integration in cloze tests In: J.A. Niles & R.V. Lalik (Eds.) Issues in literacy research perspective 1985 National Reading Conference Rochester, NY 213-218
41. Jonz J. Improving the basic egg: The multiple choice cloze Language Learning 26 1976 255-265
42. Jonz J. Cloze item types and second language comprehension Language Testing 8 1 1991 1-22
43. Klein-Braley C. Empirical investigation of cloze tests. An examination of the validity of cloze tests as tests of general language proficiency in English for German University students Unpublished Ph.D. dissertation 1981 University of Duisburg
44. Kumpf L. Structuring narratives in a second language: A description of rhetoric and grammar 1986 University of California Los Angeles Unpublished Ph.D. thesis
45. Lado R. Analysis of native speaker performance on a cloze test Language Testing 3 1986 130-146
46. Lipson M.Y. Irwin M. & Poth L. The relationship between metacognitive self-report and strategic reading behaviour in: J.A. Niles R.V. & Lalik (Eds.) Solving problems in literacy: Learners, teachers and researchers, thirty-fifth yearbook of the National Reading Conference 1986 National Reading Conference Rochester, NY 214-225
47. Long D.L. & Bourg T. Thinking aloud: Telling a story about a story Discourse Processes 21 1996 329-339
48. Mann S.J. Verbal reports as data: A focus on retrospection In: S. Dingwall & S.J. Mann (Eds.) Methods and problems in doing applied linguistic research 1982 University of Lancaster, Department of Linguistics and Modern Languages Lancaster, UK 87-104
49. Mann W.C Matthiessen C.M.I.M. & Thompson S.A. Rhetorical structure theory and text analysis In: W.C. Mann C.M.I.M. & Thompson (Eds.) Discourse description: Diverse linguistic analysis of a fund-raising text 1992 John Benjamin Amsterdam
50. Mann W.C. & Matthiessen C.M.I.M. Functions of language in two frameworks Word 42 3 1991 231-249
51. Mann W.C. & Thompson S.A. Rhetorical structure theory: Toward a functional theory of text organisation Text 8 3 1988 243-281
52. Mann W.C. & Thompson S.A. Rhetorical structure theory: Description and construction of text structures In: G. Kempen (Ed.), Natural language generation: New results in artificial intelligence, psychology and linguistics Processing of the Third International Workshop on Text Generation, Nijmegen, the Netherlands 1986 85-95
53. Markham P.L. The rational deletion cloze and global comprehension in German Language Learning 35 1985 423-430
54. McKenna M.C. & Layton K. Concurrent validity of cloze as a measure of intersentential comprehension Journal of Educational Psychology 82 2 1990 372-377
55. Morrison L. Talking about words: A study of French as a second language learners' lexical inferencing procedures The Canadian Modern Language Review 53 1 1996 41-66
56. Mullen K. More on cloze tests as tests of proficiency in English as a second language in: E. Brière F. (Eds.) Hinofotis Concepts in language testing 1979 TESOL Washington, DC
57. Neöl D. Towards a functional; Characterisation of the news of the BBC World News Service Antwerp Papers in Linguistics 49 1986
58. Nevo N. Test taking strategies on a multiple-choice test of reading comprehension Language Testing 6 1989 199-215
59. Nisbett R.E. & Wilson T.D. Telling more than we can know: Verbal reports on mental processes Psychological Review 84 1977 231-259
60. Nunan D. Language teaching course design: Trends and issues 1985 National Curriculum Resource Centre Adelaide
61. O'Brien T. Writing for continuous assessment and in examination conditions: A comparison of undergraduate performance 1992 University of Manchester Unpublished Ph.D. dissertation
62. O'Brien T. Rhetorical structure analysis and the case of the inaccurate, incoherent source - Hopper Applied Linguistics 16 4 1995 442-482
63. Ohnmacht F.W. & Fleming J.T. Further effects of selected deletion strategies and varying contextual constraints on cloze performance The 23rd Yearbook of the National Reading Conference 1974 The National Reading Conference Clemson, SC 163-171
64. Oller J.W. Jr. Scoring methods and difficulty levels for cloze tests of proficiency in ESL Modern Language Journal 56 1972 151-158
65. Oller J.W. Jr. Cloze tests of second language proficiency and what they measure Language Learning 23 1973 105-118
66. Olson G. Duffy S.A. & Mack R.L. Thinking-out-aloud as a method for studying real time comprehension processes In: D.E. Kieras & M.A. Just (Eds.) New methods in reading comprehension research 1984 Erlbaum Hillsdale, NJ 253-286
67. Oster L. Using the think-aloud for reading instruction The Reading Teacher 55 1 2001 64-70
68. Paribakht T.S. & Wesche M. Reading and "incidental" L2 vocabulary acquisition: An introspective study of lexical inferencing Studies in Second Language Acquisition 21 1999 195-218
69. Péry-Woodley M.P. Textual designs: Signalling coherence in first and second language academic writing 1989 University of Lancaster Unpublished Ph.D. thesis
70. Pressley M. & Afflerbach P. Verbal protocols of reading: The nature of constructively responsive reading 1995 Erlbaum Hillsdale, NJ
71. Ramanauska S. The responsiveness of cloze readability measures to linguistic variables operating over segments of text longer than a sentence Reading Research Quarterly 8 1 1972 72-91
72. Ransdell S. Generating thinking-aloud protocols: Impact on the narrative writing of college students American Journal of Psychology 108 1 1995 89-98
73. Russo J.E. Johnson E.J. & Stephens D.L. The validity of verbal protocols Memory and Cognition 17 6 1989 759-769
74. Seliger H.W. The language learner as linguist: Of metaphors and realities Applied Linguistics 4 1983 179-191
75. Shanahan T. Kamil M.L. & Tobin A.W. Cloze as a measure of intersentential comprehension Reading Research Quarterly 17 1982 229-255
76. Soria J. A study of Ilokano learners' lexical inferencing procedures through think aloud Second Language Studies 19 2 2001 77-110
77. Stewart A. Clause combining in conchucos quechua discourse 1987 University of California at Los Angeles Unpublished Ph.D. thesis
78. Stratman J.F. & Hamp-Lyons L. Reactivity in concurrent think-aloud protocols: Issues for research In: P. Smagorinsky (Ed.), Speaking about writing: Reflections on research methodology Vol. 8 1994 Sage Thousand Oaks, CA 89-111
79. Taylor W.L. Cloze procedure: A new tool for measuring readability Journalism Quarterly 30 1953 414-438
80. Trabasso T. & Magliano J.P. Conscious understanding during comprehension Discourse Processes 21 1996 255-287
81. Van Leuvan P. & Wang M.C. An analysis of students' self-monitoring in first- and second-grade classrooms The Journal of Educational Research 97 3 1977 132-144
82. Van Someren M.W. Barnard Y.F. & Sandberg J.A. The think aloud method: A practical guide to modelling cognitive processes 1994 Academic Press London
83. Waern Y. How do you fill in this xxx? On some interpretation processes In: A. Flammer & W. Kinstch (Eds.) Discourse processing 1982 North Holland Amsterdam 152-165
84. Waern Y. How to get from deceive to detect. Association and creation in interpretation Working papers from the Cognitive Seminar. No. 15 1982 Department of Psychology, University of Stockholm
85. Waern Y. Creative comprehension in: L. Gustavsson (Ed.) Studies in communication III 1985 53-66
86. Waern Y. Thoughts on text in context: Applying the think-aloud method to text processing Text 8 4 1988 327-350
87. Walker L. Word identification strategies in reading a foreign language Foreign Language Annals 16 4 1983 293-299
88. Whitney P. & Budd D. Think-aloud protocols and the study of comprehension Discourse Processes 21 3 1996 341-351
89. Wilson T.D. The proper protocol: Validity and completeness of verbal reports Psychological Science 5 5 1994 249-251
90. Zwaan R.A. & Brown C.M. The influence of language proficiency and comprehension skill on situation-model construction Discourse Processes 21 1996 289-327