Developing and Gathering Psychometric Evidence for a Fidelity Instrument: The Teaching Pyramid Observation Tool-Pilot Version

Journal of Early Intervention

Volumn 35, Issue 2, 2013, Pages 150-172

  Snyder, Patricia A ^a   Hemmeter, Mary Louise ^b   Fox, Lise ^c   Bishop, Crystal Crowe ^a   Miller, M David ^a  

^a UNIVERSITY OF FLORIDA   (United States)

^b VANDERBILT UNIVERSITY   (United States)

^c UNIVERSITY OF SOUTH FLORIDA   (United States)

Author keywords

assessment; generalizability theory; implementation fidelity; preschool; social emotional teaching practices

Indexed keywords

EID: 84891552893     PISSN: 10538151     EISSN: None     Source Type: Journal    
DOI: 10.1177/1053815113516794     Document Type: Article

References (70)

1. Standards for educational and psychological testing. Washington, DC: Author; 1999:.
2. Blair K. S. C.,Fox L.,Lentini R.Use of positive behavior support to address the challenging behavior of young children within a community early childhood program.Topics in Early Childhood Special Education. 2010;30:68-79.
3. Bond G. R.,Evans L.,Salyers M. P.,Williams J.,Kim H. W.Measurement of fidelity in psychiatric rehabilitation.Mental Health Services Research. 2000;2:75-87.
4. Eager to learn: Educating our preschoolers. Bowman B. T.Donovan M. S.Burns M. S., ed. Washington, DC: Committee on Early Childhood Pedagogy, Commission on Behavioral and Social Sciences and Education, National Academy Press, National Research Council; 2001:.
5. Brennan R. L.Generalizability theory. New York, NY: Springer-Verlag; 2001:.
6. Brown W. H.,Odom S. L.,McConnell S. R.Social competence of young children: Risk, disability, and intervention. Baltimore, MD: Brookes; 2008:.
7. Bruckner C. T.,Yoder P. J.,McWilliam R. A.Generalizability and decision studies: An example using conversational language samples.Journal of Early Intervention. 2006;28:139-154.
8. Burchinal M.,Vandergrift N.,Pianta R.,Mashburn A.Threshold analysis of association between child care quality and child outcomes for low-income children in pre-kindergarten programs.Early Childhood Research Quarterly. 2010;25:166-176.
9. Chien N. C.,Howes C.,Burchinal M.,Pianta R. C.,Ritchie S.,Bryant D. M., Barbarin O. A.Children's classroom engagement and school readiness gains in pre-kindergarten.Child Development. 2010;81:1534-1549.
10. Conroy M. A.,Brown W. H.,Olive M. L.Social competence of young children: Risk, disability, and intervention. Brown W. H.Odom S. L.McConnell S. R., ed. Baltimore, MD: Brookes; 2008:205-232.
11. Conroy M. A.,Dunlap G.,Clarke S.,Alter P. J.A descriptive analysis of behavioral intervention research with young children with challenging behavior.Topics in Early Childhood Special Education. 2005;25:157-166.
12. Crocker C.,Algina J.Introduction to classical and modern test theory. Mason, OH: Cengage Learning; 2008:.
13. Cronbach L. J.,Gleser G. C.,Nanda H.,Rajaratnam N. R.The dependability of behavioral measurements: Theory of generalizability of scores and profiles. New York, NY: John Wiley; 1972:.
14. Cronbach L. J.,Rajaratnam N. R.,Gleser G. C.Theory of generalizability: A liberalization of reliability theory.The British Journal of Statistical Psychology. 1963;16:137-163.
15. Denham S. A.,Blair K. A.,DeMulder E.,Levitas J.,Sawyer K.,Auerbach-Major S.,Queenan P.Preschool emotional competence: Pathway to social competence?.Child Development. 2003;74:238-256.
16. Domitrovich C. E.,Cortes R.,Greenberg M. T.Improving young children's social and emotional competence: A randomized trial of the Preschool PATHS Program.Journal of Primary Prevention. 2007;28:67-91.
17. Downer J.Applying implementation science in early childhood programs and systems. Halle T.Metz A.Beck I. M., ed. Baltimore, MD: Brookes; 2013:157-169.
18. Downer J.,Yazejian N.Measuring the quality and quantity of implementation in early childhood interventions. Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services; 2013:.
19. DunlapG.ConroyM.KernL.DuPaulG.VanBrakleJ.StrainP. JosephG. E. (2003). Research synthesis on effective intervention procedures: Executive summary. Retrieved from http://www.challengingbehavior.org/explore/publications_docs/research_synthesis.pdf.
20. Dunlap G.,Strain P. S.,Fox L.,Carta J. J.,Conroy M.,Smith B. J., Sowell C.Prevention and intervention with young children's challenging behavior: Perspectives regarding current knowledge.Behavioral Disorders. 2006;32:29-45.
21. Dunlap G.,Wilson K.,Strain P.,Lee J. K.Prevent-teach-reinforce for young children: The early childhood model of individualized positive behavior support. Baltimore, MD: Brookes; 2013:.
22. Fixsen D. L.,Naoom S. F.,Blase K. A.,Friedman R. M.,Wallace F.Implementation research: A synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network; 2005:.
23. Fox L.,Hemmeter M. L.Handbook of positive behavior support. Sailor W.Dunlap G.Sugai G.Horner R., ed. New York, NY: Springer; 2009:177-202.
24. Fox L.,Carta J.,Strain P. S.,Dunlap G.,Hemmeter M. L.Response-to-intervention and the Pyramid model.Infants & Young Children. 2010;23:3-14.
25. Fox L.,Dunlap G.,Hemmeter M. L.,Joseph G. E.,Strain P. S.The teaching pyramid: A model for supporting social competence and preventing challenging behavior in young children.Young Children. 2003;58:48-52.
26. Fox L.,Hemmeter M. L.,Snyder P. A.Teaching pyramid observation tool-Research edition. Baltimore, MD: Brookes; in press:.
27. FoxL.HemmeterM. L.SnyderP. (2008, August). Teaching Pyramid Observation Tool for preschool classrooms: Pilot version (Unpublished instrument and manual). Nashville, TN: Vanderbilt University.
28. Fox L.,Hemmeter M. L.,Snyder P. S.,Binder D. P.,Clarke S.Coaching early childhood special educators to implement a comprehensive model for the promotion of young children's social competence.Topics in Early Childhood Special Education. 2011;31:178-192.
29. Goodwin L. D.,Goodwin W. L.Using generalizability theory in early childhood special education.Journal of Early Intervention. 1991;15:193-204.
30. Haertel E. H.Educational measurement. 2006). Reliability. In BrennanR. L. (Ed.), Educational measurement (4th ed., pp. 65-110). Westport, CT: American Council on Education.Brennan R. L., ed. Westport, CT: American Council on Education; 2006:65-110.
31. Hagermoser Sanetti L. M.,Dobey L. M.,Gritter K. L.Treatment integrity of interventions with children in the Journal of Positive Behavior Interventions from 1999 to 2009.Journal of Positive Behavior Interventions. 2012;14:29-46.
32. Halle T.,Metz A.,Martinez-Beck I.Applying implementation science in early childhood programs and systems. Baltimore, MD: Brookes; 2013:.
33. Harms T.,Clifford R. M.,Cryer D.Early Childhood Environment Rating Scale Revised Edition. New York, NY: Teachers College Press; 2005:.
34. HemmeterM. L.FoxL.SnyderP. (2007). Examining the potential efficacy of a classroom wide model for promoting social emotional development and addressing challenging behavior in preschool children with and without disabilities [Abstract]. Retrieved from http://ies.ed.gov/funding/grantsearch/details.asp?ID=577.
35. Hemmeter M. L.,Fox L.,Snyder P.Handbook of response-to-intervention in early childhood. Buysse V.Peisner-Feinberg E., ed. Baltimore, MD: Brookes; 2013:283-300.
36. Hemmeter M. L.,Ostrosky M.,Fox L.Social and emotional foundations for early learning: A conceptual model for intervention.School Psychology Review. 2006;35:583-601.
37. Hemmeter M. L.,Snyder P.,Fox L.,Algina J. Paper presented at the annual meeting of the American Educational Research Association; 2011New Orleans, LA; 2011.
38. Horner R. H.,Carr E. G.,Halle J.,McGee G.,Odom S.,Wolery M.The use of single subject research to identify evidence-based practice in special education.Exceptional Children. 2005;71:165-179.
39. Hulleman C. S.,Rimm-Kaufman S. E.,Abry T.Applying implementation science in early childhood programs and systems. Halle T.Metz A.Beck I. M., ed. Baltimore, MD: Brookes; 2013:65-93.
40. Joseph G. E.,Strain P. S.Comprehensive evidence-based social emotional curricula for young children: An analysis of efficacious adoption potential.Topics in Early Childhood Special Education. 2003;23:65-76.
41. LaParo K. M.,Pianta R. C.,Stuhlman M.The Classroom Assessment Scoring System: Findings from the prekindergarten year.The Elementary School Journal. 2004;104:409-426.
42. LeLaurin K.,Wolery M.Research standards in early intervention: Defining, describing, and measuring the independent variable.Journal of Early Intervention. 1992;16:275-287.
43. Lloyd C. M.,Supplee L. H.,Mattera S. K.Applying implementation science in early childhood programs and systems. Halle T.Metz A.Beck I. M., ed. Baltimore, MD: Brookes; 2013:139-155.
44. Mashburn A. J.,Pianta R.Childhood programs and practices in the first decade of life: A human capital integration. Reynolds A.Rolnick A.Englund M.Temple J., ed. New York, NY: Cambridge University Press; 2010:243-265.
45. Mashburn A. J.,Pianta R. C.,Hamre B. K.,Downer J. T.,Barbarin O.,Bryant D. Howes C.Measures of pre-k quality and children's development of academic, language and social skills.Child Development. 2008;79:732-749.
46. McClelland M. M.,Morrison F. J.,Holmes D. L.Children at risk for early academic problems: The role of learning-related social skills.Early Childhood Research Quarterly. 2000;15:307-329.
47. McLaren E. M.,Nelson C. M.Using functional behavior assessment to develop behavior interventions for children in Head Start.Journal of Positive Behavior Interventions. 2009;11:3-21.
48. McWilliam R. A.,Ware W. B.The reliability of observations of young children's engagement: An application of generalizability theory.Journal of Early Intervention. 1994;18:34-46.
49. Messick S.Validity of test interpretation and use. Princeton, NJ: Educational Testing Service; 1990:.
50. Metz A.,Bartley L.Active implementation frameworks for program success: How to use implementation science to improve outcomes for children.Zero to Three. 2012;32 (4): 11-18.
51. Metz A.,Halle T.,Bartley L.,Blasberg A.Applying implementation science in early childhood programs and systems. Halle T.Metz A.Beck I. M., ed. Baltimore, MD: Brookes; 2013:21-42.
52. Mowbray C. T.,Holter M. C.,Teague G. B.,Bybee D.Fidelity criteria: Development, measurement, and validation.American Journal of Evaluation. 2003;24:315-340.
53. O'Donnell C. L.Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in K-12 curriculum intervention research.Review of Educational Research. 2008;78:33-84.
54. Pianta R. C.,LaParo K.,Hamre B.Classroom Assessment Scoring System-PreK [CLASS]. Baltimore, MD: Brookes; 2008:.
55. Raver C.,Knitzer J.Ready to enter: What research tells policymakers about strategies to promote social and emotional school readiness among three- and four-year old children. New York, NY: National Center for Children in Poverty; 2002:.
56. RitchieS.HowesC.Kraft-SayreM.WeiserB. (2001). Emerging academics snapshot (Unpublished instrument), University of California, Los Angeles.
57. Shavelson R.,Webb N.Generalizability theory: A primer. Thousand Oaks, CA: SAGE; 1991:.
58. Shonkoff J. P.Building a new biodevelopmental framework to guide the future of early childhood policy.Child Development. 2010;81:357-367.
59. From neurons to neighborhoods: The science of early childhood development. Shonkoff J. P.Phillips D. A., ed. Washington, DC: National Academy Press; 2000:.
60. Snyder P.,McLaughlin T.,Denney M.Handbook of special education: Section XII Early identification and intervention in exceptionality. Kauffman J. M.Hallahan D. P.Conroy M., ed. New York, NY: Routledge; 2011:716-730.
61. Spearman C.Demonstration of formulae for the true measurement of correlation.American Journal of Psychology. 1907;18:72-101.
62. Spearman C.Correlations of sums and differences.British Journal of Psychology. 1913;5:417-426.
63. Strain P. S.,Joseph G. E.You got to have friends.Young Exceptional Children Monograph Series. 2006;8:1-22.
64. Thompson B.Score reliability: Contemporary thinking on reliability issues. Thousand Oaks, CA: SAGE; 2003:.
65. Thompson R. A.,Goodman M.The handbook of child development and early education: Research to practice. Barbarin O. A.Wasik B. H., ed. New York, NY: Guilford; 2009:147-171.
66. Thompson R. A.,Raikes H. A.Social and emotional health in early childhood: Building bridges between services and systems. Perry D. F.Kaufmann R. K.Knitzer J., ed. Baltimore, MD: Brookes; 2007:13-36.
67. Vaughn S.,Kim A.,Sloan C. V. M.,Hughes M. T.,Elbaum B.,Sridhar D.Social skills interventions for young children with disabilities: A synthesis of group design studies.Remedial and Special Education. 2003;24:2-15.
68. Webster-Stratton C.How to promote children's social and emotional competence. Thousand Oaks, CA: SAGE; 1999:.
69. Webster-Stratton C.,Reid M. J.Treating conduct problems and strengthening social and emotional competence in young children: The Dina Dinosaur treatment program.Journal of Emotional and Behavioral Disorders. 2003;11:130-143.
70. Wolery M.Intervention research: The importance of fidelity measurement.Topics in Early Childhood Special Education. 2011;31:155-157.