User-Centered Design for Psychosocial Intervention Development and Implementation

Clinical Psychology: Science and Practice

Volumn 23, Issue 2, 2016, Pages 180-200

  Lyon, Aaron R ^a   Koerner, Kelly ^b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b Evidence Based Practice Institute LLC   (United States)

Author keywords

design; evidence based treatment; implementation; intervention development

Indexed keywords

HUMAN; HUMAN EXPERIMENT;

EID: 84975299362     PISSN: 09695893     EISSN: 14682850     Source Type: Journal    
DOI: 10.1111/cpsp.12154     Document Type: Review

References (142)

1. Aarons, G. A., & Chaffin, M. (2013). Scaling-up evidence-based practices in child welfare services systems. CYF News. Retrieved from http://www.apa.org/pi/families/resources/newsletter/2013/04/child-welfare.aspx
2. Aarons, G. A., Fettes, D. L., Hurlburt, M. S., Palinkas, L. A., Gunderson, L., Willging, C. E., & Chaffin, M. J. (2014). Collaboration, negotiation, and coalescence for interagency-collaborative teams to scale-up evidence-based practice. Journal of Clinical Child and Adolescent Psychology, 43, 915–928. doi:10.1080/15374416.2013.876642
3. Aarons, G., Green, A., Palinkas, L., Self-Brown, S., Whitaker, D., Lutzker, J., & Chaffin, M. (2012). Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implementation Science, 7(1), 32. doi:10.1186/1748-5908-7-32
4. Aarons, G., Hurlburt, M., & Horwitz, S. (2011). Advancing a conceptual model of evidence-based practice implementation in child welfare. Administration and Policy in Mental Health, 38, 4–23. doi:10.1007/s10488-010-0327-7
5. Addis, M. E., & Krasnow, A. D. (2000). A national survey of practicing psychologists’ attitudes toward psychotherapy treatment manuals. Journal of Consulting and Clinical Psychology, 68, 331–339. doi:10.1037/0022-006X.68.2.331
6. Addis, M. E., Wade, W. A., & Hatgis, C. (1999). Barriers to dissemination of evidence-based practices: Addressing practitioners’ concerns about manual-based psychotherapies. Clinical Psychology: Science and Practice, 6, 430–441. doi:10.1093/clipsy.6.4.430
7. American Psychological Association. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271–285. doi:10.1037/0003-066X.61.4.271
8. Balas, E. A., & Boren, S. A. (2000). Managing clinical knowledge for health care improvement. In J. Bemmel, & A. T. McCray (Eds.), Yearbook of medical informatics 2000: Patient-centered systems (pp. 65–70). Stuttgart, Germany: Schattauer Verlagsgesellschaft mbH.
9. Barlow, D. H., Agras, W. S., Leitenberg, H., & Wincze, J. P. (1970). An experimental analysis of the effectiveness of “shaping” in reducing maladaptive avoidance behavior: An analogue study. Behaviour Research and Therapy, 8, 165–173. doi:10.1016/0005-7967(70)90086-0
10. Barlow, D. H., Allen, L. B., & Choate, M. L. (2004). Toward a unified treatment for emotional disorders. Behavior Therapy, 35, 205–230. doi:10.1016/S0005-7894(04)80036-4
11. Becker, E. M., Smith, A. M., & Jensen-Doss, A. (2013). Who's using treatment manuals? A national survey of practicing therapists. Behaviour Research & Therapy, 51, 706–710. doi:10.1016/j.brat.2013.07.008
12. Becker, S. J., Spirito, A., & Vanmali, R. (2015). Perceptions of ‘evidence-based practice’ among the consumers of adolescent substance use treatment. Health Education Journal. Advance online publication. doi:10.1177/0017896915581061
13. Beidas, R. S., Cross, W., & Dorsey, S. (2014). Show me, don't tell me: Behavioral rehearsal as a training and analogue fidelity tool. Cognitive and Behavioral Practice, 21, 1–11. doi:10.1016/j.cbpra.2013.04.002
14. Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17, 1–30.
15. Beidas, R. S., Koerner, K., Weingardt, K. R., & Kendall, P. C. (2011). Training research: Practical recommendations for maximum impact. Administration and Policy in Mental Health and Mental Health Services Research, 38, 223–237. doi:10.1007/s10488-011-0338-z
16. Bickman, L., Kelley, S. D., & Athay, M. (2012). The technology of measurement feedback systems. Couple and Family Psychology: Review and Practice, 1, 274–284. doi:10.1037/a0031022
17. Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services, 62, 1423–1429. doi:10.1176/appi.ps.002052011
18. Boote, J., Baird, W., & Beecroft, C. (2010). Public involvement at the design stage of primary health research: A narrative review of case examples. Health Policy, 95(1), 10–23. doi:10.1016/j.healthpol.2009.11.007
19. Borntrager, C., Chorpita, B., Higa-McMillan, C., & Weisz, J. (2009). Provider attitudes toward evidence-based practices: Are the concerns with the evidence or with the manuals? Psychiatric Services, 60, 677–681. doi:10.1176/ps.2009.60.5.677
20. Brooke, J. (1996). SUS: A “quick and dirty” usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester, & A. L. McClelland (Eds.), Usability evaluation in industry. London, UK: Taylor and Francis.
21. Chaffin, M., Silovsky, J. F., Funderburk, B., Valle, L. A., Brestan, E. V., Balachova, T., … Bonner, B. L. (2004). Parent-child interaction therapy with physically abusive parents: Efficacy for reducing future abuse reports. Journal of Consulting and Clinical Psychology, 72, 500–510. doi:10.1037/0022-006X.72.3.500
22. Chambers, D., Glasgow, R., & Stange, K. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8(1), 117. doi:10.1186/1748-5908-8-117
23. Chambless, D. L., & Ollendick, T. H. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52, 685–716. doi:10.1146/annurev.psych.52.1.685
24. Chandler, R. K., Peters, R. H., Field, G., & Juliano-Bult, D. (2004). Challenges in implementing evidence-based treatment practices for co-occurring disorders in the criminal justice system. Behavioral Sciences & the Law, 22, 431–448. doi:10.1002/bsl.598
25. Chorpita, B. F., Bernstein, A., & Daleiden, E. L. (2011). Empirically guided coordination of multiple evidence-based treatments: An illustration of relevance mapping in children's mental health services. Journal of Consulting and Clinical Psychology, 79, 470–480. doi:10.1037/a0023982
26. Chorpita, B. F., Bernstein, A., Daleiden, E. L., & Research Network on Youth Mental Health. (2008). Driving with roadmaps and dashboards: Using information resources to structure the decision models in service organizations. Administration and Policy in Mental Health and Mental Health Services Research, 35, 114–123. doi:10.1007/s10488-007-0151-x
27. Chorpita, B. F., & Daleiden, E. L. (2014). Structuring the collaboration of science and service in pursuit of a shared vision. Journal of Clinical Child and Adolescent Psychology, 43, 323–338. doi:10.1080/15374416.2013.828297
28. Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005a). Modularity in the design and application of therapeutic interventions. Applied and Preventive Psychology, 11, 141–156. doi:10.1016/j.appsy.2005.05.002
29. Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005b). Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental Health Services Research, 7(1), 5–20. doi:10.1007/s11020-005-1962-6
30. Chorpita, B. F., Korathu-Larson, P., Knowles, L. M., & Guan, K. (2014). Emergent life events and their impact on service delivery: Should we expect the unexpected? Professional Psychology: Research and Practice, 45, 387–393. doi:10.1037/a0037746
31. Christensen, C. M., Bohmer, R., & Kenagy, J. (2000). Will disruptive innovations cure health care? Harvard Business Review, 78(5), 102–112.
32. Clark, D. M., Layard, R., Smithies, R., Richards, D. A., Suckling, R., & Wright, B. (2009). Improving access to psychological therapy: Initial evaluation of two UK demonstration sites. Behaviour Research and Therapy, 47, 910–920. doi:10.1016/j.brat.2009.07.010
33. Cooper, A. (1999). The inmates are running the asylum: Why high-tech products drive us crazy and how to restore the sanity. Indianapolis, IN: Macmillan.
34. Cooper, A., Reimann, R., & Cronin, D. (2007). About face 3: The essentials of interaction design. Indianapolis, IN: John Wiley & Sons.
35. Courage, C., & Baxter, K. (2005). Understanding your users: A practical guide to user requirements methods, tools, and techniques. San Francisco, CA: Elsevier.
36. Daleiden, E. L., & Chorpita, B. F. (2005). From data to wisdom: Quality improvement strategies supporting large-scale implementation of evidence-based services. Child and Adolescent Psychiatric Clinics of North America, 14, 329–349. doi:10.1016/j.chc.2004.11.002
37. Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 50. doi:10.1186/1748-5908-4-50
38. Dillon, A., & Watson, C. (1996). User analysis in HCI—The historical lessons from individual differences research. International Journal of Human-Computer Studies, 45, 619–637. doi:10.1006/ijhc.1996.0071
39. Dimeff, L. A., Paves, A. P., Skutch, J. M., & Woodcock, E. A. (2010). Shifting paradigms in clinical psychology: How innovative technologies are shaping treatment delivery. In D. H. Barlow (Ed.), Handbook of clinical psychology (pp. 618–648). New York, NY: Oxford University Press.
40. Driessen, E., Hollon, S. D., Bockting, C. L., Cuijpers, P., & Turner, E. H. (2015). Does publication bias inflate the apparent efficacy of psychological treatment for major depressive disorder? A systematic review and meta-analysis of U.S. National Institutes of Health-funded trials. PLoS ONE, 10(9), e0137864. doi:10.1371/journal.pone.0137864
41. Eccles, M. P., & Mittman, B. S. (2006). Welcome to implementation science. Implementation Science, 1(1), 1. doi:10.1186/1748-5908-1-1
42. Embry, D. D., & Biglan, A. (2008). Evidence-based kernels: Fundamental units of behavioral influence. Clinical Child and Family Psychology Review, 11(3), 75–113. doi:10.1007/s10567-008-0036-x
43. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. FMHI Publication #231. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.
44. Fontaine, P., Ross, S. E., Zink, T., & Schilling, L. M. (2010). Systematic review of health information exchange in primary care practices. Journal of the American Board of Family Medicine, 23, 655–670. doi:10.3122/jabfm.2010.05.090192
45. Frazier, S. L., Chacko, A., Van Gessel, C., O'Boyle, C., & Pelham, W. E. (2011). The summer treatment program meets the south side of Chicago: Bridging science and service in urban after-school programs. Child and Adolescent Mental Health, 17(2), 86–92. doi:10.1111/j.1475-3588.2011.00614.x
46. Gagne, R. M., Wager, W. W., Golas, K. C., Keller, J. M., & Russell, J. D. (2004). Principles of instructional design (5th ed.). Fort Worth, TX: Harcourt Brace Jovanovich.
47. Garland, A. F., Accurso, E. C., Haine-Schlagel, R., Brookman-Frazee, L., Roesch, S., & Zhang, J. J. (2014). Searching for elements of evidence-based practices in children's usual care and examining their impact. Journal of Clinical Child and Adolescent Psychology, 43, 201–215. doi:10.1080/15374416.2013.869750
48. Garland, A. F., Hawley, K. M., Brookman-Frazee, L., & Hurlburt, M. S. (2008). Identifying common elements of evidence-based psychosocial treatments for children's disruptive behavior problems. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 505–514. doi:10.1097/CHI.0b013e31816765c2
49. Glover, G., Webb, M., & Evison, F. (2010). Improving access to psychological therapies: A review of the progress made by sites in the first roll-out year. North East Public Health Observatory. Retrieved from www.iapt.nhs.uk/silo/files/iapt-a-review-of-the-progress-made-by-sites-in-the-first-roll8208-out-year.pdf
50. Goldstein, S. M., Johnston, R., Duffy, J., & Rao, J. (2002). The service concept: The missing link in service design research? Journal of Operations Management, 20(2), 121–134. doi:10.1016/S0272-6963(01)00090-0
51. Gordon, V. S., & Bieman, J. M. (1995). Rapid prototyping: Lessons learned. IEEE Software, 12(1), 85–95. doi:10.1109/52.363162
52. Grudin, J., & Pruitt, J. (2002). Personas, participatory design and product development: An infrastructure for engagement. In T. Binder, J. Gregory, & I. Wagner (Eds.), PDC 2002 Proceedings of the Participatory Design Conference, Sweden (pp. 144–161). Palo Alto, CA: Computer Professionals for Social Responsibility.
53. Hackos, J. T., & Redish, J. (1998). User & task analysis for interface design. New York, NY: Wiley. doi:10.1002/(SICI)1097-4571(1998)49:14<1334:AID-ASI14>3.0.CO;2-0
54. Hasson, H., Andersson, M., & Bejerholm, U. (2011). Barriers in implementation of evidence-based practice: Supported employment in Swedish context. Journal of Health, Organisation and Management, 25, 332–345. doi:10.1108/14777261111143563
55. Hill, L. G., & Owens, R. W. (2013). Component analysis of adherence in a family intervention. Health Education, 113, 264–280. doi:10.1108/09654281311329222
56. von Hippel, E. (1989). New product ideas from lead users. Research Technology Management, 32(3), 24–27.
57. Hodgetts, A., & Wright, J. (2007). Researching clients’ experiences: A review of qualitative studies. Clinical Psychology & Psychotherapy, 14, 157–163. doi:10.1002/cpp.527
58. Holmqvist, M., Vincent, N., & Walsh, K. (2014). Web- vs telehealth-based delivery of cognitive behavioral therapy for insomnia: A randomized controlled trial. Sleep Medicine, 15, 187–195.
59. Holtzblatt, K., Wendell, J. B., & Wood, S. (2004). Rapid contextual design: A how-to guide to key techniques for user-centered design. San Francisco, CA: Elsevier.
60. Howe, G. W., Beach, S. R., & Brody, G. H. (2010). Microtrial methods for translating gene–environment dynamics into preventive interventions. Prevention Science, 11, 343–354. doi:10.1007/s11121-010-0177-2
61. Hurlburt, M., Aarons, G. A., Fettes, D., Willging, C., Gunderson, L., & Chaffin, M. J. (2014). Interagency collaborative team model for capacity building to scale-up evidence-based practice. Children and Youth Services Review, 39, 160–168. doi:10.1016/j.childyouth.2013.10.005
62. Hwang, J., & Christensen, C. M. (2008). Disruptive innovation in health care delivery: A framework for business-model innovation. Health Affairs, 27, 1329–1335. doi:10.1377/hlthaff.27.5.1329
63. Hyde, P. S. (2013). Report to Congress on the nation's substance abuse and mental health workforce issues. Washington, DC: U.S. Department for Health and Human Services, Substance Abuse and Mental Health Services.
64. International Standards Organization. (1998). Ergonomic requirements for office work with visual display terminals (VDTs) – Part 11: Guidance on usability. Geneva, Switzerland: International Organization for Standardization, 9241.
65. Jewell, J., Handwerk, M., Almquist, J., & Lucas, C. (2004). Comparing the validity of clinician-generated diagnosis of conduct disorder to the Diagnostic Interview Schedule for Children. Journal of Clinical Child and Adolescent Psychology, 33, 536–546. doi:10.1207/s15374424jccp3303_11
66. Kakuma, R., Minas, H., van Ginneken, N., Dal Poz, M. R., Desiraju, K., Morris, J. E., … Scheffler, R. M. (2011). Human resources for mental health care: Current situation and strategies for action. The Lancet, 378(9803), 1654–1663. doi:10.1016/S0140-6736(11)61093-3
67. Karsh, B. T. (2004). Beyond usability: Designing effective technology implementation systems to promote patient safety. Quality and Safety in Health Care, 13, 388–394. doi:10.1136/qshc.2004.010322
68. Kaysen, D., Lindgren, K., Zangana, G. A. S., Murray, L., Bass, J., & Bolton, P. (2013). Adaptation of cognitive processing therapy for treatment of torture victims: Experience in Kurdistan, Iraq. Psychological Trauma: Theory, Research, Practice, & Policy, 5(2), 184–192. doi:10.1037/a0026053
69. Kazdin, A. (2008). Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist, 63, 146–159. doi:10.1037/0003-066X.63.3.146
70. Kazdin, A. E., & Rabbitt, S. M. (2013). Novel models for delivering mental health services and reducing the burdens of mental illness. Clinical Psychological Science, 1, 170–191. doi:10.1177/2167702612463566
71. Khomh, F., Dhaliwal, T., Zou, Y., & Adams, B. (2012). Do faster releases improve software quality? An empirical case study of Mozilla Firefox. In Mining Software Repositories (MSR), 2012 9th IEEE Working Conference (pp. 179–188). Piscataway, NJ: Institute of Electrical and Electronics Engineers. doi:10.1109/MSR.2012.6224279
72. Koerner, K. (2013). What must you know and do to get good outcomes with DBT? Behavior Therapy, 44, 568–579. doi:10.1016/j.beth.2013.03.005
73. Kujala, S., & Kauppinen, M. (2004, October). Identifying and selecting users for user-centered design. In Proceedings of the Third Nordic Conference on Human-Computer Interaction (pp. 297–303). ACM.
74. Kujala, S., & Mäntylä, M. (2000). How effective are user studies? In S. McDonald, Y. Waern, & G. Cockton (Eds.), People and computers XIV—Usability or else!: Proceedings of Human-Computer Interaction 2000 (pp. 61–71). London, UK: Springer-Verlag. doi:10.1007/978-1-4471-0515-2_5
75. Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10, 288–301. doi:10.1093/clipsy.bpg025
76. Langley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010). Evidence-based mental health programs in schools: Barriers and facilitators of successful implementation. School Mental Health, 2(3), 105–113. doi:10.1007/s12310-010-9038-1
77. Leijten, P., Dishion, T. J., Thomaes, S., Raaijmakers, M. A. J., Orobio de Castro, B., & Matthys, W. (2015). Bringing parenting interventions back to the future: How randomized controlled microtrials may benefit parenting intervention efficacy. Clinical Psychology: Science and Practice, 22, 47–57. doi:10.1111/cpsp.12087
78. Lewis, C. C., & Simons, A. D. (2011). A pilot study disseminating cognitive behavioral therapy for depression: Therapist factors and perceptions of barriers to implementation. Administration and Policy in Mental Health and Mental Health Services Research, 38, 324–334. doi:10.1007/s10488-011-0348-x
79. Lewis, C. C., Stanick, C. F., Martinez, R. G., Weiner, B. J., Kim, M., Barwick, M., & Comtois, K. A. (2015). The Society for Implementation Research Collaboration Instrument Review Project: A methodology to promote rigorous evaluation. Implementation Science, 10(1), 2. doi:10.1186/s13012-014-0193-x
80. Lieb, R., Mayfield, J., Miller, M., & Pennucci, A. (2004). Benefits and costs of prevention and early intervention programs for youth (Document No. 04-07-3901). Retrieved from Washington State Institute for Public Policy website: http://www.wsipp.wa.gov/Reports/04-07-3901
81. Littlejohns, P., Wyatt, J. C., & Garvican, L. (2003). Evaluating computerised health information systems: Hard lessons still to be learnt. British Medical Journal, 326, 860–863. doi:10.1136/bmj.326.7394.860
82. Lyon, A. R., Bruns, E. J., Ludwig, K., Vander Stoep, A., Pullmann, M. D., Dorsey, S., … McCauley, E. (2015). The Brief Intervention for School Clinicians (BRISC): A mixed-methods evaluation of feasibility, acceptability, and contextual appropriateness. School Mental Health, 7, 273–286.
83. Lyon, A. R., Bruns, E. J., Weathers, E., Canavas, N., Ludwig, K., Vander Stoep, A., … McCauley, E. (2014a). Taking EBPs to school: Developing and testing a framework for applying common elements of evidence based practice to school mental health. Advances in School Mental Health Promotion, 7, 42–61. doi:10.1080/1754730X.2013.857903
84. Lyon, A. R., Lau, A. S., McCauley, E., Vander Stoep, A., & Chorpita, B. F. (2014b). A case for modular design: Implications for implementing evidence-based interventions with culturally diverse youth. Professional Psychology: Research and Practice, 45(1), 57–66. doi:10.1037/a0035301
85. Lyon, A. R., Ludwig, K., Romano, E., Koltracht, J., Vander Stoep, A., & McCauley, E. (2014c). Using modular psychotherapy in school mental health: Provider perspectives on intervention-setting fit. Journal of Clinical Child and Adolescent Psychology, 43, 890–901. doi:10.1080/15374416.2013.843460
86. Lyon, A. R., Stirman, S. W., Kerns, S. E., & Bruns, E. J. (2011). Developing the mental health workforce: Review and application of training approaches from multiple disciplines. Administration and Policy in Mental Health and Mental Health Services Research, 38, 238–253. doi:10.1007/s10488-010-0331-y
87. Lyon, A. R., Wasse, J. K., Ludwig, K., Zachry, M., Bruns, E. J., Unützer, J., & McCauley, E. (2016). The Contextualized Technology Adaptation Process (CTAP): Optimizing health information technology to improve mental health systems. Administration and Policy in Mental Health and Mental Health Services Research, 43, 394–409. doi:10.1007/s10488-015-0637-x
88. Maguire, M. (2001). Methods to support human-centred design. International Journal of Human-Computer Studies, 55, 587–634. doi:10.1006/ijhc.2001.0503
89. Martin, D. (1990). Book design: A practical introduction. New York, NY: Van Nostrand-Reinhold.
90. McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65(2), 73. doi:10.1037/a0018121
91. Methodology Committee of the Patient-Centered Outcomes Research Institute. (2012). Methodological standards and patient-centeredness in comparative effectiveness research: The PCORI perspective. JAMA, 307, 1636. doi:10.1001/jama.2012.466
92. Moggridge, B. (2007). Designing interactions. Cambridge, MA: Massachusetts Institute of Technology.
93. Nakamura, B. J., Higa-McMillan, C. K., Okamura, K. H., & Shimabukuro, S. (2011). Knowledge of and attitudes towards evidence-based practices in community child mental health practitioners. Administration and Policy in Mental Health and Mental Health Services Research, 38, 287–300. doi:10.1007/s10488-011-0351-2
94. Nielsen, J. (1994). Usability engineering. San Diego, CA: Elsevier.
95. Nielsen, J., & Loranger, H. (2006). Prioritizing web usability. Berkley, CA: Pearson Education.
96. Norman, D. A. (1988). The design of everyday things. New York, NY: Basic Books.
97. Norman, D. (2004). Affordances and design. Retrieved from http://www.jnd.org/dn.mss/affordances_and_desi.html
98. Norman, D. A., & Draper, S. W. (Eds.). (1986). User centered system design: New perspectives on human-computer interaction. Hillsdale, NJ: Erlbaum.
99. Olson, E. L., & Bakke, G. (2001). Implementing the lead user method in a high technology firm: A longitudinal study of intentions versus actions. Journal of Product Innovation Management, 18, 388–395. doi:10.1111/1540-5885.1860388
100. Patel, V. (2009). The future of psychiatry in low- and middle-income countries. Psychological Medicine, 39, 1759–1762. doi:10.1017/S0033291709005224
101. Pelham, W. E., Lang, A. R., Atkeson, B., Murphy, D. A., Gnagy, E. M., Greiner, A. R., … Greenslade, K. E. (1997). Effects of deviant child behavior on parental distress and alcohol consumption in laboratory interactions. Journal of Abnormal Child Psychology, 25, 413–424. doi:10.1023/A:1025789108958
102. Penuel, W. R., Roschelle, J., & Shechtman, N. (2007). Designing formative assessment software with teachers: An analysis of the co-design process. Research and Practice in Technology Enhanced Learning, 2(1), 51–74. doi:10.1142/S1793206807000300
103. Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., … Kirchner, J. E. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Science, 10(1), 21. doi:10.1186/s13012-015-0209-1
104. Proctor, E. K., Powell, B. J., Baumann, A. A., Hamilton, A. M., & Santens, R. L. (2015). Writing implementation research grant proposals: Ten key ingredients. Implementation Science, 7(1), 96. doi:10.1186/1748-5908-7-96
105. Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38, 65–76. doi:10.1007/s10488-010-0319-7
106. Rahman, A. (2007). Challenges and opportunities in developing a psychological intervention for perinatal depression in rural Pakistan–A multi-method study. Archives of Women's Mental Health, 10(5), 211–219. doi:10.1007/s00737-007-0193-9
107. Rahman, A., Malik, A., Sikander, S., Roberts, C., & Creed, F. (2008). Cognitive behaviour therapy-based intervention by community health workers for mothers with depression and their infants in rural Pakistan: A cluster-randomised controlled trial. The Lancet, 372(9642), 902–909. doi:10.1016/S0140-6736(08)61400-2
108. Reed Construction Data/RSMeans Market Intelligence. (2013). Design-build project delivery market share and market size report. Retrieved from http://www.dbia.org/resource-center/Documents/rsmeansreport_2013rev.pdf
109. Rogers, E. M. (2003). Diffusions of innovations (5th ed.). New York, NY: Free Press.
110. Rotheram-Borus, M. J., Swendeman, D., & Chorpita, B. F. (2012). Disruptive innovations for designing and diffusing evidence-based interventions. American Psychologist, 67, 463. doi:10.1037/a0028180
111. Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001). A stage model of behavioral therapies research: Getting started and moving on from stage I. Clinical Psychology: Science and Practice, 8, 133–142. doi:10.1093/clipsy.8.2.133
112. Roy-Byrne, P., Craske, M. G., Sullivan, G., Rose, R. D., Edlund, M. J., Lang, A. J., … Stein, M. B. (2010). Delivery of evidence-based treatment for multiple anxiety disorders in primary care: A randomized controlled trial. JAMA, 303, 1921–1928. doi:10.1001/jama.2010.608
113. Salvo, M., Zoetewey, M. W., & Agena, K. (2007). A case of exhaustive documentation: Re-centering system-oriented organizations around user need. Technical Communication, 54(1), 46–57.
114. Sanders, M. R., & Kirby, J. N. (2015). Surviving or thriving: Quality assurance mechanisms to promote innovation in the development of evidence-based parenting interventions. Prevention Science, 16, 421–431. doi:10.1007/s11121-014-0475-1
115. Sauro, J. (2011). A practical guide to the System Usability Scale: Background, benchmarks & best practices. Denver, CO: Measuring Usability LLC.
116. Schoenwald, S. K., Kelleher, K., Weisz, J. R., & Research Network on Youth Mental Health. (2008). Building bridges to evidence-based practice: The MacArthur Foundation Child System and Treatment Enhancement Projects (Child STEPs). Administration and Policy in Mental Health and Mental Health Services Research, 35, 66–72. doi:10.1007/s10488-007-0160-9
117. Scott, K., & Lewis, C. (2014). Using measurement-based care to enhance any treatment. Cognitive and Behavioral Practice, 22(1), 49–59. doi:10.1016/j.cbpra.2014.01.010
118. Smart, K. L., Madrigal, J. L., & Seawright, K. K. (1996). The effect of documentation on customer perception of product quality. IEEE Transactions on Professional Communication, 39, 157–162. doi:10.1109/47.536264
119. Solberg, C., Larsson, B., & Jozefiak, T. (2015). Consumer satisfaction with the Child and Adolescent Mental Health Service and its association with treatment outcome: A 3–4-year follow-up study. Nordic Journal of Psychiatry, 69, 224–232.
120. Southam-Gerow, M. A., Rodríguez, A., Chorpita, B. F., & Daleiden, E. L. (2012). Dissemination and implementation of evidence based treatments for youth: Challenges and recommendations. Professional Psychology: Research and Practice, 43, 527. doi:10.1037/a0029101
121. Spielmans, G. I., Gatlin, E. T., & McFall, J. P. (2010). The efficacy of evidence-based psychotherapies versus usual care for youths: Controlling confounds in a meta-reanalysis. Psychotherapy Research, 20, 234–246. doi:10.1080/10503300903311293
122. Steinfeld, B., Scott, J., Vilander, G., Marx, L., Quirk, M., Lindberg, J., & Koerner, K. (2014). The role of lean process improvement in implementation of evidence-based practices in behavioral health care. Journal of Behavioral Health Services & Research, 42, 504–518. doi:10.1007/s11414-013-9386-3
123. Stirman, S. W., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012). The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implementation Science, 7(12), 17. doi:10.1186/1748-5908-7-17
124. Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A. (2013). Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implementation Science, 8, 1186. doi:10.1186/1748-5908-8-65
125. Tognazzini, B. (2014). First principles of interaction design. Retrieved from http://asktog.com/atc/principles-of-interaction-design/
126. Tufte, E. R. (2001). The visual display of quantitative information. Cheshire, CT: Graphics Press.
127. Tullis, T. S., & Stetson, J. N. (2004). A comparison of questionnaires for assessing website usability. Paper presented at the Usability Professional Association Conference, Minneapolis, MN.
128. Van Merriënboer, J. J., Kirschner, P. A., & Kester, L. (2003). Taking the load off a learner's mind: Instructional design for complex learning. Educational Psychologist, 38(1), 5–13. doi:10.1207/S15326985EP3801_2
129. Ware, C. (2013). Information visualization: Perception for design. San Francisco, CA: Elsevier.
130. Weingardt, K. R. (2004). The role of instructional design and technology in the dissemination of empirically supported, manual-based therapies. Clinical Psychology: Science and Practice, 11, 313–331. doi:10.1093/clipsy.bph087
131. Weisz, J. R., & Chorpita, B. F. (2011). Mod squad for youth psychotherapy: Restructuring evidence-based treatment for clinical practice. In P. Kendall (Ed.), Child and adolescent therapy: Cognitive-behavioral procedures (4th ed., pp. 379–397). New York, NY: Guilford Press.
132. Weisz, J. R., Chorpita, B. F., Palinkas, L. A., Schoenwald, S. K., Miranda, J., Bearman, S. K., … Research Network on Youth Mental Health. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69, 274–282. doi:10.1001/archgenpsychiatry.2011.147
133. Weisz, J. R., Jensen, A. L., & McLeod, B. D. (2005). Development and dissemination of child and adolescent psychotherapies: Milestones, methods, and a new deployment-focused model. In E. Hibbs, & P. S. Jensen (Eds.), Psychosocial treatments for child and adolescent disorders: Empirically based strategies for clinical practice (2nd ed., pp. 9–39). Washington, DC: American Psychological Association.
134. Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006). Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist, 61, 671. doi:10.1037/0003-066X.61.7.671
135. Weisz, J. R., Kuppens, S., Eckshtain, D., Ugueto, A. M., Hawley, K. M., & Jensen-Doss, A. (2013). Performance of evidence-based youth psychotherapies compared with usual clinical care: A multilevel meta-analysis. JAMA Psychiatry, 70, 750–761. doi:10.1001/jamapsychiatry.2013.1176
136. Whaley, A. L., & Davis, K. E. (2007). Cultural competence and evidence-based practice in mental health services: A complementary perspective. American Psychologist, 62, 563–574. doi:10.1037/0003-066X.62.6.563
137. Wilson, J., & Rosenberg, D. (1988). Rapid prototyping for user interface design. In M. Helander (Ed.), Handbook of human-computer interaction (pp. 859–875). Amsterdam: North-Holland.
138. Wright, A. J., Weinman, J., & Marteau, T. M. (2003). The impact of learning of a genetic predisposition to nicotine dependence: An analogue study. Tobacco Control, 12, 227–230. doi:10.1136/tc.12.2.227
139. Wu, S., Duan, N., Wisdom, J. P., Kravitz, R. L., Owen, R. R., Sullivan, J. G., … Hoagwood, K. E. (2015). Integrating science and engineering to implement evidence-based practices in health care settings. Administration and Policy in Mental Health and Mental Health Services Research, 42, 588–592. doi:10.1007/s10488-014-0593-x
140. Yamey, G. (2011). Scaling up global health interventions: A proposed framework for success. PLoS Medicine, 8(6), e1001049. doi:10.1371/journal.pmed.1001049
141. Zaff, B. S. (1995). Designin"g with affordances in mind. In J. M. Flach, P. A. Hancock, J. Caird, & K. J. Vicente (Eds.), Global perspectives on the ecology of human-machine systems (pp. 121–156). Mahwah, NJ: Erlbaum.
142. Zomerdijk, L. G., & Voss, C. A. (2010). Service design for experience-centric services. Journal of Service Research, 13(1), 67–82. doi:10.1177/1094670509351960