Evaluating the science of discovery in complex health systems

American Journal of Evaluation

Volumn 32, Issue 1, 2011, Pages 70-84

  Norman, Cameron D ^a   Best, Allan ^b   Mortimer, Sharon ^c   Huerta, Timothy ^d   Buchan, Alison ^c  

^a UNIVERSITY OF TORONTO   (Canada)

^b InSource Research Group   (Canada)

^c UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^d TEXAS TECH UNIVERSITY   (United States)

Author keywords

collaboration; complex health systems; discovery; social networks; team science; transdisciplinarity

Indexed keywords

EID: 79551626818     PISSN: 10982140     EISSN: 15570878     Source Type: Journal    
DOI: 10.1177/1098214010379038     Document Type: Article

References (67)

1. Abrams, D.B. (2006). Applying transdisciplinary research strategies to understanding and eliminating health disparities. Health Education & Behavior, 33, 515-531.
2. Balas, E.A., & Boren, S.A. (2000). Managing clinical knowledge for health care improvement. In J. Bemmel & A. T. McCray (Eds.), Yearbook of medical informatics. Stuttgart, DE: Schattauer Verlagsgesellschaft mbH.
3. Bammer, G. (2005). Integration and implementation sciences: Building a new specialization. Ecology and Society, 10, 6-31.
4. Becher, T., & Trowler, P.R. (2001). Academic tribes and territories: Intellectual enquiry and the culture of disciplines (2nd ed.). Buckingham, UK: Open University Press.
5. Best, A., Hiatt, R., & Norman, C.D. (2008). Knowledge integration: Conceptualizing communications in cancer control systems. Patient Education and Counseling, 71, 319-327.
6. Best, A., Terpstra, J., Moor, G., Riley, B., Norman, C.D., & Glasgow, R. (2009). Building knowledge integration systems for evidence-informed decisions. Journal of Health Organization and Management, 23, 627-641.
7. Best, A., Trochim, W.K., Haggerty, J., Moor, G., & Norman, C.D. (2008). Systems thinking for knowledge integration: New models for policy-research collaboration. In L. McKee, E. Ferlie, & P. Hyde (Eds.), Organizing and reorganizing: Power and change in health care organizations (pp. 154-166). Houndsmill, UK: Palgrave McMillan.
8. Boschma, R.A. (2005). Role of proximity in interaciton and performance: Conceptual and empirical challenges. Regional Studies, 39, 41-45.
9. Brownstein, J.S., Wolfe, C.J., & Mandl, K.D. (2006). Empirical evidence for the effect of airline travel on inter-regional influenza spread in the United States. PLoS Medicine, 3, e401.
10. Buchan, A., Huerta, T.R., Norman, C.D., & Best, A. (2006). Evaluating the impact of transdisciplinary research networks on science practice and knowledge translation. Paper presented at the Science of Team Science conference, Bethesda, Maryland.
11. Crowley, W.F., Jr., Sherwood, L., Salber, P., Scheinberg, D., Slavkin, H., Tilson, H.,. . . Rimoin, D. (2004). Clinical research in the United States at a crossroads: Proposal for a novel public-private partnership to establish a national clinical research enterprise. Journal of the American Mediacl Association, 291, 1120-1126.
12. Davison, C.M. (2009). Knowledge translation: Implications for evaluation. New Directions for Evaluation, 2009, 75-87.
13. Denis, J.L., Lehoux, P., & Champagne, F. (2004). A knowledge utilization perspective on fine-tuning dissemination and contextualizing knowledge. In L. Lemieux-Charles & F. Champagne (Eds.), Using knowledge and evidence in health care. Toronto, Ontario, Canada: University of Toronto Press.
14. Desrochers, P. (2001). Local diversity, human creativity, and technological innovation. Growth and Change, 32, 369-394.
15. Dillman, D.A. (2000). Mail and Internet surveys: The tailored design method (2nd ed.). New York, NY: John Wiley.
16. Ferguson, N.M., Cummings, D.A.T., Cauchemez, S., Fraser, C., Riley, S., Meeyai, A.,. . Burke, D.S. (2005). Strategies for containing an emerging influenza pandemic in Southeast Asia. Nature, 437, 209-214.
17. Frank, C., & Nason, E. (2009). Health research: Measuring the social, health and economic benefits. CMAJ: Canadian Medical Association Journal, 180, 528-534.
18. Frank, D. (2009). One world, one health, one medicine. Canadian Veterinary Journal, 49, 1063-1065.
19. Fuqua, J., Stokols, D., Gress, J., Phillips, K., & Harvey, R. (2004). Critical issues in the study of transdisciplinary scientific collaboration. Substance Use Misuse, 39, 2073-4.
20. Gibbons, M., Limoges, C., Nowotny, H., Schwartzman, S., Scott, P., & Trow, M. (1994). New production of knowledge: Dynamics of science and research in contemporary societies. London, UK: Sage.
21. Glasgow, R.E., & Emmons, K.M. (2007). How can we increase translation of research into practice? Types of evidence needed. Annual Review Public Health, 28, 413-433.
22. Graham, I.D., Logan, J., Harrison, M.B., Straus, S., Tetroe, J., Caswell, W., & Robinson, N. (2006). Lost in knowledge translation: Time for a map? The Journal of Continuing Education in the Health Professions, 26, 13-24.
23. Gray, B. (1989). Collaborating: Finding common ground for multiparty problems. San Francisco, CA: Jossey-Bass.
24. Greek, R., & Greek, J. (2005). The Ivory Towers of Babel. The Quarterly Newsletter of Americans for Medical Advancement and Europeans for Medical Advancement.
25. Green, L.W. (2006). Public health asks of systems science: To advance our evidence-based practice, can you help us get more practice-based evidence. American Journal of Public Health, 96, 406-409.
26. Green, L.W., & Glasgow, R.E. (2006). Evaluating the relevance, generalization, and applicability of research: Issues in external validation and translation. Evaluation and the Health Professions, 29, 126-153.
27. Hall, J., Bainbridge, L., Buchan, A., Cribb, A., Drummond, J., Gyles, C.,. . . Solomon, P. (2006). A meeting of minds: Interdisciplinary research in the health sciences in Canada. Canadian Medical Association Journal, 175, 763.
28. Heberger, A., Christie, C., & Aikin, M. (2010). A bibliometric analysis of the academic influences of and on evaluation theorists' published works. American Journal of Evaluation, 31, 9-23.
29. Huang, T.T., Drewnowski, A., Kumanyika, S.K., & Glass, T.A. (2009). A systems-oriented multilevel framework for addressing obesity in the 21st century. Preventing Chronic Disease: Public Health Research, Practice and Policy, 6, 1-9.
30. Kaplan, B.H., Kahn, L.H., & Monath, T.H. (2009). 'One Health' in Action Series: Nos 1-8. Veterinaria Italiana, 45, 195-208.
31. Katz, J.S., & Martin, B.R. (1997). What is research collaboration? Research Policy, 26, 1-18.
32. Kellerman, B. (2008). Followership: How followers are creating change and changing leaders. Boston, MA: Harvard Business Press.
33. Kessel, F., Rosenfield, P. L., & Anderson, N. B. (Eds.). (2003). Expanding the boundaries of health and social science: Case studies in interdisciplinary innovation. New York, NY: Oxford University Press.
34. Klein, J. (2008). Evaluation of interdisciplinary and transdisciplinary research a literature review. American Journal of Preventive Medicine, 35, 116-123.
35. Knoben, J., & Oerlemans, L.A.G. (2006). Proximity and inter-organizational collaboration: A literature review. International Journal of Management Reviews, 8, 71-89.
36. Kraut, R., Fussell, S., Brennan, S., & Siegel, J. (2002). Understanding effects of proximity on collaboration: Implications for technologies to support remote collaborative work. Distributed work, 137-162.
37. Kusiak, A. (2007). Innovation: The living laboratory perspective. Computer-Aided Design & Applications, 4, 863-876.
38. Lee, A.S. (1991). Integrating positivist and interpretive approaches to organizational research. Organization Science, 2, 342-365.
39. Leischow, S., Best, A., Trochim, W., Clark, P., Gallagher, R., Marcus, S., & Matthews, E. (2008). Systems thinking to improve the public's health. American Journal of Preventive Medicine, 35, S196-S203.
40. Martin, R. (2007). How successful leaders think. Harvard Business Review, 85, 60-67.
41. Martin, R. (2008). The opposable mind. Boston, MA: Harvard Business School Press.
42. Mâsse, L.C., Moser, R.P., Stokols, D., & Taylor, B.K. (2008). Measuring collaboration and transdisciplinary integration in team science. American Journal of Preventive Medicine, 35, S151-S160.
43. Melin, G., & Persson, O. (1996). Studying research collaboration using co-authorships. Scientometrics, 36, 363-377.
44. Midgley, G. (2003). Science as systemic intervention: Some implications of systems thinking and complexity for the philosophy of science. Systemic Practice and Action Research, 16, 77-97.
45. Midgley, G. (2006). Systemic intervention for public health. American Journal of Public Health, 96, 466-472.
46. Midgley, G. (2007). Systems thinking for evaluation. In B. Williams & I. Imam (Eds.), Systems concepts in evaluation: An expert anthology. Point Reyes, CA: EdgePress of Inverness.
47. Miller, R. (2001). Partnership synergy: A practical framework for studying and strengthening the collaborative advantage. The Milbank Quarterly, 79, 179-205.
48. National Institutes of Health. (2008). NIH roadmap-Research teams of the future. Retrieved June 22, 2008, from http://nihroadmap.nih.gov/researchteams/index.asp.
49. Norman, C.D., & Huerta, T.R. (2006). Knowledge exchange through social networks: Building foundations for a community of practice in tobacco control. Implementation Science, 1, e20.
50. Nowotny, H., Scott, P., & Gibbons, M. (2001). Re-thinking science: Knowledge and the public in an age of uncertainty. Cambridge, UK: Polity Press.
51. Office of Behavioral and Social Sciences Research. (2007). The contributions of behavioral and social sciences research to improving the health of the nation: A prospectus for the future. Washington, DC: National Institutes of Health, U.S. Department of Health and Human Services.
52. Page, S.E. (2007). The difference: How the power of diversity creates better groups, firms, schools and societies. Princeton, NJ: Princeton University Press.
53. Powell, W.W., White, D.R., Koput, K.W., & Owen-Smith, J. (2005). Network dynamics and field evolution: The growth of interorganizational collaboration in the life sciences. American Journal of Sociology, 110, 1132-1205.
54. Provan, K., Clark, P., & Huerta, T. (2008). Transdisciplinarity among tobacco harm-Reduction researchers: A Network Analytic Approach. American Journal of Preventive Medicine, 35, S173-S181.
55. Rosenfield, P.L. (1992). The potential of transdisciplinary research for sustaining and extending linkages between the health and social sciences. Social Science & Medicine, 35, 1343-1357.
56. Snowden, D. (2005). Multi-ontology sense making: A new simplicity in decision making. Informatics in Primary Care, 13, 45-53.
57. Stokols, D., Fuqua, J., Gress, J., Harvey, R., Phillips, K., Baezconde-Garbanati, L.,. . . Trochim, W. (2003). Evaluating transdisciplinary science. Nicotine & Tobacco Research, 5, S21-S39.
58. Stokols, D., Harvey, R., Gress, J., Fuqua, J., & Phillips, K. (2005). In vivo studies of transdisciplinary scientific collaboration lessons learned and implications for active living research. American Journal of Preventive Medicine, 28, 202-213.
59. Stokols, D., Misra, S., Moser, R.P., Hall, K.L., & Taylor, B.K. (2008). The ecology of team science: Understanding contextual influences on transdisciplinary collaboration. American Journal of Preventive Medicine, 35, S96-S115.
60. Trochim, W., Cabrera, D., Millstein, B., & Gallagher, R. (2006). Practical challenges of systems thinking and modeling in public health. American Journal of Public Health, 96, 538-546.
61. UK Evaluation Forum. (2006). Medical research: Assessing the benefits to society. London, UK: Academy of Medical Sciences.
62. van den Bulte, C., & Moenaert, R.K. (1998). The effects of R&D team co-location on communication patterns among R&D, marketing, and manufacturing. Management Science, 44, S1-S18.
63. Walter, A., Helgenberger, S., Wiek, A., & Scholz, R. (2007). Measuring societal effects of transdisciplinary research projects: Design and application of an evaluation method. Evaluation and Program Planning, 30, 325-338.
64. Weinberg, B. (1993). Dreams of a final solution. London, UK: Hutchinson.
65. Woolf, S.H. (2008). The meaning of translational research and why it matters. Journal of the American Medical Association, 299, 211-213.
66. Xiao, Y. (2005). Artifacts and collaborative work in healthcare: Methodological, theoretical, and technological implications of the tangible. Journal of biomedical Informatics, 38, 26-33.
67. Zahn, G.L. (1991). Face-to-face communication in an office setting: The effects of position, proximity, and exposure. Communication Research, 18, 737-754.