Preventing Chronic Disease | The Program Sustainability Assessment Tool: A New Instrument for Public Health Programs - CDC

full-text ►

Preventing Chronic Disease | The Program Sustainability Assessment Tool: A New Instrument for Public Health Programs - CDC

The Program Sustainability Assessment Tool: A New Instrument for Public Health Programs

Navigate This Article

• Abstract
• Introduction
• Methods
• Results
• Discussion
• Acknowledgments
• Author Information
• References
• Tables

Douglas A. Luke, PhD; Annaliese Calhoun, MSW; Christopher B. Robichaux, MS; Michael B. Elliott, PhD; Sarah Moreland-Russell, MPH, PhD

Suggested citation for this article: Luke DA, Calhoun A, Robichaux CB, Elliott MB, Moreland-Russell S. The Program Sustainability Assessment Tool: A New Instrument for Public Health Programs. Prev Chronic Dis 2014;11:130184. DOI:http://dx.doi.org/10.5888/pcd11.130184.

PEER REVIEWED

Abstract

Introduction
Public health programs can deliver benefits only if they are able to sustain programs, policies, and activities over time. Although numerous sustainability frameworks and models have been developed, there are almost no assessment tools that have demonstrated reliability or validity or have been widely disseminated. We present the Program Sustainability Assessment Tool (PSAT), a new and reliable instrument for assessing the capacity for program sustainability of various public health and other programs.

Methods
A measurement development study was conducted to assess the reliability of the PSAT. Program managers and staff (n = 592) representing 252 public health programs used the PSAT to rate the sustainability of their program. State and community-level programs participated, representing 4 types of chronic disease programs: tobacco control, diabetes, obesity prevention, and oral health.

Results
The final version of the PSAT contains 40 items, spread across 8 sustainability domains, with 5 items per domain. Confirmatory factor analysis shows good fit of the data with the 8 sustainability domains. The subscales have excellent internal consistency; the average Cronbach’s α is 0.88, ranging from 0.79 to 0.92. Preliminary validation analyses suggest that PSAT scores are related to important program and organizational characteristics.

Conclusion
The PSAT is a new and reliable assessment instrument that can be used to measure a public health program’s capacity for sustainability. The tool is designed to be used by researchers, evaluators, program managers, and staff for large and small public health programs.

Author Information

Corresponding Author: Douglas A. Luke, PhD, Center for Public Health Systems Science, George Warren Brown School of Social Work, Washington University in St Louis, 700 Rosedale Ave, Campus Box 1009, St Louis, MO 63112. Telephone: 314-935-3794. E-mail: dluke@wustl.edu.

Author Affiliations: Annaliese Calhoun, Christopher B. Robichaux, Sarah Moreland-Russell, Washington University in St Louis, Missouri; Michael B. Elliott, Saint Louis University, St Louis, Missouri.

Top of Page

References

1. Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health 2009;36(1):24–34. CrossRef PubMed
2. Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice. New York (NY): Oxford University Press; 2012.
3. Scheirer MA, Dearing JW. An agenda for research on the sustainability of public health programs. Am J Public Health 2011;101(11):2059–67.CrossRef PubMed
4. Schell SF, Luke DA, Schooley MW, Elliott MB, Herbers SH, Mueller NB, et al. Public health program capacity for sustainability: a new framework. Implement Sci 2013;8:15. PubMed
5. Hutchinson K. Literature review of program sustainability assessment tools. Vancouver (BC): The Capture Project, Simon Fraser University; 2010. http://www.thecaptureplatform.ca/intervention/379/. Accessed January 9, 2013.
6. Scheirer MA. Is sustainability possible? A review and commentary on empirical studies of program sustainability. American Journal of Evaluation 2005;26(3):320–47. CrossRef
7. Shediac-Rizkallah MC, Bone LR. Planning for the sustainability of community-based health programs: conceptual frameworks and future directions for research, practice and policy. Health Educ Res 1998;13(1):87–108. CrossRef PubMed
8. Evashwick C, Ory M. Organizational characteristics of successful innovative health care programs sustained over time. Fam Community Health 2003;26(3):177–93. CrossRef PubMed
9. Sustainability Framework. Atlanta (GA): Georgia Health Policy Center; 2011. http://www.raconline.org/sustainability/pdf/georgia-health-policy-center-sustainability-framework.pdf. Accessed December 13, 2012.
10. Trochim WM. An introduction to concept mapping for planning and evaluation. Eval Program Plann 1989;12(1):1–16. CrossRef
11. Rosseel Y. Lavaan: an R package for structural equation modeling. J Stat Softw 2012;48(2):1–36. http://www.jstatsoft.org/v48/i02/. Accessed July 30, 2013.
12. Floyd FJ, Widaman KF. Factor analysis in the development and refinement of clinical assessment instruments. Psychol Assess 1995;7(3):286–99.CrossRef
13. Luke DA, Ribisi KM, Walton MA, Davidson WS. Assessing the diversity of personal beliefs about addiction: development of the Addiction Belief Inventory. Subst Use Misuse 2002;37(1):89–120. CrossRef PubMed
14. Brown T. Confirmatory factor analysis for applied research. New York (NY): Guilford Press: 2006.
15. Hu LT, Bentler PM. Evaluating model fit. In: Hoyle RH, editor. Structural equation modeling: concepts, issues, and applications. Thousand Oaks (CA): Sage Publications; 1995. p 76–99.
16. Hu LT, Bentler PM. Fit indices in covariance structure modeling: sensitivity to underparameterized model misspecification. Psychol Methods 1998;3(4):424–53. CrossRef
17. Kenny DA, McCoach DB. Effect of the number of variables on measures of fit in structural equation modeling. Struct Equ Modeling 2003;10(3):333–51. CrossRef
18. Schmitt N. Uses and abuses of coefficient alpha. Psychol Assess 1996;8(4):350–3. CrossRef
19. Calhoun A, Mainor A, Moreland-Russell S, Maier RC, Brossart L, Luke DA. Using the Program Sustainability Assessment Tool to assess and plan for sustainability. Prev Chronic Dis 2014;11:130185. CrossRef
20. Best A, Greenhalgh T, Lewis S, Saul JE, Carroll S, Bitz J. Large-system transformation in health care: a realist review. Milbank Q 2012;90(3):421–56.CrossRef PubMed
21. Scheirer MA. Linking sustainability research to intervention types. Am J Public Health 2013;103(4):e73–80. CrossRef PubMed