Factors Affecting Implementation of the California Childhood Obesity Research Demonstration (CA-CORD) Project, 2013
ORIGINAL RESEARCH — Volume 13 — October 20, 2016
Emmeline Chuang, PhD; Julian Brunner, MPH; Jamie Moody, MS; Leticia Ibarra, MPH; Helina Hoyt, RN, MS; Thomas L. McKenzie, PhD; Amy Binggeli-Vallarta, DrPH, RD; Griselda Cervantes, MA, MPH; Tracy L. Finlayson, PhD; Guadalupe X. Ayala, PhD, MPH
Suggested citation for this article: Chuang E, Brunner J, Moody J, Ibarra L, Hoyt H, McKenzie TL, et al. Factors Affecting Implementation of the California Childhood Obesity Research Demonstration (CA-CORD) Project, 2013. Prev Chronic Dis 2016;13:160238. DOI: http://dx.doi.org/10.5888/pcd13.160238.
Ecological approaches to health behavior change require effective engagement from and coordination of activities among diverse community stakeholders. We identified facilitators of and barriers to implementation experienced by project leaders and key stakeholders involved in the Imperial County, California, Childhood Obesity Research Demonstration project, a multilevel, multisector intervention to prevent and control childhood obesity.
A total of 74 semistructured interviews were conducted with project leaders (n = 6) and key stakeholders (n = 68) representing multiple levels of influence in the health care, early care and education, and school sectors. Interviews, informed by the Multilevel Implementation Framework, were conducted in 2013, approximately 12 months after year-one project implementation, and were transcribed, coded, and summarized.
Respondents emphasized the importance of engaging parents and of ensuring support from senior leaders of participating organizations. In schools, obtaining teacher buy-in was described as particularly important, given lower perceived compatibility of the intervention with organizational priorities. From a program planning perspective, key facilitators of implementation in all 3 sectors included taking a participatory approach to the development of program materials, gradually introducing intervention activities, and minimizing staff burden. Barriers to implementation were staff turnover, limited local control over food provided by external vendors or school district policies, and limited availability of supportive resources within the broader community.
Project leaders and stakeholders in all sectors reported similar facilitators of and barriers to implementation, suggesting the possibility for synergy in intervention planning efforts.
Approximately one-third of US children are overweight or obese (1). Rates are particularly high among Hispanic children and those living in rural communities (1). To more effectively prevent and control childhood obesity, policy makers and practitioners have begun to promote social ecological approaches that simultaneously target changes in multiple sectors and at multiple levels of influence (2).
Preliminary evidence suggests that multisector, multilevel approaches can promote health behavior change and prevent child weight gain (3,4). However, the success of such approaches is contingent on their ability to effectively engage and coordinate activities across diverse community stakeholders (5,6). Differences in community stakeholders’ readiness and willingness to implement policy, system, and environmental changes can significantly affect whether targeted improvements to children’s health and well-being are achieved and sustained (7–9).
We conducted semistructured interviews to identify facilitators of and barriers to implementation experienced by project leaders and stakeholders involved in a multisector, multilevel intervention for childhood obesity prevention and control. Participating stakeholders were located in 3 sectors with high potential to affect childhood obesity — health care, early care and education, and schools — and represented multiple levels of influence within their respective organizations (eg, organizational leaders and frontline staff). Findings contribute to knowledge about how to more effectively coordinate and implement social ecological approaches for obesity prevention and control.
Data were drawn from the evaluation of the Imperial County, California, Childhood Obesity Research Demonstration project (CA-CORD) (10). Rates of childhood overweight and obesity in Imperial County are among the highest in California (47% in Imperial County vs 38% in the state overall) (11). Most residents are Hispanic/Latino (83%), and almost one-quarter (24%) live in poverty (12). CA-CORD is 1 of 3 studies funded by the Centers for Disease Control and Prevention to test the effectiveness of integrated health care and public health evidence-based approaches to prevent and control childhood obesity (13). CA-CORD used a 2 × 2 factorial study design to assess changes in body mass index in 1,183 children aged 2 to 11 years assigned to 1 of 4 conditions (health care and public health intervention, health care intervention only, public health intervention only, or control). Intervention activities focused on improving 4 health behaviors: fruit and vegetable consumption, water consumption, physical activity, and sleep. Consistent with a social ecological approach (14), CA-CORD activities spanned multiple sectors (eg, health care, early care and education, schools) and levels of influence (individual, family, organization, and community); cross-sector coordination occurred via a CA-CORD community advisory committee that included members of each sector, some of whom were also members of the Childhood Obesity Prevention Alliance led by the local public health department. A brief overview of CA-CORD intervention activities is provided in Table 1; more detailed information is available elsewhere (11,15).
A multiple holistic case study design was used, with participating organizations as the unit of analysis (16). Of the 29 organizations from the health care, early care and education, and school sectors participating in CA-CORD during fiscal year 2013, 27 agreed to participate in this study. We interviewed 68 key stakeholders from these organizations (25 from health care, 17 from early care and education, and 26 from schools), including senior leaders responsible for the decision to participate in CA-CORD (eg, clinic CEO, school superintendents [n = 8]), middle managers and other leaders whose support or participation could affect implementation (eg, principals, clinic managers [n = 30]), and frontline staff directly responsible for implementation (eg, health care and early care and education providers, community health workers, school teachers [n = 30]). CA-CORD project leaders responsible for liaising with organizations to implement CA-CORD activities (n = 6) were also interviewed to provide context about the status of intervention activities in each sector, resulting in a total of 74 respondents.
All interviews were conducted in 2013, approximately 12 months after year-one implementation of CA-CORD intervention activities. Interviews were conducted by trained interviewers in respondents’ language of choice (English or Spanish) using a semistructured interview guide tailored to respondents’ role in the organization. Interview questions (available from the authors upon request) were informed by the Multilevel Implementation Framework (MIF) (15), a conceptual framework of factors affecting implementation of multisector, multilevel approaches. Organization-specific constructs relevant to this study included previous experience promoting healthy behaviors, compatibility with organizational values and priorities, compatibility with existing work processes, leadership support, and implementation climate (ie, the extent to which intervention use is expected and rewarded by the organization). Additional constructs of interest included the characteristics of people involved (ie, frontline staff responsible for implementing CA-CORD and of participating children and/or families), connections to the broader community, and the strength of the external support system (eg, trainings and intervention-specific materials provided by academic-community partners).
On average, interviews lasted from 30 to 60 minutes. With respondents’ permission, most (95%, n = 70) were recorded. For the remaining interviews (n = 4), notes were used in place of a recording.
All recordings were transcribed verbatim. Interviews conducted in Spanish were translated into English by a certified translator. Final transcripts and interview notes were imported into the qualitative software NVivo 10.0 (QSR International) for analysis. We used template analysis (17), in which an initial codebook informed by the MIF was refined to incorporate emergent themes. Initial codes were applied to a subset of 6 transcripts. Coding was compared for consistency by a second person, and the codebook was revised to clarify construct definitions or better highlight critical themes. All transcripts were subsequently coded by 2 investigators. Discrepancies in coding were discussed until consensus was reached. Within-case and between-case analyses focused on the degree to which specific constructs emerged in the data and the degree to which each construct was perceived as affecting implementation. Coded data were also analyzed to identify similarities and differences by sector.
Three community health care clinics, 13 early care and education centers, and 11 schools agreed to participate in the study. On average, respondents from these organizations were aged 45 years and had been with their organization for 8 years. Most were female (86%) and Latino/Hispanic (69%). All respondents reported facilitators of and barriers to implementing CA-CORD. We summarized major themes according to key MIF constructs (Table 2) and provided illustrative quotations (Table 3).
Previous experience promoting healthy behaviors
Previous experience promoting healthy behaviors varied across sectors. In the clinic setting, providers and staff reported distributing educational materials to families but otherwise did not have prior experience promoting healthy behaviors among pediatric patients. For these providers and staff, CA-CORD was viewed as providing important, additional resources that supported their work with children and families. By contrast, respondents in most early care and education centers (10 of 13) and all schools (11 of 11) had prior experience implementing programs to promote healthy behavior, such as Head Start’s I Am Moving, I Am Learning initiative (18). For staff in these centers and schools, CA-CORD was often perceived as supplementing existing curriculum by providing additional, structured activities they could engage in with the children (Table 3, quotation 1). In a few cases, these activities were perceived as competing with other programs (quotation 2). In several schools, a previous failed effort by the district to implement the SPARK (Sports, Play, and Active Recreation for Kids) physical education program (SPARK-PE) (19), because of insufficient teacher training, was identified as contributing to teacher resistance to implementing CA-CORD.
Compatibility with organizational values/priorities and existing work routines
In general, respondents in the health care and early care and education sectors described CA-CORD as highly compatible with organizational priorities (Table 3, quotations 3 and 4). Perceptions of CA-CORD were more mixed in schools; respondents in 5 of 11 schools identified CA-CORD as a low priority for their organizations. Primary reasons given for this low rating included competing demands and a need for teachers to focus on academic outcomes for which they were held accountable, such as reading and math (quotation 5). Respondents who rated CA-CORD more highly typically perceived a greater association between healthy behaviors and successful learning or felt that activities achieved multiple purposes (eg, improved both physical health and cooperative social behavior).
Perceptions of CA-CORD’s compatibility with existing work routines also varied across sectors. In the health care sector, respondents described CA-CORD as highly compatible with their existing work routines and not particularly time-consuming to implement (Table 3, quotations 6 and 7). In schools and to a lesser extent in the early care and education sector, CA-CORD activities were described as time-consuming to learn and difficult to implement given competing demands on teachers’ and providers’ time. This perception was particularly true for SPARK-PE activities, which were often outside teachers’ and providers’ comfort zones and viewed as more difficult to implement than other CA-CORD activities (quotation 8).
Leadership support and implementation climate
Senior leaders in all 3 sectors were generally supportive of CA-CORD. However, this support was typically passive, with the most commonly reported indicator being permission to participate in CA-CORD activities. The major exception was the superintendent of one school district who was heavily involved in district wellness committee meetings and willing to allocate significant resource support for CA-CORD. Many respondents within this district identified this resource support, which included funds to hire a part-time physical education support staff member, as a valuable facilitator to project implementation.
Respondents indicated that middle managers, such as early care and education directors and school principals, varied in their support for the project. For example, in several schools, principals were described as actively engaged in promoting CA-CORD, for example, by frequently interacting with teachers to ensure they had the support needed to implement intervention activities (Table 3, quotation 9). In other schools, principals either took no action or engaged in behaviors that negatively affected implementation (eg, in one case by reprimanding a teacher who allowed students to leave the classroom to get a drink of water).
In all 3 sectors, respondents indicated that engaging in CA-CORD activities was not expected or rewarded by leaders in their organizations (Table 3, quotation 10). This perception was particularly strong in the school sector. For example, even though California’s education code requires that students engage in 200 minutes of physical education every 10 school days, several respondents admitted that teachers often did not achieve this requirement and that conformity to education code requirements was not enforced by leadership (quotation 11). However, multiple respondents also indicated that regular, supportive contact from CA-CORD staff during training sessions and staff meetings created a positive implementation climate even in the absence of more proactive leadership support and follow-up within the organization (quotation 12).
Characteristics of frontline staff and children and families
Respondents in the health care and early care and education sectors identified the supportive attitudes of frontline staff as facilitating the implementation of CA-CORD activities. In schools, teacher buy-in was inconsistent and served as either a barrier or a facilitator, depending on whether teachers resisted or championed the project (Table 3, quotation 13). Consequently, CA-CORD staff reported needing to allocate time to engage teachers as well as principals (quotation 14).
Respondents in all 3 sectors identified parent engagement (or lack thereof) as significantly affecting implementation, because it affected whether healthy behaviors were reinforced in the home (quotations 15 and 16). Although some respondents reported ongoing efforts to engage parents (eg, by distributing materials that would allow parents to try CA-CORD activities at home), most simply identified lack of parental engagement as a barrier to improving targeted health behaviors. In the health care setting, several respondents identified income and language barriers as contributing to lack of parent engagement in CA-CORD (quotation 17).
In 2 of the 3 sectors (early care and education and school), respondents also identified child engagement as affecting implementation. For example, several teachers and providers noted that they could not force resistant children to participate in SPARK exercises or to try healthy foods (quotation 18). However, in some centers and schools, highly engaged children enhanced teachers’ and providers’ enthusiasm for the project and also spurred behavior change in teachers.
Connection to broader community and external support system
Although CA-CORD project staff identified many initiatives intended to promote healthy behaviors that were taking place in the broader community, most frontline staff were either not aware of them or felt they were still not sufficient. Several respondents expressed frustration that their efforts to promote healthy behaviors were not reinforced by others in the community, either because of limited resources or general lack of support (Table 3, quotations 19–21). Nonetheless, respondents in all sectors felt that connections to the broader community were critical for reinforcing the healthy behaviors promoted by CA-CORD and ensuring sustainable change.
In all 3 sectors, respondents identified technical assistance and support provided by CA-CORD project staff as critical for maintaining project momentum and ensuring activities did not fall by the wayside (quotation 22). Additional facilitators to implementation included the use of a participatory approach by CA-CORD project staff and the decision to gradually introduce intervention activities in a way that would minimally disrupt existing work schedules (quotation 23).
Other facilitators and barriers
In all sectors, staff turnover was described as a barrier to implementation. In the health care sector, turnover of community health workers contributed to project costs and delayed implementation of educational workshops for families. In the school sector, turnover of principals and other administrative personnel negatively affected leadership support for CA-CORD and necessitated additional effort by CA-CORD staff to re-engage staff at the affected schools. In the early care and education sector, participating centers were all part of large agencies that purposely rotated staff annually. This movement of early care and education providers, supervisors, and even directors was a barrier that had to be taken into account when planning and implementing CA-CORD activities.
Theoretical constructs identified in the MIF were useful for summarizing the major facilitators and barriers experienced by key stakeholders in implementing CA-CORD. Perceptions of the strengths of the external support system and of the importance of parent engagement were remarkably congruent across sectors and consistent with previous research indicating the importance of robust academic–community partnerships and family engagement for health behavior change in rural communities (20). Respondents also consistently emphasized the importance of the broader community for reinforcing health behaviors. Similar to previous literature on innovation implementation (21), study findings confirmed that prior experience with programs promoting healthy behaviors helped strengthen perceived compatibility of CA-CORD with existing work processes. However, particularly in cases of prior failed implementation (eg, in the school district that had previously implemented SPARK-PE with limited success), previous exposure could also increase staff resistance to implementation. Respondents in all 3 sectors identified turnover at multiple levels of the organization as a barrier that should be addressed in the program planning process (eg, by incorporating a train-the-trainer model or other strategies for minimizing knowledge loss due to turnover) (22).
Several sector-specific issues were also identified. In the school sector, lower perceived compatibility of obesity prevention and control activities with organizational priorities contributed to variable leadership support and greater emphasis on the importance of obtaining teachers’ buy-in and support for CA-CORD. Strict scheduling in the school sector also meant that planning for CA-CORD activities needed to be completed by the end of the previous academic year. In the early care and education sector, where centers were often smaller or reliant upon relationships with external vendors to provide services, space constraints and limited control over foods served to children limited staff ability to implement CA-CORD as intended.
In general, however, similarity in the facilitators of and barriers to implementation identified by project leaders and key stakeholders suggest the possibility of common ground in collaborative efforts to develop and sustain social ecological approaches to prevent and control obesity. In particular, findings reinforce the importance of taking a participatory approach during the planning process and of ensuring that proposed changes are introduced in a time frame and manner compatible with stakeholders’ work processes and priorities. Specific actions taken by the CA-CORD team to facilitate implementation included conducting formative assessments to assess organizations’ receptivity to proposed project activities and engaging community members to better understand organizations’ different needs and priorities. Study findings also indicate that the support of senior leaders is necessary but not sufficient for program success; strategies for cultivating buy-in of staff at multiple levels within participating organizations should be considered.
This study had several limitations. First, implementation is often a dynamic, nonlinear process (23). These data provide an overview of key facilitators and barriers to implementation encountered by organizations during the first intervention year of CA-CORD but may not represent a comprehensive list of relevant issues over time. Second, this study focused on a limited number of organizations within a single, rural county in California, which may limit generalizability to other settings. Finally, resource constraints and our desire to minimize respondent burden meant we only interviewed a limited number of people within each participating organization. Although we interviewed a diverse sample of respondents at different levels within each organization and theoretical saturation was achieved (ie, later interviews did not generate new insights to research questions), study findings may not capture all facilitators and barriers encountered during implementation.
Despite these limitations, this study contributes to the literature by capturing the perceptions of project leaders and key stakeholders regarding facilitators and barriers experienced in implementing multilevel approaches to childhood obesity prevention and control. Congruity in perceptions of certain facilitators and barriers represents not only critical points to consider during intervention planning, but also key areas in which stakeholders could fruitfully collaborate in developing and implementing social ecological approaches to obesity prevention and control.
This research was supported by the Centers for Disease Control and Prevention (award no. U18DP003377) and by the Johns Hopkins Global Obesity Prevention Center, which is funded by the National Institute of Child Health and Human Development (no. U54HD070725). The authors thank Hena Din and Priscilla Rios for their assistance with conducting interviews.
Corresponding Author: Emmeline Chuang, PhD, Department of Health Policy and Management, Fielding School of Public Health, University of California, Los Angeles, 650 Charles E. Young Dr South, Los Angeles, California 90095-1772. Telephone: 310-825-8908. Email: email@example.com.
Author Affiliations: Julian Brunner, University of California, Los Angeles, Fielding School of Public Health, Los Angeles, California; Jamie Moody, Helina Hoyt, Thomas L. McKenzie, Griselda Cervantes, San Diego State University Research Foundation, Institute for Behavioral and Community Health, San Diego, California; Leticia Ibarra, Clínicas de Salud del Pueblo, Inc., Brawley, California; Amy Binggeli-Vallarta, Imperial County Public Health Department, El Centro, California; Tracy L. Finlayson, San Diego State University Research Foundation, Institute for Behavioral and Community Health, and San Diego State University, Graduate School of Public Health, San Diego, California; Guadalupe X. Ayala, San Diego State University Research Foundation, Institute for Behavioral and Community Health, and San Diego State University, College of Health and Human Services, San Diego, California.
- Ogden CL, Carroll MD, Kit BK, Flegal KM. Prevalence of childhood and adult obesity in the United States, 2011–2012. JAMA 2014;311(8):806–14. CrossRef PubMed
- Institute of Medicine. Accelerating progress in obesity prevention: solving the weight of the nation. Washington (DC): The National Academies Press; 2012.
- Samuels SE, Craypo L, Boyle M, Crawford PB, Yancey A, Flores G. The California endowment’s Healthy Eating, Active Communities program: a midpoint review. Am J Public Health 2010;100(11):2114–23. CrossRef PubMed
- Economos CD, Hyatt RR, Goldberg JP, Must A, Naumova EN, Collins JJ, et al. A community intervention reduces BMI A community intervention reduces BMI z-score in children: Shape Up Somerville first year results. Obesity (Silver Spring) 2007;15(5):1325–36. CrossRef PubMed
- Hammond RA. Complex systems modeling for obesity research. Prev Chronic Dis 2009;6(3):A97–106. PubMed
- Sterman JD. Learning from evidence in a complex world. Am J Public Health 2006;96(3):505–14. CrossRef PubMed
- Jacobs SR, Weiner BJ, Bunger AC. Context matters: measuring implementation climate among individuals and groups. Implement Sci 2014;9(1):46. CrossRef PubMed
- Beebe TJ, Harrison PA, Sharma A, Hedger S. The Community Readiness Survey: development and initial validation. Eval Rev 2001;25(1):55–71. CrossRef PubMed
- Sterman JD. Learning from evidence in a complex world. Am J Public Health 2006;96(3):505–14. CrossRef PubMed
- Ayala GX, Ibarra L, Binggeli-Vallarta A, Moody J, McKenzie TL, Angulo J, et al. Our Choice/Nuestra Opción: the Imperial County, California, Childhood Obesity Research Demonstration study (CA-CORD). Child Obes 2015;11(1):37–47. CrossRef PubMed
- Babey S, Wolstein J, Diamant A. A patchwork of progress: changes in overweight and obesity among California 5th-, 7th-, and 9th graders, 2005–2010. http://www.publichealthadvocacy.org/research/patchworkdocs/OFT%20brief_final.pdf. Accessed December 12, 2014.
- United States Census Bureau. State and Country QuickFacts: Imperial County, California. 2015. http://www.census.gov/quickfacts/table/PST045215/06025,00. Accessed July 10, 2016.
- Dooyema CA, Belay B, Foltz JL, Williams N, Blanck HM. The childhood obesity research demonstration project: a comprehensive community approach to reduce childhood obesity. Child Obes 2013;9(5):454–9. CrossRef PubMed
- Bronfenbrenner U. The ecology of human development: experiments by nature and design. Cambridge (MA): Harvard University Press; 1979.
- Chuang E, Ayala GX, Schmied E, Ganter C, Gittelsohn J, Davison KK. Evaluation protocol to assess an integrated framework for the implementation of the Childhood Obesity Research Demonstration project at the California (CA-CORD) and Massachusetts (MA-CORD) sites. Child Obes 2015;11(1):48–57. CrossRef PubMed
- Yin R. Case study research, third edition. Thousand Oaks (CA): Sage Publications; 2003.
- King N. Doing template analysis. In: Cassell GSC, editor. Qualitative organizational methods: core methods and current challenges. Thousand Oaks (CA): Sage Publications; 2012. p. 426–50.
- Region III Administration for Children and Families. I Am Moving, I Am Learning: a proactive approach for addressing childhood obesity in Head Start children. Summary report: the first two years. Washington (DC): US Department of Health and Human Services; 2006. http://eclkc.ohs.acf.hhs.gov/hslc/tta-system/health/healthy-active-living/imil/imil_report.pdf. Accessed April 07, 2016.
- Sallis JF, McKenzie TL, Alcaraz JE, Kolody B, Faucette N, Hovell MF. The effects of a 2-year physical education program (SPARK) on physical activity and fitness in elementary school students. Sports, Play, and Active Recreation for Kids. Am J Public Health 1997;87(8):1328–34. CrossRef PubMed
- Melvin CL, Corbie-Smith G, Kumanyika SK, Pratt CA, Nelson C, Walker ER, et al. ; Workshop Working Group on CVD Prevention in High-Risk Rural Communities. Developing a research agenda for cardiovascular disease prevention in high-risk rural communities. Am J Public Health 2013;103(6):1011–21. CrossRef PubMed
- Weiner BJ, Lewis MA, Linnan LA. Using organization theory to understand the determinants of effective implementation of worksite health promotion programs. Health Educ Res 2009;24(2):292–305. CrossRef PubMed
- Parise S, Cross R, Davenport T. Strategies for preventing a knowledge-loss crisis. MIT Sloan Manag Rev 2006;47(4):31.
- Van de Ven AH, Polley DE, Garud R, Venkataraman S. The innovation journey. Oxford (UK): Oxford University Press; 1999.
- Ayala GX, Ibarra L, Horton L, Arredondo EM, Slymen DJ, Engelberg M, et al. Evidence supporting a promotora-delivered entertainment education intervention for improving mothers’ dietary intake: the Entre Familia: Reflejos de Salud Study. J Health Commun 2015;20(2):165–76. CrossRef PubMed
- Crespo NC, Elder JP, Ayala GX, Slymen DJ, Campbell NR, Sallis JF, et al. Results of a multi-level intervention to prevent and control childhood obesity among Latino children: the Aventuras Para Niños Study. Ann Behav Med 2012;43(1):84–100. CrossRef PubMed
- Elder JP, Crespo NC, Corder K, Ayala GX, Slymen DJ, Lopez NV, et al. Childhood obesity prevention and control in city recreation centres and family homes: the MOVE/me Muevo Project. Pediatr Obes 2014;9(3):218–31. CrossRef PubMed
- Benjamin SE, Neelon B, Ball SC, Bangdiwala SI, Ammerman AS, Ward DS. Reliability and validity of a nutrition and physical activity environmental self-assessment for child care. Int J Behav Nutr Phys Act 2007;4(1):29–39. CrossRef PubMed
- Ayala GX, Castro IA, Pickrel JL, Williams CB, Lin SF, Madanat H, et al. A restaurant-based intervention to promote sales of healthy children’s menu items: the Kids’ Choice Restaurant Program cluster randomized trial. BMC Public Health 2016;16(1):250. CrossRef PubMed
- Schmied E. Predicting parent engagement in family-based childhood obesity prevention and control programs (doctoral dissertation). San Diego (CA): University of California San Diego; 2015.