RESUMEN

INTRODUCTION: As hospitals and physician organizations increasingly vertically integrate, there is an important opportunity to use health systems to improve performance. Prior research has largely relied on secondary data sources, but little is known about how health systems are organized "on the ground" and what mechanisms are available to influence physician practice at the front line of care. METHODS: We collected in-depth information on eight health systems through key informant interviews, descriptive surveys, and document review. Qualitative data were systematically coded. We conducted analyses to identify organizational structures and mechanisms through which health systems influence practice. RESULTS: As expected, we found that health systems vary on multiple dimensions related to organizational structure (e.g., size, complexity) which reflects history, market and mission. With regard to levers of influence, we observed within-system variation both in mechanisms (e.g., employment of physicians, system-wide EHR, standardization of service lines) and level of influence. Concepts such as "core" versus "peripheral" were more salient than "ownership" versus "contract." DISCUSSION: Data from secondary sources can help identify and map health systems, but they do not adequately describe them or the variation that exists within and across systems. To examine the degree to which health systems can influence performance, more detailed and nuanced information on health system characteristics is necessary. CONCLUSION: The mixed-methods data accrual approach used in this study provides granular qualitative data that enables researchers to describe multi-layered health systems, grasp the context in which they operate, and identify the key drivers of performance.

RESUMEN

OBJECTIVE: The Aligning Forces for Quality (AF4Q) initiative was the Robert Wood Johnson Foundation's (RWJF's) signature effort to increase the overall quality of healthcare in targeted communities throughout the country. In addition to sponsoring this 16-site complex program, RWJF funded an independent scientific evaluation to support objective research on the initiative's effectiveness and contributions to basic knowledge in 5 core programmatic areas. The research design, data, and challenges faced during the summative evaluation phase of this near decade-long program are discussed. STUDY DESIGN: A descriptive overview of the summative research design and its development for a multi-site, community-based, healthcare quality improvement initiative is provided. METHODS: The summative research design employed by the evaluation team is discussed. RESULTS: The evaluation team's summative research design involved a data-driven assessment of the effectiveness of the AF4Q program at large, assessments of the impact of AF4Q in the specific programmatic areas, and an assessment of how the AF4Q alliances were positioned for the future at the end of the program. CONCLUSION: The AF4Q initiative was the largest privately funded community-based healthcare improvement initiative in the United States to date and was implemented at a time of rapid change in national healthcare policy. The implementation of large-scale, multi-site initiatives is becoming an increasingly common approach for addressing problems in healthcare. The summative evaluation research design for the AF4Q initiative, and the lessons learned from its approach, may be valuable to others tasked with evaluating similarly complex community-based initiatives.

Asunto(s)

RESUMEN

OBJECTIVE: The Robert Wood Johnson Foundation's (RWJF's) Aligning Forces for Quality (AF4Q) program was the largest privately funded, community-based quality improvement initiative to date, providing funds and technical assistance (TA) to 16 multi-stakeholder alliances located throughout the United States. This article describes the AF4Q initiative's underlying theory of change, its evolution over time, and the key activities undertaken by alliances. STUDY DESIGN: Descriptive overview of a multi-site, community-based quality improvement initiative. METHODS: We summarized information from program documents, program meetings, observation of alliance activities, and interviews with RWJF staff, TA providers, and AF4Q alliance stakeholders. RESULTS: The AF4Q program was a dynamic initiative, expanding and evolving over time. The underlying theory of change was based on the notion that an aligned, multi-stakeholder approach is superior to independent siloed efforts by stakeholders. Participating alliances developed or strengthened programming to varying degrees in 5 main programmatic areas: (1) measurement and public reporting of healthcare quality, patient experience, cost, and efficiency for ambulatory physician practices and hospitals; (2) efforts to engage consumers in health, healthcare, and alliance governance (consumer engagement); (3) adoption and spread of effective strategies to improve care delivery; (4) advancing healthcare equity; and (5) integration of alliance activities with payment reform initiatives. CONCLUSION: The AF4Q initiative was an ambitious program affecting multiple leverage points in the healthcare system. AF4Q alliances were provided a similar set of expectations, and given financial support and access to substantial TA. There was considerable variation in how alliances addressed the AF4Q programmatic areas, given differences in their composition, market structure, and history.

Asunto(s)

RESUMEN

OBJECTIVE: To report summative evaluation results from the Aligning Forces for Quality (AF4Q) initiative, the Robert Wood Johnson Foundation's (RWJF's) signature effort to improve quality of care from 2005 to 2015. METHODS: This was a longitudinal mixed methods program evaluation (ie, multiphase triangulated evaluation) of 16 grantee "alliances" from across the country, funded by RWJF as part of the AF4Q initiative. Grantees were selected in a nonexperimental manner and were charged with deploying interventions in 5 main programmatic areas to improve health and healthcare in their communities. RESULTS: Except for a small proportion of outcomes, there were no major differences in the rate of longitudinal improvement in AF4Q communities, compared with control communities, on quantitative outcomes related to the Triple Aim. Although the majority of the measures improved in both AF4Q and non-AF4Q communities, there were some exceptions to this improving trend, most noticeably in the cost of care and population health. There was also considerable heterogeneity across communities in terms of programmatic areas and the scale and scope of interventions in these areas. Although a number of AF4Q alliances implemented robust interventions in specific areas, often advancing strategies useful for others in the field, no AF4Q alliance pursued and aligned all 5 AF4Q programmatic areas in a robust way. In addition, whereas all alliances were able to garner the participation of multiple stakeholders initially, sustaining this participation and securing new sources of funding after RWJF support ended proved challenging for many alliances. Conclusion and Policy and Practice Implications: While the AF4Q program did not attain the ambitious community-level changes predicted by its sponsor at the program's outset, it did produce pockets of success on some dimensions for particular alliances. A number of factors explain the less-than-expected impact of the AF4Q initiative on community health and the observed variation in alliance sustainability and intervention strength. These include differing acceptance of the AF4Q initiative's theory of change, variation in the experience and capacity of the alliance communities selected for the program, differences in alliances' local healthcare market context, and the changing programmatic requirements for alliances participating in the AF4Q initiative. The variation in AF4Q program outcomes offers important lessons for those engaged in regional health improvement work.

Asunto(s)

RESUMEN

PURPOSE OF THE STUDY: A key directive of the Affordable Care Act of 2010 is to transform both institutional and community-based long-term care into a more person-centered system. In the nursing home industry, the culture change movement is central to this shift in philosophy. If policymakers are to further encourage implementation of culture change, they need to better understand the factors associated with implementation. DESIGN AND METHODS: Using logistic regression (N = 16,835), we examined the extent to which resident, facility, and state characteristics relate to a nursing home being identified by experts as having implemented culture change over the period 2004 through 2011. RESULTS: At baseline, the 291 facilities that were later identified by experts to have implemented culture change were more often nonprofit-owned, larger in size, and had fewer Medicaid and Medicare residents. Implementers also had better baseline quality with fewer health-related survey deficiencies and greater licensed practical nurse and nurse aide staffing. States experienced greater culture change implementation when they paid a higher Medicaid per diem. IMPLICATIONS: To date, nursing home culture change has been implemented differentially by higher resource facilities, and nursing homes have been responsive to state policy factors when implementing culture change.

Asunto(s)