Skip to main content

An organizational readiness intervention and randomized controlled trial to test strategies for implementing substance use disorder treatment into primary care: SUMMIT study protocol

Abstract

Background

Millions of people who need treatment for substance use disorders (SUD) do not receive it. Evidence-based practices for treating SUD exist, and some are appropriate for delivery outside of specialty care settings. Primary care is an opportune setting in which to deliver SUD treatment because many individuals see their primary care providers at least once a year. Further, the Patient Protection and Affordable Care Act (PPACA) increases coverage for SUD treatment and is increasing the number of individuals seeking primary care services. In this article, we present the protocol for a study testing the effects of an organizational readiness and service delivery intervention on increasing the uptake of SUD treatment in primary care and on patient outcomes.

Methods/design

In a randomized controlled trial, we test the combined effects of an organizational readiness intervention consisting of implementation tools and activities and an integrated collaborative care service delivery intervention based on the Chronic Care Model on service system (patient-centered care, utilization of substance use disorder treatment, utilization of health care services and adoption and sustainability of evidence-based practices) and patient (substance use, consequences of use, health and mental health, and satisfaction with care) outcomes. We also use a repeated measures design to test organizational changes throughout the study, such as acceptability, appropriateness and feasibility of the practices to providers, and provider intention to adopt the practices. We use provider focus groups, provider and patient surveys, and administrative data to measure outcomes.

Discussion

The present study responds to critical gaps in health care services for people with substance use disorders, including the need for greater access to SUD treatment and greater uptake of evidence-based practices in primary care. We designed a multi-level study that combines implementation tools to increase organizational readiness to adopt and sustain evidence-based practices (EBPs) and tests the effectiveness of a service delivery intervention on service system and patient outcomes related to SUD services.

Trial registration

Current controlled trials: NCT01810159

Peer Review reports

Background

Substance use disorders (SUD) continue to be under-identified and under-treated [1]. In 2013, 22.7 million people aged 12 or older needed treatment for an illicit drug or alcohol use problem; of these, 20.2 million did not receive it [1]. The consequences of untreated alcohol and drug abuse are great and include increased risk of disease, injury, disability, and death [2,3] as well as hundreds of billions of dollars in costs to the criminal justice, social welfare, and health care systems [4-6]. Historically, treatment of SUD has taken place in residential and outpatient specialty care settings. Although specialty care settings play an important role for individuals with severe dependence, long waiting lists, stigma, and the lack of public funding for patients without insurance coverage have contributed to the lack of access. Further, many people who need treatment are not aware that they need it, are not ready for treatment, or do not know how or where to seek treatment [7].

Primary care clinics are a feasible and opportune setting in which to identify and provide treatment to people with SUD. Studies suggest that the prevalence of alcohol use disorders and use of illicit drugs is higher among primary care and emergency room patients than it is in the general population [8,9]. Further, most individuals (82%) visit a health professional at least once a year, thus providing ample opportunity for providers to identify patients in need of treatment [10]. Research suggests that integrating SUD treatment and general health care can result in less utilization of inpatient care and fewer emergency room visits [11] and that integrated care is acceptable to patients with an SUD [12].

However, despite the potential benefits of providing SUD screening and treatment in primary care and the existence of evidence-based practices (EBP) suitable for delivery in these settings [13-21], uptake of evidence-based SUD treatments in primary care has been slow. Accordingly, patients are unlikely to receive treatment for their SUD in primary care [20-24]. Some of the organizational barriers to providing SUD treatment in primary care settings include lack of insurance reimbursement, perceived lack of time to fully assess and discuss substance use, and lack of administrative buy-in for integrating SUD care into medical practices [25,26]. At the physician level, perceived barriers to SUD treatment adoption include negative attitudes toward people with SUD, lack of confidence among physicians in their ability to treat SUDs, lack of adequate role models and access to decision support consultants, and deficiencies in training and expertise in addiction treatment [13,25-28].

Research on introducing new practices into health care and other organizations suggests that intervention at both the organizational level (i.e., to increase organizational readiness to adopt new practices) and service delivery system level (i.e., reorganizing how care is provided to support the new practice) may both be necessary to integrate and sustain EBP [29-31]. Organizational readiness refers to “the extent to which organizational members are psychologically and behaviorally prepared to implement organizational change” [32]. Interventions that increase an organization’s commitment to change and the ability of the members of the organization to visualize how the new practice could be adopted and incorporated into existing practices are both important to increasing organizational readiness and adoption of EBP [33]. However, even when an organization exhibits high organizational readiness, change may not be successful unless attention is paid to how the new practice is supported and integrated into existing care practices. Further, adapting new practices to fit the nuances of a setting is a key component of whether the practice is ultimately accepted and adopted. As Damschroder et al. note, “without adaptation, interventions usually come to a setting as a poor fit, resisted by individuals who will be affected by the intervention, and requiring an active process to engage individuals in order to accomplish implementation [30].”

To address the need for change at two levels—organizational and service delivery system—to increase the intent and ability of primary care providers to identify and treat opioid and alcohol use disorders (OAUD), we designed a multi-level study to create and evaluate change at both levels. We call this study substance use motivation medication integrated treatment (SUMMIT) and focus on alcohol and opiate use disorders because of their relevance to the clinic population and availability of effective medications. At the organizational level, we test the effects of an organizational readiness intervention on the organization’s readiness to identify and treat individuals with opioid and alcohol use disorders. At the service delivery system level, we use Wagner’s Chronic Care Model [34] to reorganize and guide how care for OAUD is provided and supported; we call the service delivery intervention integrated collaborative care (ICC). Integrated, collaborative approaches have been successful in improving outcomes for patients experiencing a variety of different chronic illnesses, including diabetes [35], asthma [35], and depression [36]. ICC has improved implementation of evidence-based treatments and quality of care [37], lowered costs [38], improved patient outcomes [39-42], and is thought to be feasible for and sustainable in primary care clinics [43]. We test the effects of the organizational readiness intervention using a repeated measures pre-post design and the impact of the service delivery intervention on patient-level outcomes using a randomized controlled trial (RCT) to compare the service delivery intervention (ICC) with “service as usual” (SAU) on service system and patient outcomes. We hypothesize that provider (providers include administrators, medical and mental health providers, and other staff) readiness to implement the EBP and patient-centered SUD care will improve from the pre-organizational readiness intervention period (year 1) to the post-readiness intervention periods (years 2–5); that patients in the ICC condition will report more integrated, patient-centered evidence-based care for their opioid and/or alcohol use disorders, will be more likely to receive OAUD care, and will have lower overall health care utilization (e.g., emergency department and medical visits) than patients in the SAU condition; and that provider adoption of EBP will increase from year 2 to years 3 and 4 and that providers will still be delivering OAUD EBP a year after completion of the study in year 5. We also hypothesize that patients in the ICC condition will report less substance use, fewer SUD consequences, higher health and mental health functioning, and greater satisfaction with their SUD care 6 months after enrollment than SAU patients.

The evidence-based practices that we are introducing into the clinic are two medications—buprenorphine/naloxone (BUP/NX) (trade name Suboxone®) for opioid dependence and extended-release injectable naltrexone (XR-NTX) (trade name Vivitrol®) for alcohol dependence—and a motivational interviewing (MI)-based behavioral treatment for those with abuse or dependence of either substance. BUP/NX has been proven effective for patients with opioid (heroin as well as prescription opioid) dependence and is feasible for delivery in office-based settings [12,44-49]; XR-NTX has been found effective for people with alcohol or opioid dependence and also is feasible for delivery in primary care [50-54]. Due to greater complexity for administration for opiate dependence, in this study, XR-NTX is used only to treat alcohol dependence. MI-based interventions have improved SUD treatment outcomes [18,19,55,56].

In this article, we present our methods, including study setting; conceptual framework; study design; participant recruitment; a description of the interventions, which consist of the organizational readiness intervention and the service delivery intervention; as well as our measures, data collection procedures, and analysis plan. We conclude with a discussion of the study’s unique design and its relevance to implementation of OAUD treatment in primary care, and we note the study’s limitations.

Methods/design

Study setting

We are conducting the study in a large urban, federally qualified health center (FQHC) in Los Angeles that serves approximately 20,000 patients annually. The study is taking place at the FQHC’s two largest sites. We elected to hold the study in an FQHC because of the expected influx of patients into publicly funded clinics due to expanded coverage, an increased funding and an increase in the number of clinics due to the Patient Protection and Affordable Care Act (PPACA) [57], and the greater opportunity to reach more individuals who need treatment. The clinic currently has integrated mental health services and provides treatment for anxiety and depressive disorders; however, prior to the study, the clinic did not conduct any screening or treatment for SUD. If substance misuse was identified, patients were sometimes, but not systematically, referred to specialty care.

Conceptual framework

In our conceptual framework, illustrated in Figure 1, the organizational readiness intervention increases provider readiness to use each of the EBP for OAUD (the two medications and the MI-based behavioral therapy) as well as readiness to adopt ICC (the service delivery intervention) to deliver the three EBP. The organizational readiness intervention consists of well-studied “implementation” tools, designed to increase the readiness of an organization to implement and deliver new practices. Our measures of organizational readiness are provider acceptability of the EBP, provider perceptions of EBP appropriateness and feasibility, and provider intention to adopt each EBP. In addition, because an aspect of organizational readiness is the ability of providers to visualize how the new practices can be adopted and integrated into the existing workflow [33], a final measure of readiness is the development of locally tailored EBP protocols and an ICC protocol that shows how the EBP will fit into clinic workflow.

Figure 1
figure 1

SUMMIT conceptual framework for integrating SUD EBP into primary care.

In the second part of the conceptual framework, the service delivery intervention (ICC) facilitates the uptake of the EBP and affects service system outcomes (e.g., patient-centered SUD care, measured at the level of the patient and provider, and service utilization, measured at the level of the patient) and patient functioning outcomes (e.g., substance use, consequences of use, both measured at the level of the patient). While organizational readiness may improve immediately following the organizational readiness intervention, we expect that once the three EBP are implemented through ICC and the staff sees improved patient outcomes, a feedback loop will occur, leading to even greater staff acceptance of the new practices.

Study design

The study is designed to test the combined effect of both an organizational readiness intervention (which includes a 1-year organizational preparation period and an 8-month pilot of the ICC condition study) and a service delivery intervention (see Figure 2). We examine the effects of the interventions on organizational readiness, service system, and patient outcomes, all of which are believed to be important in understanding the uptake of new practices [58]. To test the unique effects of the organizational readiness intervention on provider outcomes, we use a pre-post-intervention design and measure these outcomes at the beginning of the study and then again at the end of year 1. At the end of year 1, we implement an eight-month pilot test of ICC. During the pilot test, providers gain experience with the protocols, and the protocols are iteratively adapted and refined based on provider feedback. Because we hypothesize that readiness outcomes may continue to improve as providers gain experience with ICC and the three treatments, we continue to measure organizational readiness outcomes annually at years 2–5. Thus, changes in outcomes between year 1 and years 2–5 reflect the combined effect of both the organizational readiness intervention and ICC on provider outcomes. To test the effects of the interventions on service system and patient-level outcomes, we are conducting an RCT to compare the effects of ICC with SAU. Service-system outcomes are patient-centered collaborative care, utilization of SUD treatment, patient utilization of health care services, provider adoption of EBP, and sustainability of EBP. Patient-level outcomes include substance use, consequences of use, physical and mental health functioning, and patient satisfaction with SUD care.

Figure 2
figure 2

SUMMIT study design and timeline.

For the RCT, all patients are screened for drug and alcohol use by clinic staff as part of usual care; eligible consenting patients (i.e., those with risky use or worse) are referred for further eligibility screening by the research staff, and eligible patients (N = 400) are invited to participate in the study. After consenting and completing the baseline interview at one of the study sites, patients are randomized to the ICC or SAU study condition. We use a concealed randomization protocol so neither patient nor research staff is aware of the randomization until after the baseline interview is completed when research staff open sequentially numbered envelopes that contain the randomization assignment. Assignments were made in advance by a statistician using R software. Patients complete a follow-up interview by telephone 6 months after the baseline interview.

The design is a variation of a “hybrid type 2” study, which Curran et al. [59] describe as the “simultaneous testing of a clinical intervention and an implementation intervention/strategy.” In this case, the organizational readiness intervention is the implementation intervention/strategy and the ICC service delivery intervention is the clinical intervention. The design, which incorporates implementation outcomes such as intention to adopt EBP as well as service system and patient outcomes, follows the recommendations for implementation research outcomes suggested by Proctor et al. [58].

Study participants

Organizational readiness intervention

Organizational readiness intervention participants are full-time clinic administrators, medical and mental health providers, and other clinic staff, including medical assistants, discharge coordinators, and front desk and security staff who agree to participate in interviews, focus groups and/or surveys (N = 70).

Service delivery intervention

Service delivery intervention participants are full-time medical and mental health providers (not including residents) as well as patients who come to the clinic for a medical visit; the participants initially screen positive for risky (or worse) alcohol or opioid use using an adapted NIDA Quick Screen [60] and then meet all study eligibility criteria and consent to participate in the study (N = 400). To be eligible for the study, patients must be 18 years or older; meet the “Diagnostic and Statistical Manual of Mental Disorders, fourth edition (DSM IV)” criteria for abuse of or dependence on alcohol or opioids (heroin or prescription opioids) (assessed using the WHO ASSIST [61]); must not have marked functional impairment from bipolar disorder or schizophrenia; speak English or Spanish; and are not currently in treatment for SUD.

Interventions

Organizational readiness intervention

To create organizational readiness to provide evidence-based treatment for OAUD, we employ multiple tools and activities known to facilitate adoption of EBP as follows: (1) engaging (and obtaining buy-in from) key administrators through regular administrator and board briefings about the proposed study and how to best prepare the organization to implement the ICC intervention and providers to adopt the EBP [29,62]; (2) convening an implementation team that includes key clinical leadership to develop the ICC service delivery intervention and EBP protocols that fit the clinic [29,63]; (3) selecting and training physician and therapist champions to serve as role models for adopting the EBPs [29]; (4) providing trainings for the staff and providers on the ICC intervention and evidence-based treatment for opioid and alcohol use disorders [64,65]; and (5) preparing the clinic environment to identify patients with SUD by instituting universal screening and brief intervention procedures. After preparing the organization, we then conduct the final part of the organizational readiness intervention—piloting the EBP and ICC protocols and making iterative adaptations using plan-do-study-act (PDSA) cycles [66,67]. PDSA cycles offer a structured approach to engaging staff in making iterative, feedback-based changes in service delivery [65,66].

Service delivery intervention

We use Wagner’s Chronic Care Model (CCM) [35] as the theoretical basis for the service delivery intervention (ICC). The ICC intervention is comprised of five components that have been shown to result in improved patient outcomes; each component supports the delivery of the planned care for opioid and alcohol use disorders: (1) redesigning the delivery system to support the delivery of the EBP and establishing a care coordinator; (2) modifying clinical information systems to provide alerts to indicate that patients have problematic substance use and developing a patient registry used by the care coordinators to monitor and track patients; (3) providing expert consultation to therapists for complex cases; (4) offering patients self-management tools; and (5) identifying and establishing linkages with community resources. These components are thought to lead to productive patient-provider interactions, which, in turn, lead to improved service system and patient outcomes. The ICC components are described in greater detail in Additional file 1.

Outcomes, procedures, measures, and analysis plan

Next we describe our data collection procedures, measures, and analysis plans for the organizational readiness and service delivery interventions.

Organizational readiness intervention

Procedures

We use qualitative and quantitative methods to study our organizational readiness outcomes as follows: 1) Provider focus groups and semi-structured interviews. We conduct focus groups with medical and mental health providers and one-on-one interviews with key administrators to inform the development of our intervention and EBP protocols and to understand perceptions of acceptability, appropriateness, feasibility, and intention to adopt the ICC and EBP protocols. For both the focus groups and the interviews, we follow a semi-structured protocol guide that asks “grand tour” questions related to each domain (i.e., general thoughts about ICC and the EBP), and includes specific probes for more detailed responses. 2) Provider Surveys. We also conduct surveys in years 1–5 with all the staff and providers to assess changes in organizational readiness outcomes throughout the study. The survey includes validated measures as well as “home-grown” items about specific activities, such as whether providers prescribed a medication and any barriers to doing so. Surveys are web-based, or, for providers with less access to email, through in-person, paper and pencil surveys.

Measures

We measure organizational readiness using outcomes for implementation research recommended by Proctor et al. (2011) [58]. We will evaluate the following outcomes specifically related to our organizational readiness intervention: (1) Acceptability. Acceptability refers to satisfaction among implementation stakeholders with the complexity of an EBP or new practice (such as the ICC intervention) and relative advantage over current practices [58]. To assess acceptability we adapted items for the staff survey from Moore and Benbasat’s [68] validated instrument which maps onto parallel elements of Roger’s elements of successful diffusion (i.e., complexity, relative ease of use) [69]. An example of these items is: Prescribing extended-release injectable naltrexone for patients with alcohol use disorders at this clinic would be relatively easy to do. We also include locally developed items in the survey to capture barriers to use as well as items from the National Center for Addiction and Substance Abuse’s (CASA) National Survey of Primary Care Physicians and Patients on Substance Abuse [70] that capture providers’ opinions about the effectiveness of OAUD EBP, as well whether providers find it difficult to discuss OAUD with their patients. We ask specific questions about acceptability in the focus groups and interviews, such as: How easy or difficult would it be for providers to prescribe and administer extended-release injectable naltrexone? What are some of the barriers? What changes would have to be made to make it more acceptable? (2) Appropriateness. This refers to the “perceived fit, relevance, or compatibility” [58] of the EBP and ICC intervention in the clinic. We have adapted items from Moore and Benbasat [68] that measure compatibility of EBP and the ICC intervention with the clinic and with current work style (also an element of Roger’s diffusion theory) [69]. This includes items such as: I think the ICC intervention will fit with the way I like to work. We also include items from the “Substance Abuse Attitudes Survey (SAAS)” to measure changes in provider attitudes about people with substance abuse disorders [71]. The focus groups and interviews also capture reasons why the EBP or ICC intervention may or may not be perceived as compatible with work style and with other approaches to managing patients with OAUD or introducing new practices into the clinic. (3) Intent to adopt the EBP. We assess intention to adopt EBP in several ways. First, we incorporate into the survey the EBP Attitude Scale (EBPAS). The EBPAS is a brief (15-item), valid, reliable measure that assesses general attitudes toward adoption of new clinical practices [72]. Next, we use items from Moore and Bensabet’s scale that measure elements associated with successful adoption of new EBP [68]. To measure intention or willingness to adopt, we use the “demonstrability” scale, which asks questions such as “I believe I can communicate to others the consequences of using extended release injectable naltrexone.” Finally, we ask questions in the focus groups and interviews about intent to adopt. (4) Feasibility. Feasibility is the actual fit, utility, and suitability of a program within an organization: the practicability [58]. We assess feasibility retrospectively by asking participants in focus groups and interviews whether the EBP and ICC intervention were successfully implemented and whether poor resources, training, or other barriers impeded use. We also ask about feasibility in the provider survey using items from CASA’s National Survey of Primary Care Physicians and Patients on Substance Abuse that capture how prepared providers feel they are to treat patients with SUD [70]. (5) Adapted EBP and intervention protocols. Our final measure of readiness is finalized, adapted protocols for each of the three EBP and the ICC service delivery intervention, which describe how the EBP fit into the clinic workflow. Adapted, finalized protocols are key to ensuring that staff can visualize how the EBP and ICC intervention will be implemented.

Analysis plan

The semi-structured interview and focus group data will be analyzed to identify key facilitators and barriers to implementation using classic content analyses. Our quantitative analysis of survey items will consist of pre-post, one-way repeated measures ANOVA comparisons of survey responses between pre- and all post-intervention periods.

Service delivery intervention

To examine the effect of our service delivery intervention, we examine service system and patient functioning outcomes.

Procedures

We use a combination of administrative records, patient interviews and staff surveys to evaluate service system and patient outcomes, as follows: 1) Administrative records. We collect three administrative files every 6 months—appointments (all appointments scheduled whether or not they were kept), encounters (including medical and therapy visit reasons and diagnoses), and medication orders. 2) Patient interviews. The patient interview contains an assessment of SUD diagnoses, substance use frequency and quantity, consequences related to use, and health and mental health functioning items. We administer patient interviews at baseline and 6 months after enrollment. 3) Staff surveys. Staff surveys are described above.

Service system measures

We are analyzing five service system outcomes: (1) Patient-centered, collaborative SUD care. We measure patient experiences using a locally developed measure based on the validated Patient Assessment of Chronic Illness Care (PACIC) [73]. Provider perceptions of collaborative SUD care are measured using the Assessment of Chronic Illness Care (ACIC) [74]. (2) Patient utilization of SUD services. This refers to patient linkage to and usage of appropriate treatment. We measure this by examining clinic administrative records that capture all patient encounter dates, types and providers, and by patient self-report of clinic services on the follow-up survey. (3) Patient utilization of health care services. This refers to utilization of emergency department and health care services. We measure this by examining clinic administrative records of clinic health care visits and by patient self-report of emergency department visits. (4) Provider adoption of EBP. This is a measure of provider use of the EBP (either of the medications or the brief therapy). Although adoption is sometimes thought of as an implementation (or readiness) outcome, we include it with service system outcomes because we believe that both interventions—organizational readiness and service delivery—are needed for adoption of EBP. We measure adoption by examining administrative records for prescription of either medication or use of the therapy and by asking providers to self-report use of the EBP in the survey. (5) Sustainability of EBP. This is the extent to which the three EBP are still being utilized during year 5 of the study. Following the end of patient enrollment in the RCT, we will continue to monitor clinic practices to examine whether the EBPs are still being utilized following the end of the RCT.

Patient outcomes

We are examining four primary patient outcomes. Patient outcomes are: (1) Changes in quantity and frequency of substance use. We measure this using the Timeline Follow-Back (TFLB), a validated instrument that uses a calendar to facilitate recall of substance use over the past 30 days [75]. (2) Consequences of substance use. To assess consequences, we use the Shortened Inventory of Problems Alcohol and Drugs (SIP-AD), a validated instrument that assesses consequences related to substance use in the past 90 days [76]. (3) Functioning. We assess overall health functioning with the SF12 version 2, four-week recall [77]. We use the Patient Health Questionnaire-9 (PHQ-9) [78] to assess depressive symptoms and the generalized anxiety disorder (GAD) [79] to assess symptoms of anxiety. (4) Satisfaction with SUD care. We use an adapted standardized patient satisfaction survey [80] to assess patient satisfaction with SUD services at the clinic.

Analysis plan

Our quantitative analysis of provider survey items and administrative data related to service system outcomes will consist of pre-post, one-way repeated measures ANOVA comparisons of survey responses between pre- and all post-intervention periods. To analyze patient-level outcomes, we use an intent-to-treat approach. We will first conduct a bivariate analysis to estimate the uncontrolled association between being in the ICC group and outcome. In addition, even though our design randomly assigns patients, we will assess any possible imbalance in covariates between ICC and SAU groups including age, gender, race/ethnicity, and education that affect the impact of the ICC intervention on the outcomes. In cases where observed imbalances are attributable to sample attrition, we will correct for potential bias due to attrition at follow-up using response weights. In addition, characteristics related to an outcome at a conservative significance level of α = 0.2 will be considered covariates in a multivariate analysis for reduction of bias if imbalanced or for efficiency gains. For the multivariate analyses, we will infer about the impact of ICC on an outcome by fitting hierarchical models using SAS Proc Mixed, R LME4, and Winbugs. These models take into account the multi-level structure of the data: two repeated measures over time (baseline and 6 months) nested within patient and patients nested within clinics. Sensitivity analyses will be conducted testing model functional forms, the covariates to be used, and the impact of influential outliers in the analyses results. For outcomes assessed only at month 6 (e.g., treatment satisfaction), we will use cross-sectional analyses (such as linear and logistic regression) to estimate the effect of ICC relative to SAU. This study was designed to estimate sufficient effect sizes that can be detected with a power of at least 80% when comparing the outcomes of patients randomly assigned to the two conditions in an end-status analysis at month 6 for a 5% significance level. For continuous outcomes, the study will be able to detect effect sizes of about 0.30–0.32 standard deviations. These are the kind of effects that can be expected for an intervention like ICC [42]. For dichotomous outcomes, we will be able to detect a difference of 13–14 percentage points under the assumption that the SAU group has a 15% rate of receiving the outcome.

Trial status

The RCT is currently in month 11 of 18 planned months of active enrollment and data collection.

Discussion

The present study responds to several critical gaps in health care services for people with SUD—the need for greater access to SUD treatment, the need for more evidence to support the growing emphasis on collaborative, integrated care for SUD in primary care settings, and the call for broader dissemination and adoption of evidence-based treatments for SUD in general and in medical settings in particular. To meet these diverse and complex needs, we designed a multi-level study that (1) combines well-studied implementation tools into an intervention to increase organizational readiness to adopt and sustain SUD EBPs in primary care and (2) tests the effectiveness of a service delivery intervention (ICC) on service system and patient outcomes related to SUD services.

Our hybrid type 2 design [59] allows us to support and study important organizational changes thought to be critical for the adoption and sustainability of new practices and to add what we believe is a necessary component of integrating SUD EBP into primary care—a service delivery intervention tailored to meet clinic specifications and the complex needs of patients with SUD treated in these settings. The study’s unique design takes into account the complexity of introducing new EBPs into a clinical setting, the barriers to integrating SUD EBP into primary care, and the chronic nature of SUD and the corresponding complex needs of SUD patients. We believe that our 18-month organizational readiness phase, starting with preparing the organization for SUD EBP delivery and ending with a pilot phase to ensure that the ICC intervention (i.e., service delivery system intervention) and EBP protocols fit the environment will ensure greater organizational readiness and thus greater likelihood of adoption and sustainability. We believe our multi-level approach—addressing organizational change plus SUD-specific service delivery—is necessary for adoption and sustainability of SUD EBP in primary care. The organizational readiness outcomes will allow us to assess whether our organizational readiness intervention improves provider perceptions of and intention to adopt the EBP while the service delivery intervention will help determine whether the ICC delivery system improves quality of care and patient outcomes compared to service delivery as usual.

Despite the study’s strengths, there are some limitations. One limitation is the lack of provider randomization to test the effects of ICC on provider outcomes. This was determined to be infeasible, due to potential contamination across study conditions and lack of provider and patient support for asking patients to switch providers to match their study condition. Additionally, because we are testing the combined impact of the organizational readiness intervention with the ICC intervention, we will not be able to draw conclusions about the unique contribution of either intervention on EBP implementation, sustainability, or patient outcomes. Moreover, both the organizational readiness and the ICC interventions are complex, containing multiple elements. We will be unable to tease apart the impact of particular elements of the interventions (e.g., the effect of the decision support system from the self-management support) on outcomes. Given the emphasis on examining two complex interventions simultaneously, we elected to examine them initially in one FQHC serving a diverse population in a large metropolitan area in California. It is important to note that this occurred during a time of rapid health care reform especially in California, a state that was an early adopter of Medicaid expansion. We will not know whether our study results will be applicable to other FQHCs or in other geographical locations.

References

  1. U.S. Department of Health and Human Services. Results from the 2013 national survey on drug use and health: summary of national findings, NSDUH Series H-46, HHS Publication No. (SMA) 14–4863. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2014.

  2. Yoon YH, Yi HY. Surveillance report #93: liver cirrhosis mortality in the United States, 1970–2009. National Institute on Alcohol Abuse and Alcoholism: Bethesda, MD; 2012.

    Google Scholar 

  3. Mokdad AH, Marks JS, Stroup DF, Gerberding JL. Actual causes of death in the United States, 2000. JAMA. 2004;291(10):1238–45. doi:10.1001/jama.291.10.1238.

    PubMed  Google Scholar 

  4. National Drug Intelligence Center. The economic impact of illicit drug use on American society. Washington D.C: United States Department of Justice; 2011.

    Google Scholar 

  5. Centers for Disease Control and Prevention. Excessive drinking costs U.S. $223.5 billion. In: CDC features. Atlanta: National Center for Chronic Disease Prevention and Health Promotion, Division of Adult and Community Health; 2014. http://www.cdc.gov/features/alcoholconsumption/. Accessed June 12 2014.

  6. Bouchery EE, Harwood HJ, Sacks JJ, Simon CJ, Brewer RD. Economic costs of excessive alcohol consumption in the U.S., 2006. Am J Prev Med. 2011;41(5):516–24.

    PubMed  Google Scholar 

  7. U.S. Department of Health and Human Services. Results from the 2012 national survey on drug use and health: summary of national findings, NSDUH Series H-46, HHS Publication No. (SMA) 13–4795. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2013.

    Google Scholar 

  8. Pilowsky DJ, Wu LT. Screening for alcohol and drug use disorders among adults in primary care: a review. Subst Abuse Rehabil. 2012;3(1):25–34. doi:10.2147/SAR.S30057.

    PubMed  PubMed Central  Google Scholar 

  9. Cherpitel CJ, Ye Y. Trends in alcohol- and drug-related emergency department and primary care visits: data from four U.S. national surveys (1995–2010). J Stud Alcohol Drugs. 2012;73(3):454–8.

    PubMed  PubMed Central  Google Scholar 

  10. Blackwell D, Lucas J, Clarke T. Summary health statistics for U.S. adults: national health interview survey, 2012. In: Vital Health Stat National Center for Health Statistics, editor. 2014

  11. Parthasarathy S, Mertens J, Moore C, Weisner C. Utilization and cost impact of integrating substance abuse treatment and primary care. Med Care. 2003;41(3):357–67.

    PubMed  Google Scholar 

  12. Drainoni ML, Farrell C, Sorensen-Alawad A, Palmisano JN, Chaisson C, Walley AY. Patient perspectives of an integrated program of medical care and substance use treatment. Aids Patient Care STDS. 2014;28(2):71–81. doi:10.1089/apc.2013.0179.

    PubMed  PubMed Central  Google Scholar 

  13. U.S. Department of Health and Human Services. Treatment Improvement Protocol (TIP) 49: incorporating alcohol pharmacotherapies into medical practice, HHS Publication No SMA13-4380. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2009.

    Google Scholar 

  14. U.S. Department of Health and Human Services. Technical Assistance Publication (TAP) 30: buprenorphine: a guide for nurses, HHS Publication No SMA09-4376. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2009.

    Google Scholar 

  15. Fudala PJ, Bridge TP, Herbert S, Williford WO, Chiang CN, Jones K, et al. Office-based treatment of opiate addiction with a sublingual-tablet formulation of buprenorphine and naloxone. N Engl J Med. 2003;349(10):949–58. doi:10.1056/NEJMoa022164.

    CAS  PubMed  Google Scholar 

  16. O’Malley SS, Froehlich JC. Advances in the use of naltrexone: an integration of preclinical and clinical findings. Recent Dev Alcohol. 2003;16:217–45.

    PubMed  Google Scholar 

  17. Substance Abuse and Mental Health Services Administration. Motivational enhancement therapy. In: SAMSHA’s National Registry of Evidence-Based Programs and Practices. 2007. http://www.nrepp.samhsa.gov/ViewIntervention.aspx?id=347. Accessed September 14 2011.

  18. Ball SA, Martino S, Nich C, Frankforter TL, Van Horn D, Crits-Christoph P, et al. Site matters: multisite randomized trial of motivational enhancement therapy in community drug abuse clinics. J Consult Clin Psychol. 2007;75(4):556–67. doi:10.1037/0022-006X.75.4.556.

    PubMed  PubMed Central  Google Scholar 

  19. Miller WR, Benefield RG, Tonigan JS. Enhancing motivation for change in problem drinking: a controlled comparison of two therapist styles. J Consult Clin Psychol. 1993;61(3):455–61.

    CAS  PubMed  Google Scholar 

  20. Boldt R. Obstacles to the development and use of pharmacotherapies for addiction. J Health Care Law Pol. 2010;13:1–6.

    Google Scholar 

  21. Buck JA. The looming expansion and transformation of public substance abuse treatment under the affordable care act. Health Aff (Millwood). 2011;30(8):1402–10. doi:10.1377/hlthaff.2011.0480.

    Google Scholar 

  22. Aspy C, Mold J, Thompson D, Blondel R, Lander P, Reilly K, et al. Integrating screening and interventions for unhealthy behaviors into primary care practices. Am J Prev Med. 2008;35(Suppl):S373–80.

    PubMed  Google Scholar 

  23. Bradley KA, Williams EC, Achtmeyer CE, Volpp B, Collins BJ, Kivlahan DR. Implementation of evidence-based alcohol screening in the Veterans Health Administration. Am J Manag Care. 2006;12(10):597–606.

    PubMed  Google Scholar 

  24. Friedmann P, McCullough D, Chin M, Saitz R. Screening and intervention for alcohol problems: a national survey of primary care physicians and psychiatrists. J Gen Intern Med. 2000;15:84–91.

    CAS  PubMed  PubMed Central  Google Scholar 

  25. Urada D, Teruya C, Gelberg L, Rawson R. Integration of substance use disorder services with primary care: health center surveys and qualitative interviews. Subst Abuse Treat Prev Policy. 2014;9:15. doi:10.1186/1747-597X-9-15.

    PubMed  PubMed Central  Google Scholar 

  26. Quest TL, Merrill JO, Roll J, Saxon AJ, Rosenblatt RA. Buprenorphine therapy for opioid addiction in rural Washington: the experience of the early adopters. J Opioid Manag. 2012;8(1):29–38.

    PubMed  PubMed Central  Google Scholar 

  27. Gueorguieva R, Wu R, Donovan D, Rounsaville BJ, Couper D, Krystal JH, et al. Naltrexone and combined behavioral intervention effects on trajectories of drinking in the COMBINE study. Drug Alcohol Depend. 2009;107(2–3):221–9. doi:10.1016/j.drugalcdep.2009.10.017.

    PubMed  PubMed Central  Google Scholar 

  28. West SL, Garbutt JC, Carey TS, Lux LJ, Jackman AM, Tolleson-Rinehart S, et al. Pharmacotherapy for alcohol dependence. Evid Rep Technol Assess (Summ). 1999;3:1–5.

    PubMed  Google Scholar 

  29. Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature. University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231); 2005.

  30. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. doi:10.1186/1748-5908-4-50.

    PubMed  PubMed Central  Google Scholar 

  31. Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2011;69(2):123–57. doi:10.1177/1077558711430690.

    PubMed  PubMed Central  Google Scholar 

  32. Weiner BJ, Amick H, Lee SY. Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008;65(4):379–436. doi:10.1177/1077558708317802.

    PubMed  Google Scholar 

  33. Weiner BJ, Lewis MA, Linnan LA. Using organization theory to understand the determinants of effective implementation of worksite health promotion programs. Health Educ Res. 2009;24(2):292–305. doi:10.1093/her/cyn019.

    PubMed  Google Scholar 

  34. Wagner EH, Glasgow RE, Davis C, Bonomi AE, Provost L, McCulloch D, et al. Quality improvement in chronic illness care: a collaborative approach. Jt Comm J Qual Improv. 2001;27(2):63–80.

    CAS  PubMed  Google Scholar 

  35. Wagner EH, Austin BT, Davis C, Hindmarsh M, Schaefer J, Bonomi A. Improving chronic illness care: translating evidence into action. Health Aff (Millwood). 2001;20(6):64–78.

    CAS  Google Scholar 

  36. Unutzer J, Katon W, Callahan CM, Williams Jr JW, Hunkeler E, Harpole L, et al. Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial. JAMA. 2002;288(22):2836–45.

    PubMed  Google Scholar 

  37. Katon W, Unutzer J, Wells EA, Jones L. Collaborative depression care: history, evolution and ways to enhance dissemination and sustainability. Gen Hosp Psychiatry. 2010;32:456–64.

    PubMed  Google Scholar 

  38. Unutzer J, Katon WJ, Fan MY, Schoenbaum MC, Lin EH, Della Penna RD, et al. Long-term cost effects of collaborative care for late-life depression. Am J Manag Care. 2008;14(2):95–100.

    PubMed  PubMed Central  Google Scholar 

  39. McGregor M, Lin EH, Katon WJ. TEAMcare: an integrated multicondition collaborative care program for chronic illnesses and depression. J Ambul Care Manage. 2011;34(2):152–62. doi:10.1097/JAC.0b013e31820ef6a4.

    PubMed  PubMed Central  Google Scholar 

  40. Katon WJ. Collaborative care: evidence-based models that improve primary care depressive outcomes. CNS Spectr. 2009;14(12 Suppl 14):10–3.

    PubMed  Google Scholar 

  41. Ell K, Katon W, Xie B, Lee PJ, Kapetanovic S, Guterman J, et al. One-year postcollaborative depression care trial outcomes among predominantly Hispanic diabetes safety net patients. Gen Hosp Psychiatry. 2011;33(5):436–42. doi:10.1016/j.genhosppsych.2011.05.018.

    PubMed  PubMed Central  Google Scholar 

  42. Katon W, Guico-Pabia CJ. Improving quality of depression care using organized systems of care: a review of the literature. Prim Care Companion CNS Disord. 2011;13(1). doi:10.4088/PCC.10r01019blu.

  43. Blasinsky M, Goldman HH, Unutzer J. Project IMPACT: a report on barriers and facilitators to sustainability. Adm Policy Ment Health. 2006;33(6):718–29. doi:10.1007/s10488-006-0086-7.

    PubMed  Google Scholar 

  44. Schackman BR, Leff JA, Polsky D, Moore BA, Fiellin DA. Cost-effectiveness of long-term outpatient buprenorphine-naloxone treatment for opioid dependence in primary care. J Gen Intern Med. 2012;27(6):669–76. doi:10.1007/s11606-011-1962-8.

    PubMed  PubMed Central  Google Scholar 

  45. Myles J, FL, Raybould T. A double-blind randomised controlled trial of buprenorphine/naloxone (suboxone) versus methadone/lofexidine for the detoxification of opiate-dependent addicts. Drug Alcohol Depend. 2000;60 Suppl 1:S156.

  46. Tofighi B, Grossman E, Williams AR, Biary R, Rotrosen J, Lee JD. Outcomes among buprenorphine-naloxone primary care patients after Hurricane Sandy. Addict Sci Clin Pract. 2014;9:3. doi:10.1186/1940-0640-9-3.

    PubMed  PubMed Central  Google Scholar 

  47. Mauger S, Fraser R, Gill K. Utilizing buprenorphine-naloxone to treat illicit and prescription-opioid dependence. Neuropsychiatr Dis Treat. 2014;10:587–98. doi:10.2147/NDT.S39692.

    CAS  PubMed  PubMed Central  Google Scholar 

  48. Doolittle B, Becker W. A case series of buprenorphine/naloxone treatment in a primary care practice. Subst Abus. 2011;32(4):262–5. doi:10.1080/08897077.2011.599256.

    PubMed  Google Scholar 

  49. Balhara YP. Time to include buprenorphine-naloxone combination in the WHO model list of essential medicines. J Opioid Manag. 2014;9(4):237.

    Google Scholar 

  50. Lee JD, Grossman E, Huben L, Manseau M, McNeely J, Rotrosen J, et al. Extended-release naltrexone plus medical management alcohol treatment in primary care: findings at 15 months. J Subst Abuse Treat. 2012;43(4):458–62.

    PubMed  Google Scholar 

  51. Garbutt JC, Kranzler HR, O’Malley SS, Gastfriend DR, Pettinati HM, Silverman BL. Efficacy and tolerability of long-acting injectable naltrexone for alcohol dependence: a randomized controlled trial. JAMA. 2005;293(13):1617–25.

    CAS  PubMed  Google Scholar 

  52. Kranzler H, Wesson D, Billot L. Drug abuse sciences: naltrexone depot study group. Naltrexone depot for treatment of alcohol dependence: a multicenter, randomized, placebo-controlled clinical trial. Alcohol Clin Exp Res. 2004;28:1051–9.

    CAS  PubMed  Google Scholar 

  53. Krupitsky E, Nunes EV, Ling W, Gastfriend DR, Memisoglu A, Silverman BL. Injectable extended-release naltrexone (XR-NTX) for opioid dependence: long-term safety and effectiveness. Addiction. 2013;108(9):1628–37.

    PubMed  Google Scholar 

  54. Hartung DM, McCarty D, Fu R, Wiest K, Chalk M, Gastfriend DR. Extended-release naltrexone for alcohol and opioid dependence: a meta-analysis of healthcare utilization studies. J Subst Abuse Treat. 2014;47(2):113–21.

    PubMed  PubMed Central  Google Scholar 

  55. Miller WR, Sanchez VC. Motivation of young adults for treatment and lifestyle change. In: Howard G, editor. Issues in alcohol use and misuse by young adults. Notre Dame, IN: University of Notre Dame Press; 1994. p. 55–82.

    Google Scholar 

  56. Miller WR, Zweben A, DiClemente CC, Rychtarik RG. Motivational enhancement therapy: a clinical research guide for therapists treating individuals with alcohol abuse and dependence. Rockville, MD: National Institutes of Health; 1994. Report No.: NIH Publication No. 94–3723.

    Google Scholar 

  57. U.S. Department of Health and Human Services Health Resources and Services Administration. The Affordable Care Act and Health Centers. 2013. http://bphc.hrsa.gov/about/healthcenterfactsheet.pdf. Accessed January 22 2015.

  58. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76. doi:10.1007/s10488-010-0319-7.

    PubMed  Google Scholar 

  59. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26. doi:10.1097/MLR.0b013e3182408812.

    PubMed  PubMed Central  Google Scholar 

  60. Smith PC, Schmidt SM, Allensworth-Davies D, Saitz R. A single-question screening test for drug use in primary care. Arch Intern Med. 2010;170(13):1155–60.

    PubMed  PubMed Central  Google Scholar 

  61. WHO ASSIST Working Group. The Alcohol, Smoking and Substance Involvement Screening Test (ASSIST): development, reliability and feasibility. Addiction. 2002;97(9):1183–94.

    Google Scholar 

  62. Rodgers R, Hunter J, Rogers D. Influence of top management commitment on management program success. J Appl Psychol. 1993;78:151–5.

    Google Scholar 

  63. Kraft JM, Mezoff JS, Sogolow ED, Neumann MS, Thomas PA. A technology transfer model for effective HIV/AIDS interventions: science and practice. AIDS Educ Prev. 2000;12(5 Suppl):7–20.

    CAS  PubMed  Google Scholar 

  64. Beidas R, Kendall P. Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clin Psychol. 2010;17:1–30.

    Google Scholar 

  65. Hunter S, Chinman M, Ebener P, Imm P, Wandersman A, Ryan G. Technical assistance as a prevention capacity-building tool: a demonstration using the getting to outcomes framework. Health Educ Behav. 2009;36:810–28.

    PubMed  Google Scholar 

  66. Deming W. Out of the crisis, 1986. Cambridge, MA: Massachusetts Institute of Technology Center for Advanced Engineering Study iii; 1991.

    Google Scholar 

  67. Berwick DM. Developing and testing changes in delivery of care. Ann Intern Med. 1998;128(8):651–6.

    CAS  PubMed  Google Scholar 

  68. Moore G, Benbasat I. Development of an instrument to measure the perceptions of adopting an information technology innovation. Inform Syst Res. 1991;2(3):192–222.

    Google Scholar 

  69. Rogers E. Diffusion of innovations. 4th ed. New York: The Free Press; 1995.

    Google Scholar 

  70. The National Center on Addiction and Substance Abuse (CASA). Missed opportunity: survey of primary care providers and patients on substance abuse. Columbia University; 2000.

  71. Chappel JN, Veach TL, Krug RS. The substance abuse attitude survey: an instrument for measuring attitudes. J Stud Alcohol Drugs. 1985;46(1):48–52.

  72. Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the evidence-based practice attitude scale (EBPAS). Ment Health Serv Res. 2004;6(2):61–74.

    PubMed  PubMed Central  Google Scholar 

  73. Glasgow RE, Wagner EH, Schaefer J, Mahoney LD, Reid RJ, Greene SM. Development and validation of the patient assessment of chronic illness care (PACIC). Med Care. 2005;43(5):436–44.

    PubMed  Google Scholar 

  74. Bonomi AE, Wagner EH, Glasgow RE, VonKorff M. Assessment of chronic illness care (ACIC): a practical tool to measure quality improvement. Health Serv Res. 2002;37(3):791–820. doi:10.1111/1475-6773.00049.

    PubMed  PubMed Central  Google Scholar 

  75. Sobell LC, Maisto SA, Sobell MB, Cooper AM. Reliability of alcohol abusers’ self-reports of drinking behavior. Behav Res Ther. 1979;17:157–60.

    CAS  PubMed  Google Scholar 

  76. Gillespie W, Holt JL, Blackwell RL. Measuring outcomes of alcohol, marijuana, and cocaine use among college students: a preliminary test of the shortened inventory of problems–alcohol and drugs (SIP-AD). J Drug Issues. 2007;37:549–68.

    Google Scholar 

  77. Ware Jr J, Kosinski M, Turner-Bowker D, Gandek B. How to score version 2 of the SF-12® health survey (with a supplement documenting version 1). Lincoln, RI: Quality Metric Incorporated; 2002.

    Google Scholar 

  78. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.

    CAS  PubMed  PubMed Central  Google Scholar 

  79. Spitzer R, Kroenke K, Williams J, Lowe B. A brief measure for assessing generalized anxiety disorder. Arch Inern Med. 2006;166:1092–7.

    Google Scholar 

  80. Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD. Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann. 1979;2(3):197–207.

    CAS  PubMed  Google Scholar 

Download references

Acknowledgements

We acknowledge all providers and staff at the Venice Family Clinic for their contributions to and participation in the study. We thank the SUMMIT team, including Kirsten Becker and the RAND Survey Research Group, Keith Heinzerling, Karen Osilla, David Devries, Scot Hickey, Brett Ewing, and Tiffany Hruby for their contributions to carrying out the study. We also acknowledge the SUMMIT Scientific Advisory Board for their input on the study design and protocols: Frank de Gruy, Adam J. Gordon, Miriam Komaromy, Tom McLellan, Harold Pincus, Rick Rawson, Richard Saitz, and Jurgen Unutzer. We acknowledge the National Institute on Drug Abuse (NIDA) for funding the study under 1R01DA034266 and Alkermes for providing the XR-NTX (Vivitrol®).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Allison J Ober.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

AJO contributed to the design and implementation of the study and drafted the manuscript. KW contributed to the design and implementation of the study and provided substantial input on the manuscript. SH contributed to the design of the study and provided substantial input on the manuscript. KL contributed to the design and implementation of the study and carried out the service delivery intervention. ML contributed to the design and implementation of the study and carried out the service delivery intervention, CMS contributed to the evaluation and analytic plan and provided input in the manuscript. All authors read and approved the final manuscript.

Allison J Ober, and Katherine E Watkins contributed equally to this work.

Additional file

Additional file 1:

Integrated collaborative care intervention (ICC). This file contains a detailed description of the elements of the ICC intervention.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ober, A.J., Watkins, K.E., Hunter, S.B. et al. An organizational readiness intervention and randomized controlled trial to test strategies for implementing substance use disorder treatment into primary care: SUMMIT study protocol. Implementation Sci 10, 66 (2015). https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-015-0256-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-015-0256-7

Keywords