Despite this limitation, we identified substantial convergence and consistency of reported barriers and facilitators across studies, providing some evidence of saturation. The severity of social problems, which is driven by contextual instability and inequality, directly affected the prevalence of mental disorders. These sociopolitical and contextual adversities were exacerbated by social stigma, which reduced demand for services. As specified in our study objective a priori, we added the primary patient outcome—the prevalence of mental disorders—to our theoretical framework. The types of review article varied across studies and were described as critical reviews, desk reviews, literature and document reviews, narrative reviews, nonsystematic reviews, rapid appraisal reviews, review of government documents and guidelines, scoping reviews, and systematic reviews that sometimes included a meta-analysis. The elaborated causal loop diagram was then evaluated by study authors to determine whether the relationships were consistent with scientific knowledge and applied experience.
We acknowledge that our conceptual definition of mental models is not an operational definition that could be used to select concrete forms of representation, elicitation, and analysis, but rather a starting point for understanding and entry into its use in implementation science. We argue these mental models deserve attention, much like the attention that has been given to identifying challenges, such as having enough resources (money, time, people) to get an intervention to happen, or lack of knowledge or training. These models and frameworks consider categories of where implementation challenges may be found, such as in the intervention itself, the internal setting and/or infrastructure, or the change strategies. We review the concepts of mental models and illustrate how they pertain to implementation of an example intervention, shared decision making.
- We hope the results will facilitate novel, rigorous, and replicable implementation research in areas of high need.
- In decentralized systems like the USA, this type of intervention is aligned with the specialized mental health supervision model, which has emerged as a promising practice for supervising people with mental illnesses.
- The direction of the arrows in the causal loop diagram indicates the directionality of the association between determinants or outcomes as described in the included studies.
- Finding an evidence-based practice or an intervention with good evidential rigor is essential; however, it is of limited practical consequence if that intervention has shown little efficacy in settings outside the one in which it was tested.
Prevalence of mental disorders and the supply of, and demand for, mental health services
The authors suggest that such “a mapping review will inform policy implementation and evaluation in the WHO European Region” (p. 3) of the World Health Organisation (WHO) Global and European Mental Health Action Plans in 2013 since many countries introduced new national MHPPs. Such a consolidated methodology might result in a checklist that would mirror each objective of MHPPs and that would allow for various contexts to be taken into account as well as for experiences and lessons from implementation and evaluation to be shared. Efforts should be made to consolidate available methods and tools into clear methodologies that would address various stages and objectives of implementation taking into consideration a variety of possible policy goals. Due to the broad scope of this review, we were unable to compare tools across contexts and applications. There is a lack of information on the tools used in most studies included in our review, as such we were unable to assess the quality of evaluation methods. We recognise that our search strategy was not able to capture all relevant studies, particularly those that focused on the impact of policy implementation.
Implementation of a sensory modulation intervention in mental health outpatient services: a process evaluation study
Yet even complex studies have inherently limited sample size, so implementation research is typically beset by a “small n” problem. In the area of design, studying EBP implementation in even one service system or organization is conceptually and logistically ambitious, given multiple stakeholders and levels of influence. The measurement challenge for intervention processes and outcomes requires that measures developed for the conduct of efficacy trials must be adapted and tested for feasible and efficient use in ongoing service systems. Systematic studies of implementation require creative multi-level designs to address the challenges of sample size estimation; by definition, larger system levels carry sample sizes with lower potential power estimates than do individual level analyses. Informed by these three frameworks, we propose a heuristic model that posits nested levels, reflects prevailing quality improvement perspectives, and distinguishes but links key implementation processes and outcomes (Fig. 1).
Ten years of implementation outcomes research: a scoping review
Implementation Science is a multidisciplinary field that focuses on the systematic study of methods and strategies for promoting the uptake of research findings into practice. Ongoing evaluation and learning can https://www.nationalacademies.org/read/26809/chapter/5 help to improve implementation quality and intervention effectiveness, ultimately leading to better outcomes. Their measurement and empirical test can help specify the mechanisms and causal relationships within implementation processes and advance an evidence base around successful implementation. The science of implementation cannot be advanced without attention to implementation outcomes. Thus using implementation outcomes, the success of implementation may be modeled and tested, thereby making decisions about what to implement more explicit and transparent.
This implementation outcome mediated the relation between coaching dosage and increases in student outcomes of classroom engagement (Pianta et al., 2022). Consultation or coaching can be provided by someone internal or external to the school system, focused on the implementers who actually provide the EBP (Cappella et al., 2015). Despite this evidence, we notice educational meetings and onetime training to be the prevailing PD modality used in schools (Langreo, 2022; Wilkinson et al., 2020). There is a growing recognition that schools are a key setting to help address this unmet need (IES, 2023); at the same time, school systems and personnel are experiencing tremendous stress, disruption, and staff turnover (Steiner & Woo, 2021), which pose heightened implementation challenges. Given the rudimentary state of the field, we chose a narrative approach to reviewing the literature and constructing a taxonomy.
