U.S. flag

An official website of the United States government

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

Cover of Peer Support Programs for Youth Mental Health

Peer Support Programs for Youth Mental Health

Health Technology Assessment

CADTH Health Technology Review

Key Messages

  • We conducted a Health Technology Assessment (HTA) to inform decisions related to the adoption, implementation, and evaluation of peer support programs for youth mental health. This HTA consisted of consultations with youth advisors (peer support users and workers), a systematic review of the available evidence on the clinical effectiveness and safety of peer support interventions for youth with mental health concerns (compared with interventions without peer support), and an Environmental Scan of peer support program evaluations.
  • Youth recognize the value of peer support in their mental health recovery and wellness, and they view peer support as an accessible, convenient, and safe mental health resource. They also highlight the importance of representation and involvement of youth with diverse backgrounds and experiences across the design and evaluation of peer support programs to ensure equity, diversity, and inclusion.
  • In the Clinical Review, we found that formal peer support programs (i.e., trained peer support workers based at structured community- or health clinic–based organizations provide support to peer support users) might help a young person feel more comfortable to share information about their mental health issue and ask for help. The authors of 2 randomized controlled trials we identified found that compared to no peer support, peer support may improve youth’s attitudes toward disclosure of mental illness, distress related to that disclosure, and help-seeking behaviour. However, overall, only a small amount of low-quality evidence (due to risk of bias, inconsistency, indirectness, and imprecision) is available. Therefore, it is very uncertain whether peer support programs are more effective at supporting an individual in their recovery compared to programs without a peer support component. In addition, the safety of peer support programs is currently unknown (no research evidence was found).
  • Our Environmental Scan did not identify formal guidelines or best practices for evaluating peer support programs; however, we found some common evaluation approaches among programs. These approaches include focusing on recovery-oriented outcomes, involving youth throughout the evaluation (to ensure relevance), and tailoring the evaluation to reflect the local program context.
  • When considering implementation of peer support programs for youth mental health, decision-makers may wish to allocate resources for ongoing program evaluation. Strengthened program evaluations can improve the understanding of the benefits and maximize the effectiveness of peer support programs. In addition, practice-based evidence from the evaluation of peer support programs can be used to further support the design and implementation of appropriate, equitable, and culturally competent programs.

Summary

Context and Decision Problems

The mental health of youth living in Canada is a serious public health concern that worsened during the COVID-19 pandemic. Mental health decision-makers are considering adopting and implementing peer support programs as an option for improving access to mental health care for youth. Peer support is based on the recovery model and typically involves a relationship between a peer support worker who shares lived experience of mental health challenges with a peer support user. Peer support has the potential to increase youth’s access to mental health services in the form of youth peer support workers, who can support recovery, connect youth to additional mental health care services, and reduce the stigma around seeking mental health care because they also experienced mental health issues.3 The role of peer support and peer support workers can vary by program and be tailored to the specific needs of the community. As a result, there is a wide range of applications of peer support for youth mental health. For example, peer support can help youth navigate and access health care or provide tangible coping strategies to youth coping with feelings of depression .

Peer support is an intervention that could increase access to mental health support for youth; therefore, decision-makers want to know the clinical effectiveness and safety of formal peer support programs and their impact on the use of health care resources. Decision-makers have also expressed the need for and importance of considering equity into the design, implementation, and evaluation of peer support programs to ensure that these programs are accessible and relevant to youth who are disadvantaged. Policy and program decision-makers are interested in understanding how to best evaluate peer support programs to ensure that they meet funder and program objectives and the needs of youth.

To support decision-making about formal peer support programs for youth mental health, in this HTA we (referring to the CADTH review team):

  • assessed the clinical effectiveness and safety of formal peer support programs for youth mental health
  • identified and described existing and recommended methods for the evaluation of peer support programs for youth mental health (including completed evaluations conducted in Canada and internationally) and summarized findings of completed evaluations for formal peer support programs in Canada
  • engaged youth peer support workers and youth peer support service users to serve as advisors so the team could consider the research findings with an understanding of the wider experiences of those accessing and providing peer support.

Peer Support Youth Advisor Engagement

Four youth with lived experience of peer support were involved as peer support youth advisors to help the research team understand the context for the scientific evidence and the experiences of those accessing and providing peer support. The advisors shared their perspectives before the protocol was finalized, when preliminary evidence findings were available, and after the final report was completed. The feedback helped ensure that this HTA was relevant to peer support service users and peer support workers.

The advisors spoke about how recovery-based outcomes are especially important to youth and described recovery as an ongoing journey rather than a finite outcome. They shared that outcomes such as use of health care resources and clinical effectiveness are not as relevant to youth, but these can offer a measurable way to determine whether peer support is effective. The advisors also expressed that youth accessing peer support for mental health are concerned about self-stigma and public and community stigma.

The advisors encouraged diversity, inclusion, and representation in all aspects of peer support programs. To help achieve this, the advisors called for youth with lived experience to be involved in the creation of program evaluation strategies. Youth involvement can inform and improve programs and ensure that programs align with and reflect the needs and identities of their users.

Peer support youth advisors shared their knowledge and experiences with the CADTH team. From these discussions, the team was able to identify and consider outcomes of interest to youth involved in peer support programs. Moreover, it encouraged further reflection on considerations of equity and program inclusivity.

Clinical Effectiveness and Safety Evidence

We conducted a systematic review to assess the effectiveness and safety of peer support interventions compared with interventions without peer support among youth aged 12 to 25 years with mental health challenges (substance use was excluded). For the purpose of this review, we considered formal peer support to be support delivered by trained peer support workers with shared lived experience.

We conducted a systematic search of multiple electronic databases and the grey literature. We identified 3 publications, which reported results from 2 randomized controlled trials with a total of 216 participants. The outcomes in the included trials related to personal recovery and clinical symptoms. We did not identify any evidence on the safety of peer support interventions. The findings from these 3 publications suggest that peer support may be favoured over no peer support in some personal recovery outcomes (e.g., attitudes to disclosure, disclosure-related distress, secrecy, help-seeking behaviour), whereas evidence for the other outcomes show there may be little to no difference in the effect of peer support compared with interventions without peer support. However, the evidence for all outcomes was very uncertain because of high risk of bias in the studies, and serious concerns related to inconsistency, indirectness, and imprecision. Overall, the clinical evidence on the benefits of peer support programs compared with no peer support for the management of mental health concerns among youth is very uncertain, meaning it is not a reliable indication of how effective peer support programs are compared with interventions without peer support.

Environmental Scan of Program Evaluation Methods

An Environmental Scan was conducted to identify and describe program evaluation methods and guidelines in Canada and internationally and the findings of completed program evaluations in Canada. The scan was informed by a limited literature search and targeted stakeholder consultations, which included representatives from 7 organizations across Canada that offered peer support services for youth mental health. The findings showed that there is a lack of standardization and formal guidance for program evaluation of peer support programs which contributes to heterogeneity in evaluation approaches across programs. Yet, heterogeneity in program evaluation can be valuable as it allows to adapt practices to individual and program needs. Despite the lack of formal guidance or standardized methods, programs did share common principles and practices for program evaluations. These include practice-based evidence, a focus on evaluation that adheres to a recovery model of care, employing a co-design approach to evaluation so that youth are involved in the design and conduct of evaluation, and addressing the needs of the youth involved in the program through evaluation. Data collection methods varied across organization and program evaluations, but generally programs relied on the use of survey, interviews, focus groups and case studies to collect data. Program evaluation data were analyzed at various time points depending on the goal and aim of the program evaluation. The identified programs addressed equity in the program evaluations by ensuring youth safety, inclusiveness, and cultural competency for local communities. Program representatives also discussed challenges that are faced when balancing the needs of the program participants and the funder’s expectations for program evaluation.

Conclusions and Implications for Decision- or Policy-Making

The findings of this HTA highlight opportunities to build an evidence base for peer support programs for youth mental health., peer support is a promising option despite the limited evidence of the clinical effectiveness and safety of formal programs. Peer support is currently positioned to be an informal, flexible, and convenient intervention that can connect youth to additional mental health care, reduce the stigma around seeking care, and provide youth with coping skills and support for their mental health challenges. Formal programs with trained peer support workers who have access to ongoing debriefing and support mentorship may mitigate safety concerns for both peer support users and peer support workers (such as confidentiality and inappropriate boundaries) and ensure that the support offered is likely to aid in individual youth peer support users’ recovery. Evaluations of peer support programs can serve to assess the needs of the programs and of the youth engaged in the programs to help with quality improvement efforts and inform future programming. It is necessary to train and recruit youth who are diverse and youth who are disadvantaged for the programs to be inclusive to ensure fair and equitable access to peer support programs. Equity, in the context of peer support was described by the consulted organizations as being inclusive, safe, and prioritizing the needs of the diverse youth whom the program is designed to serve, and needs to be integrated into program design, recruitment, training and evaluation. Opportunities for engaging youth can advance equity, diversity, and inclusion initiatives.

Introduction

Introduction and Rationale

The mental health of youth living in Canada is a prominent public health concern. Even before the COVID-19 pandemic, youth aged 15 to 24 years were the least likely of all people living in Canada to report excellent or very good mental health.4 Compared with other high-income countries, Canada ranked 31 out of 38 countries on measures of well-being (feeling positive and being in good mental health) and 35 out of 38 countries on teen suicide rates, with Indigenous youth having the highest rates.5 The estimated proportion of youth reporting poor mental health has jumped to more than 60% in 2020 because of the COVID-19 pandemic.6 Youth who experience marginalization, including members of the 2SLGBTQ+ community, Indigenous youth, racialized youth, youth who are refugees and newcomers, young people with disability, and youth living in rural or remote areas are particularly vulnerable to mental health challenges,4,6 and have been disproportionately affected by the economic, social, and health consequences of the COVID-19 pandemic.6

According to a survey of 14,000 public school students by a research team based at the Centre for Addictions and Mental Health (CAMH) in Toronto, 1 in 3 youth surveyed said there was a time in the past year where they wanted to talk to someone about a mental health problem but did not know where to turn.7 It is estimated that less than 20% of children and youth who are affected by mental illness will receive appropriate treatment.8 Barriers to accessing mental health services are both social and structural.9 The fear of or experiences of stigma are a significant deterrent to seeking care, particularly for those who already experience marginalization.9 Mental health services themselves are often complex and difficult to navigate,2,6 with limited public (either publicly insured or publicly provided) services that typically have lengthy wait lists. Many other services are covered only by private insurance or out-of-pocket expenses.2 For those services now offered online or virtually due to the COVID-19 pandemic, limited internet or computer or smartphone access and the physical need for privacy are barriers affecting youth seeking virtual or remote care for their mental health.6 As a result of the limited availability of mental health services, youth have increasingly sought mental health care from emergency departments (EDs) and hospitals. Over a 10-year period between 2008–2009 and 2018–2019, there was a 61% increase in visits to EDs for mental health and a 60% increase in hospitalizations for children and youth in Canada aged 5 to 24 years.10 Those youth aged 15 to 17 years have the highest rates of visits to the ED and hospitalization for mental health disorders among children and youth.10 ED visits for mental health care are an established indicator of poor access to mental health services.10

As a result, many health care systems across Canada are planning or implementing wide-scale change or making system-level investments in mental health care for youth. These include new models of care (e.g., stepped care, integrated youth care, Youth Wellness Hubs) and an increase in funding to community-based and virtual mental health care to improve timely access to support for those youth seeking care.11 It is in these conversations around further investments in mental health for youth that decision-makers are considering adopting or implementing peer support programs.

Peer support programs provide a peer service user with support from a peer support worker. The basis of support is the relationship between peers which is founded on and draws from their shared lived experience. In the case of peer support for youth mental health, lived experience typically means the peer worker is a youth who is in a positive state of recovery from or supported someone in recovery from mental health challenges and has the skills and aptitude to provide peer support.3,12 Participation in peer support programs is usually voluntary and does not require a referral or formal diagnosis to receive care.

Peer support is based on a recovery model of mental health, which means that rather than seeking a cure or reduction of symptoms, the focus is on supporting an individual to recover a quality of life while striving to achieve their full potential.3 Some aspects of recovery include an individual’s ability to connect with their community, forge or maintain personal relationships, and the ability to feel hopeful about their future. A variety of theories underlie the mechanism of peer support in which the peer service user can learn from the information, modelled behaviour, or encouragement and empowerment provided from the peer support worker through their relationship.13 Peer support is also seen as a means of addressing or reducing stigma around mental health, specifically in youth who are described as being more open to seeking services and support from other youth as opposed to adults.3

Many of ethical and social considerations around peer support relate to the relationship between the peer support worker and the peer service user, with concerns about the privacy and confidentiality of the information shared by both peers and the boundaries between the peer service user and peer worker, meaning recognizing a potential or actual power imbalance and the need for professional relationships and the potential harms to the peer support worker or peer service user should inadequate training or supports be available to them.14 Further, peer support programs can potentially widen existing inequities in access to services and the burden of mental health if they are not inclusive, culturally safe, and provide fair and equitable access, and do not meet the needs of peer service users and peer workers from communities who experience marginalization or disadvantage.14

Peer support programs often explicitly intend to be inclusive and provide support to youth who are disadvantaged. There is broad acknowledgement that ensuring inclusivity requires, among other things, training, hiring, and supporting peer support workers who are themselves members of disadvantaged groups. This is because the peer user and peer worker need to share meaningful lived experience that includes that of being a youth who is socially disadvantaged with mental health challenges.3 Moreover, inclusive care is enhanced by involving youth who are disadvantaged as peer workers and services users to help inform and influence program and policy development.15,16 Stigma is a complex phenomenon that can exacerbate and be exacerbated by other forms of systematic discrimination17; therefore, peer support programs that are inclusive and support youth who are disadvantaged are necessary to meaningfully address the diverse forms of stigma experienced by youth with mental health challenges.

Peer support programs can range from informal to formal and from programs self-organized by peers to meet their own needs to highly structured programs that include training, paid peer support workers, and case management. Some programs start as self-organized, grassroots programs, but evolve over time into more formal programs delivered as part community non-governmental organizations and health care facilities.18 Peer support can be a stand-alone program or be integrated into a larger multi-component program and complement existing mental health services.18 The specific objectives of peer support and the role of the peer support worker can be tailored to meet local program aims and needs of the local youth; for example, it can assist youth to navigate and access health care or provide resources to support improved coping with academic pressures. Peer support programs have the potential to increase youth’s access to mental health services through youth peer support workers, who can support recovery and connect youth to additional mental health care services. Despite the interest in peer support programs as a means of providing mental health care for young people, the effectiveness of peer support programs for young people is not well-established.13 Moreover, there is a recognized need to use available information and evidence to support building programs that are inclusive and meet policy objectives (e.g., support transitions in care) and to design ongoing evaluations. Service and health care organizations face the challenge of making decisions on how to recruit, train, and maintain peer support workers, and ministry and regional funders want to ensure value on their investment into programs. CADTH undertook this HTA to provide evidence to support decision-making around formal peer support programs for youth mental health.

Context and Decision Problems

Decision Problems

Policy and program decision-makers across Canada designing and implementing services for youth mental health are considering the potential role of formal peer support programs. To inform potential decisions about the adoption and implementation of peer support programs for youth mental health, decision-makers have expressed the need to understand their clinical effectiveness and safety and the potential impact on the use of health care resources. Additionally, to meet the needs of youth in Canada it is recognized that peer support programs need to provide care that is inclusive, that is, meets the needs of all youth including those who may experience marginalization or disadvantage. To this end, decision-makers have expressed the importance of including considerations of equity to ensure peer support programs are accessible and relevant to youth who experience marginalization or disadvantage when thinking about the possibility of designing and implementing peer support programs.

To support potential design and implementation, policy and program decision-makers have asked for information on how to evaluate peer support programs. Evaluation is seen as an opportunity to build the evidence base for peer support programs for youth mental health and inform how to design programs to maximize their benefits, minimize their harms, and set standards for program design. Given that peer support programs are a complex intervention with wide variation in their design and with the potential for the influence of local context, decision-makers have expressed a need to understand what evaluations of peer support programs for youth mental health have been conducted and what methods or approaches can be considered for future evaluations.

Objective

The objective of this HTA was to support decision-making around adopting, implementing, and evaluating formal peer support programs for youth mental health. To do this, CADTH:

  • assessed the clinical effectiveness and safety of formal peer support programs for youth mental health
  • identified and described existing and recommended methods for the evaluation of formal peer support programs for youth mental health including completed evaluations conducted in Canada and internationally; and summarized findings of completed evaluations in Canada
  • engaged youth peer support workers and youth peer support service users as part of CADTH’s patient engagement activities.

Research Questions

This HTA informs the decision problems by answering the following research questions. Details on the specific interventions and outcomes are included in Table 2.

Systematic review of clinical effectiveness and safety:

  1. What is the clinical effectiveness of formal peer support programs compared with interventions without peer support for the management of mental health concerns among youth?
  2. What is the safety of formal peer support programs compared with interventions without peer support for the management of mental health concerns among youth?

Scan of program evaluation methods:

  1. What completed evaluations and evaluation method guidelines for formal peer support programs for youth mental health exist in Canada and internationally?
  2. What are the characteristics and components used in the evaluations and method guidelines for formal peer support programs for youth mental health, and how are they measured?
  3. What are the findings of the completed evaluations in Canada?

Methods Overview

This HTA was informed by preliminary scoping activities, including scoping searches of the existing published and grey literature around peer support for youth mental health. We wrote an a priori protocol using appropriate reporting guidelines (e.g., the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols [PRISMA-P], Guidance for Reporting Involvement of Patients and the Public [GRIPP2])19 to ensure clarity and completeness. We chose to use language from the peer support field to accurately capture our intended meaning to describe the populations in this report.

Informed by the recommendations of the Campbell and Cochrane Equity Methods Group,20,21 we worked to include considerations of equity throughout the conduct of this review. We selected the Equity Checklist for HTA (ECHTA)22 as a tool to iteratively guide our consideration of equity in the HTA. Specific groups of youth who are disadvantaged who experience an inequitable burden of mental health challenges and access to inclusive mental health services were identified using PROGRESS-Plus,23 the available published and grey literature on peer support, discussions with clinical and content experts, and through existing descriptions of peer support programs explicitly designed to target or serve youth who are disadvantaged. These groups of youth include but are not limited to youth members of the 2SLGBTQ+ community, Indigenous youth, Black youth and youth of colour, youth members of newcomer communities, youth experiencing homelessness or street involvement, youth with disabilities, and youth living in rural and remote communities. The prompts provided by the ECHTA were used for discussion and reflection in the development and conduct of each of the individual components and in the writing of the Discussion section in this final report.

A systematic review (SR) of clinical effectiveness and safety was conducted to address decision-makers’ need for evidence around the impact of formal peer support programs on patient and health systems outcomes. We considered effectiveness a broad term, covering all aspects of benefits and harms of any intervention. In this context of peer support, the term includes recovery, as described in the Introduction and Rationale sections of this report. We included a wide variety of study designs (beyond randomized trials) recognizing that non-randomized studies may be the only sources of evidence available and may provide important insights into the benefits and harms of peer support among populations that are disadvantaged. We also intended to present information regarding effectiveness and safety within relevant population subgroups (informed by PROGRESS-Plus)23,24; however, this evidence was not available within the included studies.

We conducted an Environmental Scan (ES) of completed evaluations in Canada and the methods used to evaluate peer support programs for youth mental health in Canada and internationally to address decision-makers’ need for information about how to evaluate peer support programs. We collected data through a limited literature search of both the published and grey literature and through consultations with key informants from programs offering peer support for youth mental health. We considered equity by identifying and describing features of evaluation methods that may address or reflect program goals of fair and equitable access and inclusivity. We have reported whether and how youth who are disadvantaged (as service users and support workers) were involved in evaluations when information was available.

We engaged with peer support service users and peer support workers (i.e., peer support youth advisors), which helped to ensure that this HTA is relevant to youth with mental health challenges who participate in peer support programs Our engagement activities were informed by our reflections on equity and resulted in us involving youth who may be disproportionately affected by decisions made about the design and implementation of peer support programs for mental health and who can help inform the development of inclusive programs. The peer support service users and peer support workers we engaged brought a variety of experiences from underserved communities.

Opportunities for Stakeholder Feedback

Stakeholders were given the opportunity to provide feedback on the draft list of included studies and the draft report through a process which included an invitation to comment on the CADTH website, and draft documents were provided to targeted stakeholders identified through CADTH’s networks.

Peer Support Youth Advisor Engagement

Overview

CADTH involves patients, families, and patient groups to improve the quality and relevance of our assessments, ensuring that those affected by the assessments have an opportunity to contribute to them. CADTH has adopted a framework for patient engagement in HTA. The framework includes the Standards for Patient Involvement in Individual HTAs which is used to support and guide our activities involving patients.

For this Health Technology Review, CADTH engaged 4 peer support youth advisors with lived experience of peer support whose first-hand knowledge, understanding, and experiences of peer support programs provided context to the evidence used to refine the protocol and helped reviewers interpret the overall findings of the assessment.

Methods

Invitation to Participate and Consent

Potential participants were identified through CADTH connections with peer support programs and pan-Canadian health organizations. A CADTH patient engagement officer contacted individuals who had expressed interest via teleconference and/or email (depending on individuals’ availability and level of comfort). During this initial meeting, the patient engagement officer described CADTH, the purpose and scope of the project, the purpose of the engagement, and the nature of the engagement activities.

To learn from a diversity of experiences and perspectives, CADTH engaged 4 peer support youth advisors with lived experience of receiving or providing peer support. Advisors were located across the country and had varied experience in terms of the types of programs they accessed as peer support users and the training they received as peer support workers. Some self-identified as members of communities who experience marginalization or disadvantage. In their role as advisors, they were able to share their own experiences as well as reflect on and share knowledge they gained through their interactions with other youth. Advisors shared knowledge of issues of particular importance to youth who are 2SLGBTQ+, youth of colour, youth with disabilities, and youth experiencing homelessness.

The patient engagement officer obtained the individuals’ informed consent to share their information and comments with CADTH staff. Advisors are recognized and thanked in the Acknowledgements section of this report. The advisors consented to having their names published in the report. They were also offered an honorarium for their time and effort.

Engagement Activities

Peer support youth advisors who are peer service users and trained peer support workers were involved at several time points, including:

  • before protocol finalization
  • during drafting of the initial report
  • upon completion of the final report during the feedback period.

The involvement of peer support youth advisors enabled the research team to consider the scientific evidence with an understanding of the wider experiences of those accessing and providing peer support. Considering the perspectives shared during engagement processes helped ensure that this review is relevant to peer support service users and peer support workers who participate in peer support programs. It enabled the research team to consider the outcomes of interest to youth involved in peer support programs and encouraged further reflection on considerations of equity and program inclusivity.

Upon completion of the final report, advisors were invited to provide feedback on the clarity of writing and comment on the relevance of the findings to youth in Canada. They were asked if they felt that their contributions to the project were reflected in the draft final report, and revisions will be made if needed.

Results

The reporting of this section follows the GRIPP2 Short Form19 reporting checklist and includes the results, discussion, and reflections and critical perspectives on advisor involvement, to outline the process of engagement and where and how advisors’ contributions were used in the review.

Table 1. Peer Support Youth Advisor Involvement in CADTH’s Health Technology Review of Peer Support Programs for Youth Mental Health.

Table 1

Peer Support Youth Advisor Involvement in CADTH’s Health Technology Review of Peer Support Programs for Youth Mental Health.

Systematic Review of Clinical Effectiveness and Safety

Overview

Research Questions

  1. What is the clinical effectiveness of formal peer support programs compared with interventions without peer support for the management of mental health concerns among youth?
  2. What is the safety of formal peer support programs compared with interventions without peer support for the management of mental health concerns among youth?

Study Design

To inform the design of this Clinical Review, we conducted preliminary scoping searches of existing published literature and produced a CADTH reference list.25 As the name indicates, a CADTH reference list is a published report which lists some of the relevant evidence regarding a specific health care topic. CADTH published a reference list regarding the clinical effectiveness and safety of structured peer support interventions for the management of mental health concerns among young people (aged 10 to 25 years) in January 2021. We searched for HTAs, SRs, primary studies, and evidence-based guidelines published between 2010 and December 2020 to include on the reference list. Because the CADTH report was produced to inform the scope of subsequent evidence evaluations, it had broad inclusion criteria compared with this report. Young people between the ages of 10 and 25 years and various types of peer support programs were eligible for inclusion and all mental health conditions were considered for the reference list.25 In the reference list, we identified 2 SRs26,27 and 1 cross-sectional study28 comparing the clinical effectiveness of various peer support interventions for the management of mental health concerns in young people.25 We identified no HTAs or evidence-based guidelines. The Mental Health Commission of Canada has published guidelines for practice and training of peer support which underscore the importance of shared lived experience in peer support workers and that of the recovery- based model of care.12

One of the SRs (Rose-Clarke et al. [2019]26) identified during scoping considered a wide range of peer-facilitated community-based interventions for several physical and mental health conditions for adolescents in low- and middle-income countries. The authors considered various peer-facilitated strategies, such as peer counselling, peer education, and peer activism. The review included 7 studies and found inconsistent results regarding the effectiveness of peer-facilitated interventions in improving adolescent mental health. The second SR (Ali et al. [2015]27) included online peer-to-peer support using tools such as online chat rooms and collaborative virtual environments for youth with mental health conditions. The overall results across studies were inconsistent, and the SR highlighted the lack of high-quality studies. In both SRs, the peer-facilitated and peer-to-peer support interventions did not fulfill the definition of formal peer support provided by trained youth with lived experience. Lastly, 1 cross-sectional study28 surveyed lesbian, gay, bisexual, transgender, and queer (LGBTQ) youth who attended Hatch Youth in Texas, USA for various durations. Hatch Youth is a drop-in centre for LGBTQ youth (irrespective of their mental health status) to improve their mental health and to lower behavioural risk outcomes. Each meeting consisted of a social hour, consciousness-raising hour, and a youth-led peer support hour. The peer support session involved group discussions on various topics (e.g., bullying, coming-out, self-awareness) and were facilitated by trained volunteers from the community (shared lived experience unclear). The study found that longer participation in Hatch Youth was associated with a decrease in self-reported depressive symptomatology, increased self-esteem, and improved coping ability.28 Two other SRs, published in 2021 and 2020, examined the effectiveness of group1 and one-to-one29 peer support interventions for adults with mental health concerns, respectively. The SRs highlighted the inconsistencies in the definition of “peer support” used by studies. Heterogeneity in population (spectrum of mental health disorders), intervention (varying definitions of peer support), and outcomes (varied depending on the mental health condition) were notable.

The informal scoping and the reference list25 show there is no up-to-date syntheses of evidence assessing the effectiveness and/or safety of formal peer support programs among youth. Accordingly, we surmised that an overview of SRs or an update of existing SRs would not be an appropriate nor feasible method to inform the research questions because existing reviews were either not up-to-date or did not match our review focus. Therefore, we conducted a de novo SR of relevant primary studies to synthesize the evidence regarding the clinical effectiveness and safety of formal peer support programs compared with interventions without peer support for the management of mental health concerns among youth.

Methods

Review Conduct

For the current SR, we followed a protocol that was written a priori. We prospectively registered the protocol for the Clinical Review in the international repository PROSPERO (registration number: CRD42022299556). We made no protocol amendments during the review. We have reported the Clinical Review in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) 2020 statement.30

Literature Search Strategy

The literature search for clinical studies was performed by an information specialist using a peer-reviewed search strategy according to the PRESS Peer Review of Electronic Search Strategies checklist.31 The complete search strategy is presented in Appendix 1.

Published literature was identified by searching the following bibliographic databases: MEDLINE All (1946‒) via Ovid, Embase (1974‒) via Ovid, the Cumulative Index to Nursing and Allied Health Literature (CINAHL) via EBSCO, PsycInfo via Ovid, Cochrane Central Register of Controlled Trials via Ovid, and Scopus. All Ovid searches, with the exception of Cochrane Central Register of Controlled Trials, were run simultaneously as a multi-file search. Duplicates were removed using Ovid deduplication for multi-file searches, followed by manual deduplication in Endnote. The search strategy comprised both controlled vocabulary, such as the National Library of Medicine’s MeSH (Medical Subject Headings), and keywords. The main search concepts were peer support and youth with mental health concerns. Clinical trials registries searched were the US National Institutes of Health’s clinicaltrials.gov, WHO’s International Clinical Trials Registry Platform (ICTRP) search portal, Health Canada’s Clinical Trials Database, and the European Union Clinical Trials Register.

CADTH-developed search filters were applied to limit retrieval to health technology assessments, systematic reviews, meta-analyses, or network meta-analyses, and any types of clinical trials or observational studies. The search was limited to English- and French-language documents published between January 1, 2006, and December 17, 2021. Conference abstracts were excluded from the search results.

Regular alerts updated the database literature searches until the publication of the final report. The clinical trials registries search was updated before the completion of the stakeholder feedback period.

Grey literature (literature that is not commercially published) was identified by searching sources listed in relevant sections of the Grey Matters: A Practical Tool For Searching Health-Related Grey Literature checklist,32 which includes the websites of regulatory agencies, HTA agencies, clinical guideline repositories, systematic review repositories, patient-related groups, and professional associations. Google was used to search for additional internet-based materials. These searches were supplemented by reviewing bibliographies of key papers (relevant SRs and the included primary studies) and through contacts with experts and industry, as appropriate. The grey literature search was updated before the completion of the stakeholder feedback period. See Appendix 1 for more information on the grey literature search strategy.

Study Eligibility Criteria

Table 2 shows the study eligibility criteria for the clinical research questions.

Screening and Selecting Studies for Inclusion

We considered the following criteria when selecting studies for inclusion:

  • For this review, youth were defined as individuals aged between 12 and 25 years because this age range overlaps with that of youth mental health hubs (which often include peer support) in several Canadian provinces and the time period when mental health concerns often first appear.36
  • Youth could be of any gender, sexuality, or ethnicity. Studies in all settings were eligible for inclusion. There were no restrictions placed on setting or severity of symptoms.
  • Studies of wider populations (i.e., including children and/or adults) were included if:
    • findings for youth could be isolated (e.g., in subgroup analyses)
    • at least 80% of the sample consisted of youth
    • the mean and mean ± 1.5 standard deviation (SD) age fell between 12 and 25 years.
  • Peer support workers could be of any age.
Table 2. Selection Criteria for Clinical Research Questions.

Table 2

Selection Criteria for Clinical Research Questions.

  • Peer support could be offered on a one-to-one or on a group basis, be in person or virtual (e.g., video or telephone chat), and synchronous (in real time; e.g., in-person sessions, video chat) or asynchronous (not in real time; e.g., text messaging).
  • Mental health concerns could be of any severity.
  • Studies that had a larger scope than only youth with mental health concerns (e.g., studies of youth with both mental health concerns and substance use disorders) were included if relevant findings related to peer support primarily for mental health concerns were reported in isolation (e.g., in a subgroup).
  • Peer service users could receive concurrent interventions (e.g., psychotherapy, pharmacotherapy).
  • For the outcomes, all instruments and all time points were eligible for inclusion.
  • Studies not meeting the eligibility criteria outlined in Table 2 or published in a language other than English or French were excluded.

Study Selection

Two reviewers independently screened titles and abstracts for relevance to the clinical research questions following the liberal accelerated approach (i.e., a single reviewer’s decision was required for inclusion, and 2 reviewers’ decisions for exclusion).37,38 We retrieved full-text articles that at least 1 reviewer judged to be potentially relevant and independently assessed these for possible inclusion based on the predetermined selection criteria (Table 2). We used Distiller SR (Evidence Partners, Ottawa, Canada) to facilitate study selection. One reviewer scanned the reference lists of the included studies and relevant SRs to locate additional studies of potential interest. Two reviewers independently reviewed full text of all selected articles. The 2 reviewers compared their chosen included and excluded studies and discussed disagreements until consensus was reached, involving the opinion of a third reviewer, if needed (i.e., methodologist, content expert). We presented the study selection process in a flow chart. We had planned to contact study authors if any additional information was needed to determine the relevancy of any studies. However, this ended up not being necessary. We posted a list of studies selected for inclusion in the Clinical Review to the CADTH website for stakeholder review and feedback for 10 business days and planned to review any additional studies identified for potential inclusion. No additional studies were identified. We screened studies identified through search alerts using the aforementioned process and incorporated those meeting the selection criteria of the review into the analysis if they were identified before the end of the stakeholder feedback period for the draft report. We had planned to describe studies identified after the last stakeholder feedback period in the discussion, with a focus on comparing their results with those obtained from the synthesis of earlier reports included in the review. However, no additional studies were identified after stakeholder feedback period.

Data Extraction

A single reviewer performed data extraction with independent verification for accuracy and completeness by a second reviewer. Reviewers extracted data directly into Microsoft Office Word. Because there were only 2 included studies, we deemed it not possible to truly pilot the form, and instead edited it iteratively as needed. The information extracted included characteristics of the study (i.e., design, setting, funding source), population (i.e., inclusion and exclusion criteria, number of participants, age, sex and/or gender, sexuality, race and/or ethnicity, mental health concerns), intervention (i.e., details of the program, number of sessions, selection and training of peer supporters) and comparators, outcomes and their ascertainment (e.g., instruments used for measurement), length of follow-up and time points of outcome measurement, and results data regarding the outcomes and the subgroups of interest. Because 1 of the included trials was published in 2 reports, we extracted data from the main publication (Conley et al.)39 and only additional information and any data related to the 2-month follow-up were extracted from Hundert et al.40

We extracted all data that were compatible with each relevant outcome domain at any duration of follow-up, including measures of treatment effects (e.g., mean changes in outcome scores from baseline to follow-up), and any results of between-group statistical tests reported on those measures. We made no assumptions about the presence or absence of an outcome if it was not reported in the study. For example, we did not assume that no adverse events occurred only because the authors did not report on any. We did not make any attempts to contact study authors because we did not deem any relevant data to be unclear or missing.

Risk-of-Bias Appraisal

Two independent reviewers assessed outcome-level risk of bias (or for groups of outcomes believed to be at similar risk of bias, for feasibility reasons) of RCTs from the intention-to-treat perspective using version 2 of the Cochrane risk-of-bias tool for randomized trials (RoB 2).41 Because there were only 2 included studies, we did not pilot the RoB form. The RoB 2 assessment tool is structured into 5 domains to assist in evaluating biases arising from the randomization process, deviations from intended interventions, missing outcome data, measurement of the outcome, and selection of the reported result.41 For each domain, we assigned a judgment of low risk of bias, high risk of bias, or some concerns about risk of bias. We then judged the overall risk of bias of each trial as low risk of bias, some concerns about risk of bias, or high risk of bias based on the domain-level determinations. We predicted the direction of the potential risk of bias when possible and provided a rationale for decisions about the risk of bias for both the domain-level and overall assessments.

Reviewers resolved disagreements in the risk of bias for the domain-level and overall assessments through discussion. We did not exclude studies from the review based on the results of the critical appraisal. However, we incorporated the critical appraisal results into assessments of the certainty in the body of evidence for each outcome comparison.

Data Analysis and Synthesis

Narrative Synthesis

We considered factors such as clinical heterogeneity (i.e., differences in study setting, populations, and interventions), methodological heterogeneity across the included trials, and the reported outcome measures in our decision on whether to pool findings statistically via a meta-analysis. Because we included only 2 trials in this review and many of the outcomes were reported by a single trial, it did not seem appropriate nor informative to conduct a statistical synthesis. Instead, we conducted a narrative synthesis of the results reported in the trials considering available guidance.42 The narrative synthesis included the presentation of study characteristics and findings by outcome within summary tables, together with descriptions in the main text. To synthesize study findings, we first grouped trials by outcome domain and time point of interest for the comparisons between peer support interventions and control groups. We then developed a preliminary synthesis by organizing the findings and identifying patterns in the size and direction of reported effects. We evaluated the within and between-study relationships and discussed the findings about the direction and magnitude of any observed effects. We interpreted the findings with consideration for the differences in instruments used across the studies. We chose to synthesize data at the 3 reported time points; namely, post-intervention, post-booster (available in 1 study), and at the longest follow-up. We considered the sample size of the included trials and their risk of bias in determining the relative weight of each study’s findings in the overall conclusion. However, the included studies were both similar in sample size (both small, N < 120) and had high risk of bias; therefore, their findings were considered to contribute equally to the overall conclusion. Reviewers then came to consensus on having a single overall conclusion across trials for each outcome comparison (i.e., favouring either intervention or comparator, little to no difference).

When findings across the trials were heterogeneous (especially in terms of direction of observed effects), we had planned to explore this heterogeneity using within- and between-study subgroup analyses. No within-study subgroup analyses were reported in the included trials, and the small number of trials representing various subgroups precluded drawing credible conclusions about the potential sources of heterogeneity. Therefore, we drew conclusions based on the main comparison and did not present separate conclusions by subgroups of the population or intervention. Instead, we considered this unexplained heterogeneity in our assessments of the certainty of the evidence.

We had planned to assess the risk of small study bias for meta-analyses containing at least 10 studies of variable size,43 but because we only included 2 trials and did not perform a meta-analysis, we were unable to complete this assessment.

Certainty of the Evidence

Two independent reviewers rated the certainty of the body of evidence for each outcome comparison using the methods of the Grading of Recommendations Assessment, Development and Evaluation (GRADE) working group.44,45 Reviewers discussed discrepancies until consensus was reached. We had planned to contact study authors if any additional information was needed to complete the GRADE assessments; however, this did not end up being necessary.

Following the GRADE approach, the included RCTs started as high certainty evidence.45,46 We then rated down the certainty in treatment effect estimates for concerns related to risk of bias, inconsistency across studies, indirectness, imprecision of effects, and/or publication bias.45,46 We considered the possibility of rating up the certainty of evidence, but this was not appropriate for any outcome comparison.45,46 Ultimately, the GRADE approach resulted in an assessment of the certainty of a body of evidence in 1 of 4 grades: high, moderate, low, or very low.47 Because the certainty in the evidence decreased, so did our confidence that the estimate of effect from the included study was close to that of the true effect.47 We employed a non-contextualized approach whereby we rated the certainty that a non-null effect was present.48

The results of GRADE assessments are reported in the Summary of Findings tables in Appendix 2, which include notes that justify all decisions to rate down the certainty of the evidence for any given outcome comparison. When providing summaries of the evidence in the text, we used the word “may” for low certainty evidence and “probably” or “likely” for moderate certainty evidence.49 We describe very low certainty evidence as “very uncertain.”49

Results

Quantity of Research Available

We identified 5,357 unique citations via the electronic literature search. We excluded 5,168 of these records during title and abstract screening. We retrieved 8 additional records from the grey literature search. After full-text screening of 197 potentially relevant articles, we excluded 194 records and included 3 publications39,40,50 (reporting results from 2 RCTs). No additional unique studies were identified during the stakeholder review of the included studies nor from subsequent search alerts. A PRISMA flow chart30 (Appendix 2, Figure 1) shows the study selection process. We have included a list of excluded studies with the reason for exclusion in Appendix 3.

Trial and Participant Characteristics

We identified 2 open-label RCTs (reported in 3 publications)39,40,50 that were included in this Clinical Review. Conley et al. (2020)39 evaluated a peer support program among students from 3 university campuses in the US. A second publication,40 about the same trial (Hundert et al. [2021]) reported results from a subset of participants who were followed for a longer period. Mulfinger et al. (2018)50 assessed the effectiveness of a peer support intervention among adolescent psychiatric patients in Germany. Table 3 shows the overview of characteristics of the included trials. We have included a detailed table of characteristics of the included trials in Table 8 (Appendix 2). Throughout this report, we have used the term “mental health concerns” to denote self-reported or formally diagnosed mental health concerns. However, if the included studies used the term “mental illness” to describe the study population, we retained that terminology.

Table 3. Overview of Characteristics of Included Clinical Trials.

Table 3

Overview of Characteristics of Included Clinical Trials.

Population

In the study by Conley et al.,39 university students (aged ≥ 18 years) with a self-identified mental health challenge or mental illness were included. The study by Mulfinger et al.50 included adolescent psychiatric patients aged 13 to 18 years with at least 1 self-reported current axis I or axis II disorder (e.g., psychiatric illnesses such as anxiety, depression; personality disorders), and a moderate (or severe) level of self-reported disclosure-related distress. Across the trials, 216 participants were included (Conley et al.,39 N = 118; Mulfinger et al.,50 N = 98). Across the studies, depressive symptoms were reported in 59.1%50 to 85.5%39 of participants, while 17.3%50 to 69.2%39 reported anxiety symptoms. The authors did not describe other mental health concerns potentially experienced by participants. The population in the trial by Conley et al.39 was mostly female (82.2%), White (68.6%) and heterosexual (66.9%). In the Mulfinger et al. study,50 most participants were female (69.3%), born in Germany (94.8%), and with a mean of 22.5 (SD = 32.2) months since their first psychiatric diagnosis.

Intervention and Comparators

The peer support intervention in both of the included trials39,50 was the Honest, Open, Proud (HOP) program.51 HOP was a peer-led, in-person group intervention developed to empower participants with disclosing their mental health concerns and to reduce their mental health-related self-stigma. HOP was originally developed for adults but was later adapted for adolescents. This manualized program covered 5 themes in three 2-hour sessions over the course of 3 weeks. These included beliefs and attitudes about having a mental illness, the advantages and disadvantages of disclosing one’s mental illness, recognizing the right people and setting for disclosure, personal disclosure and telling one’s own story, and about the role of solidarity and peer support. The sessions included vignettes, role plays, exercises on self-reflection, and group discussions. Conley et al.39 evaluated the college version of HOP (HOP-C), which was adapted for university students. In the HOP-C program, the first session included a discussion on the concepts of identifying as an individual with mental illness and the pros and cons of disclosure. In the second session, different ways of disclosure, including social media disclosure, were discussed; in the third session, participants were asked to craft personal disclosure stories and to practice telling their story. The HOP-C program included an additional booster workshop session given 2 to 3 weeks later.39 The session manual and a workbook for the participants are available online.51,52

The sessions were led by trained individuals who had shared lived experience of mental illness. The peer facilitators were youth or young adults who underwent a 2-day training course. In the Mulfinger et al. study, a young mental health professional was also present for the sessions.50 Because this study was conducted in Germany, the program was adapted to a German context.

The comparators were treatment as usual (TAU)50 or a waitlist control.39,40 In the Mulfinger et al. study, participants in both groups received TAU, which included regular care from the psychiatric clinic.50 Additional details of usual treatment were unclear from the publication. In the Conley et al. study, HOP-C was compared with a waitlist control group, who were offered the program at a later point in time. In the HOP-C group, 41.3% (n = 26) of participants were reported as receiving therapy or counselling and 57.1% (n = 36) were reported as receiving medications at the time of the study; 45.5% (n = 25) and 54.5% (n = 30) of participants in the waitlist group were reported as receiving therapy or counselling and medications, respectively, at the time of the study.39,40

Outcomes

The included trials assessed several self-reported outcomes, mostly related to personal recovery. Among them, self-stigma and stigma stress were reported in both included trials.39,40,50 Other personal recovery outcomes, such as secrecy and disclosing mental illness (e.g., self-efficacy about disclosing mental illness, attitudes to disclosure), health-related quality of life (HRQoL), self-identified stage of recovery, empowerment, feelings of hopelessness, social withdrawal, and help-seeking, were included only in the Mulfinger et al. trial.50 Clinical outcomes, such as symptoms of anxiety (Conley et al.)39,40 and depression (both trials),39,40,50 were included. No outcomes related to health care resource utilization or social outcomes were reported. Detailed descriptions of all outcome measures are available in Table 33 in Appendix 2. No relevant studies were identified that reported on harms related to peer support. The authors of the included studies did not report on the safety of peer support workers.

Both trials measured the outcomes at baseline, after the HOP sessions (post-intervention), and at follow-up.39,50 The follow-up time ranged from 6 weeks after baseline (3 weeks after the sessions) in the Conley et al. trial39 to around 2 months after the sessions (5 weeks after booster) in the Mulfinger et al. trial.50 In the Conley et al. trial, the intervention included an additional booster session 3 weeks after completion of the initial program; an additional outcome assessment was conducted after this booster session (post-booster).39

Risk-of-Bias Appraisal

Table 4 shows a summary of the risk-of-bias assessments for the 2 RCTs.39,40,50 Table 9 in Appendix 2 shows the detailed risk-of-bias assessments. Overall, we assessed the included RCTs to have a high risk of bias.

Table 4. Risk of Bias Summary — RCTs (RoB 2, Effect of Assignment to the Intervention).

Table 4

Risk of Bias Summary — RCTs (RoB 2, Effect of Assignment to the Intervention).

For the risk of bias arising from the randomization process, we judged the Conley et al. study39,40 to have some concerns because the randomization method at 1 site may not have been adequate. While 2 universities appeared to have used adequate randomization methodologies, a third used “blindly shuffled pieces of paper”; this methodology may not have been adequate and it is possible that the allocation of participants was revealed before their assignment to treatment groups.39,40 The magnitude and direction of bias this may have been introduced is not clear. There were no serious concerns about risk of bias due to deviation from the intended interventions. All outcomes reported in both RCTs39,40,50 were at a high risk of bias due to missing outcome data. In the Conley et al. study, data from up to 33% of participants in the HOP group and 19% of in the control group were missing at the longest follow-up; it is possible that the high and imbalanced losses to follow-up were at least in part related to perceived lack of efficacy in the HOP group. There was also no evidence to indicate that the results were not biased by missing outcome data (e.g., sensitivity analyses). Similarly, in the Mulfinger et al. study, data from 22% of participants were missing in both groups.50 We also judged both RCTs39,40,50 to be at a high risk of bias in measurement of the outcome because all outcomes were self-reported by the study participants who were aware of their treatment allocation, and it was possible that this knowledge influenced the outcome assessment. Although it is possible that response of participants in both groups were influenced by their allocation, it is likely that this risk favoured the intervention (HOP or HOP-C) because it is possible that the participants assigned to the intervention group might have been optimistic of the effects of the intervention. Published protocols were not available for either of the studies; therefore, it was unclear if data for all outcomes were analyzed in accordance with a pre-specified analysis plan that was finalized before unblinding of outcome data. However, the Mulfinger et al. study50 was registered (NCT02751229) and all reported outcomes were pre-specified. The predicted direction of the risk of potential bias in selection of the reported result is unclear for both trials.

Data Analysis and Synthesis

Table 5 shows a high-level overview of the findings and certainty of evidence assessments for each outcome comparing the clinical effectiveness of peer support programs versus interventions without peer support (i.e., waitlist or TAU) for the management of mental health concerns among youth. Appendix 2 presents detailed GRADE Summary of Findings tables which include notes that detail the reasons for rating down the certainty of evidence. We identified no relevant studies regarding the safety of peer support programs compared with interventions without peer support.

Table 5. High-Level Overview of Trial Findings and GRADE Assessments.

Table 5

High-Level Overview of Trial Findings and GRADE Assessments.

Question 1: Clinical Effectiveness

In this section, we present the findings for all the outcomes on the clinical effectiveness of peer support interventions from the included trials. Overall, we judged the certainty of the evidence regarding the clinical effectiveness of peer support programs compared with interventions without peer support on all outcomes across all time points to be very uncertain due to serious concerns across all GRADE domains aside from publication bias: risk of bias, inconsistency, indirectness, and imprecision. Therefore, readers should be mindful when interpreting the results that the true effect of formal peer support programs compared with interventions without peer support may be very different than the findings generated from these 2 trials. The trials were judged to be at high risk of bias due to missing outcome data and self-reported subjective outcomes that may have been affected by the open-label nature of the trials. We rated down our certainty in the evidence due to serious concerns about inconsistency because either only 1 trial was available that reported on the outcome (limited evidence of consistency) or because of inconsistent results between the trials (at post-intervention). We judged the results to be indirect because the effect of the single included intervention (HOP or HOP-C) is unlikely to be representative of the wide spectrum of peer-support interventions that may exist for all youth (including populations that are disadvantaged) across the spectrum of mental health concerns. We also assessed the evidence as imprecise because of the small sample size in each comparison (n < 400), which may have resulted in unstable estimates of effect. Although only 2 trials were included, we did not find any persuasive evidence of publication bias; instead, we consider it quite possible that many programs exist but are not formally evaluated and shared in the public domain. Therefore, we did not rate down in that domain for any outcome comparison.

Stigma
Self-Stigma

The authors of the 2 RCTs (in 3 publications)39,40,50 reported on self-stigma or internalized stigma. The peer support interventions were the HOP50 and HOP-C39,40 programs, which were compared with TAU50 or waitlist controls.39,40 Outcomes were measured at post-intervention, post-booster, and at follow-up (6 weeks50 or 2 months40 after core sessions) using the 4 subscales of the Self-Stigma of Mental Illness Scale–Short Form (SSMIS-SF; range = 5 to 45)53 or the Internalized Stigma of Mental Illness scale54 (10-item version, range = 1 to 4). Conley et al.39,40 reported the mean score from 3 subscales of the SSMIS-S ranging from 1 to 5 for each subscale. For both measures, higher scores indicate more self-stigma.

At post-intervention, the results were heterogenous (2 RCTs,39,50 N = 191) and we consider the findings to be very uncertain. Conley et al.39 found that in the harm subdomain of the SSMIS-SF scale, HOP-C was favoured compared with waitlist control at follow-up. The mean scores of the harm subdomain in the HOP group were 3.23 (SD = 2.08) at baseline and 2.49 (SD = 1.65) at post-intervention, whereas the scores in the waitlist control were 2.92 (SD = 1.75) at baseline and 3.02 (SD = 2.08) at post-intervention (P = 0.019).39 The authors did not report results for change from baseline for the other domains. In the Mulfinger et al. study, at post-intervention, change from baseline of the overall score of SSMIS showed that HOP was associated with a reduction in self-stigma compared with TAU (mean between-group difference for change from baseline = –2.93; 95% CI, –5.35 to –0.52). There was no significant difference between groups in the change from baseline of ISMI scores.50

At post-booster (1 RCT,39 N = 97), evidence from the study by Conley et al. showed little to no difference in the effect of HOP-C compared to waitlist in reducing self-stigma, as found by between-group t-tests for the agreement, application, and harm subdomains of the SSMIS-SF. However, we consider these findings to be very uncertain, and we could not rule out an effect in either direction because the apparent lack of difference could be related to imprecision resulting from the small sample size.

At the longest follow-up (2 RCTs, N = 117; 6 weeks50 or 2 months40), the evidence was heterogenous, and we consider the findings very uncertain. HOP-C was not associated with any significant reduction in any of the subdomain scores of SSMIS compared with waitlist control. Results from the study by Mulfinger et al.50 found that participants who received HOP reported lower self-stigma scores at 2 months follow-up compared with those who received TAU. The mean between-group difference for change from baseline in ISMI scores was –0.35 (95% CI, –0.54 to –0.05); the mean between-group difference for change from baseline in SSMIS scores was –5.14 (95% C, –8.22 to –2.05).

Stigma Stress

Both included RCTs39,40,50 reported on stigma stress. Outcomes were measured at post-intervention and at follow-up (6 weeks50 to 2 months40 after core sessions). In the HOP trial and in the 2-month follow-up of the HOP-C trial, the Stigma Stress Scale (score range, –6 to 6) was used to calculate stigma stress as perceived harm minus perceived resources. Higher scores indicated increased stigma-related stress. At the post-intervention and post-booster follow-ups of the HOP-C trial, stigma stress was not calculated; rather, the results of the subscale scores were reported separately.

At post-intervention, Mulfinger and colleagues50 (N = 84) reported that peer support may be favoured compared with TAU in lowering the stress related to self-stigma. The mean between-group difference for change from baseline to post-intervention was –2.06 (95% CI, –2.70 to –1.42), but we consider the evidence to be very uncertain..50

At the longest follow-up, the evidence was heterogenous (2 RCTs, N = 11740,50; 6 weeks50 or 2 months40) and we consider the overall certainty of the evidence to be very low. The Conley et al. trial (reported in Hundert et al.)40 showed there was little to no difference (potentially related to imprecision) in the effect of peer support intervention (HOP-C) in reducing stigma-related stress, whereas the results from the Mulfinger et al. trial50 favoured peer support. At 6 weeks follow-up, the mean difference for change in scores from baseline in the HOP group was 2.19 units lower than the TAU group (95% CI, –2.89 to –1.43). At post-intervention and at post-booster, Conley et al.39 found that there was a significant increase in the scores related to perceived resources to cope with stigma stress in the HOP-C group compared with the control group (P = 0.001). There were no differences in the subscale stigma as a stressor (perceived harm). However, the stigma stress scores were not calculated for post-intervention and post-booster time points.

Secrecy and Disclosing Mental Illness
Self-Efficacy Related to Secrecy and Disclosing of Mental Illness

The HOP-C trial by Conley et al.39,40 reported on participants’ self-reported self-efficacy related to secrecy and to the disclosure of mental illness. The outcome was assessed by 2 questions: “How confident are you in making decisions and handling well all the issues related to disclosing your mental illness? (p.171)”39 and “How confident are you in making decisions and handling well all the issues related to keeping mental illness a secret?” Answers were rated from 1 (not at all) to 7 (very much).

At post-intervention, there was little to no difference (potentially due to imprecision) in the effect of peer support in efficacy related to keeping the mental illness a secret or to that related to disclosure of mental illness compared with no peer support (n = 107)39 Following a booster session (n = 97), the trial showed that HOP may be favoured with respect to self-efficacy about disclosure (P = 0.001) but there may be little to no difference in self-efficacy related to keeping mental illness a secret.39 At the 2 month follow-up assessment (n = 55), the results suggested that there may be little to no difference in the effect of peer support versus no peer support (waitlist) in self-efficacy related to secrecy or to disclosing mental illness.40 We considered the evidence at all time points to be very uncertain.

Attitudes to Disclosure

Mulfinger et al.50 reported on participants’ attitude to disclosure of mental illness to family and friends and to teachers and employers. The outcome was assessed by 2 questions about how comfortable they are in disclosing mental illness to family and friends, and teachers and employers. Answers were rated from 1 (not at all) to 7 (very much).

The trial showed that peer support may be favoured compared to TAU on improving the attitudes of participants to disclosing their mental illness at post-intervention and at 6 weeks follow-up, but we considered the evidence informing these results to be very uncertain. At post-intervention (n = 84), participants in the HOP group reported significantly higher improvement from baseline in their attitudes to disclosure toward family and friends (mean between-group difference for change from baseline = 1.00; 95% CI, 0.43 to 1.57) and toward teachers and employers (mean between-group difference for change from baseline = 0.66; 95% CI, 0.15 to 1.16) compared with participants in the TAU group. Similarly, at the 6-week follow-up assessment (n = 62), participants in the HOP group reported significantly higher improvement from baseline in their attitudes to disclosure toward family and friends (mean between-group difference for change from baseline = 1.02; 95% CI, 0.43 to 1.61) and toward teachers and employers (mean between-group difference for change from baseline = 0.91; 95% CI, 0.28 to 1.53) compared with participants in the TAU group, but we considered the evidence to be very uncertain.

Disclosure-Related Distress

Mulfinger et al.50 reported on participants’ distress related to disclosure of mental illness. The outcome was assessed by a single question about how distressed or worried participants were about disclosing mental illness. Answers were rated from 1 (not at all) to 7 (very much). This single item was also used as a screening item for study inclusion, with a score of 4 or higher required to be enrolled to the trial.

The results of the trial showed that peer support may be favoured over TAU for lowering participants’ disclosure-related distress at post-intervention and at the 6-week follow-up, but we consider this evidence to be very uncertain. At post-intervention (n = 84), the between-group difference for change from baseline was –0.44 (95% CI, –0.79 to –0.08). Similarly, at the 6-week follow-up (n = 62), the distress related to disclosure of mental illness was lower in the HOP group compared with the TAU group (mean between-group difference for change from baseline = –0.78; 95% CI, –1.16 to –0.40).

Secrecy

Mulfinger et al.50 reported on participants’ secrecy related to mental illness. The outcome was assessed by the Stigma Coping and Orientation subscale of the Link Stigma Scale.55 Higher mean scores (range = 1 to 6) indicate more secrecy.50

The results of the trial showed that peer support may be favoured compared with TAU on lowering the participants’ secrecy related to mental illness at post-treatment, and at 6 weeks follow-up, but we considered the evidence to be very uncertain. At post-intervention (n = 84) and at 6-week follow-up (n = 62), the mean between-group differences of change from baseline were –0.44 (95% CI, –0.79 to –0.08), and –0.78 (95% CI, –1.16 to –0.40), respectively.

Health-Related Quality of Life

Mulfinger et al.50 reported on participants’ HRQoL. The outcome was assessed by KIDSCREEN-10,56 a 10-item questionnaire with a total score range from 10 to 50, with higher scores indicating better quality of life.56,57

The results from the trial showed that at post-intervention (n = 84) there may be little to no difference in the effect of peer support on HRQoL compared to TAU, but we considered the evidence to be very uncertain, and could not rule out the potential for a difference between groups due to imprecision. At the 6-week follow-up assessment (n = 62), the results suggested that HOP may be favoured compared to TAU in improving HRQoL, but we considered the evidence to be very uncertain. The mean between-group difference in score for change from baseline to 6-week follow-up was 3.54 (95% CI, 1.14 to 5.93).

Empowerment

Mulfinger et al.50 reported on participants’ feeling of empowerment. The outcome was assessed by the Self-esteem (9 items) and Optimism (4 items) subscales of the Empowerment Scale.58 A mean score was calculated from the scores of each of the subscales (range = 1 to 4), with higher scores indicating more empowerment.

In the self-esteem subscale of the Empowerment Scale, the results from the trial showed that at post-intervention (n = 84), participants in the HOP group reported a larger improvement in self-esteem compared with those in the TAU group (mean between-group differences for change from baseline = 0.21; 95% CI, 0.04 to 0.39). At 6-week follow-up (n = 62) there was no significant difference between the groups. In the optimism subscale, the results showed that there was no significant difference between the groups at post-intervention or at 6-week follow-up. Overall, we concluded that there may be little to no difference in the effect of peer support on feeling of empowerment compared to TAU at all time points; however, we considered the evidence to be of very low certainty.

Social Withdrawal

Mulfinger et al.50 reported on participants’ self-reported assessment of social withdrawal. The outcome was assessed by the Stigma Coping Orientation subscale of the Link Stigma Scale55 (7 items related to withdrawal). Higher mean scores (range = 1 to 6) indicate more social withdrawal.50

The results of the trial suggested that peer support may be favoured compared with TAU on lowering the participants’ social withdrawal at post-intervention, but the evidence was very uncertain (mean between-group difference for change from baseline = 0.34; 95% CI, –0.63 to –0.05; n = 84). At 6 weeks post-intervention (n = 62), there was no significant difference between the groups in the change from baseline of mean scores; however, we considered the evidence to be of very low certainty and affected by imprecision.

Help-Seeking

Mulfinger et al50 reported on participants’ help-seeking behaviour. The outcome was assessed by the General Help-Seeking Questionnaire.59 In the RCT, an average of scores from items related to family and friends and to professionals were reported. Higher scores indicate an increased likelihood for seeking help.50 A mean score was calculated from the scores of the subscales (range = 1 to 4), with higher scores indicating more empowerment.

The results of the trial showed that at post-intervention (n = 84), participants in the HOP group reported increased help-seeking behaviour compared with those in the TAU group (mean between-group difference for change from baseline = 0.77; 95% CI, 0.36 to 1.17). However, at 6-week follow-up (n = 62), there was no significant difference between the groups, but this evidence was affected by imprecision. As for seeking help from professionals, participants in HOP group reported significantly higher improvement compared with those in the TAU group at post-intervention (mean between-group difference for change from baseline = 0.60; 95% CI, 0.15 to 1.05; n = 84) and at 6-week follow-up (mean between-group difference for change from baseline = 0.82; 95% CI, 0.32 to 1.32, n = 62). Overall, we conclude that peer support may be favoured compared with no peer support in improving help-seeking behaviour among youth, but the evidence supporting this conclusion is very uncertain.

Hopelessness

Mulfinger and colleagues50 reported on participants’ feeling of hopelessness. The outcome was assessed by the Beck’s Hopelessness Scale (brief version),60 a 4-item questionnaire (range = 4 to 24) with higher scores indicating increased hopelessness.

The trial showed that at post-intervention and at 6-week follow-up, there were no significant differences between the HOP and TAU groups in change from baseline of mean scores. The mean between-group differences for change from baseline were 0.51 (95% CI, –1.88 to 0.85) and 1.22 (95% CI, –2.68 to 0.24) at post -intervention (n = 84) and at 6-week follow-up (n = 62), respectively. Thus, there may be little to no difference in the effect of peer support on feeling of hopelessness compared with TAU; however, we considered the evidence to be of very low certainty and affected by imprecision.

Stage of Recovery

Mulfinger and colleagues50 reported on participants’ self-reported stage of recovery. The outcome was assessed by Self-Identified Stage of Recovery Scale,61 in which the total score ranges from 4 to 24, higher scores indicating a better recovery process.

At post-intervention, the trial indicated that there may be little to no difference in the effect of peer support on the stage of recovery compared to TAU, but these findings were very uncertain and affected by imprecision because of the small sample size (n = 84). At the 6-week follow-up (n = 62), the results suggested that peer support may be favoured compared with TAU on the stage of recovery (mean between-group difference for change from baseline = 1.59; 95% CI, 0.10 to 3.07). We assessed the evidence to be of very low certainty and affected by imprecision.

Anxiety

The HOP-C trial39,40 reported on participants’ self-reported anxiety symptoms. Anxiety symptoms were assessed using Generalized Anxiety Disorder 7-Item scale62,63 (score range = 0 to 21), with higher scores indicating increased severity of symptoms.63

At post-booster (n = 97)39 and at the 2-month follow-up (n = 55),40 there was little to no difference in self-reported improvement in anxiety symptoms between the HOP-C and waitlist groups, but we considered the evidence to be of very uncertain. . . In the HOP group, the mean scores were 1.66 (SD = 0.77), 1.66 (SD = 0.75), and 1.57 (SD = 0.88) at baseline, post-booster, and at 2-month follow-up, respectively. In the waitlist control group, the mean scores at those time points were 1.92 (SD = 0.75), 1.69 (SD = 0.90), and 1.77 (SD = 0.85), respectively.

Depression

Both included RCTs39,40,50 reported on depression symptoms. Self-reported symptoms of depression were measured at post-intervention, post-booster, and at follow-up (6 weeks50 to 2 months40 after core sessions), using the 10-item Center for Epidemiologic Studies Depression (CES-D-10) scale39 or the Center for Epidemiologic Studies Depression (CES-D) scale50 scales. CES-D64 is a 20-item scale to assess symptoms of depression and to identify at-risk individuals for depression; total scores range from 0 to 60.65 CES-D-1066,67 is a shorter 10-item version of the CES-D, in which the scores range from 0 to 30. In both measures, higher scores indicate increasing severity of symptoms.

At post-intervention (n = 84), in 1 RCT there was little to no difference in symptom improvement between HOP and TAU groups (mean between-group difference for change from baseline = 1.25; 95% CI, –4.87 to 2.38).50 At post-booster (n = 97), results from the Conley et al. study39 showed little to no difference between the HOP-C and waitlist groups in improving symptoms of depression; we found that the findings for both these time points were very uncertain and affected by imprecision. At the longest follow-up (6 weeks50 to 2 months40 after core sessions; n = 117), the results were heterogenous. Findings from the study by Mulfinger et al.50 favoured HOP at 6 weeks after the sessions (mean between-group difference for change from baseline = 7.25; 95% CI, –10.85 to –3.65), whereas Conley et al.40 found little to no difference between the groups at 2 months after the sessions. In the HOP group, the mean scores were 1.74 (SD = 0.58), and 1.54 (SD = 0.70) at baseline and at 2-month follow-up, respectively. In the waitlist control group, the scores at those time points were 1.65 (SD = 0.59) and 1.39 (SD = 0.77), respectively (P = 0.860); we consider the evidence to be of very uncertain.

Health Care Resource Utilization

We did not locate any studies that evaluated or reported on health care resource utilization.

Social Outcomes

We did not locate any studies that evaluated or reported on social outcomes.

Question 2: Safety

We identified no relevant studies that provided outcome data regarding the safety of peer support programs compared with interventions without peer support in the management of mental health concerns among youth.

Limitations

The Clinical Review is not without limitations. The grassroots origin and organization of peer support services were developed to provide an alternate approach to formal mental health care. Therefore, groups involved with peer support may not have had access to conventional RCTs and traditional research. Peer support services are described as value-based, in which the values of peer support are process- and goal-oriented. Conventional evidence synthesis, such as a SR of RCTs, may not be aligned with the values and principles of peer support. Outcomes such as recovery and social connectedness are not delineated by individual variables and are challenging to capture in traditional RCTs. This review is limited to summarizing effectiveness based on published literature with quantifiable outcomes. However, if peer support is to be integrated into the mainstream health care system, systematic evidence from the perspective of decision-makers of the benefits and harms of peer support interventions could be useful. We defined formal peer support programs as structured programs delivered by community- or health clinic–based organizations that offer peer support to youth peer service users by trained peer support workers who share lived experience relating to mental health. Evidence about peer support programs that do not fulfill this definition were not captured in the review but may be relevant to the broader understanding of the effectiveness and safety of peer support in general. We used this definition to ensure that findings from this review can inform potential decisions about the adoption and implementation of formal peer support programs for youth mental health. The main limitation of this review was the sparse evidence base from which definitive conclusions about effectiveness could not be drawn due to numerous limitations related to risk of bias, inconsistency, imprecision (small sample size), and indirectness. We did not conduct a meta-analysis because many of the outcomes were reported by a single trial. We did not locate any studies that reported on the safety of formal peer support (compared with interventions without peer support), and we located no studies reporting on health care resource utilization or social outcomes despite these being important to decision-makers and youth. Because only a single program was represented in the included trials (i.e., HOP), which included homogeneous populations of youth, we were unable to draw conclusions for our a priori subgroup populations.

Summary of Clinical Evidence

The purpose of this clinical SR was to assess the clinical effectiveness and safety of peer support programs compared with interventions without peer support for youth mental health. We conducted a systematic search of the literature for primary studies of formal peer support programs (with or without a comparison group who did not have peer support) among youth aged 12 to 25 years with self-identified or formally diagnosed mental health concerns. We identified 2 RCTs39,40,50 that assessed the clinical effectiveness of peer support programs compared with interventions without peer support (i.e., waitlist or TAU) for the management of mental health concerns among youth. We did not identify any relevant studies evaluating the clinical safety of peer support programs compared with interventions without peer support for the management of mental health concerns among youth.

The findings of the review suggest that peer support may be favoured over no peer support for some outcomes (e.g., attitudes to disclosure, disclosure-related distress, secrecy, help-seeking behaviour), whereas evidence for other outcomes showed there may be little to no difference in the effect of peer support compared with waitlist or TAU without peer support (although findings were affected by imprecision due to small sample size). However, for all outcomes at all time points, we judged the evidence to be very uncertain due to serious concerns for risk of bias, inconsistency, indirectness, and imprecision. The very low certainty of evidence suggests that the findings do not provide a reliable indication of the likely treatment effect and that there is a very high likelihood that the true effect of peer support programs compared with interventions without peer support could be substantially different than what is shown by the 2 included trials.

There are numerous types of peer support programs being studied for young people with mental health concerns. These include informal drop-in spaces for peer support, peer-to-peer communication programs, peer support delivered by volunteers without lived experience of mental health concerns, and peer-moderated online social forums. This variability in the forms and definitions of peer support has been observed in peer support for adult mental health as well.68 We defined formal peer support programs as formal or structured community- or health clinic–based programs that offer peer support to youth peer service users by trained peer support workers who share lived experience relating to mental health. Peer support can be offered on a one-to-one or group basis, and may be delivered virtually (e.g., video conferencing, mobile applications, web platforms or online chat, phone) or in person. We used this definition because formal programs with trained workers may mitigate safety concerns for both peer workers and peer support program users as well as ensure that the aspects of recovery orientation, empowerment, and trust be highlighted in the relationship between peer support worker and user.12

During the literature search and study selection process for this SR, we excluded several studies in which the interventions did not meet our definition of formal peer support. However, it is possible that, although the excluded studies did not focus on structured formal peer support, the findings could have value for decision-makers when considering adopting or implementing peer support programs. Two studies described programs that used the principles of a moderated online social therapy program for managing young individuals with mental health concerns.69,70 The studies evaluated the feasibility and effectiveness of the Rebound70 and Horyzon69,71 programs, which were multi-component interventions comprising online tailored psychosocial therapy, peer-to-peer online social networking, and expert support and peer moderations. In the Horyzons program, for youth following first-episode psychosis, for example, the online social networking component known as the “Café” was led by trained peer workers who had lived experience of mental illness. The peer workers moderated conversations and discussions in the social forum. In the Rebound program, peer moderators with lived experience of mental illness helped moderate and monitor online engagement of the participants. Thus, in these programs, the role of peer support beyond moderating online platforms seems limited. Because the intervention had multiple components, including tailored therapy, and because of the likely minor role of peer workers, the effectiveness of peer support is challenging to infer. We excluded studies of peer support programs in which the peer support workers did not have a shared lived experience of mental health concerns. It was also not clear whether the findings of those excluded studies could be extrapolated to peer support in general.

When designing and implementing peer support programs, equity considerations are important to ensure peer support programs are accessible and relevant to youth who experience marginalization or disadvantage. We sought to identify specific groups of youth who are disadvantaged who could experience an inequitable burden of mental health challenges and access to inclusive mental health services. For this process, we used PROGRESS-Plus,23 information from the available published and grey literature on peer support, and discussions with clinical and content experts. These groups of youth include, but are not limited to, youth members of the 2SLGBTQ+ community, Indigenous youth, Black youth and youth of colour, youth members of newcomer communities, youth experiencing homelessness or street involvement, youth with disabilities, and youth living in rural and remote communities. The included trials were conducted among a relatively homogenous population, and no subgroups of interest were identified within the trials. Thus, we identified no evidence regarding the value of considerations of equity in designing and implementing peer support programs for youth mental health, which highlights the evidence gap in this area. Future research focusing on these groups of youth who are likely to experience inequitable barriers to access to care and support are warranted.

Environmental Scan of Program Evaluation Methods

Overview

Research Questions

  1. What completed evaluations and evaluation method guidelines for peer support programs for youth mental health exist in Canada and internationally?
  2. What are the characteristics and components used in these evaluations and method guidelines for peer support programs for youth mental health and how are they measured?
  3. What are the findings of the completed evaluations of peer support programs for youth mental health in Canada?

Methods

Study Design

An ES was conducted to identify and describe program evaluation methods and guidelines in Canada and internationally, program evaluation characteristics and components, and any findings of completed program evaluations in Canada. The findings presented in this ES are based on a limited literature search and information obtained through targeted stakeholder consultations and stakeholder feedback. We used the limited literature search and targeted stakeholder consultations to inform the decision problem related to understanding how youth peer support programs are evaluated to support the design and implementation of these programs.

Literature Search Methods

The search for literature describing program evaluation aspects was performed by an information specialist using a peer-reviewed search strategy according to the PRESS Peer Review of Electronic Search Strategies checklist.31 The search strategy is available on request.

Published literature was identified by searching the following bibliographic databases: MEDLINE All (1946‒) via Ovid, Embase (1974‒) via Ovid, PsycInfo via Ovid, Cochrane Central Register of Controlled Trials via Ovid, Scopus, and the Cumulative Index to Nursing and Allied Health Literature (CINAHL) via EBSCO. All Ovid searches, with the exception of Cochrane Central Register of Controlled Trials, were run simultaneously as a multi-file search. Duplicates were removed using Ovid deduplication for multi-file searches, followed by manual deduplication in Endnote. The search strategy comprised both controlled vocabulary, such as the National Library of Medicine’s MeSH (Medical Subject Headings), and keywords. The main search concepts were peer support programs and youth with mental health concerns.

The search was limited to English- and French-language documents published between January 1, 2006, and January 17, 2022. Conference abstracts were excluded from the search results. Regular alerts updated the search until the publication of the final report.

Grey literature (literature that is not commercially published) was identified by searching sources listed in relevant sections of the Grey Matters: A Practical Tool For Searching Health-Related Grey Literature checklist,32 which includes the websites of regulatory agencies, HTA agencies, clinical guideline repositories, SR repositories, patient-related groups, and professional associations. Google was used to search for additional internet-based materials. These searches were supplemented by reviewing bibliographies of key papers and through contacts with experts and industry, as appropriate. Refer to Appendix 1 for more information on the grey literature search strategy.

Screening and Selecting Publications for Inclusion

One author independently screened and retrieved citations using management software DistillerSR (Evidence Partners, Ottawa, Canada). In the first level of screening, the author reviewed the titles and abstracts and retrieved and assessed potentially relevant articles for inclusion. The final selection of full-text articles was based on the inclusion criteria presented in Table 6. Articles that were published in a language other than English or French were excluded. All publication types were eligible. We excluded any articles that did not adhere to the definition of formal peer support programs and did not identify or describe information relevant to program evaluation methodology or outcomes.

Table 6. Components for Literature Screening and Information Gathering.

Table 6

Components for Literature Screening and Information Gathering.

Consultation Methods

We conducted targeted consultations with key informants involved in program evaluation for peer support programs for youth mental health to fill gaps in knowledge and to provide organizational perspectives. We adopted a purposive sampling approach to identify representatives from various organizations across Canada that offered peer support for youth mental health that included some component of program evaluation. We identified stakeholders through CADTH’s network of liaison officers situated across Canada, referred through other informants during consultations, and through internet searching. One researcher reached out to stakeholders via email and interviewed those willing or able to participate. The researcher conducted the consultations with each key informant via Zoom using a semi-structured interview format. We developed the interview questions based on the research questions, and included questions related to how program evaluation was conducted within the organization that the informant represented, methods and resources used to inform program evaluation, and outcomes that are captured through evaluation. In addition to understanding the methods of program evaluation, equity considerations related to program evaluation were sought during consultations. When possible, representatives shared additional documents and resources to provide examples of what program evaluation efforts look like within their organization and what informs their program evaluation processes.

Six of the consultations followed the same original semi-structured interview guide. Upon analysis of the initial interviews and new emerging insights, the researcher refined the semi-structured interview guide to explore newly identified and targeted information for the remaining consultation (refer to Appendix 4 for the interview guide). Before each consultation, we obtained key informants’ consent to participate and informed them how we will use the information in the final report. Consultations were recorded, and transcripts of the consultations were generated using Microsoft Word and reviewed by the researcher. Key informants involved in the consultations and other relevant stakeholders were also asked to provide feedback on the draft report after completion.

Synthesis Approach

One researcher conducted a descriptive analysis of the literature and consultation transcripts. To do so, the researcher first identified and summarized completed evaluations and methods guidelines identified in the literature, including article characteristics such as author, year of publication, and country in which the evaluation was completed using Microsoft Word. Relevant characteristics are presented in tabular form in Appendix 6 and narratively summarized in the Findings section.

To identify the characteristics and methodology that guide program evaluation, the researcher then examined the identified literature and consultation transcripts to systematically identify and sort information relevant to program evaluation characteristics, methods, outcomes, and equity considerations into relevant categories. The researcher exported the categories to a table in a Microsoft Word document and shared the table with a second and third researcher for discussion. The 3 researchers compared and adjusted the categories in regular meetings. The lead researcher then narratively summarized the categories, formulating a description of program evaluation methods and characteristics in the findings. Information related to program evaluation characteristics, methods, guiding principles and resources, and outcomes measured are presented in Appendix 8.

Findings

The findings are based on a limited literature search, 7 consultations collected between February 7 and May 20, 2022, and stakeholder feedback. We present the findings by describing identified evaluations and methodological guidance for evaluating peer support programs for youth mental health in Canada and internationally; principles, methods, and outcomes used in evaluations of peer support programs for youth mental health; and findings of completed evaluations of peer support programs for youth mental health in Canada.

A total of 642 citations were identified in the literature. After screening the titles and abstracts, we excluded 627 citations and retrieved 15 potentially relevant reports from the electronic search for full-text review. We retrieved 23 potentially relevant publications from a grey literature search for full-text review. Of these potentially relevant articles from the electronic and grey literature searches, 36 publications were excluded for various reasons and 2 publications met the inclusion criteria and are included in this report. An overview of the included publications is provided in Appendix 6. We retrieved additional program evaluation resources through consultations and stakeholder feedback which included guiding resources and examples of completed program evaluations from different organizations. Relevant information related to the use of these guiding resources or findings from examples of program evaluations conducted in Canada that were shared have also been included in this report. An overview of the examples of program evaluations that were shared and included in this report are provided in Appendix 7.

We contacted 17 stakeholders via email for consultation. Nine stakeholders responded to this call for consultations; 1 respondent refused consultation because they were not able to provide appropriate expertise on the subject and 1 respondent was lost to follow-up after initial consultation contact. We conducted 7 consultations via Zoom with representatives from organizations in British Columbia, Manitoba, Ontario, and New Brunswick. A list of the organizations represented through stakeholder consultations and a brief description of each peer support program from the organizations is provided in Appendix 5.

Identified Evaluations and Methodological Guidance for Evaluating Peer Support Programs for Youth Mental Health in Canada and Internationally

We identified 2 publications72,73 from the literature search that outlined program evaluation methods used to evaluate peer support programs for youth mental health. The first publication72 outlined the approach used to evaluate the peer support services within the Transitional Aged Youth (TAY) program offered through the Leap of Faith Together community services in Ontario. The TAY program offers services to approximately 800 youth between the ages of 14 to 26 years and involved peer support services alongside case management, mental health, and housing support services.72 The authors of this publication describe the implementation of a hybrid realist and participatory approach used in the evaluation of peer support services for youth with mental health, physical health, and substance use challenges.

The second identified publication73 was an independent evaluation of the Peer Support for Mental Health and Wellbeing Pilot program offered through the Department for Education in the UK. The aim of the Peer Support for Mental Health and Wellbeing Pilot program evaluation was to gather evidence related to understanding the set up and delivery of peer support for youth mental health and well-being in schools, colleges, and Children and Young People’s Community Organizations (CYPCOs).73 The evaluation was designed to address questions related to the program model, implementation, benefits, and outcomes.

Representatives from 3 organizations involved in the stakeholder consultations shared examples of evaluations of peer support programs for youth mental health completed in Canada. One of the reports was the results of the Peer Support Integrity, Quality and Impact (PSIQI) survey for the Just Be You program offered through the Centre for Innovation in Peer Support at Support House.74 The Just Be You program is a youth-led group that provides social recreation and peer support for youth aged 15 to 25 years who are experiencing mental health and/or addiction issues. This report was completed in 2019 and was part of a system-wide administration of the PSIQI survey to provide baseline data in the perceived integrity, quality, and impact of peer support services offered through the Just Be You program. The survey included individuals who were, at the time, engaged in peer support or who had recently engaged in peer support within the past 2 months. The survey used in this report was designed to gain information related to peer support services integrity, the perceived quality of peer support being offered, and the perceived impact that peer support had on the individual.74 It should be noted that the PSIQI survey was designed as part of a larger research process, which included reliability testing and validation, to provide information and measure peer support services. This survey has been used in a wide variety of contexts, including but not limited to the Just Be You program.

Another report that was shared focuses on the evaluation of the Foundry Youth Peer Support Curriculum which was offered both in person and virtually between October 2019 and May 2020 for peer support workers.75 Participants of the evaluation were invited to complete surveys and participate in focus groups to share feedback on the curriculum. This also served as an opportunity for workers to understand their roles and training objectives. Based on this evaluation, 5 key recommendations were developed related to training content, delivery, workbooks, virtual training, and training format.75 Note the Foundry Central Office is currently undergoing a change in their evaluation practices, so information presented in this report may not align with future Foundry Central Office methods of evaluation.

Representatives from EveryMind Mental Health Services (EveryMind) shared an executive summary of the youth peer support pilot project, titled the Legacy Report, which was completed in March 2022.76 This report outlined the evaluation framework which includes the evaluation approach and objectives, data collection approaches, and analytic approach. The evaluation was conducted using an exploratory approach to assess anticipated and unanticipated program outcomes informed by participants and youth peer support workers.76

In addition, 1 program evaluation was shared during the stakeholder feedback phase of this report, titled Peers Supporting Peers: An Evaluation of a Peer Support Centre at a Canadian University, which was completed in August 2019.77 This report provided results from a program evaluation that was conducted to assess the mental health status and session quality as reported by program participants of an on-campus, student-led peer support service called the Peer Support Centre offered at McGill University.77 The results of the evaluation were analyzed using quantitative and descriptive statistics from responses to an online survey that was offered to participants after each session.77

Principles, Methods, and Outcomes Identified in Evaluations of Peer Support Programs for Youth Mental Health

Program Evaluation Goals

Generally, informants identified that the purpose of engaging in evaluation is to help inform quality improvement efforts of the program. One informant mentioned that in addition to informing quality improvement efforts for the program, evaluation also offers a way to establish a level of baseline effectiveness that can be used to promote uptake of peer support services across the organization. Another informant stated that the aim of program evaluation was to determine adherence to the program’s recovery-based model of care. The goal of program evaluation can also be oriented toward establishing a level of formality and homogeneity when youth peer support services are offered across different sites, which is the case for Foundry Central Office.

The authors of the publication that evaluated the TAY program specified that there is a lack of evaluative strategies that can be applied across youth peer support programs.72 The goal of this evaluation is to provide guidance for researchers implementing a realist evaluation aimed at describing complex processes to those involved in the evaluation, managing a flexible research approach, and incorporating a system for consideration of context, mechanism, and outcomes.72 The second publication focused on understanding set up and delivery of youth peer support, but the goal of the evaluation was to gather evidence to produce a range of replicable peer support models for different youth environments and contexts.73 In addition, evaluation was meant to inform the design and further development of youth peer support programs in schools and CYPCOs.73 The goal of the completed evaluation of the Peer Support Centre program that was shared through stakeholder feedback was to determine who was accessing the peer support service, how mental health needs may have been met by this service, and to assess the quality of the sessions as reported by those who used the peer support service through the Peer Support Centre.77 The results of this evaluation were used to inform changes to the program to better service the needs of individuals who accessed peer support services through the Peer Support Centre.77

Guiding Principles and Practices Used in Program Evaluations

Informants from 4 organizations identified a recovery-oriented model of care to be the foundation of peer support services. As such, their program evaluation focused on assessing the fidelity of the program in terms of the individual’s relationship with recovery. The Mental Health Commission of Canada has developed a guideline to support recovery-oriented practice for mental health support which was referenced by the New Brunswick Department of Health (DoH) and the Centre for Innovation in Peer Support at Support House.78 The guideline for recovery-oriented practice provides a comprehensive Canadian reference document for understanding recovery and allows for consistent application of recovery principles. The basic principle of recovery-oriented mental health practice is to support people to define personal goals, exercise capabilities, and use their strength to attain their potential through a personalized approach in managing their journey to recovery.78 In addition, 2 informants outlined the use of the Canadian Personal Recovery Outcome Measure (C-PROM) tool to be used either in conjunction with their evaluation methods or as a guide to inform evaluation methods to help collect recovery-oriented data. The C-PROM tool is a measurement tool that provides information of user health status relative to their quality of life and can be applied to assess mental health recovery.79 Despite these organizations specifying that a recovery-oriented model of care is used as a guiding principle, the practice of recovery is different across organizations because it is dependent on the user, which leads to heterogeneity in how recovery may be evaluated.

A major discussion point from stakeholders representing the various peer support programs for youth mental health is a general sense of heterogeneity and fragmentated practices related to program evaluation across organizations and jurisdictions. This collective sense stems from a lack of standardization either jurisdictionally or nationally for the process of evaluating peer support programs specifically for youth mental health. From an evaluative standpoint, there is a lack of formal guidance that is consistently applied for peer support programs specifically for youth mental health. Three informants emphasized that program evaluation efforts would benefit from having guiding resources that could support the development of program evaluations across organizations. This challenge prompts programs to develop an individual style approach to program evaluation, which may impact the broader landscape of evidence needed to support the uptake of peer support programming for youth mental health. For example, an informant from Foundry Central Office described the challenges of relying on anecdotal-based evaluative measurements to inform the need of programs that offer peer support services. Yet, the informant also described the advantages of recently transitioning to capture more comprehensive program evaluation measurements that better inform the impact of the program. Because of the heterogeneous nature of peer support programming and evaluation, applying consistent methods and measurements across organizations may not be feasible or address the actual needs of the program. Heterogeneity between programs can also be valuable in peer support programming and evaluation because it can allow programs to be more adaptable to individual and program needs.

The different ways peer support is applied in different programs contributes to the overall fragmented landscape of program evaluation for peer support services for youth mental health. One informant highlighted the challenge in understanding how other organizations interpret the definition of peer support services. For example, Foundry Central Office uses a formal definition of peer support programs, which is a program delivered by formal community or health care–based organizations that offer peer support to peer service users by trained peer support workers who share lived experience related to mental health. Yet, other organizations that Foundry Central Office interacts with may offer selected aspects of peer support (e.g., health systems navigation support). This can lead to challenges in evaluation because formal program evaluation efforts may not be consistently applied across organizations due to the discrepancy in what the programs offer. Despite the lack of standardized evaluation guidelines and practices, program representatives also acknowledge that standardized approaches to evaluation may not be beneficial to the integrity and appeal of peer support as an informal and flexible intervention to facilitate recovery.

However, programs do share commonalities in their approach to evaluation. For example, 2 informants specified that practice-based evidence informs evaluation efforts, which is the process of measuring and tracking real-world practice to inform an evaluation that is tailored to the needs and realities of the program. Another common evaluation practice is the use of co-design, as indicated by 4 informants and outlined by the authors of the TAY program evaluation.72 Co-design is the process of involving service users and workers to inform the direction and aim of program evaluation. This process allows for a tailored evaluation approach that maximizes the benefit for individuals involved in the use and delivery of the program. First, it allows for greater involvement of youth in the program evaluation strategy. This can be done through the involvement of youth-led committees in the evaluation design, or by gathering information from service users and workers through focus groups or one-on-one feedback operations to share experiences and ideas specifically toward evaluation strategies. Second, representatives from some of the organizations highlighted the benefit of youth engagement through co-design as a method of mental health recovery. For example, 1 informant from EveryMind stated that including youth program users and workers in the program evaluation process can often serve as an additional therapeutic experience because it allows the opportunity for further reflection on the program and within the individual. Finally, informants from 2 organizations and the authors of the TAY program evaluation72 also indicated what to consider when involving youth in the program evaluation process, specifically to help youth feel safe and valued. This includes the importance of favouring the voice and lived experience from youth lending their perspective over professional or clinical voices. This allows for youth to be more fully engaged and provides a sense of value without the fear of being overridden when it comes to program evaluation development.

Similarly, the authors of the publication that evaluated the TAY program adopted a realist and participatory approach to guide the evaluation of youth mental health peer support services. The authors defined the realist evaluation strategy as an approach that aims to address gaps in the design of youth peer support by answering “what works, for whom, how, why and in what circumstance?”.72 Although the realist evaluation approach does offer insight to how and why youth peer support may be effective, it is primarily theory-driven and lacks evidence related to lived and living experience from people involved in the program. The authors then integrated a participatory approach in the realist evaluation to actively engage youth in the research process through involvement in identifying the research focus and methods for data collection.72 The participatory approach allows for the inclusion of program users with lived and living experience to facilitate the design and implementation of program contexts and to assess theoretical assumptions made through the realist approach.72

Data Collection and Analysis in Program Evaluations

Program representatives and authors of the identified publications72,73 described various methods for data collection and analysis methods used in the program evaluations. Informants from each organization identified surveys as the primary method of collecting evaluation data and feedback. The design and development of the surveys used to collect data and feedback was applied differently across organizations. Two organizations used other pre-existing tools, such as the C-PROM tool, to guide the design of their surveys, while other organizations primarily based their survey and data collection methods on feedback from those engaged within the program. Informants from 2 organizations described the design of their surveys to be largely based on previous survey and data collection efforts used within the program with minimal change. In addition to the use of surveys to collect data, informants from some organizations and the authors of the identified publications72,73 described other methods of data collection, which include interviews, focus groups, and case study visits with individuals involved in the peer support program.

Representatives from the Centre for Innovation in Peer Support at Support House described and shared a modified survey tool called the PSIQI survey that was developed to help organizations providing peer support services gain insight into the experience of peer support from the perspective of people receiving peer services.80 The purpose of this survey is to assess the degree to which peer support services align with the values of peer support, the quality of service, and the degree to which users believe peer support impacts their day-to-day lives.80 The PSIQI survey includes questions about the users’ experience with a peer support worker, their experience before starting peer support, their experiences receiving peer support, changes from experiencing peer support, and demographic information.80 The example report shared by the Centre for Innovation in Peer Support at Support House shows how the PSIQI survey was applied to evaluate the Just Be You Program. The first portion of the evaluation reported information related to non-identifying demographic information, engagement in the peer support program, and the focus of peer support being received by the user (e.g., mental health purposes, substance use, harm reduction, and/or housing).74 The second portion of the evaluation reported on service integrity, service quality, and service impact.74 Service integrity and service impact was assessed using a 5-point Likert scale on a series of relevant statements, while service quality was assessed using 2 closed-ended questions, and respondents described how they felt during their experience with a list of positive and negative emotions to check off.74 Similarly, the authors of the program evaluation that was shared through stakeholder feedback described the use of an anonymous and confidential online survey that was made available to users after a support session at the Peer Support Centre.77 The online survey used questions from the Patient Health Questionnaire-9 (PHQ-9),81 Generalized Anxiety Disorder-7 (GAD-7),82 and Outcome Rating Scale83 tools to assess user mental health status.77 In addition, the online survey assessed user’s perception on peer support session quality by using the Session Rating Scale.77,84

Data collection efforts were not limited to the experiences of the program user. Informants across each organization described a need to involve both user and worker feedback within the evaluation process. Foundry Central Office described surveys that are used to establish youth experience and satisfaction with peer support and peer support worker experience through collaboration with youth and parent advisory councils. This was shown in the example report that was shared which focused on the evaluation of the curriculum and training for peer support workers. The data collection methods used included survey administration before and after training sessions, focus groups, and key informant interviews.75 Similarly, the example report shared by EveryMind included feedback from peer support workers who received program training.76 Data regarding training experience were collected qualitatively by using pre-specified, open-ended questions to create a dialogue among several small groups which were described as a “World Café.”

The authors of the publication that evaluated the TAY program outlined data collection methods for the realist and participatory approaches used in the evaluation.72 Mixed methods are recommended in the realist approach so that qualitative methods can be used to understand program processes and theory while quantitative data collection can be used to measure outcome patterns. Additionally, the realist evaluation strategy incorporates the use of a context-mechanism-outcome-configuration design to assess how and why a program may be effective.72 The realist approach included an initial exploration of the formal program theory through a review of the literature, program documents, and interviews with key stakeholders. The participatory approach was conducted through a workshop that included peer staff, non-peer staff, and students involved in the TAY program. The workshop focused on the study purpose and background, evaluation principles, and feedback on the initial program design and issues within peer support.72 After the realist and participatory evaluation data were collected and analyzed, a second round of data collection was designed based on findings from the realist and participatory data collection. The second round of data collection included peer interviews, client online surveys, peer online survey, and knowledge mobilization to present findings and facilitate discussion for decision-making surrounding the findings.

Finally, the authors of the publication that evaluated the Peer Support for Mental Health and Wellbeing pilot program used a mixed-methods approach to collect quantitative and qualitative data. This approach included a survey of organizational pilot leads, follow-up qualitative telephone interviews with pilot leads, case study visits with a purposive sample of pilot organizations, participatory research tools for youth to understand experience of peer support, and a pre- and post-quantitative survey for youth to measure changes to overall well-being. The evaluation was designed to incorporate a capacity-building element, with the aim of supporting pilot programs to undertake self-evaluation, and to engage young people in the data collection and analysis. An evaluation toolkit was developed for organizations to use, which was rolled out with supporting guidance and a training webinar.73

The analysis of the evaluation data that are collected is handled differently across organizations. One informant specified that the Canadian Mental Health Association offers yearly assessments of evaluation data. Similarly, 2 informants identified the use of external services to analyze data that have been collected and share that information back to the organization for interpretation. Some organizations specified that data analysis was done independently in an in-house setting. Different organizations described assessing data at various time points, including using 1 time point or multiple time points to assess change. One informant described using a pre-post analysis approach and results were aggregated across different programs that include peer support services. Other organizations assessed data on a regular basis or at specified time intervals. Three informants described a process for ongoing evaluation as the program was being carried out, meaning that feedback from individuals involved in the delivery and use of the program is gathered in real time as the program is being offered, while another informant specified that data are collected at program intake up to 9 months after program engagement. Similarly, authors of the evaluation of the Peer Support for Mental Health and Wellbeing Pilot program analyzed quantitative data from survey results from baseline to follow-up responses if possible, while qualitative data were analyzed at follow-up based on themes and codes mapped to the key research questions for the evaluation.73 The authors of the publication that evaluated the Peer Support Centre program analyzed the responses of an optional online survey distributed after a support session from September to December 2018 using descriptive statistics analytical methods.77

Outcomes Identified in Program Evaluations

Each organization described the general outcomes measured through program evaluation. For the purpose of reporting, we categorized these outcomes as recovery-oriented outcomes, individual outcomes, program outcomes, and system-level outcomes. Informants from 5 organizations reported that recovery-oriented outcomes were measured during program evaluation. Recovery-oriented outcomes consisted of user’s perceptions and experiences of community integration; overall fulfillment; change in emotions and emotional regulation; empowerment; relationship to education, employment, and social connections; attitudes toward personal recovery; overall well-being and mental health status; and overall recovery. Individual outcomes shared some overlap with what might be interpreted as recovery-oriented outcomes mainly because recovery shares a relationship with the individual. Informants from 4 organizations outlined individual outcomes that are measured during program evaluations. Individual outcomes identified and measured by these informants consist of user and worker experience, degree to which users felt supported, and various employment related outcomes that were not specified. These individual outcomes may be distinct from recovery-based outcomes because they may not directly impact a person’s recovery. Outcomes related to program operations and use were identified by informants from 3 organizations. Program-related outcomes consisted of tracking the number and demographics of program users, duration of user engagement, and assessment of changes implemented within the program. Informants from 3 organizations identified system-level outcomes that were assessed, which consisted of tracking hospitalizations and length of stay from program users and use of external services (e.g., psychiatric, or inpatient services) prompted from the use of peer support. One informant from Foundry Central Office described a shift in outcome measurements from program-level output metrics to understanding the impact of the program itself. This shift in collecting outcome measurements aimed at evaluating the impact of peer support services to better understand the effectiveness of the programs. This process was described as using health measurements and repeat measurements based on an outcome rating scale with composite domains focusing on the relationship to recovery.

The authors of the publication that evaluated the TAY program described outputs that the realist and participatory approach aimed to capture. The realist approach aimed to gather information and contextualize initial contexts, mechanisms, and outcomes identified by key stakeholders to inform refined research questions for additional program evaluation, while the participatory approach collected feedback on initial design and current issues of interest within peer support.72 The authors of the publication that evaluated the Peer Support for Mental Health and Wellbeing Pilot program assessed outcomes related to social and emotional well-being and resilience, personal development, organizational outcomes and capacity building within the programs.73 The authors of the publication that evaluated the Peer Support Centre program assessed user mental health status related to depressive and anxious symptoms as outlined by the PHQ-9 and GAD-7 tools, and personal, interpersonal, social, and general well-being as outlined by the Outcome Rating Scale tool.77 In addition, user’s perception of session quality outcomes were informed through an agreement scale from 0 to 10 for 4 questions related to being understood, user’s needs, session approach, and overall feeling of session “fit” from the Session Rating Scale tool.77

Equity Considerations in Program Evaluations

Questions within the consultations related to each organization’s efforts to consider equity as a component of program evaluations were presented to each representative. Offering youth an experience that is rooted in equity is an important consideration among programs. Multiple representatives from the organizations involved in the consultations were able to speak to the way in which equity is considered both within the program as a whole and specifically within program evaluation. Equity considerations were not identified within the publications included in this report; therefore, only equity considerations captured through the consultations are presented.

The informants presented multiple examples of showing how equity was considered within the program evaluation process. These considerations included using multiple methods of data collection to minimize barriers to provide feedback, ensuring that all evaluations were anonymous and data collection was confidential to ensure participant safety, providing transparency in the evaluation process to all users by explaining methods and reasoning for data collection, and making efforts to identify potential inequities during participant intake to help address barriers to participation. Additionally, all evaluation and feedback participation was kept optional to alleviate any pressure for those involved in the program; within the program evaluation process, there was an emphasis to shift away from using clinical language to minimize stigmatization. Informants from EveryMind discussed the importance of providing adequate compensation for those involved in the evaluation process as an acknowledgement of the potential effort endured during the evaluation process. Foundry Central Office has also implemented a virtual care program that offers increased access to peer support programming and evaluation by promoting access to care and evaluation capabilities for rural and remote youth.

One overarching sentiment shared from representatives from 4 of the consulted organizations was the idea that evaluation efforts should focus on the needs of, and include the perspectives of, the youth involved in the program. The informant from the New Brunswick DoH stated that within their program evaluation process, a client-led approach was adopted to include user perspectives and may allow for appropriate representation within the evaluation process. Furthermore, informants from EveryMind emphasized that efforts for including diverse perspectives to inform evaluative processes is key to ensuring appropriate representation yet stated that demographic specific data collection or attempts to measure individual identifiers are not used within the evaluation as an additional layer of participant safety.

Evaluation efforts aimed at involving and adhering to the needs of youth engaging with the program have contributed to heighten the awareness of providing appropriate and safe care for youth who experience marginalization, racialization, and who are Indigenous . Informants from the Centre for Innovation in Peer Support at Support House, EveryMind, and Foundry Central Office described fostering a relationship with youth engaged in the peer support programs and who can provide feedback regarding the evaluation process in a way that holds the organization accountable to provide appropriate care in a culturally competent manner. Foundry Central Office outlined the ongoing efforts to incorporate a learning management system that involves the implementation of an Indigenous lens and autism spectrum disorder module for youth peer support training evaluation. Additionally, they described an organizational responsibility to capture Indigenous-focused data collection and evaluate in a culturally competent manner.

Furthermore, Foundry Central Office described the challenges with implementing equitable processes within their program evaluation but understanding that these processes can often take time to ensure that the appropriate path is taken to prioritize youth safety in a culturally sensitive way. This also means developing and maintaining a continual relationship with communities engaged with the organization’s peer support services. In some cases, although equity considerations within the evaluation process were not explicitly outlined, organizations highlighted how the evaluations helped identify gaps in program uptake among those using peer support and those living in the community. In addition, some informants also emphasized that peer support services that are offered currently lack appropriate equity considerations but expressed an intention to incorporate equity considerations as program evaluation becomes consistently applied with greater program uptake.

Finally, representatives from some organizations also shared ways in which youth engage with their individual mental health recovery through program self-selection. As a result, organizations have a responsibility to offer programs that can fit the needs of youth. This is often informed through program evaluation; therefore, efforts must be made to create equitable programs that reflect the user.

Funding Considerations for Program Evaluation

During the consultations, key informants highlighted that funding considerations can affect how they carry out their program evaluations because program funders have the ability to shape the evaluation process through the criteria to access and hold funding. For example, program funders may request that certain metrics be captured to show that programs have a certain level of uptake and are effective. For other organizations, the availability of external funding specifically for evaluation prompted a shift in the aims of their evaluation. Rather than collecting program output data that can give a brief snapshot of program use, they aim to understand the effects of the programs on peer support users (i.e., demonstrate how peer support may be effective).

One informant highlighted the importance of flexibility when working with the funder’s needs to collect data while being mindful of the potential effects on program users or workers. For example, a funder may request information that is sensitive in nature so questions should be asked in a mindful manner with an emphasis on minimizing harmful language that may make the individual uncomfortable or cause further harm.

Finally, program evaluation may also be constricted by resource availability. One informant described the challenges associated with the de-prioritization of program evaluation due to costs. When cost and resourcing are considerations for organizations that are funding peer support programs, program evaluation may be cut to save on program costs or may not be accounted for in funding allocated to the program. The inability or limited resources to conduct evaluations has direct effects on programs’ functionality and ability to offer tailored programs to fit the needs of the users.

Findings of Evaluations: Peer Support Programs for Youth Mental Health in Canada

The 1 identified Canadian publication that provided information related to the evaluation of the TAY program reviewed the methodological guiding principles and information related to the characteristics, outcomes, and measures used in the evaluation; however, the findings of the evaluation were not presented in the publication so could not be extracted for the purpose of this ES. Furthermore, the examples of the completed evaluations shared by the Centre for Innovation in Peer Support at Support House and Foundry Central Office during the consultations are not publicly available, and therefore cannot be presented in this ES.

The examples of the completed evaluations provided by EveryMind and through stakeholder feedback are publicly available and report findings from the Youth Peer Support Pilot Project76 and Peer Support Centre program.77

Youth Peer Support Pilot Project: EveryMind

The objective of the evaluation conducted by EveryMind was to assess peer support worker training and program implementation process-related questions (i.e., how the peer support worker training and program were implemented and if they were implemented as intended) and outcome-related questions (i.e., changes that may have occurred as a result of the training and program).76 The findings of the evaluation were grouped in peer support worker recruitment and training findings and program implementation findings.76 The overall findings of this evaluation informed a set of recommendations related to practices for future programming of peer support programs for youth mental health. The evaluators collected and analyzed qualitative and quantitative data to assess process- and outcome-related questions, and qualitative data to capture the experiences of peer support users and workers. Program indicators were collected to capture information related to the process evaluation questions by assessing youth’s answers to content-based and demographic questions from the peer support training, and gathering attendance data, information on program access (i.e., training, group sessions, one-to-one sessions), and information on session topics. Peer support worker recruitment and training findings were informed by 31 participants, while 23 participants informed the program implementation findings. Data collection for this evaluation was completed in March 2021.

Peer Support Worker Training Recruitment Findings

The report outlined that the majority of the youth learned about peer support training through friends or peers (29% of respondents), which indicates that a variety of forums and media need to be used to reach youth and to publicize youth peer support training.76 Youth also likely have competing demands that need to be considered when engaging youth in the recruitment process.76 For example, the majority of the youth included in the evaluation identified as being full-time students (35% of respondents).76 In addition, the majority of youth included in the evaluation indicated they had previous experience participating in peer support (73% of respondents).76 Youth peer support training applicants often have previous experience either through providing or receiving peer support that need to be considered and implemented in the recruitment process, and youth interests can often inform their experience in supporting peers in their recovery journey.76

Peer Support Worker Training Findings

Overall, there was positive participant feedback regarding youth peer support training for this pilot project, showing that the training learning objectives were met with rating averages between 82% and 97% for agreement with statements about training benefits.76 The report outlined that some of the key benefits of youth peer support training included increased knowledge and understanding of youth peer support, personal growth, and a positive learning environment.76 In addition, it was noted that youth peer support workers may be able to provide insights and mentorship to address stigma, promote outreach, provide support for family dynamics and unique cultural experience, managing life transitions, and stress management.76

Peer Support Program Implementation Findings

Implementation findings focused on the experience of the peer support users and workers. It was noted that interest in accessing youth peer support was consistent across participant age (between 14 and 25 years).76 Peer support users were able to develop strategies to manage difficult situations and experienced a sense of connection, space to share, and personal growth.76 Peer support users and workers experienced reciprocity, meaning they were able to learn and benefit from one another.76 Both group components and one-to-one components of peer support received positive feedback. In addition, it was reported that youth valued being included in all phases of the program, from planning to implementation, and that it is important to provide financial compensation for youth support workers to reflect their contributions.76

Finally, evaluators developed recommendations for future programming based on the findings and lessons learned. The recommendations are:

  • Youth peer support needs to be offered as part of the core service system throughout the service process, including bridging for adult mental health service and ensuring feedback is integrated as part of the service process.
  • Ensure effective co-design as the foundation for youth peer support models by using principles of youth engagement and being responsive to youth feedback throughout the process.
  • To develop and implement a youth need–based program, support and buy-in from all levels of involvement (senior leadership, management, staff, and youth) is needed.
  • Implementing and sustaining youth peer support services needs careful consideration for the necessary supports and resources, including compensation for youth peer support workers, pay equity, and allotted time per work schedule.
  • Youth peer support training should be offered annually to young adults with lived experience. Training can help build resilience, leadership skills, increase formal knowledge of peer support, and build community capacity.
  • Strategies to engage youth with lived experience and knowledge of the system need to be developed by system leaders. This should include meaningful professional development and employment opportunities.
Peer Support Centre Program: McGill University

The aim of the evaluation was to determine who was accessing peer support services, the mental health status and needs of those using peer support services, and the quality of peer support services sessions as reported by those who used these services.77 The findings of this evaluation were based on the responses to an anonymous and confidential online survey that was offered to users of peer support services through the Peer Support Centre program.77 Data were collected after each support session from September to December, 2018, and included 120 completed surveys.77

The authors of the evaluation reported that 57.5% of users completed demographic-related questions, which may be a limiting factor for understanding who accessed this program.77 However, it was reported that the primary reasons for accessing peer support services was due to a lack of available mental health professionals and the need for immediate support.77 User’s well-being outcomes assessed by the Outcome Rating Scale found that majority of users reported well-being scores of 25 or lower out of a possible 40.77 The authors reported results from the GAD-7 tool and found that approximately 24.2% and 23.3% of users reported moderate or moderate to severe anxiety, respectively.77 Furthermore, the authors reported results from the PHQ-9 tools and found that approximately 22.5% and 14.2% of users reported moderate or moderate to severe depression, respectively.77

Users were also asked about their perception of peer support services quality offered through the Peer Support Centre program. Questions were based on the Session Rating Scale and asked:

  • Did you feel heard, understood, and respected?
  • Did you talk about things you wanted to talk about?
  • The supported approach was a good fit for me
  • Overall, today’s session was right for me.77

Approximately 57.4% of respondents reported having a good relationship between support providers and users, 80.8% of respondents reported that they would agree or strongly agree that talking to a support provider helped with their mental and emotional well-being, 69.2% of respondents indicated that their peer support session was good or excellent, 96% of respondents would recommend the Peer Support Centre program to others, and 91% perceived the peer support as being beneficial to other students.77

The overall conclusions highlighted by the authors of this evaluation found that university-based peer support services offer potential benefits through improving access to mental health services and addressing the mental health needs that are often present among this demographic.77

Limitations

The findings are based on a literature search and targeted stakeholder consultations. The consultations included representatives from 7 organizations in British Columbia, Manitoba, Ontario, and New Brunswick. Because the stakeholders were identified by CADTH or through referral from others involved in consultations, it is likely not all relevant stakeholders were identified and contacted. While our focus was on evaluation of peer support programs for youth mental health within Canada, future research should aim to include exploring completed evaluations in more detail through consultations from other countries. The results of the consultations were based on a small sample of stakeholders that is not representative of all stakeholders across Canadian jurisdictions. Additionally, despite their expertise in program evaluation and peer support services, stakeholders were only able to speak to the organizations they represented. The responses may not reflect all peer support programs and evaluation processes available in Canada. Program users or workers were not contacted for consultation; therefore, results are only representative of people involved at the organizational level. However, program user and worker insights on peer support programs for youth mental health were explored in the Peer Support Youth Advisors’ Experiences component of this HTA, which also highlighted some user and worker perspectives on program evaluation. Information on the clinical evidence supporting peer support programs for youth mental health was not collected as part of this ES. The clinical evidence supporting peer support programs for youth mental health was evaluated in the Clinical Review component of this HTA.

The limited literature search identified 2 reports that outlined evaluations for peer support programs for youth mental health. One of the identified reports was based in Canada; however, it did not provide details regarding the evaluation findings but focused on the methods used for program evaluation. The second identified report did provide findings of the program evaluation, but because this report was based in the UK, these findings were not relevant for this ES.

Considering these limitations, not all peer support program evaluations for youth mental health available in Canada were identified by this ES. As a result, it is likely that the information presented is not comprehensive or representative of all organizations that offer peer support services for youth mental health in Canada. Further research would be required to have a complete working knowledge of all program evaluation considerations for peer support programs across Canada.

Summary of Program Evaluation Methods

The findings from the literature and stakeholder consultations outline how evaluation of peer support programs in Canada is heterogenous mainly due to a lack of formal guidance and diversity stemming from adapting practices that meet the needs of the individuals and program contexts. However, we identified some commonalities across programs in the methods and approaches used to conduct evaluations. These commonalities include the principle of practice-based evidence, a focus on evaluation that adheres to a recovery model of care, involving youth in the design and conduct of the evaluation, and addressing the needs of the youth involved in the program through evaluation.

We found various methods of data collection and analysis in the literature and through consultations. The most common approach for data collection was through surveys, either designed on an individual basis or shaped after other guiding resources. Findings from the literature and some consultations highlighted other methods used for data collection such as one-on-one interviews, focus groups, and follow-up case studies. Some programs from the consultations identified the need for external resourcing for data analysis and interpretation.

We identified and categorized a number of program evaluation outcomes. These included recovery-oriented individual outcomes, program outcomes, and system-level outcomes. There was a large amount of overlap between recovery-oriented outcomes and individual outcomes. A few programs measured outcomes related to the program itself or the system (e.g., health care resource use). These latter outcomes are often measured to address the priorities of program decision-makers or funders, which might not always align with the those of the programs. This divergence highlighted the competing objectives of program evaluation as a tool to address the needs of the youth, the program and organization, and the funders.

Representatives from across organizations were able to share if and/or how equity is considered during program evaluations. It is evident that there is a special interest in providing an experience for youth that is rooted in equity. Representatives shared examples of how equity may be considered, such as providing transparency in the data collection and methods used in program evaluation, ensuring safety of the individuals by removing potential identifiers within the evaluation, ensuring that participation in evaluation is optional, and prioritizing the voice of the youth involved in the program to help guide evaluation. It was also noted that building a process for equitable resourcing in programs and evaluation must be done through a continual relationship with communities, which demands proper time allocation and resourcing.

Finally, we presented findings from 2 completed program evaluations that were shared through consultations. One set of findings were related to the evaluation of recruitment and training of peer support workers and implementation of a youth peer support pilot project, which included recommendations for future programming that were informed by the evaluation.76 The other set of findings were related the evaluation of peer support services offered at McGill University and assessed by users’ mental health status and perception of session quality.77 Findings from the limited literature search and other resources shared through consultations cannot be presented because they were either unavailable or out of scope.

Discussion

Because peer support is based on a recovery-oriented model of mental health,3,13 we prioritized recovery-oriented outcomes. Recovery is an ongoing process to regain a meaningful life even with persisting symptoms, is unique for each individual, and depends on one’s family and community connections, social and economic circumstances, and their individual identity. Outcomes that measure recovery focus on a holistic improvement in an individual’s quality of life through increased social connections and emphasize resilience and control over one’s own life.85 Recovery was consistently brought up as the most important outcome or goal of peer support by program representatives and peer support youth advisors. The peer support youth advisors we spoke with all agreed that recovery-oriented outcomes (i.e., peer journey and relationship to recovery, such as community integration, overall fulfillment, emotional regulation, empowerment, education, employment, and social connections) were central to their experiences with peer support. Additionally, the peer support youth advisors explained that recovery is not a finite outcome; rather, it is a subjective or personal journey whereby they continuously make positive movements in their own life. One advisor shared that youth are accepting that they may reach a point where they are not getting better or worse but are maintaining their mental health through peer support. Moreover, because recovery is a process, it points to the benefits of outcomes being measured over time (i.e., not at a single point).

Our SR did not find any information related to the safety of peer support programs for youth peer support users. However, issues related to safety were raised by our peer support youth advisors who had experiences as workers. They spoke of the importance of setting professional boundaries between peer support service users and workers, such as finding a balance between being easily accessible to service users via their professional phone and being able to turn it off. They also spoke about the need for a space where they can connect and have an opportunity to reaffirm that they know what they are doing. “The infrastructure of peer support is often an afterthought about how it will help someone coming into this role — What are their needs going to be? How will this peer have a community of like peers so they’re not isolated? How are we building community? Supervision? A processing space? A place for them to ask questions? A place to say, ‘I’m not doing well’?” This points to the need for sustained recognition that youth peer support workers are themselves in recovery and may need support themselves. There are potential risks to youth peer support users and workers if appropriate training and supports are not carefully considered, developed, and integrated in advance into the peer support program, including the delivery of safe care. These risks can potentially lead to staff burnout and inadvertently affect the youth who use the service. As a whole, it highlights the benefits of formal, structured peer support programs that involve trained peer support workers and an organization that supports them.

In our review, we found the overall treatment effect of peer support to be uncertain, but our peer support youth advisors described the benefits of peer support programs in terms of providing accessible mental health support. They expressed that peer support can be a first point of contact for a lot of youth, and it can be easier to approach peers and ask where to be referred. Moreover, peer support services are perceived as convenient and accessible, and offer a low-barrier, low-commitment service. Importantly, peer support provides an environment where youth peer support advisors described feeling safe and comfortable.

The peer support advisors shared that it was easier opening up to and speaking with peers about their mental health because of their shared lived experience. For the peer support youth advisors we spoke with, this meant that they felt the peer support workers had similar experiences to them, which made it easier for them to relate and understand where they were coming from. This ability to relate and normalize lived experiences with mental health challenges reduced stigma. They noted that it was not as easy to open up to clinical therapists. One said that some youth have had bad experiences in the psychiatry sector, so peer support may feel safer for them. Similarly, many program representatives noted that youth are more likely to engage with mental health care through informal practices such as peer support rather than those offered in a clinical setting such as formal psychology. One advisor described how they did not feel comfortable discussing suicidal ideation openly in a clinical setting for fear that it might be alarming to their care provider but felt comfortable doing so with a peer who was candid about their own experiences and who normalized them. Youth peer support advisors we spoke with consistently articulated how much they valued peer support and how it played an important role in their recovery.

Although our review did not evaluate different modalities of delivering peer support, 1 youth peer support advisor explained youth in rural communities seeking in-person support may know people working in centres. As a result, they may not feel comfortable sharing sensitive information about themselves for fear of it getting back to their parents or others in their small community. This may lead them to not use in-person services, and they may prefer to access virtual services that are removed from their community. Some of the peer support advisors spoke about the convenience of virtual services and how it facilitates the sharing of resources electronically. Similarly, it allows some programs to broaden their reach and provide access to youth who live in rural or remote areas. However, it is not without its limitations because individuals without access to the internet cannot access some peer support services. In-person support can help bridge that gap; the peer support youth advisors spoke about peer support workers meeting youth in person (e.g., drop-in, by appointment, or meeting in the community), and the value in being reachable via a cell phone provided by the peer support program.

There may be a role for peer support in reducing inappropriate mental health care, but it may also result in increased access to appropriate mental health care, which in some contexts may include ED visits and hospitalizations. Increased health care resource use may be an indicator that peer support is working (i.e., youth are seeking treatment of underlying metal health conditions due to reduced stigma and increased self-efficacy). Indeed, our stakeholder engagements and consultations with peer support youth advisors similarly highlighted the significance of contextualizing resource utilization outcomes in light of the overarching recovery-oriented aims of peer support. Studies looking at peer support for adult mental health often include reduced ED use or hospitalizations as evidence of the effectiveness of peer support.29 This is premised on individuals becoming engaged in the process of recovery and improving their ability to cope through peer support, which results in less need to access crisis mental health care (ED visits), or experiencing less severe symptoms leading to fewer inpatient stays (hospitalizations). The ED is typically recognized as an inappropriate setting for mental health care, particularly when used repeatedly.86,87 However, with the fragmentation of mental health services in many parts of Canada,88,89 it may be the only accessible point of contact for some youth in crisis. Thus, careful interpretation is required when considering the complicated relationship between peer support programs and health care resource use.

In our scan of methods for and evaluations of peer support programs, several program representatives described how they sought to balance the benefits of formalizing and standardizing peer support programs and their evaluation with the informal and flexible nature of peer support which is central to its integrity as an intervention. Although our respondents were all representatives of formal peer support programs, they expressed worries that increasing pressures to formalize programs and evaluation could impact the fidelity of the peer support being delivered. However, these risks appear to be outweighed by the positive dimensions of standardizing some aspects of peer support (through program design including training of peer support workers).

The program representatives we spoke with shared a principle guiding evaluations of peer support programs was that they were adhering to a recovery-oriented model of care. This meant that most evaluations included some form of recovery-oriented outcomes and reviewed how a program supported a youth’s recovery. Program representatives highlighted that recovery is unique to the individual and occurs in the context of a programs’ specific set of aims or objectives and can be evaluated in different ways so evaluations can vary across programs. Based on this, it is important for evaluations of peer support programs for youth mental health to select appropriate evaluation aims and outcomes based on their program’s specific aims, objectives, and the youth population they serve. Repeating measurements over time (longitudinal measurements) and possibly adjusting the evaluation according to changes in recovery over time could help to understand the effect that programs may have on individual recovery. As a flexible and tailorable intervention, the context matters in assessing its impact, highlighting the need for context-specific evaluations and selecting recovery-oriented outcomes that are consistent with the aims of the program.

Co-design is a process that enables participants to be involved in the design of the program evaluation and is an important principle that can ensure that the data being captured are relevant to the needs of the youth involved and can contribute to the recovery model. Co-designed evaluations can also be used highlight or capture equity considerations within the program and evaluation process and ensure safety and appropriate cultural competency that fits the needs of the youth involved in the program. Involving youth with lived experience of peer support in the co-design of the program evaluation can inform the needs of the program to better align with and reflect the needs and identities of its users. One youth peer support advisor described the role of youth involved in an evaluation as helping staff bridge to youth by ensuring the research is explained in plain language. The same advisor shared that this involvement was especially important when working with an outside evaluator who did not know how the program functions or the language used by a program.

Unsurprisingly, given the importance of local context, we found that organizations and programs vary in the aims and objectives of their evaluations. Some programs use evaluation as an opportunity to better understand how peer support “works” (i.e., leads to short- and long-term improvements in youth’s recovery, contributes to improved access to mental health care, and reduces inappropriate mental health care). But for many programs, evaluation is used to ensure that the program meets the needs of the youth (peer users and peer workers) and as a way of ensuring the integrity or the fidelity of the program. These evaluations often focus on the experience and feedback from those involved in the program for the purpose of quality improvement and are designed for the specific purpose of the program evaluation. At the same time, evaluation is an opportunity to build an evidence base around the use of peer support for youth mental health. Regardless of the specific aim or objective of the evaluation, the youth peer support advisors we spoke with shared that transparency of why the evaluation was being conducted and what was being done with their data were essential for youth buy-in to the evaluation, which highlights the benefits of a co-design approach to evaluation.

In addition to having multiple aims, programs often must balance program needs and the identified needs of youth and sometimes those of the larger organization or funders. Our consultations also highlighted the challenges that may arise when the program needs do not fully align with those of the larger organization or funders. To secure funding, program evaluation may be tailored in a way that highlights the use of program outputs (e.g., number of contacts); however, this may not capture how the programs support the individuals involved (i.e., quality improvement) or for understanding the mechanisms and context in which peer support works. Program representatives spoke about the importance of flexibility and understanding that evaluation should primarily focus on the needs of the individuals engaged in the program. Programs vary in their capacity to design and conduct evaluations of peer support programs for youth, this includes methods support (e.g., data collection, analysis) and funding. Accounting for the resources needed to conduct evaluations in funding agreements is another avenue that can be used to support advancements in evaluating peer support programs.

Equity in peer support programs requires recognizing the existing inequitable distribution of poor mental health among youth who are systematically disadvantaged,6 and the need for equitable access to inclusive and desirable peer support programs for these youth.90 In our clinical SR, we aimed to identify specific groups of youth who are disadvantaged who experience an inequitable burden of mental health challenges and access to inclusive mental health services using PROGRESS-Plus,23 the available published and grey literature on peer support, discussions with clinical and content experts, and through existing descriptions of peer support programs explicitly designed to target or serve youth who are disadvantaged. These groups of youth include but are not limited to youth members of the 2SLGBTQ+ community, Indigenous youth, Black youth and youth of colour, youth members of newcomer communities, youth experiencing homelessness or street involvement, youth with disabilities, and youth living in rural and remote communities. The trials included in the SR of clinical effectiveness were predominantly conducted among White, heterosexual, female youth. We did not identify any information on subgroups based on PROGRESS-Plus factors.

The results of our SR could not contribute to our understanding about the role of equity in peer support in terms of effectiveness and safety, our engagement with youth peer support advisors pointed to some ways equity might affect the effectiveness and safety of peer support programs. One peer support advisor described how a lack of shared lived experience or understanding of racism and discrimination is a barrier to peer support: “They don’t understand anything I’m going through. I need to explain this whole backstory about colourism and racism. If they don’t understand that, it sometimes feels like it’s not even worth the effort to go see them.”

During recruitment and training of youth peer support workers, programs have the opportunity to ensure they can meet the needs of youth and provide culturally competent support to positively influence the experience of the peer support user. One example of this was outlined during consultation with Foundry Central Office, where a process for developing and including a justice, equity, diversity, and inclusion (JEDI) lens across the organization was described.

Equity was a concern in most peer support programs and in their evaluation processes; however, the definitions of equity and approaches used to address equity concerns varied. Youth peer support advisors and program representatives shared that equity ensures all youth are able to access the service. Peer support youth advisors expressed wanting to see peer supporters who are chronically ill or disabled, are part of the 2SLGBTQ+ community, have experienced homelessness, and are from other populations who experience marginalization or disadvantage. “There are so many intersections that, often, some are missed.” They desired to see representation in all aspects of peer support programs, including involving youth in the design and evaluation of peer support programs.

Because equity is as an integral concept to peer support programs, it also needs to be integral to the evaluation approach and cannot be an add-on at the point of evaluation. Involving youth with lived experience of peer support in the co-design of the program evaluation can inform the needs of the program and to better align with and reflect the needs and identities of its users. Instead of seeking only the perspectives of professionals, using evaluation co-design includes the voice of the youth involved to identify and address gaps in equity. For programs to address equity concerns and be culturally competent, program leaders and staff should aim to prioritize the appropriate resources and time and continuously build ongoing relationships with communities.

Conclusions and Implications for Decision- or Policy-Making

Peer support could be an option for improving access to mental health care for youth despite the limited evidence (both in terms of quantity and quality) of its clinical effectiveness and safety. Formal programs with trained and supported peer support workers may mitigate some safety concerns (for both peer support users and peer support workers). Peer support may improve access to mental health services because it is informal, flexible, and portable, and addresses some of the barriers that typically face youth when trying to access mental health care. For programs to be inclusive, or accessible to and effective in supporting the recovery of youth who are disadvantaged, diverse and youth who are disadvantaged must be trained and recruited. Equity cannot be an ad hoc effort or an add-on to a program service; it is best integrated into peer support programs and requires time and commitment. Opportunities for engaging youth can advance equity, diversity, and inclusion initiatives.

The findings of this review highlight opportunities to build an evidence base around peer support programs for youth mental health. In this process, youth should be engaged by drawing on the principles of co-design. Peer support is context-dependent, and programs often need to balance broader organizational aims with the needs of the local youth they are serving. Further, peer support is often 1 of many services offered by organizations and programs, and needs to be evaluated in light of a multi-component intervention. Evaluation designers need to consider recovery-oriented outcomes that align with the program’s objectives measured over time. Developing an evidence ecosystem around peer support for youth mental health care could be achieved by strategic investments in pilot programs and their evaluations, funding arrangements that incentivize evaluation, and encouraging ongoing collaboration across the sector and with the academic and non-for-profit research community.

Abbreviations

2SLGBTQ+

2-Spirit, lesbian, gay, bisexual, transgender, queer, and other sexual identities

CES-D

Center for Epidemiologic Studies-Depression

C-PROM

Canadian Personal Recovery Outcome Measure

CYPCO

Children and Young People Community Organizations

ED

emergency department

ES

Environmental Scan

GAD-7

General Anxiety Disorder 7-item

GRADE

Grading of Recommendations Assessment, Development and Evaluation

HOP

Honest, Open, Proud

HOP-C

Honest, Open, Proud–College

HRQoL

health-related quality of life

HTA

Health Technology Assessment

PHQ-9

Patient Health Questionnaire-9

PRISMA

Preferred Reporting Items for Systematic reviews and Meta-Analyses

PSIQI

Peer Support Integrity, Quality and Impact

RCT

randomized controlled trial

RoB 2

Risk of Bias 2

SD

standard deviation

SR

systematic review

SSMIS-SF

Self-Stigma of Mental Illness Scale–Short Form

TAU

treatment as usual

TAY

Transitional Aged Youth

References

1.
Lyons N, Cooper C, Lloyd-Evans B. A systematic review and meta-analysis of group peer support interventions for people experiencing mental health conditions. BMC Psychiatry. 2021;21(1):315-315. [PMC free article: PMC8220835] [PubMed: 34162340]
2.
Canadian Mental Health Association. Fast facts about mental illness. 2021; https://cmha​.ca/fast-facts-about-mental-illness. Accessed 2021 Nov 25.
3.
Mental Health Commission of Canada. Making the Case for Peer Support: Report to the Peer Support Project Committee of the Mental Health Commission of Canada. 2016; https://www​.mentalhealthcommission​.ca/sites​/default/files/2016-07​/MHCC_Making_the​_Case_for_Peer_Support_2016_Eng.pdf. Accessed 2021 Nov 25.
4.
Statistics Canada. Impacts on Mental Health. 2020: https://www150​.statcan​.gc.ca/n1/pub/11-631-x/2020004/s3-eng​.htm. Accessed 2021 Nov 25.
5.
Worlds of Influence: Understanding what shapes child well-being in rich countries. Innocenti Report Card 16. Florence (IT): United Nations Children’s Fund (UNICEF); 2020: https://oneyouth​.unicef​.ca/sites/default​/files/2020-09/Worlds​%20of%20Influence_EN_FINAL.pdf. Accessed 2021 Nov 25.
6.
Mental Health Commission of Canada. Lockdown life. Mental Health Impacts of COVID-19 on Youth in Canada. 2020: https://www​.mentalhealthcommission​.ca/wp-content​/uploads/drupal​/2021-02/lockdown_life_eng.pdf. Accessed 2021 Nov 15.
7.
Cribb R, Keogh D. Generation Distress: The kids are in crisis — and COVID-19 is making it worse. In Canada, deteriorating youth mental health is leaving a generation in distress. Toronto Star. 2020 Nov 23. https://www​.thestar.com​/news/investigations​/2020/11/23/the-kids-are-in-crisis-and-covid-19-is-making-it-worse-in-canada-deteriorating-youth-mental-health-is-leaving-a-generation-in-distress.html. Accessed 2021 Nov 25.
8.
Mental Health Commission of Canada. Children and Youth. 2021: https:​//mentalhealthcommission​.ca/what-we-do​/children-and-youth/. Accessed 2021 Nov 25.
9.
Moroz N, Moroz I, D’Angelo MS. Mental health services in Canada: barriers and cost-effective solutions to increase access. Healthcare management forum. Vol 33: SAGE Publications Sage CA: Los Angeles, CA; 2020. [PubMed: 32613867]
10.
CIHI. Child and youth mental health in Canada — Infographic. 2020: https://www​.cihi.ca/en​/child-and-youth-mental-health-in-canada-infographic#ref1. Accessed 2021 Nov 25.
11.
Ontario Centre of Excellence for Child and Youth Mental Health. Youth peer support in a mental health context. 2016: https://mhct​.org/wp-content​/uploads/2019​/11/Paper-Youth-Peer-Support-in-a-Mental-Health-Context-Ontario.pdf. Accessed 2021 Nov 25.
12.
Sunderland K, Mishkin W, Peer Leadership Group, Mental Health Commission of Canada. Guidelines for the Practice and Training of Peer Support. Calgary (AB): Mental Health Commission of Canada; 2013: https://www​.mentalhealthcommission​.ca/sites​/default/files/peer​_support_guidelines.pdf.pdf. Accessed 2021 Dec 17.
13.
Barton JH, J. Peer Support and Youth Recovery: A Brief Review of the Theoretical Underpinnings and Evidence. Canadian Journal of Family and Youth. 2016;8(1).
14.
Reamer FG. Eye on Ethics: The Challenge of Peer Support Programs. Social Work Today. 2015;15(4). https://www​.socialworktoday​.com/archive/072115p10.shtml. Accessed 2021 Nov 25.
15.
Herington E. Building Inclusive Health Care Services: A Rapid Qualitative Review. Ottawa: CADTH; 2020: https://www​.cadth.ca​/building-inclusive-health-care-services-rapid-qualitative-review. Accessed 2021 Dec 17.
16.
Halsall T, Daley M, Hawke L, Henderson J. Exploring Peer Support Services for Youth Experiencing Multiple Health and Social Challenges in Canada: A Hybrid Realist-Participatory Evaluation Model. International Journal of Qualitative Methods. 2021;20:1609406921995680.
17.
Smith A, Herington E, Loshak H. Tuberculosis Stigma and Racism, Colonialism, and Migration: A Rapid Qualitative Review. CADTH Health Technology Review Ottawa: CADTH; 2021 Apr: https://www​.cadth.ca​/sites/default/files​/pdf/htis/2021/RC1350​%20TB%20stigma%20qual%20Final.pdf. Accessed 2021 Nov 25. [PubMed: 34260166]
18.
Fortuna KL, Solomon P, Rivera J. An Update of Peer Support/Peer Provided Services Underlying Processes, Benefits, and Critical Ingredients. Psychiatric Quarterly. 2022;93(2):571-586. [PMC free article: PMC8855026] [PubMed: 35179660]
19.
Staniszewska S, Brett J, Simera I, et al. GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. BMJ. 2017;358:j3453. [PMC free article: PMC5539518] [PubMed: 28768629]
20.
The Cochrane Collaboration. Cochrane Methods Equity. 2021; https://methods​.cochrane​.org/equity/welcome. Accessed 2021 Nov 25.
21.
Welch VA, Petkovic J, Jull J, et al. Chapter 16: Equity and specific populations. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). Cochrane Handbook for Systematic Reviews of Interventions version 6.2 (updated February 2021). Cochrane, 2021. Available from www​.training.cochrane.org/handbook. Accessed 2021 Nov 25.
22.
Benkhalti M, Espinoza M, Cookson R, Welch V, Tugwell P, Dagenais P. Development of a checklist to guide equity considerations in health technology assessment. International Journal of Technology Assessment in Health Care. 2021;37. [PubMed: 33491618]
23.
O'Neill J, Tabish H, Welch V, et al. Applying an equity lens to interventions: using PROGRESS ensures consideration of socially stratifying factors to illuminate inequities in health. Journal of clinical epidemiology. 2014;67(1):56-64. [PubMed: 24189091]
24.
The Cochrane Collaboration. PROGRESS-Plus. 2022; https://methods​.cochrane​.org/equity/projects​/evidence-equity/progress-plus. Accessed 2022 Aug 10.
25.
Subramonian A, Gray C, Severn M. Peer support for youth mental health. CADTH reference list. Ottawa: CADTH; 2021 Jan: https://www​.cadth.ca​/sites/default/files​/pdf/htis/2021/RA1159​%20Peer%20support%20for​%20youth%20mental%20health%20Final​.pdf. Accessed 2022 Jun 29.
26.
Rose-Clarke K, Bentley A, Marston C, Prost A. Peer-facilitated community-based interventions for adolescent health in low- and middle-income countries: A systematic review. PLoS One. 2019;14(1):e0210468. [PMC free article: PMC6343892] [PubMed: 30673732]
27.
Ali K, Farrer L, Gulliver A, Griffiths KM. Online Peer-to-Peer Support for Young People With Mental Health Problems: A Systematic Review. JMIR Ment Health. 2015;2(2):e19. [PMC free article: PMC4607385] [PubMed: 26543923]
28.
Wilkerson JM, Schick VR, Romijnders KA, Bauldry J, Butame SA. Social Support, Depression, Self-Esteem, and Coping Among LGBTQ Adolescents Participating in Hatch Youth. Health Promot Pract. 2017;18(3):358-365. [PubMed: 27338277]
29.
White S, Foster R, Marks J, et al. The effectiveness of one-to-one peer support in mental health services: a systematic review and meta-analysis. BMC Psychiatry. 2020;20(1):534. [PMC free article: PMC7657356] [PubMed: 33176729]
30.
Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. [PMC free article: PMC8005924] [PubMed: 33782057]
31.
McGowan J, Sampson M, Salzwedel DM, Cogo E, Foerster V, Lefebvre C. PRESS Peer Review of Electronic Search Strategies: 2015 guideline statement. Journal of clinical epidemiology. 2016;75:40-46. [PubMed: 27005575]
32.
Grey matters: a practical tool for searching health-related grey literature. Ottawa (ON): CADTH; 2019: https://www​.cadth.ca/grey-matters. Accessed 2022 Aug 10.
33.
Oliver S KJ, Caird J, Lorenc T, Oliver K, Harden A, Thomas J, Greaves A and Oakley A. Health promotion, inequalities and young people’s health: a systematic review of research. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London. 2008: https://eppi​.ioe.ac.uk​/cms/Portals/0/PDF​%20reviews%20and%20summaries​/Inequalities​%20Young%20People%20R2008Oliver​.pdf?ver​=2010-12-22-123934-167. Accessed 2021 Nov 24.
34.
Kirby M, Keon WJ. Out of the Shadows at Last. Transforming Mental Health, Mental Illness and Addiction Services in Canada. Ottawa: The Standing Senate Committee on Social Affairs, Science and Technology; 2006: https://www​.mentalhealthcommission​.ca/wp-content​/uploads/drupal​/out_of_the_shadows​_at_last_-_full_0_0.pdf. Accessed 2021 Nov 25.
35.
Piat M, Sabetti J. Recovery in Canada: Toward social equality. International Review of Psychiatry. 2012;24(1):19-28. [PMC free article: PMC4851545] [PubMed: 22385423]
36.
Solmi M, Radua J, Olivola M, et al. Age at onset of mental disorders worldwide: large-scale meta-analysis of 192 epidemiological studies. Molecular Psychiatry. 2022;27(1):281-295. [PMC free article: PMC8960395] [PubMed: 34079068]
37.
Khangura S, Konnyu K, Cushman R, Grimshaw J, Moher D. Evidence summaries: the evolution of a rapid review approach. Systematic Reviews. 2012;1(1):10. [PMC free article: PMC3351736] [PubMed: 22587960]
38.
O'Blenis P. One Simple Way To Speed Up Your Screening Process. 2017; https://blog​.evidencepartners​.com/one-simple-way-to-speed-up-your-screening-process. Accessed 2022 Jun 29.
39.
Conley CS, Hundert CG, Charles JL, et al. Honest, open, proud-college: Effectiveness of a peer-led small-group intervention for reducing the stigma of mental illness. Stigma and Health. 2020;5(2):168-178.
40.
Hundert CG, Hareli M, Conley CS. Honest, open, proud-college: Follow-up effects of a peer-led group for reducing the stigma of mental illness. Stigma and Health. 2021;7:122-125.
41.
Sterne JAC, Savovic J, Page MJ, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. Bmj. 2019;366:l4898. [PubMed: 31462531]
42.
Popay J, Roberts H, Sowden A, et al. Guidance on the conduct of narrative synthesis in systematic reviews: product from the ESRC Methods Programme. Version 1. 2006: https://www​.lancaster​.ac.uk/media/lancaster-university​/content-assets​/documents/fhm​/dhr/chir/NSsynthesisguidanceVersion1-April2006.pdf. Accessed 2022-05-25.
43.
Sterne JAC, Sutton AJ, Ioannidis JPA, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011;343:d4002. [PubMed: 21784880]
44.
Atkins D, Best D, Briss PA, et al. Grading quality of evidence and strength of recommendations. BMJ. 2004;328(7454):1490. [PMC free article: PMC428525] [PubMed: 15205295]
45.
Guyatt G, Oxman AD, Akl EA, et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. Journal of clinical epidemiology. 2011;64(4):383-394. [PubMed: 21195583]
46.
Guyatt GH, Oxman AD, Vist GE, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924-926. [PMC free article: PMC2335261] [PubMed: 18436948]
47.
GRADE Handbook. In: Schunemann H, Brozek J, Guyatt G, Oxman A, eds. Grading of Recommendations Assessment, Development and Evaluation (GRADE): Hamilton (ON); 2013: https://gdt​.gradepro​.org/app/handbook/handbook.html. Accessed 2021 Sep 27.
48.
Hultcrantz M, Rind D, Akl EA, et al. The GRADE Working Group clarifies the construct of certainty of evidence. Journal of clinical epidemiology. 2017;87:4-13. [PMC free article: PMC6542664] [PubMed: 28529184]
49.
Santesso N, Glenton C, Dahm P, et al. GRADE guidelines 26: informative statements to communicate the findings of systematic reviews of interventions. Journal of clinical epidemiology. 2020;119:126-135. [PubMed: 31711912]
50.
Mulfinger N, Müller S, Böge I, et al. Honest, Open, Proud for adolescents with mental illness: pilot randomized controlled trial. Journal of Child Psychology & Psychiatry. 2018;59(6):684-691. [PubMed: 29205343]
51.
Honest Open Proud Program. Honest, Open, Proud on College Campuses. 2012; https:​//comingoutproudprogram​.org/index.php​/coming-out-proud-on-college-campuses. Accessed 2022 May 19.
52.
Patrick W. Corrigan KN, Blythe A. Buchholz, and Maya A. Al-Khouja. Honest, open, proud to Eliminate the Stigma of Mental Illness: manual for program facilitators and participants. 2017: https:​//comingoutproudprogram​.org/images​/Honest_Open_Proud_COP​_ManualBooster_FINAL_updated_2​.1.2017-min.pdf. Accessed 2022 May 19.
53.
Corrigan PW, Michaels PJ, Vega E, Gause M, Watson AC, Rüsch N. Self-stigma of mental illness scale—short form: Reliability and validity. Psychiatry Research. 2012;199(1):65-69. [PMC free article: PMC3439592] [PubMed: 22578819]
54.
Boyd JE, Otilingam PG, Deforge BR. Brief version of the Internalized Stigma of Mental Illness (ISMI) scale: psychometric properties and relationship to depression, self esteem, recovery orientation, empowerment, and perceived devaluation and discrimination. Psychiatric rehabilitation journal. 2014;37(1):17-23. [PubMed: 24660946]
55.
Link BG, Yang LH, Phelan JC, Collins PY. Measuring mental illness stigma. Schizophrenia bulletin. 2004;30(3):511-541. [PubMed: 15631243]
56.
Ravens-Sieberer U, Erhart M, Rajmil L, et al. Reliability, construct and criterion validity of the KIDSCREEN-10 score: a short measure for children and adolescents' well-being and health-related quality of life. Quality of life research: an international journal of quality of life aspects of treatment, care and rehabilitation. 2010;19(10):1487-1500. [PMC free article: PMC2977059] [PubMed: 20668950]
57.
The KIDSCREEN Group Europe. The KIDSCREEN-10 Index. 2011; https://www​.kidscreen​.org/english/questionnaires​/kidscreen-10-index/. Accessed 2022 May 25.
58.
Rogers ES, Chamberlin J, Ellison ML, Crean T. A consumer-constructed scale to measure empowerment among users of mental health services. Psychiatric services (Washington, DC). 1997;48(8):1042-1047. [PubMed: 9255837]
59.
Wilson CJ, Deane FP, Ciarrochi J, Rickwood D. Measuring Help-Seeking Intentions: Properties of the General Help-Seeking Questionnaire. Canadian Journal of Counselling and Psychotherapy. 2007;39(1).
60.
Yip PSF, Cheung YB. Quick assessment of hopelessness: a cross-sectional study. Health and Quality of Life Outcomes. 2006;4(1):13. [PMC free article: PMC1413514] [PubMed: 16509984]
61.
Andresen R, Caputi P, Oades LG. Do clinical outcome measures assess consumer-defined recovery? Psychiatry Research. 2010;177(3):309-317. [PubMed: 20227768]
62.
Kertz S, Bigda-Peyton J, Bjorgvinsson T. Validity of the Generalized Anxiety Disorder-7 scale in an acute psychiatric sample. Clinical psychology & psychotherapy. 2013;20(5):456-464. [PubMed: 22593009]
63.
Spitzer RL, Kroenke K, Williams JBW, Löwe B. A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7. Archives of Internal Medicine. 2006;166(10):1092-1097. [PubMed: 16717171]
64.
Radloff LS. The CES-D Scale:A Self-Report Depression Scale for Research in the General Population. Applied Psychological Measurement. 1977;1(3):385-401.
65.
American Psychological Association. Center for Epidemiological Studies-Depression. 2011; https://www​.apa.org/pi​/about/publications​/caregivers/practice-settings​/assessment​/tools/depression-scale. Accessed 2022 May 25.
66.
Björgvinsson T, Kertz SJ, Bigda-Peyton JS, McCoy KL, Aderka IM. Psychometric properties of the CES-D-10 in a psychiatric sample. Assessment. 2013;20(4):429-436. [PubMed: 23513010]
67.
Kohout FJ, Berkman LF, Evans DA, Cornoni-Huntley J. Two Shorter Forms of the CES-D Depression Symptoms Index. Journal of Aging and Health. 1993;5(2):179-193. [PubMed: 10125443]
68.
Chinman M, George P, Dougherty RH, et al. Peer support services for individuals with serious mental illnesses: assessing the evidence. Psychiatric services (Washington, DC). 2014;65(4):429-441. [PubMed: 24549400]
69.
Alvarez-Jimenez M, Koval P, Schmaal L, et al. The Horyzons project: a randomized controlled trial of a novel online social therapy to maintain treatment effects from specialist first-episode psychosis services. World Psychiatry. 2021;20(2):233-243. [PMC free article: PMC8129860] [PubMed: 34002511]
70.
Rice S, Gleeson J, Davey C, et al. Moderated online social therapy for depression relapse prevention in young people: pilot study of a 'next generation' online intervention. Early Interv Psychiatry. 2018;12(4):613-625. [PubMed: 27311581]
71.
Alvarez-Jimenez M, Rice S, D'Alfonso S, et al. A novel multimodal digital service (moderated online social therapy+) for help-seeking young people experiencing mental ill-health: Pilot evaluation within a national youth e-mental health service. Journal of Medical Internet Research. 2020;22(8):e17155. [PMC free article: PMC7453330] [PubMed: 32788151]
72.
Halsall D, Hawke, Henderson. Exploring Peer Support Services for Youth Experiencing Multiple Health and Social Challenges in Canada: A Hybrid Realist-Participatory Evaluation Model. 2021: https://journals​.sagepub​.com/doi/full/10​.1177/1609406921995680. Accessed 2022 Aug 10.
73.
Department for Education (UK). Evaluation of the Peer Support for Mental Health and Wellbeing Pilots. 2020: https://www​.gov.uk/government​/publications​/peer-support-for-mental-health-pilots-an-evaluation.
74.
Orr J. Report on Results of the Peer Support Integrity, Quality and Impact Survey. Support House and Centre for Innovation in Peer Support; 2019.
75.
Foundry. Youth Peer Support V2 Training Evaluation Report. Vancouver (BC): Foundry; 2021.
76.
EveryMind Mental Health Services. Executive Summary of the Legacy Report: Youth Peer Support Pilot Project. Mississauga: EveryMind; 2022.
77.
Richard J, Atesoglu LR, Leung C, et al. Peers supporting peers: An evaluation of a Peer Support Centre at a Canadian University. 2019: https://cpa​.ca/docs/File​/Students/MindPad/MindPad_Fall2019​.pdf. Accessed 2022 Sep 1.
78.
Mental Health Comission of Canada. Guidelines for Recovery-Oriented Practice. 2015: https://www​.mentalhealthcommission​.ca/wp-content​/uploads/drupal​/MHCC_RecoveryGuidelines_ENG_0.pdf. Accessed 2022 Aug 10.
79.
Canadian Institute for Health Information. PROMs background document. 2015: https://www​.cihi.ca/sites​/default/files/proms​_background_may21_en-web_0.pdf. Accessed 2022 Jun 29.
80.
Centre for Innovation in Peer Support. Peer Support Integrity, Quality and Impact Survey. 2019: https:​//supporthouse​.ca/news/peer-support-integrity-quality-and-impact-survey/. Accessed 2022 Aug 10.
81.
Kroenke K, Spitzer RL, Williams JB, Lowe B. The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: a systematic review. Gen Hosp Psychiatry. 2010;32(4):345-359. [PubMed: 20633738]
82.
Lowe B, Decker O, Muller S, et al. Validation and standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the general population. Med Care. 2008;46(3):266-274. [PubMed: 18388841]
83.
Bringhurst DL, Watson CW, Miller SD, Duncan BL. The Reliability and Validity of the Outcome Rating Scale: A Replication Study of a Brief Clinical Measure. Journal of Brief Therapy. 2006;5(1). https://www​.scottdmiller​.com/wp-content/uploads​/JBTORSReplication.pdf. Accessed 2022 Sep 12.
84.
Duncan BL, Miller SD, Sparks JA, et al. The Session Rating Scale: Preliminary Psychometric Properties of a “Working” Alliance Measure. Journal of Brief Therapy. 2003 Winter;3(1). https://www​.scottdmiller​.com/wp-content/uploads​/documents/SessionRatingScale-JBTv3n1.pdf. Accessed 2022 Sep 12.
85.
Jacob KS. Recovery model of mental illness: a complementary approach to psychiatric care. Indian J Psychol Med. 2015;37(2):117-119. [PMC free article: PMC4418239] [PubMed: 25969592]
86.
Bhui K, Ullrich S, Coid JW. Which pathways to psychiatric care lead to earlier treatment and a shorter duration of first-episode psychosis? BMC psychiatry. 2014;14:72-72. [PMC free article: PMC3984674] [PubMed: 24620939]
87.
Saunders NR, Gill PJ, Holder L, et al. Use of the emergency department as a first point of contact for mental health care by immigrant youth in Canada: a population-based study. Canadian Medical Association Journal. 2018;190(40):E1183-E1191. [PMC free article: PMC6175628] [PubMed: 30301742]
88.
Flood CM, Thomas B. Fragmented Law & Fragmented Lives: Canada’s Mental Health Care System. Law and Mind: Mental Health Law and Policy in Canada (Toronto: LexisNexis, 2017), Ottawa Faculty of Law Working Paper. 2017(2020-33).
89.
Halsall T, Manion I, Iyer SN, Mathias S, Purcell R, Henderson J. Trends in mental health system transformation: Integrating youth services within the Canadian context. Healthcare management forum. Vol 32: SAGE Publications Sage CA: Los Angeles, CA; 2019. [PubMed: 30799661]
90.
Canadian Heritage. Canada’s first State of youth report: for youth, with youth, by youth. 2021; https://www​.canada.ca​/en/canadian-heritage​/campaigns/state-youth/report.html. Accessed 2022 Aug 10.
91.
E. Sally Rogers SD, Ruth O. Ralph PD, Mark S. Salzer PD. Validating the Empowerment Scale With a Multisite Sample of Consumers of Mental Health Services. Psychiatric Services. 2010;61(9):933-936. [PubMed: 20810594]
92.
Ritsher JB, Otilingam PG, Grajales M. Internalized stigma of mental illness: psychometric properties of a new measure. Psychiatry Res. 2003;121(1):31-49. [PubMed: 14572622]
93.
Rüsch N, Corrigan PW, Powell K, et al. A stress-coping model of mental illness stigma: II. Emotional stress responses, coping behavior and outcome. Schizophr Res. 2009;110(1-3):65-71. [PMC free article: PMC2720565] [PubMed: 19237266]
94.
Rüsch N, Corrigan PW, Wassel A, et al. A stress-coping model of mental illness stigma: I. Predictors of cognitive stress appraisal. Schizophrenia Research. 2009;110(1):59-64. [PMC free article: PMC2720567] [PubMed: 19269140]

Appendix 1. Literature Search Strategy

Note that this appendix has not been copy-edited.

Clinical Literature Search

Overview

Interface: Ovid

Databases:

  • MEDLINE All (1946-present)
  • Embase (1974-present)
  • PsycInfo (1806-present)
  • Note: Subject headings and search fields have been customized for each database. Duplicates between databases were removed in Ovid.

Date of search: December 17, 2021

Alerts: Biweekly search updates until project completion

Search filters applied: Systematic reviews; meta-analyses; network meta-analyses; health technology assessments; overview of reviews; randomized controlled trials; controlled clinical trials; observational studies.

Limits:

  • Publication date limit: 2006-present
  • Language limit: English and French language
  • Conference abstracts: excluded
Table 7. Syntax Guide.

Table 7

Syntax Guide.

Multi-Database Strategy

  1. Peer group/
  2. ((Peer* or mentor*) adj2 (support* or relationship* or help* or intervention* or network* or discussion* or service* or program* or club* or based or coach* or counsel* or exchange* or guide* or group* or influence* or led or deliver* or education or involve* or advocate* or communication* or center* or centre* or lead* or model* or worker* or specialist* or run or partner* or provided or role* or interaction* or driven or advice or assistance or facilitat* or consult*)).ti,kf,dq.
  3. ((Peer* or mentor*) adj1 (support* or relationship* or help* or intervention* or network* or discussion* or service* or program* or club* or based or coach* or counsel* or exchange* or guide* or group* or influence* or led or deliver* or education or involve* or advocate* or communication* or center* or centre* or lead* or model* or worker* or specialist* or run or partner* or provided or role* or interaction* or driven or advice or assistance or facilitat* or consult*)).ab. /freq=2
  4. Peer* support*.ab,dq.
  5. (peer* to peer* or peer mentor*).ti,ab,kf,dq.
  6. ((individual* or peer* or mentor*) adj4 lived experience*).ti,ab,kf,dq.
  7. or/1-6
  8. mental health care/ or mental health service/ or mental health/ or mental disease/ or adjustment disorder/ or alexithymia/ or exp anxiety disorder/ or complicated grief/ or exp dissociative disorder/ or exp emotional disorder/ or exp experimental mental disease/ or hikikomori/ or exp mental deficiency/ or mental infantilism/ or mental instability/ or mental overstimulation/ or exp mood disorder/ or exp neurosis/ or organic brain syndrome/ or organic psychosyndrome/ or exp personality disorder/ or psychiatric complication/ or exp psychosexual disorder/ or exp psychosis/ or exp psychosomatic disorder/ or exp psychotrauma/ or exp schizophrenia spectrum disorder/ or stupor/ or exp suicidal behavior/ or exp eating disorder/
  9. (mental disorder* or mental health or mental disease* or mental illness* or posttraumatic or PTSD or PTD or trauma* or psychiatric illness* or psychiatric disease* or psychiatric disorder* or psychotic disorder* or psychiatric diagnos?s or behavio?r disorder* or mood disorder* or affective disorder* or psychological disorder* or psychological disease* or psychological illness* or psychological diagnos?s).ti,ab,kf,dq.
  10. (anxiety or depress* or panic disorder* or neuroses or neurosis or neurotic or bipolar or schizophreni* or personality disorder* or psychosis or anorexia or eating disorder* or bulimia).ti,ab,kf,dq.
  11. (suicid* or parasuicid*).ti,ab,kf,dq.
  12. (self adj2 (injur* or mutilat* or inflict* or wound* or harm* or cut* or hurt* or destruct* or wound*)).ti,ab,kf,dq.
  13. or/8-12
  14. Young adult/
  15. Juvenile/
  16. Adolescent/
  17. (child* or paediatric* or pediatric* or girl* or boy* or kid* or teen* or tween* or youngster* or youth* or preteen* or adolescen* or school age* or preadolescen* or juvenile* or young adult* or young people* or young person* or student* or early adult* or emerging adult* or college* or universit* or high school* or post secondary or postsecondary or classmate* or class mate*).ti,ab,kf,dq.
  18. young.ti,kf.
  19. or/14-18
  20. 7 and 13 and 19
  21. (Peer* and mental*).ti.
  22. 20 or 21
  23. 22 not (conference abstract or conference review).pt.
  24. 23 use oemezd
  25. exp Peer group/
  26. ((Peer* or mentor*) adj2 (support* or relationship* or help* or intervention* or network* or discussion* or service* or program* or club* or based or coach* or counsel* or exchange* or guide* or group* or influence* or led or deliver* or education or involve* or advocate* or communication* or center* or centre* or lead* or model* or worker* or specialist* or run or partner* or provided or role* or interaction* or driven or advice or assistance or facilitat* or consult*)).ti,kf.
  27. ((Peer* or mentor*) adj1 (support* or relationship* or help* or intervention* or network* or discussion* or service* or program* or club* or based or coach* or counsel* or exchange* or guide* or group* or influence* or led or deliver* or education or involve* or advocate* or communication* or center* or centre* or lead* or model* or worker* or specialist* or run or partner* or provided or role* or interaction* or driven or advice or assistance or facilitat* or consult*)).ab. /freq=2
  28. Peer* support*.ab.
  29. (peer* to peer* or peer mentor*).ti,ab,kf.
  30. ((individual* or peer* or mentor*) adj4 lived experience*).ti,ab,kf.
  31. or/25-30
  32. Mental health/ or exp Mental health services/ or exp Community Mental Health Centers/ or Mental health recovery/ or Mentally Ill Persons/
  33. mental disorders/ or exp anxiety disorders/ or exp "bipolar and related disorders"/ or exp "disruptive, impulse control, and conduct disorders"/ or exp dissociative disorders/ or exp elimination disorders/ or exp "feeding and eating disorders"/ or exp mood disorders/ or motor disorders/ or neurotic disorders/ or exp paraphilic disorders/ or exp personality disorders/ or exp "schizophrenia spectrum and other psychotic disorders"/ or exp sexual dysfunctions, psychological/ or exp sleep wake disorders/ or exp somatoform disorders/ or exp "trauma and stressor related disorders"/ or depression/ or Schizophrenia, Childhood/ or Anxiety, Separation/ or exp Self-Injurious Behavior/
  34. (mental disorder* or mental health or mental disease* or mental illness* or posttraumatic or PTSD or PTD or trauma* or psychiatric illness* or psychiatric disease* or psychiatric disorder* or psychotic disorder* or psychiatric diagnos?s or behavio?r disorder* or mood disorder* or affective disorder* or psychological disorder* or psychological disease* or psychological illness* or psychological diagnos?s).ti,ab,kf.
  35. (anxiety or depress* or panic disorder* or neuroses or neurosis or neurotic or bipolar or schizophreni* or personality disorder* or psychosis or anorexia or eating disorder* or bulimia).ti,ab,kf.
  36. (suicid* or parasuicid*).ti,ab,kf.
  37. (self adj2 (injur* or mutilat* or inflict* or wound* or harm* or cut* or hurt* or destruct* or wound*)).ti,ab,kf.
  38. or/32-37
  39. Adolescent/ or Young adult/ or Pediatrics/
  40. (child* or paediatric* or pediatric* or girl* or boy* or kid* or teen* or tween* or youngster* or youth* or preteen* or adolescen* or school age* or preadolescen* or juvenile* or young adult* or young people* or young person* or student* or early adult* or emerging adult* or college* or universit* or high school* or post secondary or postsecondary or classmate* or class mate*).ti,ab,kf.
  41. young.ti,kf.
  42. or/39-41
  43. 31 and 38 and 42
  44. (Peer* and mental*).ti.
  45. 43 or 44
  46. 45 use medall
  47. Peers/
  48. Peer counseling/
  49. Peer relations/
  50. ((Peer* or mentor*) adj2 (support* or relationship* or help* or intervention* or network* or discussion* or service* or program* or club* or based or coach* or counsel* or exchange* or guide* or group* or influence* or led or deliver* or education or involve* or advocate* or communication* or center* or centre* or lead* or model* or worker* or specialist* or run or partner* or provided or role* or interaction* or driven or advice or assistance or facilitat* or consult*)).ti,id.
  51. ((Peer* or mentor*) adj1 (support* or relationship* or help* or intervention* or network* or discussion* or service* or program* or club* or based or coach* or counsel* or exchange* or guide* or group* or influence* or led or deliver* or education or involve* or advocate* or communication* or center* or centre* or lead* or model* or worker* or specialist* or run or partner* or provided or role* or interaction* or driven or advice or assistance or facilitat* or consult*)).ab. /freq=2
  52. Peer* support*.ab.
  53. (peer* to peer* or peer mentor*).ti,ab,id.
  54. ((individual* or peer* or mentor*) adj4 lived experience*).ti,ab,id.
  55. or/47-54
  56. exp Mental health/
  57. exp Mental health services/
  58. mental disorders/ or exp affective disorders/ or exp anxiety disorders/ or exp bipolar disorder/ or borderline states/ or exp chronic mental illness/ or exp dissociative disorders/ or exp eating disorders/ or gender dysphoria/ or mental disorders due to general medical conditions/ or exp neurosis/ or exp paraphilias/ or exp personality disorders/ or exp psychosis/ or serious mental illness/ or exp sleep wake disorders/ or exp somatoform disorders/ or exp "stress and trauma related disorders"/ or exp thought disturbances/
  59. exp suicide/
  60. Suicidal ideation/
  61. exp Self-Injurious Behavior/
  62. (mental disorder* or mental health or mental disease* or mental illness* or posttraumatic or PTSD or PTD or trauma* or psychiatric illness* or psychiatric disease* or psychiatric disorder* or psychotic disorder* or psychiatric diagnos?s or behavio?r disorder* or mood disorder* or affective disorder* or psychological disorder* or psychological disease* or psychological illness* or psychological diagnos?s).ti,ab,id.
  63. (anxiety or depress* or panic disorder* or neuroses or neurosis or neurotic or bipolar or schizophreni* or personality disorder* or psychosis or anorexia or eating disorder* or bulimia).ti,ab,id.
  64. (suicid* or parasuicid*).ti,ab,id.
  65. (self adj2 (injur* or mutilat* or inflict* or wound* or harm* or cut* or hurt* or destruct* or wound*)).ti,ab,id.
  66. or/56-65
  67. ("200" or "320").ag.
  68. Adolescent Attitudes/ or Adolescent Behavior/ or Adolescent Health/ or Adolescent Development/ or Adolescent Psychology/ or Early Adolescence/ or Adolescent Psychiatry/ or Adolescent Psychotherapy/ or Adolescent psychopathology/ or Emerging adulthood/ or Childhood development/
  69. (child* or paediatric* or pediatric* or girl* or boy* or kid* or teen* or tween* or youngster* or youth* or preteen* or adolescen* or school age* or preadolescen* or juvenile* or young adult* or young people* or young person* or student* or early adult* or emerging adult* or college* or universit* or high school* or post secondary or postsecondary or classmate* or class mate*).ti,ab,id.
  70. young.ti,id.
  71. or/67-70
  72. 55 and 66 and 71
  73. (Peer* and mental*).ti.
  74. 72 or 73
  75. 74 use psyh
  76. 24 or 46 or 75
  77. (systematic review or meta-analysis).pt.
  78. meta-analysis/ or systematic review/ or systematic reviews as topic/ or meta-analysis as topic/ or "meta analysis (topic)"/ or "systematic review (topic)"/ or exp technology assessment, biomedical/ or network meta-analysis/
  79. ((systematic* adj3 (review* or overview*)) or (methodologic* adj3 (review* or overview*))).ti,ab,kf.
  80. ((quantitative adj3 (review* or overview* or synthes*)) or (research adj3 (integrati* or overview*))).ti,ab,kf.
  81. ((integrative adj3 (review* or overview*)) or (collaborative adj3 (review* or overview*)) or (pool* adj3 analy*)).ti,ab,kf.
  82. (data synthes* or data extraction* or data abstraction*).ti,ab,kf.
  83. (handsearch* or hand search*).ti,ab,kf.
  84. (mantel haenszel or peto or der simonian or dersimonian or fixed effect* or latin square*).ti,ab,kf.
  85. (met analy* or metanaly* or technology assessment* or HTA or HTAs or technology overview* or technology appraisal*).ti,ab,kf.
  86. (meta regression* or metaregression*).ti,ab,kf.
  87. (meta-analy* or metaanaly* or systematic review* or biomedical technology assessment* or bio-medical technology assessment*).mp,hw.
  88. (medline or cochrane or pubmed or medlars or embase or cinahl).ti,ab,hw.
  89. (cochrane or (health adj2 technology assessment) or evidence report).jw.
  90. (comparative adj3 (efficacy or effectiveness)).ti,ab,kf.
  91. (outcomes research or relative effectiveness).ti,ab,kf.
  92. ((indirect or indirect treatment or mixed-treatment or bayesian) adj3 comparison*).ti,ab,kf.
  93. (meta-analysis or systematic review).md.
  94. (multi* adj3 treatment adj3 comparison*).ti,ab,kf.
  95. (mixed adj3 treatment adj3 (meta-analy* or metaanaly*)).ti,ab,kf.
  96. umbrella review*.ti,ab,kf.
  97. (multi* adj2 paramet* adj2 evidence adj2 synthesis).ti,ab,kf.
  98. (multiparamet* adj2 evidence adj2 synthesis).ti,ab,kf.
  99. (multi-paramet* adj2 evidence adj2 synthesis).ti,ab,kf.
  100. or/77-99
  101. epidemiologic methods.sh.
  102. epidemiologic studies.sh.
  103. observational study/
  104. observational studies as topic/
  105. clinical studies as topic/
  106. controlled before-after studies/
  107. cross-sectional studies/
  108. historically controlled study/
  109. interrupted time series analysis/
  110. exp seroepidemiologic studies/
  111. national longitudinal study of adolescent health/
  112. cohort studies/
  113. cohort analysis/
  114. longitudinal studies/
  115. longitudinal study/
  116. prospective studies/
  117. prospective study/
  118. follow-up studies/
  119. follow up/
  120. followup studies/
  121. retrospective studies/
  122. retrospective study/
  123. case-control studies/
  124. exp case control study/
  125. cross-sectional study/
  126. observational study/
  127. quasi experimental methods/
  128. quasi experimental study/
  129. single-case studies as topic/
  130. (observational study or validation studies or clinical study).pt.
  131. (observational adj3 (study or studies or design or analysis or analyses)).ti,ab,kf,kw.
  132. cohort*.ti,ab,kf,kw.
  133. (prospective adj7 (study or studies or design or analysis or analyses)).ti,ab,kf,kw.
  134. ((follow up or followup) adj7 (study or studies or design or analysis or analyses)).ti,ab,kf,kw.
  135. ((longitudinal or longterm or (long adj term)) adj7 (study or studies or design or analysis or analyses or data)).ti,ab,kf,kw.
  136. (retrospective adj7 (study or studies or design or analysis or analyses or data or review)).ti,ab,kf,kw.
  137. ((case adj control) or (case adj comparison) or (case adj controlled)).ti,ab,kf,kw.
  138. (case-referent adj3 (study or studies or design or analysis or analyses)).ti,ab,kf,kw.
  139. (population adj3 (study or studies or analysis or analyses)).ti,ab,kf,kw.
  140. (descriptive adj3 (study or studies or design or analysis or analyses)).ti,ab,kf,kw.
  141. ((multidimensional or (multi adj dimensional)) adj3 (study or studies or design or analysis or analyses)).ti,ab,kf,kw.
  142. (cross adj sectional adj7 (study or studies or design or research or analysis or analyses or survey or findings)).ti,ab,kf,kw.
  143. ((natural adj experiment) or (natural adj experiments)).ti,ab,kf,kw.
  144. (quasi adj (experiment or experiments or experimental)).ti,ab,kf,kw.
  145. ((non experiment or nonexperiment or non experimental or nonexperimental) adj3 (study or studies or design or analysis or analyses)).ti,ab,kf,kw.
  146. (prevalence adj3 (study or studies or analysis or analyses)).ti,ab,kf,kw.
  147. or/101-146
  148. (Randomized Controlled Trial or Controlled Clinical Trial or Pragmatic Clinical Trial or Clinical Study or Adaptive Clinical Trial or Equivalence Trial).pt.
  149. (Clinical Trial or Clinical Trial, Phase I or Clinical Trial, Phase II or Clinical Trial, Phase III or Clinical Trial, Phase IV or Clinical Trial Protocol).pt.
  150. Multicenter Study.pt.
  151. Clinical Studies as Topic/
  152. exp Clinical Trial/ or exp Clinical Trials as Topic/ or Clinical Trial Protocol/ or Clinical Trial Protocols as Topic/ or exp "Clinical Trial (topic)"/
  153. Multicenter Study/ or Multicenter Studies as Topic/ or "Multicenter Study (topic)"/
  154. Randomization/
  155. Random Allocation/
  156. Double-Blind Method/
  157. Double Blind Procedure/
  158. Double-Blind Studies/
  159. Single-Blind Method/
  160. Single Blind Procedure/
  161. Single-Blind Studies/
  162. Placebos/
  163. Placebo/
  164. Control Groups/
  165. Control Group/
  166. Cross-Over Studies/ or Crossover Procedure/
  167. (random* or sham or placebo*).ti,ab,hw,kf,kw.
  168. ((singl* or doubl*) adj (blind* or dumm* or mask*)).ti,ab,hw,kf,kw.
  169. ((tripl* or trebl*) adj (blind* or dumm* or mask*)).ti,ab,hw,kf,kw.
  170. (control* adj3 (study or studies or trial* or group*)).ti,ab,hw,kf,kw.
  171. (clinical adj3 (study or studies or trial*)).ti,ab,hw,kf,kw.
  172. (Nonrandom* or non random* or non-random* or quasi-random* or quasirandom*).ti,ab,hw,kf,kw.
  173. (phase adj3 (study or studies or trial*)).ti,ab,hw,kf,kw.
  174. ((crossover or cross-over) adj3 (study or studies or trial*)).ti,ab,hw,kf,kw.
  175. ((multicent* or multi-cent*) adj3 (study or studies or trial*)).ti,ab,hw,kf,kw.
  176. allocated.ti,ab,hw.
  177. ((open label or open-label) adj5 (study or studies or trial*)).ti,ab,hw,kf,kw.
  178. ((equivalence or superiority or non-inferiority or noninferiority) adj3 (study or studies or trial*)).ti,ab,hw,kf,kw.
  179. (pragmatic study or pragmatic studies).ti,ab,hw,kf,kw.
  180. ((pragmatic or practical) adj3 trial*).ti,ab,hw,kf,kw.
  181. ((quasiexperimental or quasi-experimental) adj3 (study or studies or trial*)).ti,ab,hw,kf,kw.
  182. trial.ti,kf,kw.
  183. or/148-182
  184. exp animals/
  185. exp animal experimentation/
  186. exp models animal/
  187. exp animal experiment/
  188. nonhuman/
  189. exp vertebrate/
  190. animal.po.
  191. or/184-190
  192. exp humans/
  193. exp human experiment/
  194. human.po.
  195. or/192-194
  196. 191 not 195
  197. 183 not 196
  198. 100 or 147 or 197
  199. 76 and 198
  200. limit 199 to (english or french)
  201. limit 200 to yr="2006 -Current"
  202. limit 201 to yr="2006 -2014"
  203. remove duplicates from 202
  204. limit 201 to yr="2015 -current"
  205. remove duplicates from 204
  206. 203 or 205

Other Databases

Cochrane Central Register of Controlled Trials

Same MeSH, keywords, and limits used as per MEDLINE search, excluding study types and human restrictions. Syntax adjusted for Wiley platform. The search strategy is available on request.

CINAHL

Same MeSH, keywords, and limits used as per MEDLINE search, excluding study types and human restrictions. Syntax adjusted for EBSCO platform, including the addition of CINAHL headings. The search strategy is available on request.

Scopus

Same MeSH, keywords, and limits used as per MEDLINE search, excluding study types and human restrictions. Syntax adjusted for Scopus platform. The search strategy is available on request.

Grey Literature

Search dates: January 12 – January 21, 2022

Keywords: Same MeSH, keywords, and limits used as per MEDLINE search

Limits: Publication years: 2006-present, language: English and French language

Updated: Search updated prior to the completion of stakeholder feedback period

Relevant websites from the following sections of the CADTH grey literature checklist Grey Matters: A Practical Tool for Searching Health-Related Grey Literature were searched:

  • Health Technology Assessment Agencies
  • Clinical Practice Guidelines
  • Databases (free)
  • Clinical Trial Registries
  • Internet Search

Appendix 2. Tables and Figures

Note that this appendix has not been copy-edited.

Alt text: A total of 5,357 citations were identified in the electronic search. Following screening of titles and abstracts, 5,168 citations were excluded, and 189 potentially relevant reports were retrieved for full-text review. Eight additional reports from the grey literature were retrieved for full-text scrutiny. 194 records were excluded for various reasons while 3 publications (reporting results from 2 RCTs) are included in the review.

Figure 1

PRISMA Flow Chart of Selected Reports — Clinical Review.

Table 8. Detailed Characteristics of the Included Trials — Clinical Review.

Table 8

Detailed Characteristics of the Included Trials — Clinical Review.

Table 9. Risk of Bias in the Included Randomized Controlled Trials Assessed Using RoB 2 (Effect of Assignment to the Intervention).

Table 9

Risk of Bias in the Included Randomized Controlled Trials Assessed Using RoB 2 (Effect of Assignment to the Intervention).

Table 10. Summary of Detailed Findings for Stigma.

Table 10

Summary of Detailed Findings for Stigma.

Table 11. Summary of Detailed Findings for Self-Efficacy About Secrecy and Disclosing Mental Illness.

Table 11

Summary of Detailed Findings for Self-Efficacy About Secrecy and Disclosing Mental Illness.

Table 12. Summary of Detailed Findings for HRQoL.

Table 12

Summary of Detailed Findings for HRQoL.

Table 13. Summary of Detailed Findings for Empowerment.

Table 13

Summary of Detailed Findings for Empowerment.

Table 14. Summary of Detailed Findings for Social Withdrawal.

Table 14

Summary of Detailed Findings for Social Withdrawal.

Table 15. Summary of Detailed Findings for Help-Seeking.

Table 15

Summary of Detailed Findings for Help-Seeking.

Table 16. Summary of Detailed Findings for Hopelessness.

Table 16

Summary of Detailed Findings for Hopelessness.

Table 17. Summary of Detailed Findings for Stage of Recovery.

Table 17

Summary of Detailed Findings for Stage of Recovery.

Table 18. Summary of Detailed Findings for Clinical Outcomes.

Table 18

Summary of Detailed Findings for Clinical Outcomes.

Table 19. GRADE Summary of Findings for Self-Stigma — Clinical Review.

Table 19

GRADE Summary of Findings for Self-Stigma — Clinical Review.

Table 20. GRADE Summary of Findings for Stigma Stress.

Table 20

GRADE Summary of Findings for Stigma Stress.

Table 21. GRADE Summary of Findings for Self-Efficacy Related to Secrecy and Disclosing of Mental Illness.

Table 21

GRADE Summary of Findings for Self-Efficacy Related to Secrecy and Disclosing of Mental Illness.

Table 22. GRADE Summary of Findings for Attitudes to Disclosure.

Table 22

GRADE Summary of Findings for Attitudes to Disclosure.

Table 23. GRADE Summary of Findings for Disclosure-Related Distress.

Table 23

GRADE Summary of Findings for Disclosure-Related Distress.

Table 24. GRADE Summary of Findings for Secrecy.

Table 24

GRADE Summary of Findings for Secrecy.

Table 25. GRADE Summary of Findings for HRQoL.

Table 25

GRADE Summary of Findings for HRQoL.

Table 26. GRADE Summary of Findings for Empowerment.

Table 26

GRADE Summary of Findings for Empowerment.

Table 27. GRADE Summary of Findings for Social Withdrawal.

Table 27

GRADE Summary of Findings for Social Withdrawal.

Table 28. GRADE Summary of Findings for Help-Seeking.

Table 28

GRADE Summary of Findings for Help-Seeking.

Table 29. GRADE Summary of Findings for Hopelessness.

Table 29

GRADE Summary of Findings for Hopelessness.

Table 30. GRADE Summary of Findings for Stage of Recovery.

Table 30

GRADE Summary of Findings for Stage of Recovery.

Table 31. GRADE Summary of Findings for Symptoms of Anxiety.

Table 31

GRADE Summary of Findings for Symptoms of Anxiety.

Table 32. GRADE Summary of Findings for Symptoms of Depression.

Table 32

GRADE Summary of Findings for Symptoms of Depression.

Table 33. Detailed Descriptions of Outcome Measurement Tools.

Table 33

Detailed Descriptions of Outcome Measurement Tools.

Appendix 3. List of Excluded Publications and Reasons for Exclusion — Review of Clinical Effectiveness and Safety

Note that this appendix has not been copy-edited.

The citations provided in this list are studies that were excluded after full-text review by 2 independent reviewers as part of the Clinical Review (in reverse chronological and alphabetical order).

    Irrelevant Population (n = 84)

    1. Ali K, Fassnacht DB, Farrer LM, et al. Recruitment, adherence and attrition challenges in internet-based indicated prevention programs for eating disorders: lessons learned from a randomised controlled trial of ProYouth OZ. Journal of Eating Disorders. 2022;10(1). [PMC free article: PMC8725518] [PubMed: 34983675]
    2. Ali SH, Mohsin FM, Banks A, Lynn P, Lim S. Peer-Led, Remote Intervention to Improve Mental Health Outcomes Using a Holistic, Spirituality-Based Approach: Results from a Pilot Study. Community mental health journal. 2021;24. [PMC free article: PMC8475393] [PubMed: 34561834]
    3. Johnson BA, Riley JB. Psychosocial impacts on college students providing mental health peer support. J Am Coll Health. 2021;69(2)():232-236. [PubMed: 31532336]
    4. Toombs E, Mushquash CJ, Lund J, et al. Adaption and implementation of the Housing Outreach Program Collaborative (HOP-C) North for Indigenous youth. Am J Orthopsychiatry. 2021;91(1)():96-108. [PubMed: 33411554]
    5. Onyeka O, Richards M, Tyson McCrea K, et al. The role of positive youth development on mental health for youth of color living in high-stress communities: A strengths-based approach. Psychol Serv. 2021;04():04. [PubMed: 34735195]
    6. Gregory D, Van Puymbroeck M, Crowe B, Garst B, Amylon M. The Influence of a Peer Support Camp on Mitigating Emotional Distress in Siblings of Children With Cancer. J Pediatr Oncol Nurs. 2021;():10434542211041929. [PubMed: 34546821]
    7. Munson MR, Jaccard J, Scott LD, Jr., et al. Outcomes of a Metaintervention to Improve Treatment Engagement Among Young Adults With Serious Mental Illnesses: Application of a Pilot Randomized Explanatory Design. J Adolesc Health. 2021;69(5):790-796. [PMC free article: PMC8545849] [PubMed: 34099390]
    8. Sansom-Daly UM, Wakefield CE, Ellis SJ, et al. Online, Group-Based Psychological Support for Adolescent and Young Adult Cancer Survivors: Results from the Recapture Life Randomized Trial. Cancers (Basel). 2021;13(10):18. [PMC free article: PMC8158368] [PubMed: 34070134]
    9. Albritton T, Ford KL, Elsbernd K, et al. Implementing a Peer Advocate Mental Health Digital Intervention Program for Ohio Youth: Descriptive Pilot Study. JMIR mental health. 2021;8(4):e24605. [PMC free article: PMC8105753] [PubMed: 33890868]
    10. Allen JP, Narr RK, Nagel AG, Costello MA, Guskin K. The Connection Project: Changing the peer environment to improve outcomes for marginalized adolescents. Dev Psychopathol. 2021;33(2):647-657. [PMC free article: PMC9034648] [PubMed: 32124707]
    11. Mohamadi S, Paryab S, Mousavi SA, Keramat A, Motaghi Z, Garkaz O. Comparison of the effect of motivational interview and peer group education on knowledge and performance about puberty and mental health in adolescent girls. Journal of Nursing & Midwifery Sciences. 2021;8(3):178-185.
    12. Fokuo J, Maroney MM, Corrigan P. Pilot of a consumer based anti-stigma mentorship program for nursing students. J Public Ment Health. 2020;19(1):51-61.
    13. Svetlitzky V, Farchi M, Ben Yehuda A, Start AR, Levi O, Adler AB. YaHaLOM training in the military: Assessing knowledge, confidence, and stigma. Psychol Serv. 2020;17(2):151-159. [PubMed: 31120293]
    14. Shankar P, Sievers D, Sharma R. Evaluating the Impact of a School-Based Youth-Led Health Education Program for Adolescent Females in Mumbai, India. Ann Glob Health. 2020;86(1):57. [PMC free article: PMC7292104] [PubMed: 32566485]
    15. Chinoda S, Mutsinze A, Simms V, et al. Effectiveness of a peer-led adolescent mental health intervention on HIV virological suppression and mental health in Zimbabwe: protocol of a cluster-randomised trial. Glob Ment Health (Camb). 2020;7():e23. [PMC free article: PMC7490770] [PubMed: 32963795]
    16. Kidd SA, Vitopoulos N, Frederick T, et al. Trialing the feasibility of a critical time intervention for youth transitioning out of homelessness. Am J Orthopsychiatry. 2020;90(5):535-545. [PubMed: 32309974]
    17. Vanderkruik R, Gist D, Dimidjian S. Preventing eating disorders in young women: An RCT and mixed-methods evaluation of the peer-delivered Body Project. J Consult Clin Psychol. 2020;88(12):1105-1118. [PubMed: 33370134]
    18. Ranzenhofer LM, Wilhelmy M, Hochschild A, Sanzone K, Walsh BT, Attia E. Peer mentorship as an adjunct intervention for the treatment of eating disorders: A pilot randomized trial. International Journal of Eating Disorders. 2020;53(5):497-509. [PMC free article: PMC7383944] [PubMed: 32159243]
    19. Maselko J, Sikander S, Turner EL, et al. Effectiveness of a peer-delivered, psychosocial intervention on maternal depression and child development at 3 years postnatal: a cluster randomised trial in Pakistan. Lancet Psychiatry. 2020;7(9):775-787. [PMC free article: PMC8015797] [PubMed: 32828167]
    20. Stice E, Rohde P, Shaw H, Gau JM. Clinician-led, peer-led, and internet-delivered dissonance-based eating disorder prevention programs: Effectiveness of these delivery modalities through 4-year follow-up. J Consult Clin Psychol. 2020;88(5):481-494. [PMC free article: PMC7810349] [PubMed: 32091226]
    21. Shorey S, Chee CYI, Ng ED, Lau Y, Dennis C-L, Chan YH. Evaluation of a technology-based peer-support intervention program for preventing postnatal depression (Part 1): Randomized controlled trial. Journal of Medical Internet Research Vol 21(8), 2019, ArtID e12410. 2019;21(8):. [PMC free article: PMC6744221] [PubMed: 31469084]
    22. Nozawa H, Ikegami K, Michii S, et al. Peer counseling for mental health in young people-Randomized clinical trial. Mental Health and Prevention Vol 14 2019, ArtID 200164. 2019;14():.
    23. Beveridge J, Phillipou A, Jenkins Z, et al. Peer mentoring for eating disorders: Results from the evaluation of a pilot program. Journal of Eating Disorders Vol 7 2019, ArtID 13. 2019;7():. [PMC free article: PMC6545742] [PubMed: 31171969]
    24. Kidd SA, Vitopoulos N, Frederick T, et al. Peer support in the homeless youth context: Requirements, design, and outcomes. Child & Adolescent Social Work Journal. 2019;36(6):641-654.
    25. Fan Y, Ma N, Ma L, et al. Feasibility of peer support services among people with severe mental illness in China. BMC Psychiatry. 2019;19(1) (no pagination)():. [PMC free article: PMC6854628] [PubMed: 31727108]
    26. Kidd SA, Vitopoulos N, Frederick T, Leon S, Karabanow J, McKenzie K. More than four walls and a roof needed: A complex tertiary prevention approach for recently homeless youth. Am J Orthopsychiatry. 2019;89(2)():248-257. [PubMed: 30382726]
    27. Crisanti AS, Murray-Krezan C, Reno J, Killough C. Effectiveness of Peer-Delivered Trauma Treatment in a Rural Community: A Randomized Non-inferiority Trial. Community Ment Health J. 2019;55(7):1125-1134. [PMC free article: PMC6744517] [PubMed: 31338716]
    28. Rusch N, Staiger T, Waldmann T, et al. Efficacy of a peer-led group program for unemployed people with mental health problems: Pilot randomized controlled trial. Int J Soc Psychiatry. 2019;65(4):333-337. [PubMed: 31056997]
    29. Fuhr DC, Weobong B, Lazarus A, et al. Delivering the Thinking Healthy Programme for perinatal depression through peers: an individually randomised controlled trial in India. Lancet Psychiatry. 2019;6(2):115-127. [PubMed: 30686385]
    30. Crisanti AS, Reno J, Salvador JG, Killough C, Greene RN. Perceived helpfulness of peer-delivered trauma specific treatment: A randomized controlled trial. Psychol Serv. 2019;16(3):425-432. [PubMed: 30407046]
    31. Pfeiffer PN, King C, Ilgen M, et al. Development and pilot study of a suicide prevention intervention delivered by peer support specialists. Psychol Serv. 2019;16(3):360-371. [PMC free article: PMC6494743] [PubMed: 30382743]
    32. Breithaupt L, Eickman L, Byrne CE, Fischer S. REbeL peer education: A model of a voluntary, after-school program for eating disorder prevention. Eat Behav. 2019;32():111-116. [PubMed: 27825587]
    33. Haft SL, Chen T, LeBlanc C, Tencza F, Hoeft F. Impact of mentoring on socio‐emotional and mental health outcomes of youth with learning disabilities and attention‐deficit hyperactivity disorder. Child Adolesc Ment Health. 2019;24(4):318-328. [PMC free article: PMC6812582] [PubMed: 31649490]
    34. Willging CE, Harkness A, Israel T, et al. A mixed-method assessment of a pilot peer advocate intervention for rural gender and sexual minorities. Community Ment Health J. 2018;54(4):395-409. [PMC free article: PMC5856590] [PubMed: 28918540]
    35. Castellanos D, Capo M, Valderrama D, Jean-Francois M, Luna A. Relationship of peer specialists to mental health outcomes in South Florida. Int J Ment Health Syst. 2018;12(1) (no pagination)():. [PMC free article: PMC6195727] [PubMed: 30377441]
    36. Johnson S, Lamb D, Marston L, et al. Peer-supported self-management for people discharged from a mental health crisis team: a randomised controlled trial. Lancet. 2018;392(10145):409-418. [PMC free article: PMC6083437] [PubMed: 30102174]
    37. Chinman M, McCarthy S, Bachrach RL, Mitchell-Miland C, Schutt RK, Ellison M. Investigating the Degree of Reliable Change Among Persons Assigned to Receive Mental Health Peer Specialist Services. Psychiatr Serv. 2018;69(12):1238-1244. [PubMed: 30286707]
    38. Kido Y, Kawakami N, Kayama M. Comparison of hospital admission rates for psychiatric patients cared for by multidisciplinary outreach teams with and without peer specialist: a retrospective cohort study of Japanese Outreach Model Project 2011-2014. BMJ Open. 2018;8(8):e019090. [PMC free article: PMC6104750] [PubMed: 30121587]
    39. Fan Y, Ma N, Ma L, Xu W, Steven Lamberti J, Caine ED. A community-based peer support service for persons with severe mental illness in China. BMC Psychiatry. 2018;18(1):170. [PMC free article: PMC5987580] [PubMed: 29866096]
    40. Druss BG, Singh M, von Esenwein SA, et al. Peer-Led Self-Management of General Medical Conditions for Patients With Serious Mental Illnesses: A Randomized Trial. Psychiatr Serv. 2018;69(5):529-535. [PMC free article: PMC5930018] [PubMed: 29385952]
    41. Schiltz HK, McVey AJ, Dolan BK, et al. Changes in Depressive Symptoms Among Adolescents with ASD Completing the PEERS R Social Skills Intervention. J Autism Dev Disord. 2018;48(3):834-843. [PMC free article: PMC10321229] [PubMed: 29164445]
    42. Ren P, Qin X, Zhang Y, Zhang R. Is Social Support a Cause or Consequence of Depression? A Longitudinal Study of Adolescents. Front Psychol. 2018;9():1634. [PMC free article: PMC6132191] [PubMed: 30233469]
    43. Baumel A, Tinkelman A, Mathur N, Kane JM. Digital Peer-Support Platform (7Cups) as an Adjunct Treatment for Women With Postpartum Depression: Feasibility, Acceptability, and Preliminary Efficacy Study. JMIR Mhealth Uhealth. 2018;6(2):e38. [PMC free article: PMC5829455] [PubMed: 29439944]
    44. Shanta Bridges L, Sharma M, Lee JHS, Bennett R, Buxbaum SG, Reese-Smith J. Using the PRECEDE-PROCEED model for an online peer-to-peer suicide prevention and awareness for depression (SPAD) intervention among African American college students: experimental study. Health promot. 2018;8(1):15-24. [PMC free article: PMC5797304] [PubMed: 29423358]
    45. Breithaupt L, Eickman L, Byrne CE, Fischer S. Enhancing empowerment in eating disorder prevention: Another examination of the REbeL peer education model. Eat Behav. 2017;25():38-41. [PubMed: 27329775]
    46. Mahlke CI, Priebe S, Heumann K, Daubmann A, Wegscheider K, Bock T. Effectiveness of one-to-one peer support for patients with severe mental illness - a randomised controlled trial. Eur Psychiatry. 2017;42():103-110. [PubMed: 28364685]
    47. Kelly E, Duan L, Cohen H, Kiger H, Pancake L, Brekke J. Integrating behavioral healthcare for individuals with serious mental illness: A randomized controlled trial of a peer health navigator intervention. Schizophr Res. 2017;182():135-141. [PubMed: 27793514]
    48. Chu BC, Carpenter AL, Wyszynski CM, Conklin PH, Comer JS. Scalable Options for Extended Skill Building Following Didactic Training in Cognitive-Behavioral Therapy for Anxious Youth: A Pilot Randomized Trial. J Clin Child Adolesc Psychol. 2017;46(3):401-410. [PubMed: 25984590]
    49. Crooks C, Exner-Cortens D, Burm S, Lapointe A, Chiodo D, Crooks CV. Two Years of Relationship-Focused Mentoring for First Nations, Métis, and Inuit Adolescents: Promoting Positive Mental Health. J Prim Prev. 2017;38(1/2):87-104. [PubMed: 27848172]
    50. Ekore R, Ajuwon A, Abdulmalik J, Omigbodun O, Bella-Awusah T. Developing mental health peer counselling services for undergraduate students of a Nigerian university: A pilot study. IFE Psychologia: An International Journal. 2016;24(2):246-258.
    51. Mason MJ, Zaharakis NM, Sabo R. Reducing social stress in urban adolescents with peer network counseling. J Child Fam Stud. 2016;25(12):3488-3496.
    52. Moir F, Henning M, Hassed C, Moyes SA, Elley CR. A Peer-Support and Mindfulness Program to Improve the Mental Health of Medical Students. Teach Learn Med. 2016;28(3):293-302. [PubMed: 27092397]
    53. Thiha P, Pisani AR, Gurditta K, et al. Efficacy of Web-Based Collection of Strength-Based Testimonials for Text Message Extension of Youth Suicide Prevention Program: Randomized Controlled Experiment. JMIR Public Health Surveill. 2016;2(2):e164. [PMC free article: PMC5121531] [PubMed: 27829575]
    54. Ciao AC, Latner JD, Brown KE, Ebneter DS, Becker CB. Effectiveness of a peer-delivered dissonance-based program in reducing eating disorder risk factors in high school girls. International Journal of Eating Disorders. 2015;48(6):779-84. [PubMed: 25959408]
    55. Letourneau N, Secco L, Colpitts J, Aldous S, Stewart M, Dennis CL. Quasi-experimental evaluation of a telephone-based peer support intervention for maternal depression. J Adv Nurs. 2015;71(7):1587-99. [PubMed: 25705786]
    56. Petrova M, Wyman PA, Schmeelk-Cone K, Pisani AR. Positive-Themed Suicide Prevention Messages Delivered by Adolescent Peer Leaders: Proximal Impact on Classmates' Coping Attitudes and Perceptions of Adult Support. Suicide Life Threat Behav. 2015;45(6):651-63. [PMC free article: PMC4540682] [PubMed: 25692382]
    57. Simpson A, Flood C, Rowe J, et al. Results of a pilot randomised controlled trial to measure the clinical and cost effectiveness of peer support in increasing hope and quality of life in mental health patients discharged from hospital in the UK. BMC Psychiatry. 2014;14():30. [PMC free article: PMC3922504] [PubMed: 24495599]
    58. Russinova Z, Rogers ES, Gagne C, Bloch P, Drake KM, Mueser KT. A randomized controlled trial of a peer-run antistigma photovoice intervention. Psychiatr Serv. 2014;65(2):242-6. [PubMed: 24337339]
    59. Noel LT, Rost K, Gromer J. Depression prevention among rural preadolescent girls: A randomized controlled trial. School Social Work Journal. 2013;38(1):1-18.
    60. Lee R, Lee KS, Oh E-G, Kim SH. A randomized trial of dyadic peer support intervention for newly diagnosed breast cancer patients in Korea. Cancer Nurs. 2013;36(3):E15-E22. [PubMed: 22964869]
    61. Chien WT, Thompson DR. An RCT with three-year follow-up of peer support groups for Chinese families of persons with schizophrenia. Psychiatr Serv. 2013;64(10):997-1005. [PubMed: 23820670]
    62. Jennings SJ, Jennings JL. Peer-Directed, Brief Mindfulness Training with Adolescents: A Pilot Study. International Journal of Behavioral Consultation & Therapy. 2013;8(2):23-25.
    63. Van Tam V, Larsson M, Pharris A, et al. Peer support and improved quality of life among persons living with HIV on antiretroviral treatment: a randomised controlled trial from north-eastern Vietnam. Health Qual Life Outcomes. 2012;10():53. [PMC free article: PMC3491019] [PubMed: 22606977]
    64. Becker CB, McDaniel L, Bull S, Powell M, McIntyre K. Can we reduce eating disorder risk factors in female college athletes? A randomized exploratory investigation of two peer-led interventions. Body Image. 2012;9(1):31-42. [PMC free article: PMC3246101] [PubMed: 22019502]
    65. Proudfoot J, Parker G, Manicavasagar V, et al. Effects of adjunctive peer support on perceptions of illness control and understanding in an online psychoeducation program for bipolar disorder: a randomised controlled trial. J Affect Disord. 2012;142(1-3):98-105. [PubMed: 22858215]
    66. van Gestel-Timmermans H, Brouwers EP, van Assen MA, van Nieuwenhuizen C. Effects of a peer-run course on recovery from serious mental illness: a randomized controlled trial. Psychiatr Serv. 2012;63(1):54-60. [PubMed: 22227760]
    67. Renner W, Banninger-Huber E, Peltzer K. Culture-Sensitive and Resource Oriented Peer (CROP)-Groups as a community based intervention for trauma survivors: A randomized controlled pilot study with refugees and asylum seekers from Chechnya. Australasian Journal of Disaster and Trauma Studies. 2011;2011(1):1-13.
    68. Struchen MA, Davis LC, Bogaards JA, et al. Making connections after brain injury: Development and evaluation of a social peer-mentoring program for persons with traumatic brain injury. J Head Trauma Rehabil. 2011;26(1):4-19. [PubMed: 21209559]
    69. Balaji M, Andrews T, Andrew G, Patel V. The acceptability, feasibility, and effectiveness of a population-based intervention to promote youth health: an exploratory study in Goa, India. J Adolesc Health. 2011;48(5):453-60. [PMC free article: PMC4991743] [PubMed: 21501803]
    70. Landers GM, Zhou M. An analysis of relationships among peer support, psychiatric hospitalization, and crisis stabilization. Community Ment Health J. 2011;47(1):106-12. [PubMed: 19551502]
    71. Sledge WH, Lawless M, Sells D, Wieland M, O'Connell MJ, Davidson L. Effectiveness of peer support in reducing readmissions of persons with multiple psychiatric hospitalizations. Psychiatr Serv. 2011;62(5):541-4. [PubMed: 21532082]
    72. Letourneau N, Stewart M, Dennis CL, Hegadoren K, Duffett-Leger L, Watson B. Effect of home-based peer support on maternal-infant interactions among women with postpartum depression: a randomized, controlled trial. Int J Ment Health Nurs. 2011;20(5):345-57. [PubMed: 21385294]
    73. Wyman PA, Brown CH, LoMurray M, et al. An outcome evaluation of the Sources of Strength suicide prevention program delivered by adolescent peer leaders in high schools. Am J Public Health. 2010;100(9):1653-61. [PMC free article: PMC2920978] [PubMed: 20634440]
    74. Druss BG, Zhao L, von Esenwein SA, et al. The Health and Recovery Peer (HARP) Program: a peer-led intervention to improve medical self-management for persons with serious mental illness. Schizophr Res. 2010;118(1-3):264-70. [PMC free article: PMC2856811] [PubMed: 20185272]
    75. Becker CB, Wilson C, Williams A, Kelly M, McDaniel L, Elmquist J. Peer-facilitated cognitive dissonance versus healthy weight eating disorders prevention: A randomized comparison. Body Image. 2010;7(4):280-8. [PubMed: 20638351]
    76. Vaughan CA, Foshee VA, Ennett ST, Vaughan CA, Foshee VA, Ennett ST. Protective effects of maternal and peer support on depressive symptoms during adolescence. J Abnorm Child Psychol. 2010;38(2):261-272. [PMC free article: PMC4029412] [PubMed: 19908140]
    77. McVey GL, Kirsh G, Maker D, et al. Promoting positive body image among university students: a collaborative pilot study. Body Image. 2010;7(3):200-204. [PubMed: 20227934]
    78. Dennis CL, Hodnett E, Kenton L, et al. Effect of peer support on prevention of postnatal depression among high risk women: multisite randomised controlled trial. BMJ. 2009;338():a3064. [PMC free article: PMC2628301] [PubMed: 19147637]
    79. Walker RL, Ashby J, Hoskins OD, Greene FN. Peer-support suicide prevention in a non-metropolitan U.S. community. Adolescence. 2009;44(174):335-46. [PubMed: 19764270]
    80. Dennis CL, Hodnett E, Kenton L, et al. Effect of peer support on prevention of postnatal depression among high risk women: multisite randomised controlled trial. Bmj. 2009;338. PM:CN-00666375 [PMC free article: PMC2628301] [PubMed: 19147637]
    81. Black Becker C, Bull S, Smith LM, Ciao AC. Effects of being a peer-leader in an eating disorder prevention program: can we further reduce eating disorder risk factors?. Eat. 2008;16(5):444-59. [PubMed: 18821367]
    82. Becker CB, Bull S, Schaumberg K, Cauble A, Franco A. Effectiveness of peer-led eating disorders prevention: a replication trial. J Consult Clin Psychol. 2008;76(2):347-54. [PubMed: 18377130]
    83. Rowe M, Bellamy C, Baranoski M, et al. A peer-support, group intervention to reduce substance use and criminality among persons with severe mental illness. Psychiatr Serv. 2007;58(7):955-61. [PubMed: 17602012]
    84. Sidhu R, Passmore A, Baker D. The effectiveness of a peer support camp for siblings of children with cancer. Pediatr Blood Cancer. 2006;47(5):580-8. [PubMed: 16317733]

    Irrelevant Intervention (n = 50)

    1. Kruzan KP, Whitlock J, Bazarova NN, Bhandari A, Chapman J. Use of a Mobile Peer support App Among Young People With Nonsuicidal Self-injury: Small-scale Randomized Controlled Trial. JMIR Form Res. 2022;6(1). [PMC free article: PMC8787664] [PubMed: 35006076]
    2. Kruzan KP, Whitlock J, Bazarova NN. Examining the relationship between the use of a mobile peer-support app and self-injury outcomes: longitudinal mixed methods study. JMIR mental health. 2021;8(1) (no pagination)():. [PMC free article: PMC7878111] [PubMed: 33507154]
    3. Ahorsu DK, Sanchez Vidana DI, Lipardo D, et al. Effect of a peer-led intervention combining mental health promotion with coping-strategy-based workshops on mental health awareness, help-seeking behavior, and wellbeing among university students in Hong Kong. Int J Ment Health Syst. 2021;15(1) (no pagination)():. [PMC free article: PMC7796456] [PubMed: 33422098]
    4. Chory A, Callen G, Nyandiko W, et al. A Pilot Study of a Mobile Intervention to Support Mental Health and Adherence Among Adolescents Living with HIV in Western Kenya. Aids Behav. 2021;22():22. [PMC free article: PMC8295454] [PubMed: 34292429]
    5. Muehlenkamp JJ, Quinn-Lee L. Effectiveness of a peer-led gatekeeper program: A longitudinal mixed-method analysis. J Am Coll Health. 2021;():1-10. [PubMed: 33759720]
    6. Rodriguez M, Eisenlohr-Moul TA, Weisman J, Rosenthal MZ. The Use of Task Shifting to Improve Treatment Engagement in an Internet-Based Mindfulness Intervention Among Chinese University Students: Randomized Controlled Trial. JMIR Form Res. 2021;5(10):e25772. [PMC free article: PMC8552103] [PubMed: 34643532]
    7. Tambag H. Examination of nursing students' anxiety levels related to clinical practice with respect to peer support. Perspect Psychiatr Care. 2021;57(3):1114-1119. [PubMed: 33111380]
    8. Alvarez-Jimenez M, Koval P, Schmaal L, et al. The Horyzons project: a randomized controlled trial of a novel online social therapy to maintain treatment effects from specialist first-episode psychosis services. World Psychiatry. 2021;20(2):233-243. [PMC free article: PMC8129860] [PubMed: 34002511]
    9. Hughes S, Rondeau M, Shannon S, et al. A Holistic Self-learning Approach for Young Adult Depression and Anxiety Compared to Medication-Based Treatment-As-Usual. Community Ment Health J. 2021;57(2):392-402. [PubMed: 32577998]
    10. Davis M. 14.1 Peer academic supports for college students with mental illness: pilot randomized controlled trial. J Am Acad Child Adolesc Psychiatry. 2021;60(10):S278-S279.
    11. Keeler LA, Skidmore B, Leenstra T, MacDonald JR, Stewart D. Treating University Students’ Depression using Physical Activity with Peers: Two Field-Based Quasi-Experiments Grounded in the Self-Determination Theory. J Coll Stud Psychother. 2021;35(3):205-223.
    12. Drysdale MTB, McBeath ML, Callaghan SA. The feasibility and impact of online peer support on the well-being of higher education students. J Ment Health Train Educ Pract. 2021.
    13. Ghaderi A, Stice E, Andersson G, Eno Persson J, Allzen E. A randomized controlled trial of the effectiveness of virtually delivered Body Project (vBP) groups to prevent eating disorders. J Consult Clin Psychol. 2020;88(7):643-656. [PubMed: 32551736]
    14. Alvarez-Jimenez M, Rice S, D'Alfonso S, et al. A novel multimodal digital service (moderated online social therapy+) for help-seeking young people experiencing mental ill-health: Pilot evaluation within a national youth e-mental health service. J Med Internet Res. 2020;22(8) (no pagination)():. [PMC free article: PMC7453330] [PubMed: 32788151]
    15. Blakeslee JE, Powers LE, Geenen S, et al. Evaluating the My Life self-determination model for older youth in foster care: Establishing efficacy and exploring moderation of response to intervention. Child Youth Serv Rev. 2020;119():. [PMC free article: PMC7544005] [PubMed: 33041412]
    16. Chyzzy B, Nelson LE, Stinson J, Vigod S, Dennis CL. Adolescent Mothers' Perceptions of a Mobile Phone-Based Peer Support Intervention. Can J Nurs Res. 2020;52(2):129-138. [PubMed: 32036679]
    17. Vanobberghen F, Weiss HA, Fuhr DC, et al. Effectiveness of the Thinking Healthy Programme for perinatal depression delivered through peers: Pooled analysis of two randomized controlled trials in India and Pakistan. J Affect Disord. 2020;265():660-668. [PMC free article: PMC7042347] [PubMed: 32090783]
    18. Campbell A, Ridout B, Amon K, Navarro P, Collyer B, Dalgleish J. A Customized Social Network Platform (Kids Helpline Circles) for Delivering Group Counseling to Young People Experiencing Family Discord That Impacts Their Well-Being: Exploratory Study. J Med Internet Res. 2019;21(12):e16176. [PMC free article: PMC6942185] [PubMed: 31859671]
    19. Sommer J, Gill KH, Stein-Parbury J, Cronin P, Katsifis V. The Role of Recovery Colleges in Supporting Personal Goal Achievement. Psychiatr Rehabil J. 2019;42(4):394-400. [PubMed: 31135174]
    20. Olowokere AE, Okanlawon FA. Improving vulnerable school children's psychosocial health outcomes through resilience-based training and peer-support activities: A comparative prospective study. Vulnerable Child Youth Stud. 2018;13(4):291-304.
    21. Pickering TA, Wyman PA, Schmeelk-Cone K, et al. Diffusion of a Peer-Led Suicide Preventive Intervention Through School-Based Student Peer and Adult Networks. Front Psychiatry. 2018;9 (no pagination)():. [PMC free article: PMC6249330] [PubMed: 30498462]
    22. Parikh SV, Taubman DS, Antoun C, et al. The Michigan peer-to-Peer depression awareness program: School-Based prevention to address depression among teens. Psychiatr Serv. 2018;69(4)():487-491. [PubMed: 29493416]
    23. Byrom N. An evaluation of a peer support intervention for student mental health. J Ment Health. 2018;27(3)():240-246. [PubMed: 29451411]
    24. Eickman L, Betts J, Pollack L, Bozsik F, Beauchamp M, Lundgren J. Randomized controlled trial of REbeL: A peer education program to promote positive body image, healthy eating behavior, and empowerment in teens. Eat. 2018;26(2):127-142. [PubMed: 29072551]
    25. Rice S, Gleeson J, Davey C, et al. Moderated online social therapy for depression relapse prevention in young people: pilot study of a 'next generation' online intervention. Early Interv Psychiatry. 2018;12(4):613-625. [PubMed: 27311581]
    26. Chiu I, Graham JA. The effect of a peer-based personal stories intervention on focus of anxiety and social distance towards people with mental illness. J Coll Stud Dev. 2017;58(1):101-107.
    27. Rohde P, Stice E, Shaw H, Gau JM, Ohls OC. Age effects in eating disorder baseline risk factors and prevention intervention effects. International Journal of Eating Disorders. 2017;50(11):1273-1280. [PMC free article: PMC5745064] [PubMed: 28861902]
    28. Arora PG, Wheeler LA, Fisher S, Barnes J. A prospective examination of anxiety as a predictor of depressive symptoms among Asian American early adolescent youth: The role of parent, peer, and teacher support and school engagement. Cultur Divers Ethni Minor Psychol. 2017;23(4):541-550. [PubMed: 28604022]
    29. Simmons MB, Batchelor S, Dimopoulos-Bick T, Howe D. The Choice Project: Peer Workers Promoting Shared Decision Making at a Youth Mental Health Service. Psychiatr Serv. 2017;68(8):764-770. [PubMed: 28457208]
    30. Stice E, Rohde P, Shaw H, Gau JM. Clinician-led, peer-led, and internet-delivered dissonance-based eating disorder prevention programs: Acute effectiveness of these delivery modalities. J Consult Clin Psychol. 2017;85(9):883-895. [PMC free article: PMC5578897] [PubMed: 28425735]
    31. Wilksch SM, Paxton SJ, Byrne SM, Austin SB, O'Shea A, Wade TD. Outcomes of three universal eating disorder risk reduction programs by participants with higher and lower baseline shape and weight concern. International Journal of Eating Disorders. 2017;50(1):66-75. [PubMed: 27768806]
    32. McConnell EA, Birkett M, Mustanski B. Families Matter: Social Support and Mental Health Trajectories Among Lesbian, Gay, Bisexual, and Transgender Youth. J Adolesc Health. 2016;59(6):674-680. [PMC free article: PMC5217458] [PubMed: 27707515]
    33. Kilpela LS, Blomquist K, Verzijl C, Wilfred S, Beyl R, Becker CB. The body project 4 all: A pilot randomized controlled trial of a mixed-gender dissonance-based body image program. International Journal of Eating Disorders. 2016;49(6):591-602. [PMC free article: PMC5365075] [PubMed: 27188688]
    34. Bohleber L, Crameri A, Eich-Stierli B, Telesko R, von Wyl A. Can We Foster a Culture of Peer Support and Promote Mental Health in Adolescence Using a Web-Based App? A Control Group Study. JMIR mental health. 2016;3(3):e45. [PMC free article: PMC5074648] [PubMed: 27663691]
    35. Greif R, Becker CB, Hildebrandt T. Reducing eating disorder risk factors: A pilot effectiveness trial of a train-the-trainer approach to dissemination and implementation. International Journal of Eating Disorders. 2015;48(8):1122-31. [PubMed: 26281792]
    36. Morris RR, Schueller SM, Picard RW. Efficacy of a Web-based, crowdsourced peer-to-peer cognitive reappraisal platform for depression: randomized controlled trial. J Med Internet Res. 2015;17(3):e72. [PMC free article: PMC4395771] [PubMed: 25835472]
    37. Farrell CT, Bolland JM, Cockerham WC. The role of social support and social context on the incidence of attempted suicide among adolescents living in extremely impoverished communities. J Adolesc Health. 2015;56(1):59-65. [PubMed: 25438969]
    38. Stice E, Marti CN, Cheng ZH. Effectiveness of a dissonance-based eating disorder prevention program for ethnic groups in two randomized controlled trials. Behav Res Ther. 2014;55():54-64. [PMC free article: PMC4014461] [PubMed: 24655465]
    39. Rose K, Hawes DJ, Hunt CJ. Randomized controlled trial of a friendship skills intervention on adolescent depressive symptoms. J Consult Clin Psychol. 2014;82(3):510-20. [PubMed: 24491074]
    40. Elafros MA, Mulenga J, Mbewe E, et al. Peer support groups as an intervention to decrease epilepsy-associated stigma. Epilepsy and Behavior. 2013;27(1)():188-192. [PMC free article: PMC3602129] [PubMed: 23454914]
    41. Kamalifard M, Yavarikia P, Babapour Kheiroddin J, Salehi Pourmehr H, Iraji Iranagh R. The effect of peers support on postpartum depression: a single-blind randomized clinical trial. J Caring Sci. 2013;2(3):237-44. [PMC free article: PMC4134152] [PubMed: 25276732]
    42. Field T, Diego M, Delgado J, Medina L. Peer support and interpersonal psychotherapy groups experienced decreased prenatal depression, anxiety and cortisol. Early Hum Dev. 2013;89(9):621-4. [PMC free article: PMC3742661] [PubMed: 23727060]
    43. Stice E, Rohde P, Durant S, Shaw H, Wade E. Effectiveness of peer-led dissonance-based eating disorder prevention groups: results from two randomized pilot trials. Behav Res Ther. 2013;51(4-5):197-206. [PMC free article: PMC3917500] [PubMed: 23419888]
    44. Horgan A, McCarthy G, Sweeney J. An Evaluation of an Online Peer Support Forum for University Students With Depressive Symptoms. Arch Psychiatr Nurs. 2013;27(2):84-89. [PubMed: 23540518]
    45. Thompson C, Russell-Mayhew S, Saraceni R. Evaluating the effects of a peer-support model: reducing negative body esteem and disordered eating attitudes and behaviours in grade eight girls. Eat. 2012;20(2):113-26. [PubMed: 22364343]
    46. Lindenberg K, Moessner M, Harney J, McLaughlin O, Bauer S. E-health for individualized prevention of eating disorders. Clinical Practice and Epidemiology in Mental Health. 2011;7():74-83. [PMC free article: PMC3115599] [PubMed: 21687562]
    47. Kumakech E, Cantor-Graae E, Maling S, Bajunirwe F. Peer-group support intervention improves the psychosocial well-being of AIDS orphans: cluster randomized trial. Soc Sci Med. 2009;68(6):1038-43. [PubMed: 19167144]
    48. Houlston C, Smith PK. The impact of a peer counselling scheme to address bullying in an all-girl London secondary school: a short-term longitudinal study. Br J Educ Psychol. 2009;79(Pt 1):69-86. [PubMed: 18435867]
    49. Specht DM. The effect of supportive strategies on computer anxiety and computer self-efficacy in nursing students. . 2008;():173 p-173 p.
    50. Nash KA. Implementation and evaluation of the Empower Youth Program. Journal of Holistic Nursing. 2007;25(1):26-36. [PubMed: 17325311]

    Irrelevant Study Design or Format (n = 60)

    1. Ma Q, Parisi JM, Joo JH, Gallo JJ. Singapore young adults' perception of mental health help-seeking from mental health professionals and peer supporters. Asian J Psychiatr. 2021;61 (no pagination)():. [PubMed: 34004461]
    2. Ojeda VD, Jones N, Munson MR, Berliant E, Gilmer TP. Roles of peer specialists and use of mental health services among youth with serious mental illness. Early Interv Psychiatry. 2021;15(4)():914-921. [PMC free article: PMC9305632] [PubMed: 32888260]
    3. Suresh R, Karkossa Z, Richard J, Karia M. Program evaluation of a student-led peer support service at a Canadian university. Int J Ment Health Syst. 2021;15(1) (no pagination)():. [PMC free article: PMC8165510] [PubMed: 34059083]
    4. Tinago CB, Frongillo EA, Warren AM, et al. Development and assessment of feasibility of a community-based peer support intervention to mitigate social isolation and stigma of adolescent motherhood in Harare, Zimbabwe. Pilot and Feasibility Studies. 2021;7(1) (no pagination)():. [PMC free article: PMC8127315] [PubMed: 34001288]
    5. Arenas DL, Viduani AC, Bassols AMS, Hauck S. Peer support intervention as a tool to address college students' mental health amidst the COVID-19 pandemic. Int J Soc Psychiatry. 2021;67(3)():301-302. [PubMed: 32883124]
    6. Ojeda VD, Munson MR, Jones N, Berliant E, Gilmer TP. The Availability of Peer Support and Disparities in Outpatient Mental Health Service Use Among Minority Youth with Serious Mental Illness. Adm Policy Ment Health. 2021;48(2)():290-298. [PMC free article: PMC7870605] [PubMed: 32728991]
    7. Andalibi N, Flood MK. Considerations in designing digital peer support for mental health: interview study among users of a digital support system (buddy project). JMIR mental health. 2021;8(1) (no pagination)():. [PMC free article: PMC7813628] [PubMed: 33393909]
    8. Ellis AE, Martino S, Simiola V, Mackintosh MA, Bellamy C, Cook JM. Study design and interventions for a peer-delivered motivational interviewing group treatment for sexual and gender minority male sexual trauma survivors. Contemp Clin Trials. 2021;111():106597. [PubMed: 34653650]
    9. Wogrin C, Willis N, Mutsinze A, et al. It helps to talk: A guiding framework (TRUST) for peer support in delivering mental health care for adolescents living with HIV. PLoS ONE [Electronic Resource]. 2021;16(3):e0248018. [PMC free article: PMC7928463] [PubMed: 33657185]
    10. Gillard S, Banach N, Barlow E, et al. Developing and testing a principle-based fidelity index for peer support in mental health services. Soc Psychiatry Psychiatr Epidemiol. 2021;56(10):1903-1911. [PMC free article: PMC8429155] [PubMed: 33606048]
    11. Birrell L, Furneaux-Bate A, Chapman C, Newton NC. A Mobile Peer Intervention for Preventing Mental Health and Substance Use Problems in Adolescents: Protocol for a Randomized Controlled Trial (The Mind Your Mate Study). JMIR Res Protoc. 2021;10(7):e26796. [PMC free article: PMC8367112] [PubMed: 34328426]
    12. Kaess M, Moessner M, Koenig J, et al. Editorial Perspective: A plea for the sustained implementation of digital interventions for young people with mental health problems in the light of the COVID‐19 pandemic. Journal of Child Psychology & Psychiatry. 2021;62(7):916-918. [PMC free article: PMC8359353] [PubMed: 32924134]
    13. Riana Lestari T, Adyas A, Karma A, et al. Model of social support for adolescent mental health with disabilities. Medico-Legal Update. 2020;20(1)():2317-2321.
    14. Guerra C, Aguilera G, Lippians C, et al. Online Sexual Abuse and Symptomatology in Chilean Adolescents: The Role of Peer Support. J Interpers Violence. 2020;():886260520957685. [PubMed: 32907454]
    15. Thomas AL, Brausch AM. Family and peer support moderates the relationship between distress tolerance and suicide risk in black college students. J Am Coll Health. 2020;():1-8. [PubMed: 32669061]
    16. Singla DR, Ratjen C, Krishna RN, Fuhr DC, Patel V. Peer supervision for assuring the quality of non-specialist provider delivered psychological intervention: Lessons from a trial for perinatal depression in Goa, India. Behav Res Ther. 2020;130():103533. [PubMed: 31870496]
    17. Simmons MB, Grace D, Fava NJ, et al. The Experiences of Youth Mental Health Peer Workers over Time: A Qualitative Study with Longitudinal Analysis. Community Ment Health J. 2020;56(5):906-914. [PubMed: 31970578]
    18. Cavazos-Rehg PA, Fitzsimmons-Craft EE, Krauss MJ, et al. Examining the self-reported advantages and disadvantages of socially networking about body image and eating disorders. International Journal of Eating Disorders. 2020;53(6):852-863. [PMC free article: PMC8135099] [PubMed: 32359127]
    19. Kachaturoff M, Caboral-Stevens M, Gee M, Lan VM. Effects of peer-mentoring on stress and anxiety levels of undergraduate nursing students: An integrative review. J Prof Nurs. 2020;36(4):223-228. [PubMed: 32819548]
    20. Bernays S, Tshuma M, Willis N, et al. Scaling up peer-led community-based differentiated support for adolescents living with HIV: keeping the needs of youth peer supporters in mind to sustain success. J Int AIDS Soc. 2020;23 Suppl 5():e25570. [PMC free article: PMC7459167] [PubMed: 32869532]
    21. Rath S, Prost A, Samal S, et al. Community youth teams facilitating participatory adolescent groups, youth leadership activities and livelihood promotion to improve school attendance, dietary diversity and mental health among adolescent girls in rural eastern India: protocol for a cluster-randomised controlled trial. Trials. 2020;21(1):52. [PMC free article: PMC6950906] [PubMed: 31915039]
    22. Bosch A, van de Ven M, van Doesum K. Development and Validation of the Guilt and Shame Questionnaire for Adolescents of Parents with a Mental Illness (GSQ-APMI). J. 2020;29(4):1147-1158.
    23. McMorris CA, Baraskewich J, Ames MA, Shaikh KT, Ncube BL, Bebko JM. Mental health issues in post-secondary students with autism spectrum disorder: Experiences in accessing services. Int J Ment Health Addict. 2019;17(3):585-595.
    24. Anderson D, Choden T, Sandseth T, Teoh T, Essock SM, Harrison ME. NYC start: A new model for securing community services for individuals hospitalized for first-episode psychosis. Psychiatr Serv. 2019;70(8)():644-649. [PubMed: 31084293]
    25. Gulliver A, Banfield M, Morse AR, Reynolds J, Miller S, Galati C. A Peer-Led Electronic Mental Health Recovery App in a Community-Based Public Mental Health Service: Pilot Trial. JMIR Form Res. 2019;3(2):e12550. [PMC free article: PMC6746099] [PubMed: 31165708]
    26. Chyzzy B, Dennis C-L. 16. Mobile Phone-Based Peer Support In The Prevention of Postpartum Depression Among Adolescent Mothers: A Pilot Randomized Controlled Trial...SAHM Annual Meeting, Psychological Well-Being: International Transcultural Perspectives, March 6-9, 2019, Washington, DC, USA. J Adolesc Health. 2019;64():S8-S9.
    27. Farkas M, Boevink W. Peer delivered services in mental health care in 2018: infancy or adolescence?. World Psychiatry. 2018;17(2)():222-224. [PMC free article: PMC5980530] [PubMed: 29856537]
    28. Roach A. Supportive Peer Relationships and Mental Health in Adolescence: An Integrative Review. Issues Ment Health Nurs. 2018;39(9):723-737. [PubMed: 30252560]
    29. Markoulakis R, Turner M, Wicik K, Weingust S, Dobbin K, Levitt A. Exploring Peer Support Needs of Caregivers for Youth with Mental Illness or Addictions Concerns in Family Navigation Services. Community Ment Health J. 2018;54(5):555-561. [PubMed: 29143904]
    30. Logie CH, Lys C, Okumu M, Leone C. Pathways between depression, substance use and multiple sex partners among Northern and Indigenous young women in the Northwest Territories, Canada: results from a cross-sectional survey. Sex Transm Infect. 2018;94(8):604-606. [PMC free article: PMC6288694] [PubMed: 28988191]
    31. Rojas SM, Bilsky SA, Dutton C, Badour CL, Feldner MT, Leen-Feldner EW. Lifetime histories of PTSD, suicidal ideation, and suicide attempts in a nationally representative sample of adolescents: Examining indirect effects via the roles of family and peer social support. J Anxiety Disord. 2017;49():95-103. [PubMed: 28482204]
    32. Yin XQ, Wang LH, Zhang GD, et al. The promotive effects of peer support and active coping on the relationship between bullying victimization and depression among Chinese boarding students. Psychiatry Res. 2017;256():59-65. [PubMed: 28623769]
    33. Cabassa LJ, Camacho D, Velez-Grau CM, Stefancic A. Peer-based health interventions for people with serious mental illness: A systematic literature review. J Psychiatr Res. 2017;84():80-89. [PubMed: 27701013]
    34. Gopalan G, Lee SJ, Harris R, Acri MC, Munson MR. Utilization of peers in services for youth with emotional and behavioral challenges: A scoping review. J Adolesc. 2017;55():88-115. [PubMed: 28068538]
    35. Acri M, Hooley CD, Richardson N, Moaba LB. Peer Models in Mental Health for Caregivers and Families. Community Ment Health J. 2017;53(2):241-249. [PMC free article: PMC5555254] [PubMed: 27344658]
    36. Stubbs B, Williams J, Shannon J, Gaughran F, Craig T. Peer support interventions seeking to improve physical health and lifestyle behaviours among people with serious mental illness: A systematic review. Int J Ment Health Nurs. 2016;25(6):484-495. [PubMed: 27600483]
    37. Calear AL, Brewer JL, Batterham PJ, et al. The Sources of Strength Australia Project: study protocol for a cluster randomised controlled trial. Trials. 2016;17(1):349. [PMC free article: PMC4960686] [PubMed: 27456094]
    38. Cooley JL, Fite PJ, Rubens SL, Tunno AM. Peer Victimization, Depressive Symptoms, and Rule-Breaking Behavior in Adolescence: The Moderating Role of Peer Social Support. J Psychopathol Behav Assess. 2015;37(3)():512-522.
    39. Ali K, Farrer L, Gulliver A, Griffiths KM. Online Peer-to-Peer Support for Young People With Mental Health Problems: A Systematic Review. JMIR mental health. 2015;2(2):e19. [PMC free article: PMC4607385] [PubMed: 26543923]
    40. Lee SH, Choi JA, Park JH. Helping Peers Seek Professional Treatment for Depression Among Young South Koreans: An Application of the Theory of Planned Behavior. J Multicult Couns Devel. 2015;43(2):122-136.
    41. Dennis CL. The process of developing and implementing a telephone-based peer support program for postpartum depression: evidence from two randomized controlled trials. Trials. 2014;15():131. [PMC free article: PMC4018974] [PubMed: 24742217]
    42. Bedard K, Bouffard T, Pansu P. The risks for adolescents of negatively biased self-evaluations of social competence: the mediating role of social support. J Adolesc. 2014;37(6):787-98. [PubMed: 25086456]
    43. Banks DM, Weems CF. Family and peer social support and their links to psychological distress among hurricane-exposed minority youth. Am J Orthopsychiatry. 2014;84(4):341-52. [PubMed: 24999520]
    44. Chinman M, George P, Dougherty RH, et al. Peer support services for individuals with serious mental illnesses: assessing the evidence. Psychiatr Serv. 2014;65(4):429-41. [PubMed: 24549400]
    45. Wade S, Watson H, Caswell J, Purcell J. Peer support for eating disorders: A pilot open trial of peer support for children and adolescents with eating disorders. Journal of Eating Disorders. 2014;2(1).
    46. Thupayagale-Tshweneagae G. Development and implementation of a peer-based mental health support programme for adolescents orphaned by HIV/AIDS in South Africa. J Child Adolesc Ment Health. 2011;23(2)():129-141. [PubMed: 25860087]
    47. Matlin SL, Molock SD, Tebes JK. Suicidality and depression among African American adolescents: The role of family and peer support and community connectedness. Am J Orthopsychiatry. 2011;81(1)():108-117. [PMC free article: PMC3058298] [PubMed: 21219282]
    48. Tajima EA, Herrenkohl TI, Moylan CA, Derr AS. Moderating the Effects of Childhood Exposure to Intimate Partner Violence: The Roles of Parenting Characteristics and Adolescent Peer Support. J Res Adolesc. 2011;21(2):376-394. [PMC free article: PMC3134328] [PubMed: 21765624]
    49. Caramlau I, Barlow J, Sembi S, McKenzie-McHarg K, McCabe C. Mums 4 Mums: structured telephone peer-support for women experiencing postnatal depression. Pilot and exploratory RCT of its clinical and cost effectiveness. Trials. 2011;12():88. [PMC free article: PMC3079657] [PubMed: 21439042]
    50. Papafratzeskakou E, Kim J, Longo GS, Riser DK. Peer Victimization and Depressive Symptoms: Role of Peers and Parent–Child Relationship. J Aggress Maltreat Trauma. 2011;20(7):784-799.
    51. Grey DD, Cook JA, Hamilton MM, Jonikas JA. Randomized controlled trial of a peer-led recovery intervention for mental illness self-management. Journal of mental health policy and economics. 2011;14. PM:CN-01756548 NEW
    52. van Gestel-Timmermans J, Brouwers E, van Nieuwenhuizen C. Recovery is up to you, a peer-run course. Psychiatr Serv. 2010;61(9):944-945. [PubMed: 20810597]
    53. Robinson J, Bruxner A, Harrigan S, et al. Study protocol: The development of a pilot study employing a randomised controlled design to investigate the feasibility and effects of a peer support program following discharge from a specialist first-episode psychosis treatment centre. BMC Psychiatry. 2010;10():37. [PMC free article: PMC2885323] [PubMed: 20500881]
    54. Dennis CL. Postpartum depression peer support: maternal perceptions from a randomized controlled trial. Int J Nurs Stud. 2010;47(5):560-8. [PubMed: 19962699]
    55. Bruxner A. The development of a project designed to test the feasibility and effects of a peer support intervention in young people being discharged from a first episode psychosis treatment centre. Early intervention in psychiatry. 2010;4(56):sychosis-Early. PM:CN-01021443 UPDATE
    56. Galasso LB, Arrell A, Webb P, et al. More than friends: Peer supports for youth and young adults to promote discovery and recovery. Transition of youth and young adults with emotional or behavioral difficulties: An evidence-supported handbook. 2009;():209-232.
    57. Cluver L. Peer group support intervention reduces psychological distress in AIDS orphans. Evidence Based Mental Health. 2009;12(4):120-120. [PubMed: 19854782]
    58. Matthey S. Telephone based peer support can reduce postnatal depression in women at high risk. Evidence Based Mental Health. 2009;12(3):82-82. [PubMed: 19633250]
    59. Menon A, Glazebrook C, Campain N, Ngoma M. Mental health and disclosure of HIV status in Zambian adolescents with HIV infection: implications for peer-support programs. J Acquir Immune Defic Syndr. 2007;46(3):349-54. [PubMed: 17721397]
    60. Kerr DC, Preuss LJ, King CA. Suicidal adolescents' social support from family and peers: gender-specific associations with psychopathology. J Abnorm Child Psychol. 2006;34(1):103-114. [PubMed: 16502141]

Appendix 4. Semi-Structured Consultation Interview Guide

Note that this appendix has not been copy-edited.

Updated Consultation Interview Guide

Introduction: Thank you for your interest and willingness to participate in our stakeholder consultation to help inform our Peer Support for Youth Mental Health project at CADTH. The purpose of this discussion is to help inform the ES component which focused on the program evaluation aspects of peer support program for youth mental health. The objective of the ES is to identify and describe existing and recommended methods for the evaluation of peer support programs for youth mental health including completed evaluation conducted in Canada or internationally and summarize any finding of completed evaluation in Canada. The structure of this consultation will be guided by a series of open-ended questions focused on your role and knowledge of current program evaluation methods specifically for peer support programs for youth mental health. The consultation should last about 60 minutes and will be recorded. You are free to raise concerns or withdraw at any time throughout the consultation process. Do you have any questions or concerns before we begin?

Discussion

  • Can you briefly explain your role(s) within the organization?
  • How does your organization define Peer Support and how does program evaluation for Peer Support Programs fit within your organization?
  • Can you explain the methods that are used when evaluating Peer Support Programs?
    • For example, how you collect your evaluation data; any specific tools used to help collect data; publicly reporting evaluation results; typical sample size of evaluation; frequency and duration of evaluations.
  • Can you identify any guiding resources that are used to inform how program evaluations are done within your organization?
  • What are the outcomes that are evaluated, and how are they measured?
    • Outcomes related to individual level, support providers, program/organizational level, health system level?
  • Who (within the organization) is involved in conducting the evaluation process?
  • Is equity a component of your program evaluations? If so, how do you ensure that equity is incorporated or considered?
  • Are there any barriers to incorporating equity within evaluations of peer support? If so, how are these barriers addressed?
  • Are peer support workers and/or peer support service users involved in the program evaluation? Does your program serve marginalized, racialized, or Indigenous youth, and if so, do you involve them in your program evaluation?
  • Would you be willing to share any examples of completed program evaluations from your peer support program for youth mental health?
  • Is there any other important information that you feel I have left out which you would like to tell me?

Conclusion: Thank you again for you participation in this consultation. If you have any additional questions or would like to discuss anything further, please do not hesitate to reach out. I will follow-up with details about the next steps, which will include an opportunity to provide feedback regarding the relevancy and accuracy of the information obtained today.

Appendix 5. List of Key Informant Organizations and Peer Support Programs

Note that this appendix has not been copy-edited.

Table 34. List of Key Informant Organizations and Peer Support Programs.

Table 34

List of Key Informant Organizations and Peer Support Programs.

Appendix 6. Summary of Included Studies

Table 35. Summary of Included Studies From Literature.

Table 35

Summary of Included Studies From Literature.

Appendix 7. Summary of Program Evaluation Reports From Stakeholders

Table 36. Summary of Program Evaluation Reports From Stakeholders.

Table 36

Summary of Program Evaluation Reports From Stakeholders.

Appendix 8. Summary of Program Evaluation Methods From Stakeholder Consultations

Table 37. Summary of Program Evaluation Methods From Stakeholder Consultations.

Table 37

Summary of Program Evaluation Methods From Stakeholder Consultations.

Disclaimer: The information in this document is intended to help Canadian health care decision-makers, health care professionals, health systems leaders, and policy-makers make well-informed decisions and thereby improve the quality of health care services. While patients and others may access this document, the document is made available for informational purposes only and no representations or warranties are made with respect to its fitness for any particular purpose. The information in this document should not be used as a substitute for professional medical advice or as a substitute for the application of clinical judgment in respect of the care of a particular patient or other professional judgment in any decision-making process. The Canadian Agency for Drugs and Technologies in Health (CADTH) does not endorse any information, drugs, therapies, treatments, products, processes, or services.

While care has been taken to ensure that the information prepared by CADTH in this document is accurate, complete, and up-to-date as at the applicable date the material was first published by CADTH, CADTH does not make any guarantees to that effect. CADTH does not guarantee and is not responsible for the quality, currency, propriety, accuracy, or reasonableness of any statements, information, or conclusions contained in any third-party materials used in preparing this document. The views and opinions of third parties published in this document do not necessarily state or reflect those of CADTH.

CADTH is not responsible for any errors, omissions, injury, loss, or damage arising from or relating to the use (or misuse) of any information, statements, or conclusions contained in or implied by the contents of this document or any of the source materials.

This document may contain links to third-party websites. CADTH does not have control over the content of such sites. Use of third-party sites is governed by the third-party website owners’ own terms and conditions set out for such sites. CADTH does not make any guarantee with respect to any information contained on such third-party sites and CADTH is not responsible for any injury, loss, or damage suffered as a result of using such third-party sites. CADTH has no responsibility for the collection, use, and disclosure of personal information by third-party sites.

Subject to the aforementioned limitations, the views expressed herein are those of CADTH and do not necessarily represent the views of Canada’s federal, provincial, or territorial governments or any third-party supplier of information.

This document is prepared and intended for use in the context of the Canadian health care system. The use of this document outside of Canada is done so at the user’s own risk.

This disclaimer and any questions or matters of any nature arising from or relating to the content or use (or misuse) of this document will be governed by and interpreted in accordance with the laws of the Province of Ontario and the laws of Canada applicable therein, and all proceedings shall be subject to the exclusive jurisdiction of the courts of the Province of Ontario, Canada.

The copyright and other intellectual property rights in this document are owned by CADTH and its licensors. These rights are protected by the Canadian Copyright Act and other national and international laws and agreements. Users are permitted to make copies of this document for non-commercial purposes only, provided it is not modified when reproduced and appropriate credit is given to CADTH and its licensors.

About CADTH: CADTH is an independent, not-for-profit organization responsible for providing Canada’s health care decision-makers with objective evidence to help make informed decisions about the optimal use of drugs, medical devices, diagnostics, and procedures in our health care system.

Funding: CADTH receives funding from Canada’s federal, provincial, and territorial governments, with the exception of Quebec.

Questions or requests for information about this report can be directed to ac.HTDAC@stseuqeR

PROSPERO Registration Number: CRD42022299556

Authors

Peer Support Youth Advisor Engagement

Julie Boucher led the patient engagement activities and wrote the summary of those activities included in this report. She also reviewed the protocol and drafts of the Patients’ Perspectives and Experiences Review and provided final approval of the version of the report submitted for publication.

Systematic Review of Clinical Effectiveness and Safety

Anusree Subramonian led the protocol development for the Clinical Review; screened and selected studies; extracted, tabulated, critically appraised, and interpreted data; wrote the Clinical Review; revised the review based on reviewers’ feedback; and provided final approval of the version of the report submitted for publication.

Shannon Hill supported the lead author of the Clinical Review by screening and selecting studies, double-checking extracted information, critically appraising studies and interpreting data, providing support in writing, reviewing the Clinical Review until completion, and providing final approval of the version of the report submitted for publication.

Michelle Gates contributed to study design during protocol development, provided methodological oversight and support throughout the conduct of the review, provided critical review of the contents of the report, and provided final approval of the version of the report submitted for publication.

Scan of Program Evaluation Methods

Shannon Hill led the protocol development for the Environmental Scan; screened and selected studies relating to program evaluation methods; conducted stakeholder consultations; extracted, tabulated, and narratively summarized information from the literature and consultations; wrote the Environmental Scan; revised the review based on reviewers’ feedback, and provided final approval of the version of the report submitted for publication.

Francesca Brundisini contributed to the Environmental Scan design during protocol development, provided methodological oversight and support throughout the conduct of the review, provided critical reviews of the contents of the report, and provided final approval of the version of the report submitted for publication.

Research Information Services

Melissa Severn designed the database search strategies for all sections of the report, executed the search strategies, completed grey literature searches, maintained search alerts, prepared the search methods and search appendix, assisted with report referencing, and provided final approval of the version of the report submitted for publication.

David Kaunelis peer-reviewed the search strategies and approved the final version of the report submitted for publication.

Program Development

Andrea Smith developed the project plan; contributed to the coordination of the review; authored the introduction; and contributed to the writing of the Discussion, Conclusions, and Implications for Policy-Making sections. She approved the final version of the report submitted for publication.

Knowledge Mobilization

Eftyhia Helis collaborated with project team members to formulate the key messages, reviewed and contributed to the drafting of the protocol and report, and provided final approval of the version of the report submitted for publication.

Contributors

The authors would like to thank Hajar Seiyad, Sydney Patterson, Mikaela Basile, and Mardi Daley who shared their lived experiences with and knowledge of peer support with the project team and provided feedback on the review protocol and the preliminary findings. Their perspectives and feedback were carefully considered by CADTH in developing this report. The contributors listed here have consented to having their names published.

The authors would like to acknowledge:

Allison Dunning for reviewing drafts of the protocol and final report of the HTA and for assisting with interpretation of the findings.

Pierre Martinelli for providing project management support.

Sarah Jones who identified the topic and guided scoping and prioritization.

External Reviewers

These individuals kindly provided comments on a draft version of this report.

Tanya Halsall, PhD

Postdoctoral Fellow, University of Ottawa Institute of Mental Health Research at the Royal

Adjunct Research Professor, Carleton University

Ottawa, ON

Mrs. Al Raimundo, BA

Peer support subject matter expert

Vancouver, BC

Definitions

CADTH has adopted the following definitions in this Health Technology Assessment:

Formal peer support programs are programs delivered by formal or structured community- or health clinic–based organizations that offer peer support to youth peer service users by trained peer support workers who share lived experience related to mental health. Peer service users are youth (aged 12 to 25 years) seeking support for a primary concern related to their mental health. Peer support can be offered on a one-to-one or group basis, and may be delivered virtually (e.g., video conferencing, mobile applications, web platforms, online chat, or phone) or in person. We have emphasized formal programs with training and supports for peer support workers because training is an important mechanism to ensure the safety of peer support workers and users, provides a degree of standardization in the peer support offered, and addresses considerations of equity by ensuring staff receive training about how to appropriately draw on their lived experience.

Programs out of scope for this project include those with a primary focus on supporting youth around a primary concern of substance use or addictions or those that aim to provide primary prevention to youth to prevent mental health conditions or issues. There are many peer-led and mutual support programs that support recovery from substances through harm reduction or abstinence; these may use different mechanisms and approaches with their own evidence base and are also outside the scope of this review.1

Youth are defined as individuals between ages 12 and 25 years. This age range is consistent with the typical age ranges of the youth served by youth mental health and wellness hubs that are established across Canadian jurisdictions. Importantly, it covers the period when many mental health issues first appear and the transition out of adolescence into young adulthood.2

Mental health challenge is any mental health condition or issue either self-identified or formally diagnosed, which includes, but is not limited to, anxiety, depressive symptoms, and eating disorders, but excludes a primary presentation of substance use and addictions.

Copyright © 2022 Canadian Agency for Drugs and Technologies in Health.

Except where otherwise noted, this work is distributed under the terms of a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International licence (CC BY-NC-ND), a copy of which is available at http://creativecommons.org/licenses/by-nc-nd/4.0/

Bookshelf ID: NBK602668PMID: 38620379