Appendix GDocumentation of Trials Rated High Risk of Bias

Publication Details

Overview of This Appendix

As explained in the Methods and Results chapters of the main report on posttraumatic stress disorder (PTSD), we did not include in our main analyses any trials that originally met our eligibility criteria but were rated high risk of bias. Our focus was solely on trials of either low or medium risk of bias. In some cases, however, these high risk-of- bias trials offered some additional information about our conclusions for efficacy or comparative effectiveness.

Reasons for rating trials as high risk of bias included problems that could relate to randomization and allocation concealment, similarity of compared groups at baseline, masking of patients and study personnel, use of intent-to-treat analysis, or overall and differential loss to followup. In general terms, these trials had flaws or were underpowered to show statistically significant differences. In some cases, significant (or nonsignificant) differences had very small effect sizes. Appendix E provides additional information and rationale for our risk-of-bias assessments. We had no trials rated high risk of bias for adverse events or harms.

Psychotherapy Trials

This appendix provides information on trial findings about psychotherapies (Key Question [KQ] 1) in the same basic order as the psychological interventions covered in the Results chapter – namely, cognitive behavioral interventions of all types, eye movement desensitization and reprocessing (EMDR), and other psychotherapies. Several of these various trials did have findings consistent with those reported in the main systematic review.

Tables in this appendix describe the trials. Entries are in alphabetical order by last name of the first author of the article(s) in question. For duration of treatment (or trial), in some cases the investigators reported only the number of sessions, rather than the length of the treatment or the trial (in, e.g., weeks or months). Some trials measured certain outcomes at some point, such as 3 months, after treatment ended (usually referred to as posttreatment). Disease severity was measured frequently by the Clinician-Administered PTSD Scale (CAPS); these are the data reported in the tables unless another instrument, such as the Davidson Trauma Scale or the PTSD Checklist, is specified. Severity measures can be reported as mean scores or a range of mean scores across groups for the CAPS or another PTSD measure listed. As in the main report, inactive arms for these trials included waitlist or usual care (which included treatment as usual as well).

Pharmacologic Trials

We also present information on the high risk-of-bias trials of pharmacological interventions (KQ 2). These include a wide array of antidepressants, anticonvulsants (or mood stabilizers), and antipsychotics, among other pharmacologic agents. As with psychological interventions, we report on both efficacy trials (placebo controls) and on comparative effectiveness (from head-to-head trials – i.e., active comparators). Several of these various trials did have findings consistent with those reported in the main systematic review.

Tables in this appendix describe the trials using the organization previously described.

Efficacy or Comparative Effectiveness of Psychological Interventions (Key Question 1)

Cognitive Behavioral Therapy

Several trials addressed a wide array of cognitive behavioral therapies (CBT). These included cognitive interventions, coping skills interventions, exposure treatments of various types, and interventions with “mixed” CBT components, including various combinations of psychoeducation, self-monitoring, stress management, relaxation training, skills training, exposure (imaginal, or in vivo, or both), cognitive restructuring, guided imagery, mindfulness training, breathing retraining, crisis/safety planning, and relapse prevention.

Three separate trials tested three cognitive interventions: two tested cognitive processing therapy (CPT) and one tested web-based cognitive therapy (CT) (see Table G-1). For the CPT trial with person-centered therapy (PCT) as the comparator, we considered PCT to be an active comparator but not one for which we were interested in examining the comparative effectiveness with interventions of interest. For the other CPT trail and the CT trial, both provided findings consistent with those from the trials described in the main report on all outcomes.

Table G-1. Characteristics of cognitive intervention trials omitted from main analyses because of high risk of bias.

Table G-1

Characteristics of cognitive intervention trials omitted from main analyses because of high risk of bias.

We rated three trials of CBT- coping skills as high risk of bias (Table G-2). One trial compared stress inoculation training (SIT) with narrative exposure therapy (NET); another compared SIT with a waitlist group. The third trial tested an affect management intervention versus waitlist. Treatment-related improvements in reducing PTSD symptoms at posttreatment were reported for SIT versus waitlist only. These findings are consistent with the single trials of these interventions included in our qualitative synthesis.

Table G-2. Characteristics of coping skills trials omitted from main analyses because of high risk of bias.

Table G-2

Characteristics of coping skills trials omitted from main analyses because of high risk of bias.

We rated 17 trials of CBT - exposure interventions (see Table G-3). The types of “exposure” therapies differed appreciably across these trials. Like the included studies, a majority of the high risk-of-bias trials of exposure found that the CBT-exposure group did significantly better than the inactive comparator group, especially with respect to reducing PTSD symptoms (using any of the available symptom measures), achieving remission, and losing the PTSD diagnosis. Persons in the exposure interventions also tended to do better as well in reducing depression symptoms. Although these findings were similar to those from the low or medium risk-of-bias trials, precision was lower, with wider confidence intervals. Similar to the set of included trials, few high risk-of-bias trials examined anxiety symptoms, functional status, quality of life, and functional impairment outcomes; when they did, however, findings were similar to those of included studies.

Table G-3. Characteristics of exposure trials omitted from main analyses because of high risk of bias.

Table G-3

Characteristics of exposure trials omitted from main analyses because of high risk of bias.

Fifteen trials tested a considerable array of “mixed” CBT interventions (Table G-4). Generally, their findings were consistent with those from low or medium risk-of-bias trials on all the outcomes examined. Specifically, a majority of the high risk-of-bias studies found that the CBT- mixed group had significantly better results than did those in the various comparison groups; these included reducing PTSD symptoms, achieving remission, and losing the PTSD diagnosis, as well as reducing depression symptoms. Similar to the set of included study evidence, few of these omitted trials examined anxiety symptoms, substance use, functional status, quality of life or functional impairment outcomes; when they reported such findings, however, they were similar to those from included studies.

Table G-4. Characteristics of mixed intervention trials omitted from main analyses because of high risk of bias.

Table G-4

Characteristics of mixed intervention trials omitted from main analyses because of high risk of bias.

Eye Movement Desensitization and Reprocessing

Seven trials of eye movement desensitization and reprocessing (EMDR) were rated high risk of bias (see Table G-5). These seven trials had findings consistent with those from included trials on various outcomes. Like the trials rated either low or medium risk of bias, a majority of the high risk-of-bias studies found that the EMDR group had significantly better outcomes than patients in an inactive comparator group in terms of reducing PTSD symptoms, losing the PTSD diagnosis, and reducing depression. Few of these seven trials examined any other coexisting condition, functional status, quality of life, or disability or functional impairments.

Table G-5. Characteristics of studies of eye movement desensitization and reprocessing omitted from main analyses because of high risk of bias.

Table G-5

Characteristics of studies of eye movement desensitization and reprocessing omitted from main analyses because of high risk of bias.

Analyses of Other Psychological Interventions

Ten trials that we rated high risk of bias dealt with a variety of other psychological interventions (Table G-6). Three of these assessed narrative exposure therapy (NET); of these three, the one comparing NET with usual care found results consistent with those from medium risk-of-bias trials. The other two NET trials had active comparators -- stress inoculation therapy and psychoeducation. Whereas the IPT study rated high risk of bias tested the efficacy of IPT versus treatment as usual, the IPT study included in the main study findings compared the effectiveness of IPT versus two other treatments, precluding comparisons of the findings. Other studies rated high risk of bias assessed interventions (or comparators) not included for the main analyses, namely slow breathing (SB) feedback, and trauma-focused CBT (TF-CBT) plus breathing biofeedback; thus, we could not assess, for example, the consistency of the results.

Table G-6. Characteristics of other psychological intervention trials omitted from main analyses because of high risk of bias.

Table G-6

Characteristics of other psychological intervention trials omitted from main analyses because of high risk of bias.

Analyses of Efficacy or Comparative Effectiveness of Psychological Interventions by Patient Characteristics or Type of Trauma (Key Question 1a)

Two trials that we rated high risk of bias reported on the efficacy or comparative effectiveness of psychological interventions for individuals with versus those without certain patient characteristics (see Table G-7). These trials examined data for subgroup characteristics (age, high dissociation and PTSD symptom severity) different from the trials we had rated medium risk of bias; this difference precluded assessment of the consistency of the results.

Table G-7. Characteristics of studies that evaluated efficacy or comparative effectiveness of interventions by patient characteristics or type of trauma omitted from main analyses because of high risk of bias.

Table G-7

Characteristics of studies that evaluated efficacy or comparative effectiveness of interventions by patient characteristics or type of trauma omitted from main analyses because of high risk of bias.

Efficacy or Comparative Effectiveness of Pharmacologic Interventions (Key Question 2)

We present descriptions of a considerable number of trials of various classes or individual drugs that we had rated high risk of bias even though they otherwise met eligibility criteria for the pharmacologic interventions (KQ 2). Tables G-8 through G-13 and G-15 are placebo-controlled trials; Table G-14 is a trial testing a head-to-head comparison of different pharmacologic agents. The specific categories of medications with high risk of bias include alpha blockers, anticonvulsants, atypical antipsychotics, benzodiazepines, SSRIs, other second generation antipsychotics, and tricyclic antidepressants (no SNRI trial was rated as high risk of bias).

Generally, the tables for these KQ 2 trials follow the formats for those above describing the psychological interventions. Data reported about PTSD severity are mean CAPS scores or a range of mean CAPS scores for the intervention and control groups unless a different source of these data is specified.

Briefly, these trials mainly had analyzed only subjects who completed treatment (i.e., the investigators did not use an intention-to-treat analysis) or had very high attrition or differential attrition rates. The trials also tended to have small sample sizes Appendix provides additional rationale for risk of bias assessments.

We comment insofar as possible on the consistency of these data with the main study findings.

Alpha Blockers

We rated two trials as high risk of bias (Table G-8). Both compared prazosin with placebo.

Table G-8. Characteristics of placebo-controlled trials of alpha blockers omitted from main analyses because of high risk of bias.

Table G-8

Characteristics of placebo-controlled trials of alpha blockers omitted from main analyses because of high risk of bias.

Anticonvulsants

We rated three placebo-controlled trials as high risk of bias (Table G-9). the interventions included one trial each of divalproex, lamotrigine, and topiramate.

Table G-9. Characteristics of placebo-controlled trials of anticonvulsants omitted from main analyses because of high risk of bias.

Table G-9

Characteristics of placebo-controlled trials of anticonvulsants omitted from main analyses because of high risk of bias.

Atypical Antipsychotics

We found no trials of atypical antipsychotics versus placebo that met our eligibility criteria but could be rated as either low or medium risk of bias. Four trials, however, were eligible but rated high risk of bias (Table G-10). Two trials tested risperidone, and one each tested aripiprazole or quetiapine,

Table G-10. Characteristics of placebo-controlled trials of atypical antipsychotics omitted from main analyses because of high risk of bias.

Table G-10

Characteristics of placebo-controlled trials of atypical antipsychotics omitted from main analyses because of high risk of bias.

Benzodiazepines

A single trial in this drug class tested alprazolam against placebo (Table G-11). As noted in the main report, no benzodiazepine trial was rated as either low or medium risk of bias. Evidence is insufficient to determine the efficacy of benzodiazepines for improving outcomes for adults with PTSD.

Table G-11. Characteristics of placebo-controlled trials of benzodiazepines omitted from main analyses because of high risk of bias.

Table G-11

Characteristics of placebo-controlled trials of benzodiazepines omitted from main analyses because of high risk of bias.

Selective Serotonin Reuptake Inhibitors

Among the trials for SSRIs, one studied fluoxetine and one examined paroxetine (both against placebo) (Table G-12). A third was more complicated: sertraline combined with mirtazapine (a newer type of antidepressant in the class known as tetracyclic piperazinoazepine) against sertraline combined with placebo. Findings reported for these trials were generally consistent with what investigators found in low or medium risk-of bias trials.

Table G-12. Characteristics of placebo-controlled trials of selective serotonin reuptake inhibitors omitted from main analyses because of high risk of bias.

Table G-12

Characteristics of placebo-controlled trials of selective serotonin reuptake inhibitors omitted from main analyses because of high risk of bias.

Other Second-Generation Antidepressants

We rated one trial comparing nefazodone (a phenylpiperazine antidepressant) with placebo as high risk of bias (Table G-13).

Table G-13. Characteristics of placebo-controlled trials of other second-generation antidepressants omitted from main analyses because of high risk of bias.

Table G-13

Characteristics of placebo-controlled trials of other second-generation antidepressants omitted from main analyses because of high risk of bias.

One trial of nefazodone and an active comparator – sertraline (an SSRI) – was rated high risk of bias (Table G-14).

Table G-14. Characteristics of one head-to-head pharmacotherapy trial omitted from main analyses because of high risk of bias.

Table G-14

Characteristics of one head-to-head pharmacotherapy trial omitted from main analyses because of high risk of bias.

Tricyclic Antidepressants

We rated three trials of otherwise meeting criteria for this section as high risk of bias (Table G-15). All were placebo-controlled trials conducted more than 20 years ago: one of amitriptyline, one of imipramine, and one of desipramine.

Table G-15. Characteristics of placebo-controlled trials of tricyclic antidepressants omitted from main analyses because of high risk of bias.

Table G-15

Characteristics of placebo-controlled trials of tricyclic antidepressants omitted from main analyses because of high risk of bias.

Psychotherapy Versus Pharmacotherapy for Adults With Posttraumatic Stress Disorder (Key Question 3)

Of the two trials bias that attempted to address KQ 3 and that we rated as high risk of bias (Table G-16) one trial compared paroxetine with CBT and the other trial compared paroxetine with PE therapy. As with the information for KQ 1 and KQ 2, disease severity is measured by CAPS unless another source is specified. Prolonged exposure plus paroxetine was not a combined intervention of interest for KQ 3 because it tested a combined psychotherapy and pharmacology intervention.

Table G-16. Characteristics of studies directly comparing pharmacotherapies and psychotherapies omitted from main analyses because of high risk of bias.

Table G-16

Characteristics of studies directly comparing pharmacotherapies and psychotherapies omitted from main analyses because of high risk of bias.

Both trials found that participants in the psychological intervention groups (CBT and PE) experienced greater reductions in PTSD symptoms than those in the paroxetine groups. These findings are consistent with those from a medium risk-of-bias trial in our analyses, which compared EMDR with fluoxetine.