NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

Chou R, Deyo R, Friedly J, et al. Noninvasive Treatments for Low Back Pain [Internet]. Rockville (MD): Agency for Healthcare Research and Quality (US); 2016 Feb. (Comparative Effectiveness Reviews, No. 169.)

Appendix FQuality Assessment

Table F1Quality assessment of systematic reviews of acetaminophen

Study, Year(1) ‘A priori’ design provided?(2) Duplicate study selection and data extraction?
  1. Study selection
  2. Data extraction
(3) Comprehensive literature search performed?(4) Status of publication used as an inclusion criteria?(5) List of studies (included and excluded) provided?(6) Characteristics of the included studies provided?(7) Scientific quality of included studies assessed and documented?(8) Scientific quality of the included studies used appropriately in formulating conclusions?(9) Methods used to synthesize the findings of studies appropriate?(10) Likelihood of publication bias assessed?(11) Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Quality Rating
Roelofs, 2008Yes
  1. Yes
  2. Yes
YesUnclearYesYesYesYesYesYes
  1. Yes
  2. No
Good

Please see Appendix C. Included Studies for full study references.

Table F2Quality assessment of randomized controlled trials of acetaminophen

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Williams, 2014YesYesYesYesYesYesYesYesYesYesYesYesYesYesGood

Please see Appendix C. Included Studies for full study references.

Table F3Quality assessment of systematic reviews of NSAIDs

Study, Year(1) ‘A priori’ design provided?(2) Duplicate study selection and data extraction?
  1. Study selection
  2. Data extraction
(3) Comprehensive literature search performed?(4) Status of publication used as an inclusion criteria?(5) List of studies (included and excluded) provided?(6) Characteristics of the included studies provided?(7) Scientific quality of included studies assessed and documented?(8) Scientific quality of the included studies used appropriately in formulating conclusions?(9) Methods used to synthesize the findings of studies appropriate?(10) Likelihood of publication bias assessed?(11) Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Quality Rating
Roelofs, 2008Yes
  1. Yes
  2. Yes
YesUnclearYesYesYesYesYesYes
  1. Yes
  2. No
Good

Please see Appendix C. Included Studies for full study references.

Table F4Quality assessment of randomized controlled trials of NSAIDs

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Herrmann, 2009YesYesYesYesYesUnclearYesYesYesYesYesYesNoYesFair
Majchrzycki, 2014YesNoYesNoNoUnclearUnclearYesYesYesYesYesNoYesFair
Shirado, 2010YesNoYesNoNoYesYesYesYesYesYesYesNoYesGood

Please see Appendix C. Included Studies for full study references.

Table F5Quality assessment of systematic reviews of opioids

Author, Year“A priori” design provided?Duplicate study selection and data abstraction?
  1. Study selection
  2. Data abstraction
Comprehensive literature search performed?Non-English language studies considered for inclusion?Conducted searches for unpublished (gray) literature?List of included studies provided?List of excluded studies provided with reasons?Characteristics of the included studies provided?Scientific quality of included studies:
  1. Assessed?
  2. Documented?
Sensitivity analyses or stratified analyses conducted according to study quality?Study conclusions supported by the evidence? (Was study quality considered in the synthesis?)Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Multidisciplinary systematic review team?Quality Rating
Carson, 2011Yes
  1. Unclear
  2. Yes
YesNoNoYesNo- only 4 of 38 excluded full text articles were listed in Appendix DYes
  1. Yes
Qualitatively, yesYes
  1. Systematic review: Yes
UnclearGood
Chaparro, 2013YesYes to bothYesYesNoYesYes- but only for 36 of 76 excluded articlesYesYes to bothNo, except for analysis 4.1, examining results of studies with “enhanced enrollment”, meaning patients were enrolled only if they benefitted from opioids and tolerated side effects, then were randomized to opioid withdrawal.Yes
  1. Systematic review: Yes
  2. Individual studies: only for strong opioids
YesGood

Please see Appendix C. Included Studies for full study references.

Table F6Quality assessment of randomized controlled trials of opioids

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in all GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in All Groups SimilarIntention-to-Treat AnalysisIs There A Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Cloutier, 2013YesYesYesYesYesYesUnclearUnclearYesNo; <20%YesYesUnclearUnclearGood
Hyup Lee, 2013YesYesYesYesYesUnclearYesYesYesNo; 21%YesYesYesYesGood
Rauck, 2014UnclearUnclearNo; not sexYesYesUnclearYesYesYesNo; 39%YesYesNoYesPoor
Schiphorst Preuper, 2014UnclearYesYesYesYesYesUnclearYesYesYesYesYesYesYesFair

Please see Appendix C. Included Studies for full study references.

Table F7Quality assessment of randomized controlled trials of SMRs

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in all GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment In All Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Pareek, 2009UnclearUnclearYesYesUnclearYesUnclearYesYesYesYesYesUnclearUnclearFair
Ralph, 2008UnclearUnclearYesYesUnclearYesYesYesYesYesYesYesUnclearUnclearFair

Please see Appendix C. Included Studies for full study references.

Table F8Quality assessment of randomized controlled trials of benzodiazepines

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Brotz, 2010YesYesYesYesYesYesYesYesYesYesYesYesYesYesGood

Please see Appendix C. Included Studies for full study references.

Table F9Quality assessment of systematic reviews of antidepressants

Study, Year(1) ‘A priori’ design provided?(2) Duplicate study selection and data extraction?
  1. Study selection
  2. Data extraction
(3) Comprehensive literature search performed?(4) Status of publication used as an inclusion criteria?(5) List of studies (included and excluded) provided?(6) Characteristics of the included studies provided?(7) Scientific quality of included studies assessed and documented?(8) Scientific quality of the included studies used appropriately in formulating conclusions?(9) Methods used to synthesize the findings of studies appropriate?(10) Likelihood of publication bias assessed?(11) Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Quality Rating
Urquhart, 2010Yes
  1. Yes
  2. No
YesUnclearYesYesYesYesYesYes
  1. Yes
  2. No
Good

Please see Appendix C. Included Studies for full study references.

Table F10Quality assessment of randomized controlled trials of antidepressants

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Farajirad, 2013UnclearUnclearYesUnclearNoNoUnclearUnclearNoUnclearUnclearUnclearUnclearUnclearPoor
Mazza, 2010UnclearUnclearYesUnclearUnclearUnclearYesUnclearYesYesYesYesUnclearUnclearFair
Skljarevski, 2009YesYesYesYesYesYesYesYesYesYesYesNoUnclearUnclearGood
Skljarevski, 2010
(Journal of Pain)
UnclearUnclearUnclearYesUnclearYesYesYesYesYesYesNoUnclearUnclearFair
Skljarevski, 2010
(Spine)
UnclearUnclearUnclearYesUnclearYesYesYesYesYesYesNoUnclearUnclearFair

Please see Appendix C. Included Studies for full study references.

Table F11Quality assessment of randomized controlled trials of antiseizure medications

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Baron, 2010YesYesYesYesYesYesYesYesYesYesYesYesUnclearYesFair
Baron, 2014UnclearUnclearYesYesYesUnclearYesYesYesYesYesYesUnclearYesFair
Kalita, 2014YesUnclearYesNoNoNoYesUnclearYesNoYesYesYesYesPoor
Markman, 2014YesYesYesYesYesYesUnclearYesYesYesYesYesYesYesFair
Pota, 2012UnclearNoYesYesUnclearUnclearUnclearUnclearYesYesYesYesNoYesFair
Romano, 2009UnclearUnclearUnclearYesYesUnclearYesUnclearYesYesYesNoUnclearYesFair
Yaksi, 2007UnclearUnclearYesUnclearUnclearUnclearYesUnclearNoUnclearYesUnclearUnclearYesPoor

Please see Appendix C. Included Studies for full study references.

Table F12Quality assessment of randomized controlled trials of corticosteroids

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Eskin, 2014YesUnclearYesYesYesYesYesYesYesYesYesNoUnclearYesFair
Friedman, 2008YesYesYesYesYesYesYesYesYesYesYesYesUnclearYesGood
Hedeboe, 1982UnclearUnclearUnclearYesYesUnclearYesUnclearNoUnclearYesYesUnclearUnclearFair
Holve, 2008No (sequential allocation)NoUnclearYesYesYesYesUnclearYesYesYesYesUnclearYesPoor
Rodrigues, 2014YesYesYesYesUnclearYesYesUnclearYesYesYesYesUnclearYesFair

Please see Appendix C. Included Studies for full study references.

Table F13Quality assessment of systematic reviews of exercise

Author, Year“A priori” design provided?Duplicate study selection and data abstraction?
  1. Study selection
  2. Data abstraction
Comprehensive literature search performed?Non-English language studies considered for inclusion?Conducted searches for unpublished (gray) literature?List of included studies provided?List of excluded studies provided with reasons?Characteristics of the included studies provided?Scientific quality of included studies:
  1. Assessed?
  2. Documented?
Sensitivity analyses or stratified analyses conducted according to study quality?Study conclusions supported by the evidence? (Was study quality considered in the synthesis?)Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Multidisciplinary systematic review team?Quality Rating
Bystrom, 2013Yesa. Yes; b. no>2 databases through October 2011; no mention of “plus” sourcesNoNot statedYesNoYes
  1. 10-point PEDro scale
  2. marginally - score out of 10 provided; areas of methodological concern for studies not described
No; no information on heterogeneity providedYes
  1. Systematic review: Yes, however 1 author is also author of one of the included trials
  2. Individual studies: No
UnclearFair
Oesch, 2010Yesa. Yes; b. NoYes, >2 databases through Aug 2008; checked refsNoNot statedYesNoYes
  1. According to Juni
  2. Not by study
Metaregresion-NS Effect of specific exercise characteristics; sensitivity by study quality; funnel plotYes
  1. Funding source stated
  2. No
YesFair
van Middelkoop, 2010Yesa. Yes; b. YesData bases through 2008 for CLBP only; unclear if additional sourcesCite Cochrane Back group strategy used - assume no restriction?Cite Cochrane Back group strategy used - assume so?Not explicitly; references providedNoNo
  1. Yes
  2. Yes
NoYes
  1. No
  2. No
UnclearFair

Please see Appendix C. Included Studies for full study references.

Table F14Quality assessment of randomized controlled trials of exercise

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in All Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Albaladejo, 2010YesYesYesNoNoYesUnclearUnclearYesYesYesYesYesYesFair (but results reporting poor)
Albert, 2012YesNoYesNoNoYesUnclearUnclearYesYesYesYesYesUnclearFair
Bronfort, 2011YesYesYesNoNoYesUnclearYesYesYesYesYesYesYesGood
Garcia, 2013YesYesYesNoNoYesUnclearUnclearYesYesYesYesYesYesGood
George, 2008YesNoNoNoNoYesUnclearUnclearYesNoYesYesYesUnclearPoor
Hagen, 2010YesNoYesNoNoYesUnclearUnclearYesYesYesYesNoUnclearFair
Hartvigsen, 2010UnclearYesYesNoNoUnclearUnclearUnclearYesYesYesYesYesYesFair
Helmhout, 2008YesUnclearNoNoNoUnclearUnclearUnclearYesYesYesYesYesUnclearPoor
Henchoz, 2010UnclearUnclearYesNoNoNoUnclearNoYesYesYesYesNoYesPoor
Hofstee, 2002YesNoNoNoNoNoNoUnclearYesYesYesYesNoUnclearPoor
Hurley, 2015YesYesYesNoNoYesUnclearNoYesNoYesYesYesYesFair
Jensen, 2012YesYesYesNoNoYesUnclearYesYesYesYesYesYesYesGood
Kell, 2011UnclearUnclearYesNoNoUnclearUnclearUnclearNoUnclearYesUnclearNoYesPoor
Little, 2008YesYesYesNoNoYesUnclearYesYesYesYesUnclearYesYesGood
Macedo, 2012YesYesYesNoNoYesUnclearUnclearYesYesYesYesYesUnclearUnclear/fair
Machado, 2010YesYesYesNoNoYesUnclearYesYesYesYesYesYesUnclearFair
Pengel, 2007YesYesYesUnclear/ shamNoYesNoUnclearYesYesYesYesYesUnclearFair

Please see Appendix C. Included Studies for full study references.

Table F15Quality assessment of systematic reviews of Pilates

Author, Year“A priori” design provided?Duplicate study selection and data abstraction?
  1. Study selection
  2. Data abstraction
Comprehensive literature search performed?Non-English language studies considered for inclusion?Conducted searches for unpublished (gray) literature?List of included studies provided?List of excluded studies provided with reasons?Characteristics of the included studies provided?Scientific quality of included studies:
  1. Assessed?
  2. Documented?
Sensitivity analyses or stratified analyses conducted according to study quality?Study conclusions supported by the evidence? (Was study quality considered in the synthesis?)Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Multidisciplinary systematic review team?Quality Rating
Wells, 2014Yesa. Yes; b. NoYes, >2 databases including CINAHL, Cochrane Library, ScopusNoYes (Proquest - dissertations and theses; Nursing and Allied Health Source; hand search of bibliographiesYesNoYesYes: Modified Guidelines for use of the McMasters Critical Appraisal Form for Quantitative StudiesNo; no metaanalysis done; quality ratingNo ; Study quality (high vs. low quality) described w/results; conclusions regarding pain short term - may be over stated;
  1. Yes
  2. No
UnclearFair

Please see Appendix C. Included Studies for full study references.

Table F16Quality assessment of randomized controlled trials of tai chi

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in All Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Hall, 2011YesYesYesNoNoNoUnclearYesYesYesYesYesNoYesFair
Weifen, 2013UnclearUnclearYesNoNoYesUnclearYesNoUnclearYesUnclearNoYesFair

Please see Appendix C. Included Studies for full study references.

Table F17Quality assessment of systematic reviews of yoga

Author, Year“A priori” design provided?Duplicate study selection and data abstraction?
  1. Study selection
  2. Data abstraction
Comprehensive literature search performed?Non-English language studies considered for inclusion?Conducted searches for unpublished (gray) literature?List of included studies provided?List of excluded studies provided with reasons?Characteristics of the included studies provided?Scientific quality of included studies:
  1. Assessed?
  2. Documented?
Sensitivity analyses or stratified analyses conducted according to study quality?Study conclusions supported by the evidence? (Was study quality considered in the synthesis?)Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Multidisciplinary systematic review team?Quality Rating
Cramer, 2013Yes
  1. Not stated explicitly; Stated used PRISMA and Cochrane methods
  2. Yes
January 2012: Medline, EMBASE, the Cochrane Library, PsycINFO, and CAMBASEYesNoYesYes - full text; reason with citationYes
  1. 2009 Updated Method Guidelines for Systematic Reviews in the Cochrane Back Review Group
  2. Yes
Yes; high vs. low ROB; if heterogeneityStudy quality considered; Conclusions regarding pain, disability are supported; HRQOL conclusions - seem to be downgraded more (short term) than rating scheme might suggest? Limited info on adverse events available, but conclude that Yoga not associated with serious adverse events
  1. Systematic review: Yes
  2. Individual studies: No
UnclearGood

Please see Appendix C. Included Studies for full study references.

Table F18Quality assessment of randomized controlled trials of yoga

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in All Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Nambi, 2014YesUnclearYesNoUnclearUnclearUnclearUnclearYesYesYesYesNounclearPoor
Saper, 2013YesUnclearNo (But adjusted estimates for baseline differences were essentially the same as crude estimates)NoUnclearYesYes use of other treatments overall: 53% (26/47) vs.. 61% (28/44); similar % for massage, PH, acupuncture, chiropractic, epidural injectionsNo; attendance: 65% for once weekly class, 44% for twice weekly classesYesYesYesYesYesYesFair

Please see Appendix C. Included Studies for full study references.

Table F19Quality assessment of systematic reviews of psychological therapies

Author, Year“A priori” design provided?Duplicate study selection and data abstraction?
  1. Study selection
  2. Data abstraction
Comprehensive literature search performed?Non-English language studies considered for inclusion?Conducted searches for unpublished (gray) literature?List of included studies provided?List of excluded studies provided with reasons?Characteristics of the included studies provided?Scientific quality of included studies:
  1. Assessed?
  2. Documented?
Sensitivity analyses or stratified analyses conducted according to study quality?Study conclusions supported by the evidence? (Was study quality considered in the synthesis?)Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Multidisciplinary systematic review team?Quality Rating
Henschke, 2010Yes
  1. Yes
  2. Yes
YesYesUnclearYesYesYes
  1. Yes
  2. Yes
NoYes (yes)
  1. Yes
  2. No
YesGood

Please see Appendix C. Included Studies for full study references.

Table F20Quality assessment of randomized controlled trials of psychological therapy

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in All Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Kahn, 2014YesUnclearUnclear (age, sex, duration of pain NR, slight differences in pain and function at baseline)Yes (statement that patients were blind to the study)No (but blinding not possible for these interventions)Yes (outcomes patient reported)UnclearUnclearYesYes (100%)YesUnclearNoYesFair
Lamb 2010/2012YesYesYesNoNo (but blinding not possible for these interventions)YesNo (control group free to seek any additional care on their own; additional treatments received not reported)No
Intervention group: 63% (294/468)
Control group: 100% (233/233)
YesYes (85% in both groups)YesNoYesYesFair
Siemonsma, 2013YesYesYesNoNo (but blinding not possible for these interventions)YesYesNo
Intervention group: 81.7%
Control group (waiting list, no interventions permitted): Unclear
YesYes (89% was lowest f/u reported (for activity-specific pain, 139/156)YesNo
(Their fig 1 makes it look like all pts randomized were included in the primary analysis but the paragraph under “Primary Outcome” contradicts this.)
YesYesFair
Vong, 2011YesUnclearYesYes (patients told they would receive one of two types of conventional patient treatment but did not know anything about motivational enhancement therapy)No (but blinding not possible for these interventions)Yes (outcomes patient reported)YesNo
Intervention group: 62%
Control group: 63% (% of patients who participated fully)
Yesyes (86%)YesNo
(they said they used ITT but 12 patients who were randomized did not receive treatment and were excluded from all analyses)
NoYesFair

Table F21Quality assessment of systematic reviews of multidisciplinary rehabilitation

Author, Year“A priori” design provided?Duplicate study selection and data abstraction?
  1. Study selection
  2. Data abstraction
Comprehensive literature search performed?Non-English language studies considered for inclusion?Conducted searches for unpublished (gray) literature?List of included studies provided?List of excluded studies provided with reasons?Characteristics of the included studies provided?Scientific quality of included studies:
  1. Assessed?
  2. Documented?
Sensitivity analyses or stratified analyses conducted according to study quality?Study conclusions supported by the evidence? (Was study quality considered in the synthesis?)Conflict of interest stated?
  1. Systematic review
  2. Individual studies
Multidisciplinary systematic review team?Quality Rating
Kamper, 2014Yes
  1. Yes
  2. Yes
YesYesNoYesNoYes
  1. Yes
  2. Yes
YesYes
  1. Yes
  2. No
YesGood

Please see Appendix C. Included Studies for full study references.

Table F22Quality assessment of randomized controlled trials of multidisciplinary rehabilitation

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in All Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Eisenberg, 2012YesUnclearYesNoNoUnclearNAYesYesYesYesYesNoUnclearGood
Gatchel, 2003YesUnclearUnclearNoNoUnclearNAYesNoNAYesUnclearYesUnclearFair
Monticone, 2014YesUnclearYesYesNoUnclearNAYesYesYesYesYesNoUnclearGood

Please see Appendix C. Included Studies for full study references.

Table F23Quality assessment of systematic reviews of acupuncture

Author, Year“A priori” design provided?Duplicate study selection and data abstraction?
  1. Study selection
  2. Data abstraction
Comprehensive literature search performed?Non-English language studies considered for inclusion?Conducted searches for unpublished (gray) literature?List of included studies provided?List of excluded studies provided with reasons?Characteristics of the included studies provided?Scientific quality of included studies:
  1. Assessed?
  2. Documented?
Sensitivity analyses or stratified analyses conducted according to study quality?Study conclusions supported by the evidence? (Was study quality considered in the synthesis?)Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Multidisciplinary systematic review team?Quality Rating
Lam, 2013Unclear
  1. Yes
  2. Yes
YesYesNoYesNoYes
  1. Yes
  2. Yes
NoUnclear
  1. Yes
  2. No
NoFair
Lee, 2013Unclear
  1. Yes
  2. Yes
YesYesYesYesNoYes
  1. Yes
  2. Yes
YesYes
  1. Yes
  2. No
NoFair

Please see Appendix C. Included Studies for full study references.

Table F24Quality assessment of randomized controlled trials of acupuncture

Author, YearRandomization adequate?Allocation concealment adequate?Groups similar at baseline?Eligibility criteria specified?Patients masked?Care provider masked?Outcomes assessors masked?Attrition and withdrawals reported?Attrition acceptable and comparable?Analyze people in the groups in which they were randomizedPrimary outcome specified and reported?Other issuesQuality Rating
Cho, 2013YesYesYesYesYesNoYesYesYesYesYesNoneGood
Hasagawa, 2014YesYesYesYesYesNoYesYesYesYesYesNoneGood
Vas, 2012YesYesYesYesYes (for acupuncture and sham groups only)NoYesYesYesYesYesNoneGood
Yun, 2012 (back points)YesUnclear, but likely ok - just says “central randomization with random block sizes”YesYesYes (only for acupuncture groups, not for usual care group)NoYesYesYesYesYesNoneFair
Weiss, 2013UnclearUnclearYesYesUnclearUnclearUnclearYesYesYesUnclearExploratory onlyPoor

Please see Appendix C. Included Studies for full study references.

Table F25Quality assessment of systematic reviews of massage

Author, Year“A priori” design provided?Duplicate study selection and data abstraction?
  1. Study selection
  2. Data abstraction
Comprehensive literature search performed?Non-English language studies considered for inclusion?Conducted searches for unpublished (gray) literature?List of included studies provided?List of excluded studies provided with reasons?Characteristics of the included studies provided?Scientific quality of included studies:
  1. Assessed?
  2. Documented?
Sensitivity analyses or stratified analyses conducted according to study quality?Study conclusions supported by the evidence? (Was study quality considered in the synthesis?)Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Multidisciplinary systematic review team?Quality Rating
Furlan, 2010Yes
  1. Yes
  2. Yes
YesYesYesYesYesYes
  1. Yes
  2. Yes
YesYes
  1. Yes
  2. No
YesGood

Please see Appendix C. Included Studies for full study references.

Table F26Quality assessment of randomized controlled trials of massage

Author, YearRandomization adequate?Allocation concealment adequate?Groups similar at baseline?Eligibility criteria specified?Outcome assessors masked?Care provider masked?Patient masked?Attrition and withdrawals reported?Attrition acceptable and comparable?Analyze people in the groups in which they were randomizedPrimary outcome specified and reported?Other issues?Quality Rating
Ajimsha, 2014UnclearNoYesYesYesNoYesYesYesYesYesNoneFair
Borges, 2014YesUnclearYesYesUnclearNoUnclearYesYesYesYesNoneFair
Cherkin, 2011YesYesYesYesYes - for the two massage groups onlyNoYesYesYesYesYesNoneGood
Kong, 2012YesYesYesYesYesNoYesYesYesYesYesNoneGood
Romanowski, 2012UnclearUnclearYesYesYesNoYesYesYesYesYesNonePoor
Sritooma, 2014YesUnclearYesYesNoNoNo - not describedYesYesYesYesNoneFair
Zhang, 2015NoNoYesYesYesNoUnclearYesYesYesYesNoneFair
Zheng, 2012YesUnknownYesYesUnclearUnclearUnclearYesYesYesYesNoneFair

Please see Appendix C. Included Studies for full study references.

Table F27Quality assessment of systematic reviews of spinal manipulation

Author, Year“A priori” design provided?Duplicate study selection and data abstraction?
  1. Study selection
  2. Data abstraction
Comprehensive literature search performed?Non-English language studies considered for inclusion?Conducted searches for unpublished (gray) literature?List of included studies provided?List of excluded studies provided with reasons?Characteristics of the included studies provided?Scientific quality of included studies:
  1. Assessed?
  2. Documented?
Sensitivity analyses or stratified analyses conducted according to study quality?Study conclusions supported by the evidence? (Was study quality considered in the synthesis?)Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Multidisciplinary systematic review team?Quality Rating
Rubinstein, 2011Yes
  1. Yes
  2. Yes
YesYesYesYesYesYes
  1. Yes
  2. Yes
YesYes
  1. Yes
  2. Yes
YesGood
Rubinstein, 2012Yes
  1. Yes
  2. Yes
YesUnclearYes, but excluded from analysisYesYesYes
  1. Yes
  2. Yes
YesYes
  1. Yes
  2. Yes
YesGood

Please see Appendix C. Included Studies for full study references.

Table F28Quality assessment of randomized controlled trials of SMT

Author, YearRandomization adequate?Allocation concealment adequate?Groups similar at baseline?Eligibility criteria specified?Patient masked?Care provider masked?Outcomes assessor masked?Attrition and withdrawals reported?Attrition acceptable and comparable?Analyze people in the groups in which they were randomizedPrimary outcome specified and reported?Other issuesQuality Rating
Balthazard, 2012YesUnclearYes - although pain slightly higher in sham group (53 vs. 62) but not statistically significantYesNoNoUnclearYesYesYesYesNoneFair
Bicahlo, 2010YesUnclearYesYesNoNoUnclearYesYesYesYesIncomplete reporting of outcomes (function)Fair
Bronfort, 2004YesNoYesYesNoNoNoNoUnclearYesNoPrimary outcome not specifiedPoor
Bronfort, 2011YesYesYesNoNoYesUnclearYesYesYesYesYesGood
Bronfort, 2014Yes - minimization used, not randomizationYesYesYesNoNoNoYesYesYesYesNoneFair - not blinded
Burton, 2000YesYesYesYesNoNoNoYesUnclearYesYesNonePoor
Cecchi, 2010YesUnclearNo - sick leave higher in back school group compared to other groupsYesNoNoUnclearYesYesYesYesNoneFair
De Oliviera, 2013YesYesYesYesYesNoYesYesYesYesYesNoneGood
Goertz, 2013YesYesYesYesNoNoYesYesNo - low followup rate in the SMC groupYesYesNoneFair
Haas, 2014YesYesYesYesNoNoYesYesYesYesYesNoneGood
Paatelma, 2008YesYesYesYesNoNoYesYesNo - high drop out rateYesYesNoneFair
Petersen, 2011YesYesYesYesNoNoYesYesYesYesYesNoneGood
Santilli, 2006YesYesYesYesYesYesUnclearYesYesYesYesNoneGood
Schneider, 2015YesYesYesYesNoNoYesYesYesYesYesNoneGood
Senna, 2011YesYesYesYesYesNoYesYesNo - low followup rate in sham SMT groupYesYesNoneFair
Von Heymann, 2013YesYesYesYesYesNoYesYesNo - low followup rateYesYesUnclear intervention (Single treatment?), small sample size with high drop out rateFair

Please see Appendix C. Included Studies for full study references.

Table F29Quality assessment of systematic reviews of ultrasound

Author, Year“A priori” design provided?Duplicate study selection and data abstraction?
  1. Study selection
  2. Data abstraction
Comprehensive literature search performed?Non-English language studies considered for inclusion?Conducted searches for unpublished (gray) literature?List of included studies provided?List of excluded studies provided with reasons?Characteristics of the included studies provided?Scientific quality of included studies:
  1. Assessed?
  2. Documented?
Sensitivity analyses or stratified analyses conducted according to study quality?Study conclusions supported by the evidence? (Was study quality considered in the synthesis?)Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Multidisciplinary systematic review team?Quality Rating
Ebadi, 2014YesYes/YesYesYesYesYesYesYesYesYes (considered in SOE analyses)YesYes/NoYesGood

Please see Appendix C. Included Studies for full study references.

Table F30Quality assessment of randomized controlled trials of ultrasound

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in all GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality (Cochrane Back Group)
Bronfort, 2011YesYesYesNoNoYesUnclearYesYesYesYesYesYesYesGood
Fiore, 2011YesYesUnclearNoNoYesUnclearUnclearYesYesYesYesUnclearUnclearFair
Goren, 2010YesYesYesYesUnclearYesYesUnclearYesYesYesYesUnclearUnclearFair
Licciardone, 2013YesYesYesYesUnclearUnclearYesYesYesYesYesYesYesYesGood
Unlu, 2008UnclearUnclearYesNoNoUnclearUnclearUnclearNoUnclearYesUnclearUnclearUnclearPoor

Please see Appendix C. Included Studies for full study references.

Table F31Quality assessment of systematic reviews of TENS

Author, Year“A priori” design provided?Duplicate study selection and data abstraction?
  1. Study selection
  2. Data abstraction
Comprehensive literature search performed?Non-English language studies considered for inclusion?Conducted searches for unpublished (gray) literature?List of included studies provided?List of excluded studies provided with reasons?Characteristics of the included studies provided?Scientific quality of included studies:
  1. Assessed?
  2. Documented?
Sensitivity analyses or stratified analyses conducted according to study quality?Study conclusions supported by the evidence? (Was study quality considered in the synthesis?)Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Multidisciplinary systematic review team?Quality Rating
van Middelkoop, 2011Yes
  1. Yes
  2. Yes
YesYesUnclearYesNoYes
  1. Yes
  2. Yes
UnclearYes
  1. Yes
  2. Yes
UnclearGood

Please see Appendix C. Included Studies for full study references.

Table F32Quality assessment of randomized controlled trials of TENS

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Buchmuller, 2012YesYesYesYesNoNoYesYesYesNoYesUnclearUnclearUnclearFair
Facci, 2011YesYesNo; significant difference between TENS and control in pain intensity at baseline (p=0.009)YesUnclearYesYesYesYesYesYesYesUnclearUnclearGood
Shimoji, 2007UnclearUnclearYesYesUnclearYesYesYesNoUnclearYesUnclearUnclearUnclearFair
Tsukayama, 2002YesUnclearYesNoNoYesYesYesYesYesYesYesUnclearUnclearFair

Please see Appendix C. Included Studies for full study references.

Table F33Quality assessment of randomized controlled trials of electrical stimulation

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in all GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality (Cochrane Back Group)Comments
Durmus, 2009UnclearUnclearYesNoNoUnclearUnclearUnclearNoUnclearYesUnclearUnclearYesPoorSome outcomes assessed as means and others as medians, no explanation provided
Durmus, 2010UnclearUnclearYesNoNoUnclearUnclearUnclearYesYesYesNoUnclearYesPoorSome outcomes assessed as means and others as medians, no explanation provided
Glaser, 2001YesUnclearYesYesYesUnclearUnclearUnclearYesNoYesNoUnclearYesPoorVery high loss to followup
Moore, 1997UnclearUnclearUnclearYesUnclearUnclearUnclearUnclearYesYesYesNoUnclearYesPoorCrossover design, results of first intervention not reported and carryover effects not assessed
Pope, 1994YesUnclearUnclearNoNoYesUnclearNoYesYesYesUnclearYesYesFair

Please see Appendix C. Included Studies for full study references.

Table F34Quality assessment of randomized controlled trials of PENS

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in all GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Hamza, 1999UnclearUnclearUnclearUnclearUnclearUnclearUnclearUnclearYesNoYesUnclearUnclearUnclearPoor
Pérez-Palomares, 2010YesUnclearUnclearNoNoYesUnclearUnclearYesYesYesUnclearUnclearUnclearPoor
Weiner, 2008YesUnclearYesYesNoYesUnclearUnclearYesYesYesYesUnclearYesFair

Please see Appendix C. Included Studies for full study references.

Table F35Quality assessment of randomized controlled trials of interferential therapy

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in all GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Lara-Palomo, 2013YesYesYesNoNoUnclearUnclearUnclearYesYesYesYesUnclearYesFair

Please see Appendix C. Included Studies for full study references.

Table F36Quality assessment of systematic reviews of heat-cold

Author, Year“A priori” design provided?Duplicate study selection and data abstraction?
  1. Study selection
  2. Data abstraction
Comprehensive literature search performed?Non-English language studies considered for inclusion?Conducted searches for unpublished (gray) literature?List of included studies provided?List of excluded studies provided with reasons?Characteristics of the included studies provided?Scientific quality of included studies:
  1. Assessed?
  2. Documented?
Sensitivity analyses or stratified analyses conducted according to study quality?Study conclusions supported by the evidence? (Was study quality considered in the synthesis?)Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Multidisciplinary systematic review team?Quality Rating
French, 2006
Updated in French, 2011
Yes
  1. Yes
  2. Yes
YesUnclearUnclearYesYes (no reasons for exclusion provided)Yes
  1. Yes
  2. Yes
NoYes
  1. Yes
  2. No
YesGood

Please see Appendix C. Included Studies for full study references.

Table F37Quality assessment of randomized controlled trials of heat-cold

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality
Dehgan, 2014UnclearUnclearUnclearNoUnclearUnclearUnclearUnclearYesYesYesYesUnclearUnclearFair
Kettenmann, 2007UnclearUnclearYesNoUnclearUnclearYesUnclearYesNoYesNoUnclearUnclearFair
Stark, 2014UnclearUnclearYesNoUnclearUnclearYesUnclearNoUnclearYesYesYesUnclearFair
Tao, 2005UnclearUnclearYesNoUnclearUnclearUnclearUnclearNoUnclearYesUnclearUnclearUnclearPoor

Please see Appendix C. Included Studies for full study references.

Table F38Quality assessment of randomized controlled trials of LLLT

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Ay, 2010YesUnclearYesYesNoYesYesYesYesYesYesYesUnclearUnclearGood
Djavid, 2007UnclearYesYesUnclearYesYesUnclearYesYesYesYesNoUnclearUnclearFair
Hsieh, 2014YesYesYesYesNoUnclearUnclearUnclearYesYesYesYesUnclearUnclearFair
Jovicic, 2012UnclearUnclearYesYesUnclearUnclearYesYesYesYesYesYesUnclearUnclearFair
Konstantinovic, 2010YesYesYesYesYesYesYesYesYesYesYesYesUnclearUnclearGood
Vallone, 2014YesYesUnclearYesUnclearUnclearYesUnclearNoUnclearYesUnclearUnclearUnclearFair

Please see Appendix C. Included Studies for full study references.

Table F39Quality assessment of randomized controlled trials of diathermy

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in all GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Ahmed, 2009UnclearUnclearUnclearYesUnclearUnclearUnclearUnclearNoUnclearYesNoUnclearUnclearPoor
Shakoor, 2008UnclearUnclearUnclearYesUnclearUnclearYesUnclearNoUnclearYesNoUnclearUnclearPoor

Please see Appendix C. Included Studies for full study references.

Table F40Quality assessment of systematic reviews of lumbar supports

Author, Year“A priori” design provided?Duplicate study selection and data abstraction?
  1. Study selection
  2. Data abstraction
Comprehensive literature search performed?Non-English language studies considered for inclusion?Conducted searches for unpublished (gray) literature?List of included studies provided?List of excluded studies provided with reasons?Characteristics of the included studies provided?Scientific quality of included studies:
  1. Assessed?
  2. Documented?
Sensitivity analyses or stratified analyses conducted according to study quality?Study conclusions supported by the evidence? (Was study quality considered in the synthesis?)Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Multidisciplinary systematic review team?Quality Rating
van Duijvenbode, 2011Yes
  1. Yes
  2. Yes
YesYesUnclearYesYesYes
  1. Yes
  2. Yes
YesYes
  1. Yes
  2. No
YesGood

Please see Appendix C. Included Studies for full study references.

Table F41Quality assessment of randomized controlled trials of lumbar support

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in all GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment In All Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Calmels, 2009YesUnclearYes (reported in text; data not shown for some characteristics)NoNoUnclearYesUnclearYesYesYesNoUnclearUnclearFair
Morrisette, 2014YesYesYesNoNoUnclearUnclearYesYesYesYesYesUnclearUnclearFair
Oleske, 2007YesYesYesNoNoYesYesUnclearYesYesYesYesUnclearUnclearFair
Sato, 2012YesUnclearYes (reported in text; data not shown)NoNoUnclearYesUnclearYesYesYesNoUnclearUnclearFair

Please see Appendix C. Included Studies for full study references.

Table F42Quality assessment of systematic reviews of traction

Author, Year“A priori” design provided?Duplicate study selection and data abstraction?
  1. Study selection
  2. Data abstraction
Comprehensive literature search performed?Non-English language studies considered for inclusion?Conducted searches for unpublished (gray) literature?List of included studies provided?List of excluded studies provided with reasons?Characteristics of the included studies provided?Scientific quality of included studies:
  1. Assessed?
  2. Documented?
Sensitivity analyses or stratified analyses conducted according to study quality?Study conclusions supported by the evidence? (Was study quality considered in the synthesis?)Conflict of interest stated?
  1. Systematic Review
  2. Individual Studies
Multidisciplinary systematic review team?Quality Rating
Wegner, 2013Yes
  1. Yes
  2. Yes
YesYesYesYesYesYes
  1. Yes
  2. Yes
YesYes
  1. Yes
  2. No
YesGood

Please see Appendix C. Included Studies for full study references.

Table F43Quality assessment of randomized controlled trials of traction

Author, yearRandomizationConcealed treatment allocationBaseline group similarityPatient blindedCare provider blindedOutcome assessor / Data analyst blindedCointerventions avoided or similarCompliance acceptable in all groupsAttrition reportedAttrition acceptableTiming of outcome assessment in all groups similiaIntention-to-treat analysisIs there a registered or published protocolAvoidance of selective outcomes reportingQuality Rating
Diab, 2012 and Diab, 2013YesYesYesNoNoNoYesYesYesYesYesUnclearYesYesFair
Moustafa, 2013YesYesYesNoUnclearUnclearYesYesYesYesYesYesUnclearUnclearFair
Prasad, 2013UnclearUnclearYesNoYesUnclearYesUnclearYesNoYesNoUnclearUnclearPoor

Please see Appendix C. Included Studies for full study references.

Table F44Quality assessment of randomized controlled trials of taping

Author, YearRandomizationConcealed Treatment AllocationBaseline Group SimilarityPatient BlindedCare Provider BlindedOutcome Assessor / Data Analyst BlindedCointerventions Avoided or SimilarCompliance Acceptable in All GroupsAttrition ReportedAttrition AcceptableTiming of Outcome Assessment in all Groups SimilarIntention-to-Treat AnalysisIs There a Registered or Published ProtocolAvoidance of Selective Outcomes ReportingQuality Rating
Bae, 2013UnclearUnclearYesNoNoUnclearYesUnclearNoUnclearYesYesUnclearYesFair
Castro-Sanchez, 2012YesYesPYesNoYesUnclearYesYesYesYesYesUnclearYesGood
Chen, 2012UnclearUnclearYesNoNoYesUnclearUnclearYesYesYesYesUnclearYesFair
Kachanathu, 2014UnclearUnclearUnclearNoNoUnclearUnclearUnclearNoUnclearYesUnclearUnclearYesPoor
Paolini, 2011YesUnclearYesNoNoUnclearUnclearUnclearNoUnclearYesUnclearUnclearYesFair
Silva Parreira, 2014YesYesYesYesNoYesUnclearYesYesYesYesYesYesYesGood

Please see Appendix C. Included Studies for full study references