PAIN
Volume 139, Issue 3 , Pages 485-493 , 31 October 2008

Analyzing multiple endpoints in clinical trials of pain treatments: IMMPACT recommendations

  • Dennis C. Turk

      Affiliations

    • Department of Anesthesiology, University of Washington, P.O. Box 356540, Seattle, WA 98195, USA
    • Corresponding Author InformationCorresponding author. Tel.: +1 (206) 616 2626; fax: +1 (206) 543 2958.
    • ,
  • Robert H. Dworkin

      Affiliations

    • Department of Anesthesiology, University of Rochester, Rochester, NY, USA
    • ,
  • Michael P. McDermott

      Affiliations

    • Department of Anesthesiology, University of Rochester, Rochester, NY, USA
    • ,
  • Nicholas Bellamy

      Affiliations

    • Mayne Medical School, University of Queensland, Brisbane, Queensland, Australia
    • ,
  • Laurie B. Burke

      Affiliations

    • United States Food and Drug Administration, Silver Spring, MD, USA
    • ,
  • Julie M. Chandler

      Affiliations

    • Epidemiology, Merck & Co., Blue Bell, PA, USA
    • ,
  • Charles S. Cleeland

      Affiliations

    • Department of Symptom Relief, MD Anderson Cancer Center
    • ,
  • Penney Cowan

      Affiliations

    • American Chronic Pain Association, Rocklin, CA, USA
    • ,
  • Rozalina Dimitrova

      Affiliations

    • Clinical Research, Allergan, Inc., Irvine, CA, USA
    • ,
  • John T. Farrar

      Affiliations

    • Center for Clinical Epidemiology & Biostatistics, University of Pennsylvania, Philadelphia, PA, USA
    • ,
  • Sharon Hertz

      Affiliations

    • United States Food and Drug Administration, Silver Spring, MD, USA
    • ,
  • Joseph F. Heyse

      Affiliations

    • Epidemiology, Merck & Co., Blue Bell, PA, USA
    • ,
  • Smriti Iyengar

      Affiliations

    • Lilly Corporate Center, Eli Lilly & Co, Indianapolis, IN, USA
    • ,
  • Alejandro R. Jadad

      Affiliations

    • Center for Global Health, University of Toronto, Toronto, Ontario, Canada
    • ,
  • Gary W. Jay

      Affiliations

    • Schwarz Biosciences, Research Triangle Park, NC, USA
    • ,
  • John A. Jermano

      Affiliations

    • NeurogesX, Inc., San Carlos, CA, USA
    • ,
  • Nathaniel P. Katz

      Affiliations

    • Analgesic Research, Needham, MA, USA
    • ,
  • Donald C. Manning

      Affiliations

    • Celgene Corporation, Summit, NJ, USA
    • ,
  • Susan Martin

      Affiliations

    • Pfizer, Inc., Ann Arbor, MI, USA
    • ,
  • Mitchell B. Max

      Affiliations

    • Department of Anesthesiology, University of Pittsburgh, Pittsburgh, PA, USA
    • ,
  • Patrick McGrath

      Affiliations

    • Department of Psychology, Dalhousie University, Canada
    • ,
  • Henry J. McQuay

      Affiliations

    • Pain Relief, Oxford University, Oxford, UK
    • ,
  • Steve Quessy

      Affiliations

    • GlaxoSmithKline, Research Triangle Park, NC, USA
    • ,
  • Bob A. Rappaport

      Affiliations

    • United States Food and Drug Administration, Silver Spring, MD, USA
    • ,
  • Dennis A. Revicki

      Affiliations

    • United Biosource Corporation, Bethesda, MD, USA
    • ,
  • Margaret Rothman

      Affiliations

    • Johnson & Johnson, Raritan, NJ, USA
    • ,
  • Joseph W. Stauffer

      Affiliations

    • Alpharma, Piscataway, NJ, USA
    • ,
  • Ola Svensson

      Affiliations

    • AstraZeneca R&D, Sodertalje, Sweden
    • ,
  • Richard E. White

      Affiliations

    • Endo Pharmaceuticals Inc, Chadds Ford, PA USA
    • ,
  • James Witter

      Affiliations

    • United States Food and Drug Administration, now at United States National Institutes of Health, USA

Received 12 March 2008 ,Revised 11 June 2008 ,Accepted 30 June 2008.

References 

  1. Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, et al. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001;134:663–694
  2. Bauer P, Chi G, Geller N, Gould AL, Jordan D, Mohanty S, et al. Industry, government, and academic panel discussion on multiple comparisons in a “real” phase three clinical trial. J Biopharm Stat. 2003;13:691–701
  3. Bauer P, Rohmel J, Maurer W, Hothorn L. Testing strategies in multi-dose experiments including active control. Stat Med. 1998;17:2133–2146
  4. Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J. An inventory for measuring depression. Arch Gen Psychiatry. 1961;4:561–571
  5. Bellamy N, Kirwan J, Boers M, Brooks P, Strand V, Tugwell P, et al. Recommendations for a core set of outcome measures for future phase III clinical trials in knee, hip, and hand osteoarthritis: consensus development at OMERACT III. J Rheumatol. 1997;24:799–802
  6. Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Royal Stat Soc B. 1995;57:289–300
  7. Chi GYH. Multiple testing: multiple comparisons and multiple endpoints. Drug Inf J. 1998;32:1347S–1362S
  8. Cleeland CS, Ryan KM. Pain assessment: global use of the brief pain inventory. Ann Acad Med. 1994;23:129–138
  9. Committee for Proprietary Medicinal Products (CPMP). Points to consider on multiplicity issues in clinical trials. London: European Agency for the Evaluation of Medicinal Products, 2002, http://www.emea.europa.eu/pdfs/human/ewp/090899en.pdf.
  10. Cruccu G, Anand P, Attal N, Garcia-Larrea L, Haanpaa M, Jorum E, et al. EFNS guidelines for neuropathic pain assessment. Eur J Neurol. 2004;11:153–162
  11. Cutter GR, Baier ML, Rudick RA, Cookfair DL, Fischer JS, Petkau J, et al. Development of a multiple sclerosis functional composite as a clinical trial outcome measure. Brain. 1999;122:871–882
  12. D’Agostino RB. Controlling alphas in a clinical trial: the case for secondary endpoints. Stat Med. 2000;19:763–766
  13. Davis CE. Secondary endpoints can be validly analyzed, even if the primary endpoint does not provide clear statistical significance. Control Clin Trials. 1997;18:557–560
  14. Deyo RA, Battie M, Beurskens AH, Bombardier C, Croft P, Koes B, et al. Outcome measures for low back pain research: a proposal for standardized use. Spine. 1998;23:2003–2013
  15. Dmitrienko A, Molenberghs G, Chuang-Stein C, Offen W. Analysis of clinical trials using SAS®: a practical guide. Cary, NC: SAS Institute; 2005;
  16. Dmitrienko A, Offen WW, Westfall PH. Gatekeeping strategies for clinical trials that do not require all primary effects to be significant. Stat Med. 2003;22:2387–2400
  17. Dmitrienko A, Wiens BL, Tamhane AC, Wang X. Tree-structured gatekeeping tests in clinical trials with hierarchically ordered multiple objectives. Stat Med. 2007;26:2465–2478
  18. Dworkin RH, Turk DC, Farrar JT, Haythornthwaite JA, Jensen MP, Katz NP, et al. Core outcome measures for chronic pain clinical trials: IMMPACT recommendations. Pain. 2005;113:9–19
  19. Dworkin RH, Turk DC, Wyrwich KW, Beaton D, Cleeland CS, Farrar JT, et al. Interpreting the clinical importance of treatment outcomes in chronic pain clinical trials: IMMPACT recommendations. J Pain. 2008;9:105–121
  20. Felson DT, Anderson JJ, Boers M, Bombardier C, Chernoff M, Fried B, et al. The American College of Rheumatology preliminary core set of disease activity measures for rheumatoid arthritis clinical trials. Arthritis Rheum. 1993;36:729–740
  21. Felson DT, Anderson JJ, Boers M, Bombardier C, Furst D, Goldsmith C, et al. The American College of Rheumatology preliminary definition of improvement in rheumatoid arthritis. Arthritis Rheum. 1995;38:727–735
  22. Fisher LD. Carvedilol and the Food and Drug Administration (FDA) approval process: the FDA paradigm and reflections on hypothesis testing. Control Clin Trials. 1999;20:16–39
  23. Freemantle N, Calvert M, Wood J, Eastaugh J, Griffin C. Composite outcomes in randomized trials: greater precision but with greater uncertainty?. Jama. 2003;289:2554–2559
  24. Gönen M, Westfall PH, Johnson WO. Bayesian multiple testing for two-sample multivariate endpoints. Biometrics. 2003;59:76–82
  25. Hochberg Y. A sharper Bonferroni procedure for multiple tests of significance. Biometrika. 1988;75:800–802
  26. Holm S. A simple sequentially rejective multiple test procedure. Scand J Stat. 1979;6:65–70
  27. Hommel G. A stepwise rejective multiple test procedure based on a modified Bonferroni test. Biometrika. 1988;75:383–386
  28. Kerns RD, Turk DC, Rudy TE. The West Haven-Yale Multidimensional Pain Inventory (WHYMPI). Pain. 1985;23:345–356
  29. Läuter J. Exact t and F tests for analyzing studies with multiple endpoints. Biometrics. 1996;52:964–970
  30. Lefkopoulou M, Ryan L. Global tests for multiple binary outcomes. Biometrics. 1993;49:975–988
  31. Legler JM, Lefkopoulou M, Ryan LM. Efficiency and power of tests for multiple binary outcomes. J Am Stat Assoc. 1995;90:680–693
  32. Lehmacher W, Wassmer G, Reitmeir P. Procedures for two-sample comparisons with multiple endpoints controlling the experimentwise error rate. Biometrics. 1991;47:511–521
  33. Leon AC. Multiplicity-adjusted sample size requirements: a strategy to maintain statistical power with Bonferroni adjustments. J Clin Psychiatry. 2004;65:1511–1514
  34. Leon AC, Heo M, Teres J, Morikawa T. Statistical power of multiplicity adjustment strategies for correlated binary endpoints. Stat Med. 2007;26:1712–1723
  35. Liu A, Tan M, Boyett JM, Xiong X. Testing secondary hypotheses following sequential clinical trials. Biometrics. 2000;56:640–644
  36. Marcus R, Peritz , Gabriel KR. On closed testing procedures with special reference to ordered analysis of variance. Biometrika. 1976;63:655–660
  37. McNair DM, Lorr M, Droppleman LF. Profile of mood states. San Diego: Educational and Industrial Testing Service; 1971;
  38. Mehrotra DM, Heyse JF. Use of the false discovery rate for evaluating clinical safety data. Stat Methods Med Res. 2004;13:227–238
  39. Moyé LA. P-value interpretation and alpha allocation in clinical trials. Ann Epidemiol. 1998;8:351–357
  40. Moyé LA. End-point interpretation in clinical trials: the case for discipline. Control Clin Trials. 1999;20:40–49
  41. Moyé LA. Alpha calculus in clinical trails: considerations and commentary for the new millennium. Stat Med. 2000;19:767–779
  42. Moyé LA. Multiple analyses in clinical trials. New York: Springer-Verlag; 2003;
  43. O’Brien PC. Procedures for comparing samples with multiple endpoints. Biometrics. 1984;40:1079–1087
  44. O’Neill RT. Secondary endpoints cannot be validity analyzed if the primary endpoint does not demonstrate clear statistical significance. Control Clin Trials. 1997;18:550–556
  45. Pocock SJ. Clinical trials with multiple outcomes: a statistical perspective on their design, analysis, and interpretation. Control Clin Trials. 1997;18:530–545
  46. Prentice RL. On the role and analysis of secondary outcomes in clinical trials. Control Clin Trials. 1997;18:561–567
  47. Sankoh AJ, D’Agostino RB, Huque MF. Efficacy endpoint selection and multiplicity adjustment methods in clinical trials with inherent multiple endpoint issues. Stat Med. 2003;22:3133–3150
  48. Sankoh AJ, Huque MF, Dubey SD. Some comments on frequently used multiple endpoint adjustment methods in clinical trials. Stat Med. 1997;16:2529–2542
  49. Tang DI, Geller NL, Pocock SJ. On the design and analysis of randomized clinical trials with multiple endpoints. Biometrics. 1993;49:23–30
  50. Tang DI, Gnecco C, Geller NL. An approximate likelihood ratio test for a normal mean vector with nonnegative components with application to clinical trials. Biometrika. 1989;76:577–583
  51. Troendle JF. A stepwise resampling method of multiple hypothesis testing. J Am Stat Assoc. 1995;90:370–378
  52. Troendle JF, Legler JM. A comparison of one-sided methods to identify significant individual outcomes in a multiple outcome setting: stepwise tests or global tests with closed testing. Stat Med. 1998;17:1245–1260
  53. Turk DC, Dworkin RH, Allen RR, Bellamy N, Brandenburg N, Carr DB, et al. Core outcome domains for chronic pain clinical trials: IMMPACT recommendations. Pain. 2003;106:337–345
  54. Turk DC, Dworkin RH, Burke LB, Gershon R, Rothman M, Scott J, et al. Developing outcome measures for pain clinical trials: IMMPACT recommendations. Pain. 2006;125:208–215
  55. U.S. Department of Health and Human Services. Guidance for industry: E9 statistical principles for clinical trials. Rockville, MD: Office of Training and Communication, Food and Drug Administration, 1998.
  56. Wassmer G, Reitmeir P, Kieser M, Lehmacher W. Procedures for testing multiple endpoints in clinical trials: an overview. J Stat Planning Inference. 1999;82:69–81
  57. Westfall PH, Krishen A. Optimal weighted, fixed sequence, and gatekeeping multiple testing procedures. J Stat Planning Inference. 2001;99:25–40
  58. Westfall PH, Krishen A, Young SS. Using prior information to allocate significance levels for multiple endpoints. Stat Med. 1998;17:2107–2119
  59. Westfall PH, Wolfinger RD. Multiple tests with discrete distributions. Am Stat. 1997;51:3–8
  60. Westfall PH, Young SS. Resampling-based multiple testing. New York: Wiley; 1993;
  61. Willke RJ, Burke LB, Erickson P. Measuring treatment impact: a review of patient-reported outcomes and other efficacy endpoints in approved product labels. Control Clin Trials. 2004;25:535–552

PII: S0304-3959(08)00373-4

doi: 10.1016/j.pain.2008.06.025

PAIN
Volume 139, Issue 3 , Pages 485-493 , 31 October 2008

Article Tools