Asian Nursing Research
Volume 1, Issue 3 , Pages 153-164, December 2007

Quality Evaluation of Randomized Controlled Trials on Complementary and Alternative Medicine

  • Kasil Oh, PhD

      Affiliations

    • College of Nursing, Yonsei University, Seoul, Korea
    • ,
  • Keum-Soon Kim, PhD

      Affiliations

    • College of Nursing, Seoul National University, Seoul, Korea
    • ,
  • Jee-Won Park, PhD

      Affiliations

    • College of Nursing, Ajou University, Suwon, Korea
    • Corresponding Author InformationCorrespondence to: Jee-Won Park, PhD, College of Nursing, Ajou University, San 5 Wonchun Dong, Yeongtonggu, Suwon 443-749, Korea
    • ,
  • Jiyeon Kang, PhD

      Affiliations

    • Department of Nursing, Dong-A University, Busan, Korea

Article Outline

Purpose

This study aims to describe the research characteristics and analyze the methodological quality of randomized clinical trials on complementary and alternative medicine (CAM).

Methods

A total of 76 studies using randomized controlled trials (RCTs) on CAM (16 by Koreans, 60 by internationals) published in the 6 years from 2000 to 2005 were reviewed systematically and analyzed with assessment criteria developed by the researchers on the basis of Jadad guidelines.

Results

Most of the studies were carried out in the area of medicine, nursing and CAM. More than 80% of the study subjects were patients. CAM modalities for independent variables were mainly on energy medicine, mind-body medicine and manipulative and body-based practices, while dependent variables were mostly physiological and psychological indexes. Most of the studies utilized randomization (93.4%) and identified the dropout rate (90.8%), whereas allocation concealment (49.3%) and double-blinding (18.9%) were specified in a small number of studies. The overall quality of RCTs based on the assessment criteria of this study was satisfactory. However, the quality score of the Korean studies (2.87) was lower than that of the international studies (3.37).

Conclusion

The methodological objectivity of CAM studies has been improving in spite of controversy over the scientific bases of CAM. More Korean studies with rigorous experimental design are needed to build up the evidence-based practice of CAM.

Key Words:  complementary and alternative medicine , randomized controlled trials , research methodology , quality

No full text is available. To read the body of this article, please view the PDF online.

 

Back to Article Outline

References 

  1. Balk EM , Bonis PA , Moskowitz H , Schmid CH , Ioannidis JP , Wang C , et al.   Correlation of quality measures with estimates of treatment effect in meta-analyses of randomized controlled trials . The Journal of the American Medical Association . 2002;287:2973–2982
  2. Barnes DE , Bero LA . Scientific quality of original research articles on environmental tobacco smoke . Tobacco Control . 1997;6:19–26
  3. Barnes J , Abbot NC , Harkness EF , Ernst E . Articles on complementary medicine in the mainstream medical literature: An investigation of MEDLINE, 1966 through 1996 . Archives of Internal Medicine . 1999;159:1721–1725
  4. Chalmers TC , Smith H , Blackburn B , Silverman B , Schroeder B , Reitman D , et al.   A method for assessing the quality of a randomized control trial . Controlled Clinical Trials . 1981;2:31–49
  5. Egger M , Juni P , Bartlett C , Holenstein F , Sterne J . How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study . Health Technology Assessment . 2003;7:1–68
  6. Eisenberg DM , Davis RB , Ettner SL , Appel S , Rompay MV , Kessler RC . Trends in alternative medicine use in the United States, 1990–1997: Results of a follow up national survey . The Journal of the American Medical Association . 1998;280:1569–1575
  7. Ernst E . Science friction–CAM on the stony road from opinion to evidence [Commentary] . International Journal of Epidemiology . 2001;30:531–532
  8. Jadad AR , Moore RA , Carroll D , Jenkinson CJ , Reynolds DJ , Gavaghan DJ , et al.   Assessing the quality of reports of randomized clinical trials: Is blinding necessary? . Controlled Clinical Trials . 1996;17:1–12
  9. Khan KS , Daya S , Jadad AR . The importance of quality of primary studies in producing unbiased systematic reviews . Archives of Internal Medicine . 1996;156:661–666
  10. Kim, M. H. (2003). Use of complementary and alternative medicine and its related factors in cancer patients. Unpublished master's thesis, Young Nam University, Deagu, Korea.
  11. Klassen TP , Pham B , Lawson ML , Moher D . For randomized controlled trials, the quality of reports of complementary and alternative medicine was as good as reports of conventional medicine . Journal of Clinical Epidemiology . 2005;58:763–768
  12. Lee EI , Shin YC , Lee JY , Kim SD , Kim HJ , Cho MS . Use of complementary and alternative medicine in cancer patients at 7 general hospitals in Seoul . Journal of the Korean Public Health Association . 2002;28:225–238
  13. Lee KP , Schotland M , Bacchetti P , Bero LA . Association of journal quality indicators with methodological quality of clinical research articles . The Journal of the American Medical Association . 2002;287:2805–2808
  14. Linde K , Jonas WB , Melchart D , Willich S . The methodological quality of randomized controlled trials of homeopathy, herbal medicines and acupuncture . International Journal of Epidemiology . 2001;30:526–531
  15. Menniti-Ippolito F , Gargiulo L , Bologna E , Forcella E , Raschetti R . Use of unconventional medicine in Italy: A nation wide survey . European Journal of Clinical Pharmacology . 2002;58:61–64
  16. Moher D , Jadad AR , Tugwell P . Assessing the quality of randomized controlled trials. Current issues and future directions . International Journal of Technology Assessment in Health Care . 1996;12:195–208
  17. Moja LP , Telaro E , D'Amico R , Moschetti I , Coe L , Liberati A . Assessment of methodological quality of primary studies by systematic reviews: Results of the metaquality cross sectional study . British Medical Journal . 2005;330:1053
  18. National Center for Complementary and Alternative Medicine  . What is CAM? . Retrieved August 2, 2007, from http://nccam.nih.gov/health/whatiscam/ 2002;
  19. Ni H , Simile C , Hardy AM . Utilization of complementary and alternative medicine by United States adults: Results from the 1999 national health interview survey . Medical Care . 2002;40:353–358
  20. Oh KS , Kim KS , Kwon SH , Park JW . Research trend of complementary and alternative medicine . Taehan Kanho Hakhoe Chi . 2006;36:721–731
  21. Pittler MH , Abbot NC , Harkness EF , Ernst E . Location bias in controlled clinical trials of complementary/alternative therapies . Journal of Clinical Epidemiology . 2000;53:485–489
  22. Raschetti R , Menniti-Ippolito F , Forcella E , Bianchi C . Complementary and alternative medicine in the scientific literature . Journal of Alternative and Complementary Medicine . 2005;11:209–212
  23. Seol KL , Choi SY , Jong IL . A study on the use, understanding and satisfaction with alternative therapy for hospitalized cancer patients . Journal of the Korean Public Health Association . 2002;28:198–211
  24. Schulz KF , Chalmers I , Hayes RJ , Altman DG . Empirical evidence of bias: Dimensions of methodological quality associated with estimates of treatment effects in controlled trials . The Journal of the American Medical Association . 1995;273:408–412
  25. Son HM . Nurses' attitudes toward complementary and alternative therapies . Journal of the Korean Academy of Adult Nursing . 2002;14:62–72
  26. Tang JL , Zhan SY , Ernst E . Review of randomised controlled trials of traditional Chinese medicine . British Medical Journal . 1999;319:160–161
  27. Trinh KV , Phillips S-D , Ho E , Damsma K . Acupuncture for the alleviation of lateral epicondyle pain: A systematic review . Rheumatology . 2004;43:1085–1090
  28. Wang G, Mao B, Xiong ZY, Fan T, Chen XD, Wang L, et al  The quality of reporting of randomized controlled trials of traditional Chinese medicine: A survey of 13 randomly selected journals from mainland China . Clinical Therapeutics . 2007;29:1456–1467

PII: S1976-1317(08)60018-3

doi:10.1016/S1976-1317(08)60018-3

Asian Nursing Research
Volume 1, Issue 3 , Pages 153-164, December 2007

Article Tools