Systematic reviews of TCM trials: how does inclusion of Chinese trials affect outcome?
Adams, Denise, Wu, Taixiang, Yasui, Yutaka et al. · Journal of evidence-based medicine · 2012 · DOI
Quick Summary
This study looked at whether including research studies published in Chinese would change what we know about treating chronic fatigue syndrome (CFS) and infectious mononucleosis with traditional Chinese medicine (TCM). Researchers searched both English and Chinese databases for high-quality studies. While searching Chinese databases found many more studies than English databases, most of these studies had serious design problems and couldn't be used to draw reliable conclusions.
Why It Matters
This study highlights a critical gap in the global evidence base for ME/CFS: even when substantially more research exists in non-English sources, methodological weaknesses can prevent that research from being reliably used to guide treatment. Understanding these limitations is essential for patients and clinicians seeking evidence-based information about TCM or other interventions for ME/CFS.
Observed Findings
Chinese-language database searches identified 28 potentially relevant CFS references compared to 8 from English-language databases, a 3.5-fold increase.
For infectious mononucleosis, Chinese database searches found 14 studies labeled as RCTs compared to zero from English databases.
Author interviews revealed that many studies labeled as RCTs were actually clinical summaries or uncontrolled clinical trials.
None of the 36 CFS studies identified met all inclusion criteria for a valid systematic review.
Only 1 of 14 mono studies identified from Chinese databases was confirmed to be a controlled clinical trial upon author verification.
Inferred Conclusions
Inclusion of Chinese-language databases substantially increases the volume of potentially relevant references but does not necessarily improve the quality of evidence available for systematic review.
Methodological flaws in Chinese medical research—particularly in randomization procedures and trial design—currently prevent Chinese-language studies from contributing usable evidence to systematic reviews.
Significant improvements in trial design and conduct standards within Chinese medical research are necessary for this body of work to guide clinical practice and future research.
Remaining Questions
What specific methodological improvements would be needed to make Chinese-language CFS research usable for systematic reviews?
What This Study Does Not Prove
This study does not prove that TCM is ineffective for CFS; rather, it demonstrates that the available published research—both in English and Chinese—is not of sufficient quality to make evidence-based claims either supporting or refuting TCM use. The absence of usable evidence is not the same as evidence of absence of benefit.
About the PEM badge: “PEM required” means post-exertional malaise was an explicit required diagnostic criterion for participant inclusion in this study — not that PEM was studied, observed, or discussed. Studies using criteria that do not require PEM (e.g. Fukuda, Oxford) are tagged “PEM not required”. How the atlas works →
Have standards for clinical trial conduct in China changed since 2008, potentially improving the quality of more recent research?
Why do Chinese-language databases contain substantially more CFS and infectious disease research than English-language databases?
Are there barriers to publishing rigorous Chinese trials in English-language journals, or do methodological differences reflect training and resource gaps?