An empirical study of the possible relation of treatment differences to quality scores in controlled randomized clinical trials

Authors: Emerson JD (1) , Burdick E , Hoaglin DC , Mosteller F , Chalmers TC
(1) Department of Health Policy and Management, Harvard School of Public Health
Source: Control Clin Trials. 1990 Oct;11(5):339-52
DOI: 10.1016/0197-2456(90)90175-2 Publication date: 1990 Oct E-Publication date: Nov. 7, 2002 Availability: abstract Copyright: © 1990 Published by Elsevier Inc
Language: English Countries: Not specified Location: Not specified Correspondence address: Frederick Mosteller, PhD, Technology Assessment Group, Harvard School of Public Health, 677 Huntington Avenue, Room LL-7A Boston, MA 02115, USA


Article abstract

Meta-analytic investigations sometimes use assessments of research quality according to a formal protocol as a tool for improving research synthesis. We asked whether a particular quality scoring system could have a direct use in adjusting the summary estimates of a treatment difference. In an empirical study of the relation of quality scores to treatment differences in published meta-analyses of 7 groups of controlled randomized clinical trials comprising 107 primary studies, we found no relation between treatment difference and overall quality score. We also found no relation between quality score and variation in treatment difference. The level of quality scores has increased at a rate of 9% per decade for three decades, averaging 0.51 on a scale of 0 to 1 for the 1980s, and leaving much room for improvement. Nevertheless, attention to quality of studies by editors, reviewers, and authors may be raising both the level of research done and quality of the reports.

Find it online