Randomized controlled trials in non-pharmacological rehabilitation research: a scoping review of the reporting of sample size calculation, randomization procedure, and statistical analyses
Journal Articles
Overview
Research
Identity
Additional Document Info
View All
Overview
abstract
INTRODUCTION: The randomized controlled trials (RCTs) are often considered as the gold standard for clinical trials and researchers argue that the quality of RCT reports should be of the highest standards due to their clinical significance. To review the quality of reporting of the sample size calculation methods, and randomization procedures, and assess whether the statistical analyses correlate as reported in the trials' Evidence acquisition and Evidence synthesis sections in non-pharmacological, physiological rehabilitation RCT interventions. EVIDENCE ACQUISITION: A systematic electronic search was conducted in Cochrane Central from 1 January 2019 to 16 December 2019. Titles and abstracts were analyzed for inclusion independently by two authors, and disagreements were resolved by a third reader. Studies were included if they met the following criteria: 1) assessed and reported a type of non-pharmacological rehabilitation RCT (e.g. physiotherapy); 2) randomized intervention to patients with a disease comparing to healthy or patients without intervention as the comparison group; 3) published in an indexed journal; and 4) original research, available full text, human study, published in 2019, and written in English. The following information was extracted from the included articles: journal impact factor (JIF), sample size calculation methods (SS), randomization procedure (RND), and statistical analyses (STAT) reported. Analyzing the full text, whether SS and RND were reported or not and whether the STAT correlated with the Methods and Results sections. The prevalence of each statistical method was derived from the Methods section of the report and compared if it was reported in the Results section. The continuous variable of JIF was tested for normality and used for independent t-test for equality of means between categories. In addition, using Downs and Black checklist the methodological quality of the articles was assessed and categorized to be poor, fair, good, and excellent based on the checklist's score. Finally, the association between the assessed quality (categorical variable) of the articles and the reporting variables (categorical variables) was analyzed utilizing the Pearson χ2. EVIDENCE SYNTHESIS: One hundred and nighty-four articles were retrieved from the systematic search out of which 99 (51%) were included for data extraction and further analyses. About one in five (20.2%) and two in five (37.4%) did not properly and adequately report the SS and RND while one in five (19.2%) there was at least one mismatch in STAT. The JIF was not significantly associated to the quality of reporting of SS (t=1.974, P=0.051), RND (t=0.309, P=0.758), and STAT (t=-0.275, P=0.784). This finding could indicate that the quality of the journal did not assure the quality of the reporting these methods. However, there was a significant association between the assessed quality of the article measured with the Down's and Black checklist and the reporting of SS (χ2=29.149, DF=2, P<0.0001), RND (χ2=55.079, df=2, P<0.0001) and STAT (χ2=25.778, df=2, P<0.0001). CONCLUSIONS: Recent reporting quality of non-pharmacological rehabilitation RCTs was investigated. We found that the quality of the article but not the quality of the journal in which it is published in may be associated to the quality of reporting in sample size methods, randomization processes, and statistical analyses reporting. The quality of study reporting may be enhanced utilizing a guideline that addresses the required information in sample size calculation, randomization of individuals, and proper statistical analyses used and reported.
