Design and Statistical Methods for Handling Covariates Imbalance in Randomized Controlled Clinical Trials: Dilemmas Resolved
DOI:
https://doi.org/10.17140/CTPOJ-4-121Keywords:
Randomization, Covariate imbalance, Stratification, Minimization, Change score analysis, ANCOVAAbstract
Introduction
In practice, between groups baseline imbalance following randomization not only opens effect estimate to bias in controlled trials,
it also has certain ethical consequences. Both design and statistical approaches to ensure balanced treatment groups in prognostic
factors are not without their drawbacks. This article identified potential limitations associated with design and statistical approaches
for handling covariate imbalance in randomized controlled clinical trials (RCTs) and proffered solutions to them.
Methods
A careful review of literatures coupled with a robust appraisal of statistical models of methods involved in a way that compared
their strength and weaknesses in trial environments, was adopted.
Results
Stratification breaks down in small sample size trials and may not accommodate more than two stratification factors in practice.
On the other hand, minimization that balances for multiple prognostic factors even in small trials is not a pure random procedure
and in addition, could present with complexities in computations. Overall, either minimization or stratification factors should be
included in the model for statistical adjustment. Statistically, estimate of effect by change score analysis (CSA) is susceptible to
direction and magnitude of imbalance. Only analysis of covariance (ANCOVA) yields unbiased effect estimate in all trial scenarios
including situations with baseline imbalance in known and unknown prognostic covariates.
Conclusion
Design methods for balancing covariates between groups are not without their limitations. Both direction and size of baseline
imbalance also have profound consequence on effect estimate by CSA. Only ANCOVA yields unbiased treatment effect and is
recommended at all trial scenarios, whether or not between groups covariate imbalance matters.
References
Altman DG, Doré CJ. Randomisation and baseline compar-isons in clinical trials. Lancet. 1990; 335(8682): 149-153. doi: 10.1016/0140-6736(90)90014-v
Tu D, Shalay K, Pater J. Adjustment of treatment effect for co-variates in clinical trials: Statistical and Regulatory issues. Drug Inf J. 2000; 34: 511-523. doi: 10.1177/009286150003400220
Hewitt CE, Torgerson DJ. Is restricted randomisation necessary? BMJ. 2000; 332(7556): 1506-1508. doi: 10.1136/bmj.332.7556.1506
Rosenberger WF, Sverdlov O. Handling covariates in the design of clinical trials. Stat Sci. 2008; 23(3): 404-419. doi: 10.1214/08- STS269
Kernan WN, Makuch RM. Letter. J Clin Epidemiol. 2001; 54: 104- 107.
Scott NW, McPherson GC, Ramsay CR, Campbell MK. The method of minimization for allocation to clinical trials. A review. Control Clin Trials. 2002; 23(6): 662-674. doi: 10.1016/s0197- 2456(02)00242-8
Hagino A, Hamada C, Yoshimura I, Ohashi Y, Sakamoto J, Na-kazato H. Statistical comparison of random allocation methods in cancer clinical trials. Control Clin Trials. 2004; 25(6): 572-584. doi: 10.1016/j.cct.2004.08.004
Taves DR. Faulty assumptions in Atkinson’s criteria for clinical trial design. J R Stat Soc. 2004; 167(1): 179-181.
Hernandez AV, Steyerberg EW, Habbema JD. Covariate adjust-ment in randomized controlled trials with dichotomous outcomes increases statistical power and reduces sample size requirements. J Clin Epidemiol. 2004; 57(5): 454-460. doi: 10.1016/j.jcline-pi.2003.09.014
Moore KL, Vanderlaan MJ. Covariates adjustment in ran-domised trials with binary outcomes: Targeted maximum likeli-hood estimation. Web site. http://www.bepress.com/ucbbiostat/ paper215/. Accessed September 30, 2021.
Kent DM, Trikalinos TA, Hill MD. Are unadjusted analyses of clinical trials inappropriately biased toward the null? Stroke. 2009; 40(3): 672-673. doi: 10.1161/STROKEAHA.108.532051
Sacks FM, Bray GA, Carey VJ, et al. Comparison of weight-loss diets with different compositions of fat, protein, and carbo-hydrates. N Engl J Med. 2009; 360(9): 859-873. doi: 10.1056/NEJ-Moa0804748
Wieder HA, Beer AJ, Lordick F, et al. Comparison of changes in tumor metabolic activity and tumor size during chemotherapy of adenocarcinomas of the esophagogastric junction. J Nucl Med. 2005; 46(12): 2029-2034.
Lachin JM. Statistical properties of randomisation in clinical trials. Control Clin Trials. 1988; 9(4): 289-311. doi: 10.1016/0197- 2456(88)90045-1
Matthews JNS. An Introduction to andomised Controlled Clinical Tri-Original Research | Volume 4 | Number 1 | Egbewale BE als. Arnold, London: Chapman and Hall/CRC; 2000.
Grimes DA, Schulz KF. An overview of clinical research: the lay of the land. Lancet. 2002; 359(9300): 57-61. doi: 10.1016/ S0140-6736(02)07283-5
Altman DG, Bland JM. How to randomise. BMJ. 1999; 319(7211): 703-704. doi: 10.1136/bmj.319.7211.703
Roberts C, Torgerson D. Understanding controlled trials: Ran-domisation methods in controlled trials. BMJ. 1998; 317: 1301. doi: 10.1136/bmj.317.7168.1301
Egbewale BE. Random allocation in controlled clinical trials: A review. J Pharm Pharm Sci. 2014; 17(2): 248-253. doi: 10.18433/ j3sw36
Kang M, Ragan BG, Park JH. Issues in outcomes research: an overview of randomization techniques for clinical trials. J Athl Train. 2008; 43(2): 215-221. doi: 10.4085/1062-6050-43.2.215
Vickers AJ. The use of percentage change from baseline as an outcome in a controlled trial is statistically inefficient: A simulation study. BMC Med Res Methodol. 2001; 1: 6. doi: 10.1186/1471-2288- 1-6
Van Breukelen GJP. ANCOVA versus change from baseline had more power in randomized studies and more bias in nonrand-omized studies. J Clin Epidemiol. 2006; 59: 920-925. doi: 10.1016/j. jclinepi.2006.02.007
Egbewale BE, Lewis M, Sim J. Bias, precision and statistical power of analysis of covariance in the analysis of randomized tri-als with baseline imbalance: A simulation study. BBMC Med Res Methodol. 2014; 14: 49. doi: 10.1186/1471-2288-14-49
Egbewale BE. Differences in sample size requirements of sta-tistical methods involved in clinical trials with baseline imbalance demonstrated and quantified: a simulation study. J Clin Trials. 2015; 5: 225. doi: 10.4172/2167- 0870.1000225
Fleiss JL. The Design and Analysis of Clinical Experiments. New York, USA: John Wiley; 1986.
Camilli G, Shepard LA. The inadequacy of ANOVA for detecting test bias. J Educ Stat. 1987; 12(1): 87-99. doi: 10.3102/10769986012001087
Christensen E, Neuberger J, Crowe J, et al. Beneficial effect of azathioprine and prediction of prognosis in primary biliary cir-rhosis. Final results of an international trial. Gastroenterology. 1985; 89(5): 1084-1091. doi: 10.1016/0016-5085(85)90213-6
Piantandosi S. Clinical Trials: A Methodological Perspective. NJ, USA: John Wiley & Sons; 1997: 302.
Rutherford A. Introducing ANOVA and ANCOVA: A GLM Approach. London, England: Sage Publications; 2001. Submit your article to this journal | https://openventio.org/submit-manuscript/
Wang SJ, Hung HM. Adaptive covariate adjustment in clini-cal trials. J Biopharm Stat. 2005; 15(4): 605-611. doi: 10.1081/BIP-
Downloads
Published
How to Cite
Issue
Section
License

This work is licensed under a Creative Commons Attribution 4.0 International License.
All content published in Clinical Trials and Practice – Open Journal (CTP) is licensed under the Creative Commons Attribution 4.0 International License (CC BY 4.0). This license allows anyone to copy, distribute, transmit, and adapt the work — including for commercial purposes — provided appropriate credit is given to the original author(s) and source.