Albert A, Anderson JA (1984). On the existence of maximum likelihood estimates in logistic regression models. Biometrika, 71, 1.
Brookhart MA, et al. (2006). Variable selection for propensity score models. American journal of epidemiology 163(12): 1149-1156.
Caliendo M, Kopeinig S (2008). Some practical guidance for the implementation of propensity score matching. Journal of economic surveys 22.1: 31-72.
Chen T, Guestrin C (2015). XGBoost: Reliable Large-scale Tree Boosting System. http://learningsys.org/papers/LearningSys_2015_paper_32.pdf. Accessed Nov. 14, 2019.
Chen T, Guestrin C (2016). XGBoost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining – KDD ’16. https://arxiv.org/abs/1603.02754.
Cochran WG (1972). Observational studies. Statistical Papers in Honor of George W. Snedecor, ed. T.A. Bancroft. Iowa State University Press, pp. 77-90.
D’Agostino R, Lang W, Walkup M, Morgon T (2001). Examining the Impact of Missing Data on Propensity Score Estimation in Determining the Effectiveness of Self-Monitoring of Blood Glucose (SMBG). Health Services & Outcomes Research Methodology 2:291–315.
D’Agostino Jr, RB, Rubin DB (2000). Estimating and using propensity scores with partially missing data. Journal of the American Statistical Association 95.451: 749-759.
Dehejia, RH, Wahba S (1999). Causal effects in nonexperimental studies: Reevaluating the evaluation of training programs. Journal of the American Statistical Association 94.448: 1053-1062.
Dehejia, RH, Wahba S (2002). Propensity score-matching methods for nonexperimental causal studies. Review of Economics and Statistics 84.1: 151-161.
Dusetzina, SB, Mack CD, Stürmer T (2013). Propensity score estimation to address calendar time-specific channeling in comparative effectiveness research of second generation antipsychotics. PloS one 8.5: e63973.
Hansen, BB (2008). The prognostic analogue of the propensity score. Biometrika 95.2: 481-488.
Heinze G, Schemper M (2002). A solution to the problem of separation in logistic regression. Statistics in Medicine 21.16: 2409-2419.
Hill J (2004). Reducing bias in treatment effect estimation in observational studies suffering from missing data. ISERP Working Papers, 04-01.
Hirano K, Imbens GW (2001). Estimation of causal effects using propensity score weighting: An application to data on right heart catheterization. Health Services and Outcomes research methodology 2.3-4: 259-278.
Ibrahim J, Lipitz S, Chen M (1999). Missing covariates in generalized linear models when the missing data mechanism is nonignorable, Journal of the Royal Statistical Society. Series B (Statistical Methodology) 61:173-190.
Leacy, FP, Stuart EA (2014).”On the joint use of propensity and prognostic scores in estimation of the average treatment effect on the treated: a simulation study. Statistics in medicine 33.20: 3488-3508.
Mack, CD et al. (2013). Calendar time‐specific propensity scores and comparative effectiveness research for stage III colon cancer chemotherapy. Pharmacoepidemiology and drug safety 22.8: 810-818.
McCaffrey DF, Ridgeway G, Morral AR (2004). Propensity score estimation with boosted regression for evaluating causal effects in observational studies. Psychological Methods 9.4: 403.
Mitra R, Reiter JP (2011). “Estimating propensity scores with missing covariate data using general location mixture models.” Statistics in Medicine 30.6: 627-641.
Nguyen T, Debray TPA (2019). “The use of prognostic scores for causal inference with general treatment regimes.” Statistics in Medicine 38.11: 2013-2029.
Pearl J (2000). Causality: models, reasoning and inference. Vol. 29. Cambridge: MIT Press.
Petri H, Urquhart J (1991). Channeling bias in the interpretation of drug effects. Statistics in Medicine 10(4): 577-581.
Qu Y, Lipkovich I (2009). “Propensity score estimation with missing values using a multiple imputation missingness pattern (MIMP) approach.” Statistics in Medicine28.9: 1402-1414.
Rosenbaum PR and Rubin DB (1983). The central role of the propensity score in observational studies for causal effects. Biometrika 70: 41-55.
Rosenbaum PR, Rubin DB (1984). Reducing bias in observational studies using subclassification on the propensity score. Journal of the American Statistical Association 79.387: 516-524.
Rubin DB (1978). Multiple imputations in sample surveys-a phenomenological Bayesian approach to nonresponse. Proceedings of the survey research methods section of the American Statistical Association. Vol. 1. American Statistical Association, 1978.
Rubin DB (2001). Using propensity scores to help design observational studies: application to the tobacco litigation. Health Services and Outcomes Research Methodology 2.3-4: 169-188.
Shrier I, Platt RW, Steele RJ (2007). Re: Variable selection for propensity score models. American journal of epidemiology 166(2): 238-239.
Chapter 5: Before You Analyze – Feasibility Assessment
5.2 Best Practices for Assessing Feasibility: Common Support
5.2.1 Walker’s Preference Score and Clinical Equipoise
5.2.2 Standardized Differences in Means and Variance Ratios
5.2.4 Proportion of Near Matches
5.3 Best Practices for Assessing Feasibility: Assessing Balance
5.3.1 The Standardized Difference for Assessing Balance at the Individual Covariate Level
5.3.2 The Prognostic Score for Assessing Balance
5.4 Example: REFLECTIONS Data
5.4.1 Feasibility Assessment Using the Reflections Data
5.4.2 Balance Assessment Using the Reflections Data
5.5 Summary
References
5.1 Introduction
This chapter demonstrates the final pieces of the design phase, which is the second stage in the four-stage process proposed by Bind and Rubin (Bind and Rubin 2017, Rubin 2007) and described as our best practice in Chapter 1. Specifically, this stage covers the assessment of feasibility of the research and confirmation that balance can be achieved by the planned statistical adjustment for confounders. It is assumed at this point that you have a well-defined research question, estimand, draft analysis plan, and draft propensity score (or other adjustment method) model. Both graphical and statistical analyses are presented along with SAS code and are applied as an example using the REFLECTIONS data.
In a broad sense, a feasibility assessment examines whether the existing data are sufficient to meet the research objectives using the planned analyses. That is, given the research