Data-Driven Variable Decomposition for Treatment Effect Estimation
Kun Kuang, Peng Cui, Hao Zou et al. · IEEE Transactions on Knowledge and Data Engineering · 2020
Causal Inference plays an important role in decision making in many fields, such as social marketing, healthcare, and public policy. One fundamental problem in causal inference is the treatment effect estimation in observational studies when variables are confounded. Controlling for confounding effects is generally handled by propensity score. But it treats all observed variables as confounders and ignores the adjustment variables, which have no influence on treatment but are predictive of the outcome. Recently, it has been demonstrated that the adjustment variables are effective in reducing the variance of the estimated treatment effect. However, how to automatically separate the confounders and adjustment variables in observational studies is still an open problem, especially in the scenarios of high dimensional variables, which are common in the big data era. In this paper, we first propose a Data-Driven Variable Decomposition (D$^2$VD) algorithm, which can 1) automatically separate confounders and adjustment variables with a data-driven approach, and 2) simultaneously estimate treatment effect in observational studies with high dimensional variables. Under standard assumptions, we theoretically prove that our D$^2$VD algorithm can unbiased estimate treatment effect and achieve lower variance than traditional propensity score based methods. Moreover, to address the challenges from high-dimensional variables and nonlinear, we extend our D$^2$VD to a non-linear version, namely Nonlinear-D$^2$VD (N-D$^2$VD) algorithm. To validate the effectiveness of our proposed algorithms, we conduct extensive experiments on both synthetic and real-world datasets. The experimental results demonstrate that our D$^2$VD and N-D$^2$VD algorithms can automatically separate the variables precisely, and estimate treatment effect more accurately and with tighter confidence intervals than the state-of-the-art methods. We also demonstrated that the top-ranked features by our algorithm have the best prediction performance on an online advertising dataset.
Cited by 29 works. doi:10.1109/tkde.2020.3006898
Authors
References
- Regression Shrinkage and Selection Via the Lasso
- The central role of the propensity score in observational studies for causal effects
- Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy
- An Introduction to Propensity Score Methods for Reducing the Effects of Confounding in Observational Studies
- Statistics and Causal Inference
- A comparison of methods to test mediation and other intervening variable effects.
- Matching Methods for Causal Inference: A Review and a Look Forward
- Marginal Structural Models to Estimate the Causal Effect of Zidovudine on the Survival of HIV-Positive Men
- Proximal Algorithms
- Model-Based Direct Adjustment