×

Advancing statistical thinking in observational health care research. (English) Zbl 1423.62150

Summary: Observational medical studies are becoming more prominent due to interest in using data from current medical practice to help guide treatment selection. We start by reviewing why current analysis strategies for observational data tend to produce findings that fail to replicate. We then argue that there is a real need for simple and objective statistical strategies that yield findings more likely to be dependable. Our proposed way forward is to focus on the empirical distribution of local treatment differences, LTDs, which reveal heterogeneity in effect-sizes. The LTD is the difference in mean outcomes for treated and control patients within a cluster of patients relatively well matched on their observed pretreatment characteristics. Because we focus on only one question (comparing two alternative treatment choices for a given disease or condition) and clustering is nonparametric, our proposed approach is more simple and objective than commonly used statistical analysis strategies. By studying graphical displays of information from an LTD distribution, a doctor and patient not only can see a full picture of current treatment outcomes but also can make a truly well-informed, individualized treatment choice.

MSC:

62P10 Applications of statistics to biology and medical sciences; meta analysis
62G05 Nonparametric estimation
62H30 Classification and discrimination; cluster analysis (statistical aspects)

Software:

SAS; SAS/STAT
Full Text: DOI

References:

[1] Breslow, N. E., Are statistical contributions to medicine undervalued?, Biometrics, 59, 1-8 (2003) · Zbl 1210.62144 · doi:10.1111/1541-0420.00001
[2] Cardwell, C. R.; Abnet, C. C.; Cantwell, M. M.; Murry, L. J., Exposure to oral bisphosphonates and risk of exophageal cancer, J. Am. Med. Assoc., 304, 657-663 (2010) · doi:10.1001/jama.2010.1098
[3] Efron, B., Computers and the theory of statistics: Thinking the unthinkable, SIAM Rev., 21, 460-480 (1979) · Zbl 0417.62001 · doi:10.1137/1021092
[4] Feinstein, A. R., Scientific standards in epidemiologic studies of the menace of daily life, Science, 242, 1257-1263 (1988) · doi:10.1126/science.3057627
[5] Glaeser, E. L. 2006. Researcher incentives and empirical methods. www.economics.harvard.edu/pub/hier/2006/HIER2122.pdf
[6] Green, J.; Czanner, G.; Reeves, G.; Watson, J.; Wise, L.; Beral, V., Oral bisphosphonates and risk of cancer of oesophagus, stomach, colerectum: Case-control analysis with a UK primary care cohort, Br. Med. J., 341, c4444 (2010) · doi:10.1136/bmj.c4444
[7] Ho, D. E.; Imai, K.; King, G.; Stuart, EA, Matching as nonparametric preprocessing for reducing model dependence in parametric causal inference, Polit. Anal., 15, 199-236 (2007) · doi:10.1093/pan/mpl013
[8] Hong, Q., R. L. Obenchain, A. Zagar, and D. E. Faries. 2011. An archive of R-code and datasets for comparison of observational data analyses via calls to SAS/STAT procedures and macros. Unpublished technical materials. http://members.iquest.net/∼softrx
[9] Hothorn, T.; Hornik, K.; Zeileis, A., Unbiased recursive partitioning: A conditional inference framework, J. Comput. Grap. Stat., 15, 651-674 (2006) · doi:10.1198/106186006X133933
[10] Hothorn, T., K. Hornik, C. Strobl, and A. Zeileis. 2010. Party: A laboratory for recursive partitioning. http://cran.r-project.org/web/packages/party
[11] Hughes, S. 2007. New York Times Magazine focuses on pitfalls of epidemiological trials. September 18. http://www.theheart.org/article/813719.do
[12] Ioannidis, J. P A., Contradicted and initially stronger effects in highly cited clinical research, J. Am. Med. Assoc., 294, 218-229 (2005) · doi:10.1001/jama.294.2.218
[13] Kaplan, S. H.; Billimek, J.; Sorkin, D. H.; Ngo-Metzger, Q.; Greenfield, S., Who can respond to treatment? Identifying patient characteristics related to heterogeneity of treatment effects, Medical Care, 48, s9-s16 (2010) · doi:10.1097/MLR.0b013e3181d99161
[14] Mangano, D. T.; Tudor, I. C.; Dietzel, C., The risk associated with aprotinin in cardiac surgery, N. Engl. J. of Med., 354, 353-365 (2006) · doi:10.1056/NEJMoa051379
[15] Obenchain, R. L. 2009. SAS macros for local control (phases one and two), Observational Medical Outcomes Partnership (OMOP), Foundation for the National Institutes of Health (Apache 2.0 License). http://members.iquest.net/∼softrx
[16] Obenchain, R. L.; Faries, D. E (ed.); Leon, A. C (ed.); Haro, J. M (ed.); Obenchain, R. L (ed.), The local control approach using JMP, 151-192 (2010), Cary, NC
[17] Obenchain, R. L. 2011. Observational data analysis competition: Heterogeneous response challenge. http://www.mbswonline.com/presentationyear.php?year=2011
[18] Obenchain, R. L., Q. Hong, A. Zagar, and D. E. Faries. 2011. Observational data simulation scenarios for Windzorized yearly costs of patients with major depressive disorder. Unpublished technical materials. http://members.iquest.net/∼softrx
[19] Obenchain, R. L., Q. Hong, A. Zagar, and D. E. Faries, 2012. Observational data analysis: MSE loss comparisons of local control versus parametric models. Submitted.
[20] Pagano, D.; Howell, N. J.; Freemantle, N.; etal., Bleeding in cardiac surgery: The use of aprotinin does not affect survival, J. Thorac. Cardiovasc. Surg., 135, 495-502 (2008) · doi:10.1016/j.jtcvs.2007.11.045
[21] Pocock, S. J.; Collier, T. J.; Dandreo, K. J.; etal., Issues in the reporting of epidemiological studies: A survey of recent practice, Br. Med. J., 329, 883-888 (2004) · doi:10.1136/bmj.38250.571088.55
[22] Ryan, P. 2011. Impact of observational analysis design: Lessons from the Observational Medical Outcomes Partnership. http://www.niss.org/sites/default/files/OMOP_Ryan_NISS_16Jun2011.pdf
[23] Ruberg, S. J.; Chen, L.; Wang, Y., The mean does not mean as much anymore: Finding sub-groups for tailored therapeutics, Clin. Trials, 7, 574-583 (2010) · doi:10.1177/1740774510369350
[24] Stuart, E. A., Matching methods for causal inference: A review and a look forward, Stat. Sci., 25, 1-21 (2010) · Zbl 1328.62007 · doi:10.1214/09-STS313
[25] Taubes, G.; Mann, C. C., Epidemiology faces its limits, Science, 269, 164-169 (1995) · doi:10.1126/science.7618077
[26] Taubes, G. 2007. Do we really know what makes us healthy? New York Times Magazine, September 16. http://www.nytimes.com/2007/09/16/magazine/16epidemiology-t.html
[27] van der Laan, M., and S. Rose. 2010. Statistics ready for a revolution: Next generation of statisticians must build tools for massive data sets. AMStat News, September, 38-39.
[28] Young, S. S., 2011. Identification and use of patient heterogeneity. http://www.mbswonline.com/presentationyear.php?year=2011
[29] Young, S. S., and A. Karr. 2011. Deming, data and observational studies: A process out of control and needing fixing. Significance, September, 122-126.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.