Variational inference on a Bayesian adaptive lasso Tobit quantile regression model. (English) Zbl 07858692
Summary: The Tobit quantile regression model is a useful tool for quantifying the relationship between response variables with limited values and the explanatory variables. Under the Bayesian framework, the Tobit quantile regression model is often simulated by an asymmetric Laplacian distribution (ALD), which can be reformulated as a hierarchical structure model. An adaptive lasso prior is used to address the selection of active explanatory variables. A mean-field variational family is adopted, where the variables are assumed to be mutually independent with each being governed by a different factor in the variational density. A coordinate ascent variational inference (CAVI) algorithm is developed to iteratively optimize each factor, and the evidence lower bound (ELBO) is obtained. Parameter estimation and variable selection are simultaneously produced by the optimal variational density. Several simulation studies and an example are presented to illustrate the proposed methodologies.
© 2023 John Wiley & Sons Ltd.
© 2023 John Wiley & Sons Ltd.
MSC:
| 62-XX | Statistics |
Keywords:
Bayesian adaptive Lasso; CAVI algorithm; ELBO; Tobit quantile regression; variational inferenceReferences:
| [1] | Alhamzawi, R., & Ali, H. T. M. (2018). Bayesian Tobit quantile regression with penalty. Communications in Statistics‐Simulation and Computation, 47(6), 1739-1750. · Zbl 07550065 |
| [2] | Alhamzawi, R., Yu, K., & Benoit, D. F. (2012). Bayesian adaptive lasso quantile regression. Statistical Modelling, 12(3), 279-297. · Zbl 07257880 |
| [3] | Blei, D. M., Kucukelbir, A., & McAuliffe, J. D. (2017). Variational inference: A review for statisticians. Journal of the American statistical Association, 112(518), 859-877. |
| [4] | Feng, X.‐N., Wang, Y., Lu, B., & Song, X.‐Y. (2017). Bayesian regularized quantile structural equation models. Journal of Multivariate Analysis, 154, 234-248. · Zbl 1352.62094 |
| [5] | Feng, X.‐N., Wang, G.‐C., Wang, Y.‐F., & Song, X.‐Y. (2015). Structure detection of semiparametric structural equation models with Bayesian adaptive group lasso. Statistics in Medicine, 34(9), 1527-1547. |
| [6] | Fox, C. W., & Roberts, S. J. (2012). A tutorial on variational Bayesian inference. Artificial intelligence review, 38(2), 85-95. |
| [7] | Guo, R., Zhu, H., Chow, S.‐M., & Ibrahim, J. G. (2012). Bayesian lasso for semiparametric structural equation models. Biometrics, 68(2), 567-577. · Zbl 1274.62781 |
| [8] | Hoti, F., & Sillanpää, M. J. (2006). Bayesian mapping of genotype \(\times\) expression interactions in quantitative and qualitative traits. Heredity, 97(1), 4-18. |
| [9] | Koenker, R. W. (2005). Quantile regression: Cambridge University Press. · Zbl 1111.62037 |
| [10] | Kozumi, H., & Kobayashi, G. (2011). Gibbs sampling methods for Bayesian quantile regression. Journal of statistical computation and simulation, 81(11), 1565-1578. · Zbl 1431.62018 |
| [11] | Mroz, T. A. (1984). The sensitivity of an empirical model of married women’s hours of work to economic and statistical assumptions: Stanford University. |
| [12] | Ostwald, D., Kirilina, E., Starke, L., & Blankenburg, F. (2014). A tutorial on variational Bayes for latent linear stochastic time‐series models. Journal of Mathematical Psychology, 60, 1-19. · Zbl 1304.62116 |
| [13] | Park, T., & Casella, G. (2008). The Bayesian lasso. Journal of the American Statistical Association, 103(482), 681-686. · Zbl 1330.62292 |
| [14] | Powell, J. L. (1986). Censored regression quantiles. Journal of econometrics, 32(1), 143-155. · Zbl 0605.62139 |
| [15] | Tobin, J. (1958). Estimation of relationships for limited dependent variables. Econometrica: journal of the Econometric Society, 26, 24-36. · Zbl 0088.36607 |
| [16] | Tran, M.‐N., Nguyen, T.‐N., & Dao, V.‐H. (2021). A practical tutorial on variational Bayes. arXiv preprint arXiv:2103.01327. |
| [17] | Wang, Z.‐Q., & Tang, N.‐S. (2020). Bayesian quantile regression with mixed discrete and nonignorable missing covariates. Bayesian Analysis, 15(2), 579-604. · Zbl 1459.62062 |
| [18] | Wu, Y., & Tang, N. (2021). Variational Bayesian partially linear mean shift models for high‐dimensional alzheimer’s disease neuroimaging data. Statistics in Medicine, 40(15), 3604-3624. |
| [19] | Yu, K., & Moyeed, R. A. (2001). Bayesian quantile regression. Statistics & Probability Letters, 54(4), 437-447. · Zbl 0983.62017 |
| [20] | Zhao, K., & Lian, H. (2015). Bayesian Tobit quantile regression with single‐index models. Journal of Statistical Computation and Simulation, 85(6), 1247-1263. · Zbl 1457.62375 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
