×

Blind image deblurring using kernel error for \(p\)-shrinkage operator optimization model. (English) Zbl 07896899

Summary: The field of blind image deblurring has been broadly investigated and has yielded significant achievements. The two-stage method has been widely adopted for blind image deblurring. In particular, the accurate estimation of the blur kernel during the first stage is critical to overall success. Nevertheless, many existing methods may not accomplish sufficient accuracy in the blur kernel estimation, leading to restored images that exhibit boundary distortions and other undesirable artifacts in the second stage. In this paper, a robust blind image deblurring model is proposed, which addresses the inherent uncertainty in the blur kernel estimation during the blind deblurring, decomposing the blur kernel into a deterministic component and a random component for the purpose of reducing the impact of the kernel error on image restoration through iterative estimation. Furthermore, the utilization of the \(L_p\)-norm in image restoration has demonstrated exceptional performance, therefore, the \(L_p\)-norm is utilized to achieve optimal restored images. The effectiveness of the proposed method is investigated through quantitative and qualitative experimental evaluations, which demonstrate its superior performance compared to state-of-the-art methods in benchmark datasets and text images, as well as natural degradation images.

MSC:

65D18 Numerical aspects of computer graphics, image analysis, and computational geometry
68U10 Computing methodologies for image processing
65K10 Numerical optimization and variational techniques
Full Text: DOI

References:

[1] Nonconvex regularization for blurred images with cauchy noise, Inverse Problems & Imaging, 16, 625-646, 2022 · Zbl 1487.94016 · doi:10.3934/ipi.2021065
[2] Blind and semi-blind deblurring of natural images, IEEE Transactions on Image Processing, 19, 36-52, 2009 · Zbl 1371.94022 · doi:10.1109/TIP.2009.2031231
[3] Graph-based blind image deblurring from a single photograph, IEEE Transactions on Image Processing, 28, 1404-1418, 2018 · doi:10.1109/TIP.2018.2874290
[4] Improving image deblurring, Inverse Problems and Imaging, 17, 951-968, 2023 · doi:10.3934/ipi.2022066
[5] Framelet-based blind motion deblurring from a single image, IEEE Transactions on Image Processing, 21, 562-572, 2011 · Zbl 1372.94029 · doi:10.1109/TIP.2011.2164413
[6] Enhancing sparsity by reweighted \(l1\) minimization, Journal of Fourier Analysis and Applications, 14, 877-905, 2008 · Zbl 1176.94014 · doi:10.1007/s00041-008-9045-x
[7] L. Chen, F. Fang, T. Wang and G. Zhang, Blind image deblurring with local maximum gradient prior, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, (2019), 1742-1750.
[8] S. Cho and S. Lee, Fast motion deblurring, ACM SIGGRAPH Asia 2009, (2009), 1-8.
[9] Text image deblurring using kernel sparsity prior, IEEE Transactions on Cybernetics, 50, 997-1008, 2020 · doi:10.1109/TCYB.2018.2876511
[10] Removing camera shake from a single photograph, ACM Transactions on Graphics, 25, 787-794, 2006 · Zbl 1371.94125 · doi:10.1145/1141911.1141956
[11] Hierarchical bayesian image restoration from partially known blurs, IEEE Transactions on Image Processing, 9, 1784-1797, 2000 · doi:10.1109/83.869189
[12] Restoration of randomly blurred images via the maximum a posteriori criterion, IEEE Transactions on Image Processing, 1, 256-262, 1992 · doi:10.1109/83.136603
[13] Blind color-image deblurring based on color image gradients, Signal Processing, 155, 14-24, 2019 · doi:10.1016/j.sigpro.2018.09.032
[14] M. Hirsch, C. J. Schuler, S. Harmeling and B. Schölkopf, Fast removal of non-uniform camera shake, 2011 International Conference on Computer Vision, IEEE, (2011), 463-470.
[15] R. Köhler, M. Hirsch, B. Mohler, B. Schölkopf and S. Harmeling, Recording and playback of camera shake: Benchmarking blind deconvolution with a real-world database, European Conference on Computer Vision, Springer, (2012), 27-40.
[16] D. Krishnan, T. Tay and R. Fergus, Blind deconvolution using a normalized sparsity measure, CVPR 2011, IEEE, (2011), 233-240.
[17] A. Levin, Y. Weiss, F. Durand and W. T. Freeman, Understanding and evaluating blind deconvolution algorithms, 2009 IEEE Conference on Computer Vision and Pattern Recognition, IEEE, (2009), 1964-1971.
[18] A. Levin, Y. Weiss, F. Durand and W. T. Freeman, Efficient marginal likelihood optimization in blind deconvolution, CVPR 2011, IEEE, (2011), 2657-2664.
[19] Total variation blind deconvolution employing split bregman iteration, Journal of Visual Communication and Image Representation, 23, 409-417, 2012 · doi:10.1016/j.jvcir.2011.12.003
[20] A non-convex approximating lp norm regularization algorithm for image deconvolution, International Journal of Signal Processing, Image Processing and Pattern Recognition, 9, 177-190, 2016 · doi:10.14257/ijsip.2016.9.6.16
[21] Lp-norm-based successive denoising approach for hyperspectral images, Remote Sensing Letters, 14, 334-345, 2023 · doi:10.1080/2150704X.2023.2195567
[22] Regularized constrained total least squares image restoration, IEEE Transactions on Image Processing, 4, 1096-1108, 1995 · doi:10.1109/83.403444
[23] J. Pan, Z. Hu, Z. Su and M.-H. Yang, Deblurring text images via l0-regularized intensity and gradient prior, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (2014), 2901-2908.
[24] L0-regularized intensity and gradient prior for deblurring text images and beyond, IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 342-355, 2016 · doi:10.1109/TPAMI.2016.2551244
[25] Kernel estimation from salient structure for robust motion deblurring, Signal Processing: Image Communication, 28, 1156-1170, 2013 · doi:10.1016/j.image.2013.05.001
[26] J. Pan, D. Sun, H. Pfister and M.-H. Yang, Blind image deblurring using dark channel prior, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (2016), 1628-1636.
[27] D. Perrone and P. Favaro, Total variation blind deconvolution: The devil is in the details, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (2014), 2909-2916.
[28] Shared prior learning of energy-based models for image reconstruction, SIAM Journal on Imaging Sciences, 14, 1706-1748, 2021 · Zbl 1538.65158 · doi:10.1137/20M1380016
[29] Blind deconvolution using a regularized structured total least norm algorithm, SIAM Journal on Matrix Analysis and Applications, 24, 1018-1037, 2003 · Zbl 1036.65036 · doi:10.1137/S0895479801395446
[30] Image deblurring via enhanced low-rank prior, IEEE Transactions on Image Processing, 25, 3426-3437, 2016 · Zbl 1408.94557 · doi:10.1109/TIP.2016.2571062
[31] Photon-limited blind deconvolution using unsupervised iterative kernel estimation, IEEE Transactions on Computational Imaging, 8, 1051-1062, 2022 · doi:10.1109/TCI.2022.3226947
[32] High-quality motion deblurring from a single image, Acm Transactions on Graphics (tog), 27, 1-10, 2008 · doi:10.1145/1360612.1360672
[33] Non-convex nonlocal adaptive tight frame image deblurring, IET Image Processing, 16, 1908-1923, 2022 · doi:10.1049/ipr2.12456
[34] Spatial-scale-regularized blur kernel estimation for blind image deblurring, Signal Processing: Image Communication, 68, 138-154, 2018 · doi:10.1016/j.image.2018.07.010
[35] X. Tang, X. Zhao, J. Liu, J. Wang, Y. Miao and T. Zeng, Uncertainty-aware unsupervised image deblurring with deep residual prior, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, (2023), 9883-9892.
[36] A simple local minimal intensity prior and an improved algorithm for blind image deblurring, IEEE Transactions on Circuits and Systems for Video Technology, 31, 2923-2937, 2021 · doi:10.1109/TCSVT.2020.3034137
[37] Deblurring shaken and partially saturated images, International Journal of Computer Vision, 110, 185-201, 2014 · doi:10.1007/s11263-014-0727-3
[38] Incorporating the maximum entropy on the mean framework with kernel error for robust non-blind image deblurring, Communications in Computational Physics, 31, 893-912, 2022 · Zbl 1482.65087 · doi:10.4208/cicp.OA-2021-0136
[39] Two-stage image segmentation based on nonconvex \(l2-l\) p approximation and thresholding, Applied Mathematics and Computation, 403, 126168, 2021 · Zbl 1510.94030 · doi:10.1016/j.amc.2021.126168
[40] L. Xu and J. Jia, Two-phase kernel estimation for robust motion deblurring, European Conference on Computer Vision, Springer, (2010), 157-170.
[41] L. Xu, S. Zheng and J. Jia, Unnatural l0 sparse representation for natural image deblurring, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (2013), 1107-1114.
[42] Blind image deblurring using group sparse representation, Digital Signal Processing, 102, 102736, 2020 · doi:10.1016/j.dsp.2020.102736
[43] Y. Yan, W. Ren, Y. Guo, R. Wang and X. Cao, Image deblurring via extreme channels prior, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (2017), 4003-4011.
[44] M. Zhang, Y. Fang, G. Ni and T. Zeng, Pixel screening based intermediate correction for blind deblurring, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, (2022), 5892-5900.
[45] Blind remote sensing image deblurring using local binary pattern prior, Remote Sensing, 14, 1276, 2022 · doi:10.3390/rs14051276
[46] X.-L. Zhao, W. Wang, T.-Y. Zeng, T.-Z. Huang and M. K. Ng, Total variation structured total least squares method for image restoration, SIAM Journal on Scientific Computing, 35 (2013), B1304-B1320. · Zbl 1287.65014
[47] W. Zuo, D. Meng, L. Zhang, X. Feng and D. Zhang, A generalized iterated shrinkage algorithm for non-convex sparse coding, Proceedings of the IEEE International Conference on Computer Vision, (2013), 217-224.
[48] Learning iteration-wise generalized shrinkage-thresholding operators for blind deconvolution, IEEE Transactions on Image Processing, 25, 1751-1764, 2016 · Zbl 1408.94856
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.