Cooperative constrained parameter estimation by ADMM-RLS. (English) Zbl 1448.93290
Summary: With recent advances in cloud computing, resources with customizable computational power and memory can be exploited to store and analyze data collected from large sets of devices. Although one can exploit the connection to the cloud to perform all the desired tasks on the cloud itself, in many applications it is also desirable to retrieve and process information locally. In this paper, we present a collection of cloud-aided consensus-based recursive least-squares (RLS) estimators. The approaches are tailored to handle linear and nonlinear consensus constraints and limitations on parameter ranges. All the methods are designed so that raw measurements collected at the device level are processed by the device itself, requiring minimal changes to (possibly pre-existing) RLS estimators. The local estimates are then recursively refined and fused on the cloud to reach consensus among the devices.
MSC:
| 93D50 | Consensus |
| 93E24 | Least squares and related methods for stochastic control systems |
| 93C83 | Control/observation systems involving computers (process control, etc.) |
| 93B70 | Networked control |
| 68M11 | Internet topics |
Keywords:
estimation algorithms; collaborative systems; cloud computing; iterative methods; alternating direction method of multipliers; recursive least squaresSoftware:
CIRFEReferences:
| [1] | Arablouei, R.; Doǧaņay, K.; Werner, S.; Huang, Y. F., Adaptive distributed estimation based on recursive least-squares and partial diffusion, IEEE Transactions on Signal Processing, 62, 14, 3510-3522 (2014) · Zbl 1394.94047 |
| [2] | B., Lindoff; J., Holst, Convergence analysis of the RLS identification algorithm with exponential forgetting in stationary ARX-structures, International Journal of Adaptive Control and Signal Processing, 13, 1, 1-22 (1999) · Zbl 0923.93055 |
| [3] | Benning, M.; Knoll, F.; Schönlieb, C.; Valkonen, T., Preconditioned ADMM with nonlinear operator constraint (2015) |
| [4] | Bittanti, S.; Bolzern, P.; Campi, M., Recursive least-squares identification algorithms with incomplete excitation: convergence analysis and application to adaptive control, IEEE Transactions on Automatic Control, 35, 12, 1371-1373 (1990) · Zbl 0795.93105 |
| [5] | Boem, F.; Ferrari, R. M. G.; Keliris, C.; Parisini, T.; Polycarpou, M. M., A distributed networked approach for fault detection of large-scale systems, IEEE Transactions on Automatic Control, 62, 1, 18-33 (2017) · Zbl 1359.93269 |
| [6] | Boyd, S.; Parikh, N.; Chu, E.; Peleato, B.; Eckstein, J., Distributed optimization and statistical learning via the alternating direction method of multipliers, Foundations and Trends in Machine Learning, 3, 1, 1-122 (2011) · Zbl 1229.90122 |
| [7] | Breschi, V., Kolmanovsky, I., & Bemporad, A. (2018). Cloud-aided collaborative estimation by ADMM-RLS algorithms for connected vehicle prognostics. In 2018 Annual American control conference (pp. 2727-2732). |
| [8] | Cattivelli, F. S.; Lopes, C. G.; Sayed, A. H., Diffusion recursive least-squares for distributed estimation over adaptive networks, IEEE Transactions on Signal Processing, 56, 5, 1865-1877 (2008) · Zbl 1390.94115 |
| [9] | Cattivelli, F. S.; Sayed, A. H., Diffusion LMS strategies for distributed estimation, IEEE Transactions on Signal Processing, 58, 3, 1035-1048 (2010) · Zbl 1392.94123 |
| [10] | Forero, P. A.; Cano, A.; Giannakis, G. B., Consensus-based distributed support vector machines, Journal of Machine Learning Research (JMLR), 11, 1663-1707 (2010) · Zbl 1242.68222 |
| [11] | Howell, M. N., Whaite, J. P., Amatyakul, P., Chin, Y. K., Salman, M. A., & Yen, C. H., et al. (2010). Brake pad prognosis system. US Patent 7,694,555. https://www.google.com/patents/US7694555. |
| [12] | Kar, S.; Moura, J. M.F., Consensus + innovations distributed inference over networks: cooperation and sensing in networked systems, IEEE Signal Processing Magazine, 30, 3, 99-109 (2013) |
| [13] | Kidambi, N.; Harne, R. L.; Fujii, Y.; Pietron, G. M.; Wang, K. W., Methods in vehicle mass and road grade estimation, SAE International Journal of Passenger Cars-Mechanical Systems, 7, 2014-01-0111, 981-991 (2014) |
| [14] | Li, Z.; Kolmanovsky, I.; Atkins, E. M.; Lu, J.; Filev, D. P.; Bai, Y., Road disturbance estimation and cloud-aided comfort-based route planning, IEEE Transactions on Cybernetics, PP, 99, 1-13 (2017) |
| [15] | Li, Z.; Kolmanovsky, I.; Atkins, E.; Lu, J.; Filev, D. P.; Michelini, J., Road risk modeling and cloud-aided safety-based route planning, IEEE Transactions on Cybernetics, 46, 11, 2473-2483 (2016) |
| [16] | Ljung, L., System identification: theory for the user (1999), Prentice-Hall Englewood Cliffs: Prentice-Hall Englewood Cliffs NJ |
| [17] | Lopes, C. G.; Sayed, A. H., Incremental adaptive strategies over distributed networks, IEEE Transactions on Signal Processing, 55, 8, 4064-4077 (2007) · Zbl 1390.68096 |
| [18] | Mateos, G.; Schizas, I. D.; Giannakis, G. B., Distributed recursive least-squares for consensus-based in-network adaptive estimation, IEEE Transactions on Signal Processing, 57, 11, 4583-4588 (2009) · Zbl 1392.94332 |
| [19] | Mell, P. M.; Grance, T., SP 800-145. The NIST definition of cloud computingTechnical Report (2011), National Institute of Standards & Technology: National Institute of Standards & Technology Gaithersburg, MD, United States |
| [20] | Nassif, R.; Vlaski, S.; Sayed, A. H., Adaptation and learning over networks under subspace constraints - Part I: Stability analysis (2019) |
| [21] | Olfati-Saber, R. (2007). Distributed Kalman filtering for sensor networks. In 2007 46th IEEE conference on decision and control (pp. 5492-5498). Dec 2007. |
| [22] | Ozatay, E.; Onori, S.; Wollaeger, J.; Ozguner, U.; Rizzoni, G.; Filev, D. P., Cloud-based velocity profile optimization for everyday driving: A dynamic-programming-based solution, IEEE Transactions on Intelligent Transportation Systems, 15, 6, 2491-2505 (2014) |
| [23] | Rajamani, R., Vehicle dynamics and control (2012), Springer Science · Zbl 1268.70002 |
| [24] | Ram, S. S., Nedić, A., & Veeravalli, V. V. (2007). Stochastic incremental gradient descent for estimation in sensor networks. In 2007 conference record of the forty-first asilomar conference on signals, systems and computers (pp. 582-586). Nov 2007. |
| [25] | Sahu, A. K.; Jakovetić, D.; Kar, S., \( \mathcal{CIRFE} \): A distributed random fields estimator, IEEE Transactions on Signal Processing, 66, 18, 4980-4995 (2018) · Zbl 1414.62187 |
| [26] | Sahu, A. K.; Kar, S.; Moura, J. M.F.; Poor, H. V., Distributed constrained recursive nonlinear least-squares estimation: Algorithms and asymptotics, IEEE Transactions on Signal and Information Processing over Networks, 2, 4, 426-441 (2016) |
| [27] | Sayed, A. H., & Lopes, C. G. (2006). Distributed recursive least-squares strategies over adaptive networks. In 2006 fortieth asilomar conference on signals, systems and computers (pp. 233-237). Oct 2006. |
| [28] | Schizas, I. D., Mateos, G., & Giannakis, G. B. (2007). Consensus-based distributed recursive least-squares estimation using ad hoc wireless sensor networks. In 2007 conference record of the forty-first asilomar conference on signals, systems and computers (pp. 386-390). Nov 2007. |
| [29] | Schizas, I. D.; Mateos, G.; Giannakis, G. B., Distributed LMS for consensus-based in-network adaptive processing, IEEE Transactions on Signal Processing, 57, 6, 2365-2382 (2009) · Zbl 1391.94387 |
| [30] | Taheri, E., Gusikhin, O., & Kolmanovsky, I. (2016). Failure prognostics for in-tank fuel pumps of the returnless fuel systems. In Dynamic systems and control conference. Oct 2016. |
| [31] | Vahidi, A.; Eskandarian, A., Research advances in intelligent collision avoidance and adaptive cruise control, IEEE Transactions on Intelligent Transportation Systems, 4, 3, 143-153 (2003) |
| [32] | Vahidi, A.; Stefanopoulou, A.; Peng, H., Recursive least squares with forgetting for online estimation of vehicle mass and road grade: theory and experiments, Vehicle System Dynamics, 43, 1, 31-55 (2005) |
| [33] | Valkonen, T., A primal-dual hybrid gradient method for nonlinear operators with applications to MRI, Inverse Problems, 30, 5, 1-45 (2014) · Zbl 1310.47081 |
| [34] | Wei, E., & Ozdaglar, A. (2012). Distributed alternating direction method of multipliers. In 2012 IEEE 51st IEEE conference on decision and control (pp. 5445-5450). Dec 2012. |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
