Differential graphical games of multiagent systems with nonzero leader’s control input and external disturbances. (English) Zbl 07885606
Summary: In this article, we investigate the problem of differential graphical games for multiagent systems (MASs) with external disturbances. In particular, the system considered in this article allows the leader to have an unknown bounded control input, and the communication topology between agents is allowed to be a weakly restricted structure with only containing a directed spanning tree. We propose a novel dynamic sliding mode control strategy to dispose the presence of leader’s nonzero control input and external disturbances. Furthermore, a nominal controller based on the worst-case control strategies of neighbors is designed to provide a distributed solution for differential graphics games of MASs. Finally, our algorithms are applied to solve multiple unmanned surface vessels games. Simulation studies are provided to test the effectiveness of the proposed algorithms.
© 2024 John Wiley & Sons Ltd.
© 2024 John Wiley & Sons Ltd.
MSC:
| 93A16 | Multi-agent systems |
| 91A23 | Differential games (aspects of game theory) |
| 91A43 | Games involving graphs |
| 91A80 | Applications of game theory |
| 93B12 | Variable structure systems |
Keywords:
differential graphical games; distributed control; multiagent systems (MASs); sliding mode control; weakly restricted structureReferences:
| [1] | XiaoS, GeX, HanQ, ZhangY. Dynamic event‐triggered platooning control of automated vehicles under random communication topologies and various spacing policies. IEEE Trans Cybern. 2022;52(11):11477‐11490. |
| [2] | WangJ, WangJ, HanQ. Receding‐horizon trajectory planning for under‐actuated autonomous vehicles based on collaborative neurodynamic optimization. IEEE/CAA J Autom Sin. 2022;9(11):1909‐1923. |
| [3] | LvM, PengZ, WangD, HanQ‐L. Event‐triggered cooperative path following of autonomous surface vehicles over wireless network with experiment results. IEEE Trans Ind Electron. 2022;52(11):12003‐12015. |
| [4] | JiangY, PengZ, WangD, YinY, HanQ. Cooperative target enclosing of ring‐networked under‐actuated autonomous surface vehicles based on data‐driven fuzzy predictors and extended state observers. IEEE Trans Fuzzy Syst. 2022;30(7):2515‐2528. |
| [5] | JiangZ, CaoX, HuangX, LiH, CeccarelliM. Progress and development trend of space intelligent robot technology. Space Sci Technol. 2022;2022:9832053. |
| [6] | WuX, XiaoB, WuC, GuoY. Centroidal voronoi tessellation and model predictive control-based macro‐micro trajectory optimization of microsatellite swarm. Space Sci Technol. 2022;2022:9802195. |
| [7] | NingB, HanQ, DingL. Distributed secondary control of AC microgrids with external disturbances and directed communication topologies: a full‐order sliding‐mode approach. IEEE/CAA J Autom Sin. 2021;8(3):554‐564. |
| [8] | ChenD, ChenK, LiZ, et al. PowerNet: multi‐agent deep reinforcement learning for scalable powergrid control. IEEE Trans Power Syst. 2022;37(2):1007‐1017. |
| [9] | TangY, ZhuK. Optimal consensus for uncertain high‐order multi‐agent systems by output feedback. Int J Robust Nonlinear Control. 2021;32(4):2084‐2099. · Zbl 07769344 |
| [10] | HuangG, ZhangZ, YanW. Distributed control of discrete‐time linear multi‐agent systems with optimal energy performance. Front Control Eng. 2022;2:797362. |
| [11] | ZhaoY, ZhouY, ZhongZ, WuS, WenG, YuX. Distributed optimal cooperation for multiple high‐order nonlinear systems with Lipschitz‐type gradients: static and adaptive state‐dependent designs. IEEE Trans Syst Man Cybern Syst. 2022;52(9):5378‐5388. |
| [12] | ZhangJ, LiuL, JiH. Optimal output consensus of second‐order uncertain nonlinear systems on weight‐unbalanced directed networks. Int J Robust Nonlinear Control. 2022;32(8):4878‐4898. · Zbl 1528.93215 |
| [13] | LiuK, ZhengX, LinY, HanL, XiaY. Design of optimal strategies for the pursuit‐evasion problem based on differential game. Acta Autom Sin. 2021;47(8):1840‐1854. · Zbl 1488.91019 |
| [14] | SuH, ZhangH, JiangH, WeiY. Decentralized event‐triggered adaptive control of discrete‐time nonzero‐sum games over wireless sensor‐actuator networks with input constraints. IEEE Trans Neural Netw Learn Syst. 2020;31(10):4254‐4266. |
| [15] | FotiadisF, VamvoudakisKG. Recursive reasoning with reduced complexity and intermittency for nonequilibrium learning in stochastic games. IEEE Trans Neural Netw Learn Syst. 2022;34:8467‐8481. doi:10.1109/TNNLS.2022.3151250 |
| [16] | ZhangQ, ZhaoD. Data‐based reinforcement learning for nonzero‐sum games with unknown drift dynamics. IEEE Trans Cybern. 2019;49(8):2874‐2885. |
| [17] | SolisCU, ClempenerJB. Ship differential game approach for multiple players: Stackelberg security games. Optim Control Appl Methods. 2019;41(1):312‐326. · Zbl 1452.91039 |
| [18] | LuJ, WeiQ, WangZ, ZhouT, WangF. Event‐triggered optimal control for discrete‐time multi‐player non‐zero‐sum games using parallel control. Inform Sci. 2022;584:519‐535. · Zbl 1532.93238 |
| [19] | XuY, YangH, JiangB, PolycarpouMM. Multiplayer pursuit‐evasion differential games with malicious pursuers. IEEE Trans Automat Contr. 2022;67(9):4939‐4946. · Zbl 1537.91045 |
| [20] | KartalY, SubbaraoK, DoganA, LewisFL. Optimal game theoretic solution of the pursuit‐evasion intercept problem using on‐policy reinforcement learning. Int J Robust Nonlinear Control. 2021;31(6):7886‐7903. · Zbl 1527.91026 |
| [21] | VamvoudakisKG, LewisFL, HudasGR. Multi‐agent differential graphical games: online adaptive learning solution for synchronization with optimality. Automatica. 2012;48(8):1598‐1611. · Zbl 1267.93190 |
| [22] | KamalapurkarR, KlotzJR, WaltersP, DixonWE. Model‐based reinforcement learning in differential graphical games. IEEE Trans Control Netw Syst. 2018;5(1):423‐433. · Zbl 1507.91026 |
| [23] | ZhangH, ZhangJ, YangG, LuoY. Leader‐based optimal coordination control for the consensus problem of multiagent differential games via fuzzy adaptive dynamic programming. IEEE Trans Fuzzy Syst. 2015;23(1):152‐163. |
| [24] | JiaoQ, ModaresH, XuS, LewisFL, VamvoudakisKG. Multi‐agent zero‐sum differential graphical games for disturbance rejection in distributed control. Automatica. 2016;69:24‐34. · Zbl 1338.93023 |
| [25] | LopezVG, LewisFL, WanY, LiuM, HewerG, EstabridisK. Stability and robustness analysis of minmax solutions for differential graphical games. Automatica. 2020;121:109177. · Zbl 1448.91048 |
| [26] | LiJ, ModaresH, ChaiT, LewisFL, XieLOff‐policy reinforcement learning for synchronization in multiagent graphical games. IEEE Trans Neural Netw Learn Syst. 2017;28(10):2434‐2445. |
| [27] | LiuM, WanY, LopezVG, LewisFL, HewerG, EstabridisK. Differential graphical game with distributed global nash solution. IEEE Trans Control Netw Syst. 2021;8(3):1371‐1382. |
| [28] | ZhangH, LiZ, QuZ, LewisFL. On constructing Lyapunov functions for multi‐agent systems. Automatica. 2015;58:39‐42. · Zbl 1330.93182 |
| [29] | LiY, LiZ, DuanZ, FengG. Novel distributed robust adaptive consensus protocols for linear multi‐agent systems with directed graphs and external disturbances. Int J Control. 2017;90(2):137‐147. · Zbl 1359.93022 |
| [30] | XuY, YaoZ, LuR, GhoshBK. A novel fixed‐time protocol for first‐order consensus tracking with disturbance rejection. IEEE Trans Automat Contr. 2022;67(11):6180‐6186. · Zbl 1541.93325 |
| [31] | LiJ, YuanL, ChaiT, LewisFL. Consensus of nonlinear multiagent systems with uncertainties using reinforcement learning based sliding mode control. IEEE Trans Circuits Syst I Regul Pap. 2023;70(1):424‐434. |
| [32] | PilloniA, FranceschelliM, PisanoA, UsaiE. Sliding mode‐based robustification of consensus and distributed optimization control protocols. IEEE Trans Automat Contr. 2021;66(3):1207‐1214. · Zbl 1536.93137 |
| [33] | YangJ, CaoG, ChenW, ZhangW. Finite‐time formation control of second‐order linear multi‐agent systems with relative state constraints: a barrier function sliding mode control approach. IEEE Trans Circuits Syst II Express Briefs. 2022;69(3):1253‐1256. |
| [34] | ZhangZ, ShiY, ZhangS, ZhangZ, YanW. Robust cooperative optimal sliding‐mode control for high‐order nonlinear systems: directed topologies. IEEE Trans Cybern. 2022;52(6):5535‐5547. |
| [35] | FirouzbahramiM, NobakhtiA. Cooperative fixed‐time/finite‐time distributed robust optimization of multi‐agent systems. Automatica. 2022;142:110358. · Zbl 1494.93098 |
| [36] | BhatSP, BernsteinDS. Continuous finite‐time stabilization of the translational and rotational double integrators. IEEE Trans Automat Contr. 1998;43(5):678‐682. · Zbl 0925.93821 |
| [37] | ZhangZ, YanW, LiH. Distributed optimal control for linear multiagent systems on general digraphs. IEEE Trans Automat Contr. 2021;66(1):322‐328. · Zbl 1536.93831 |
| [38] | WangY, HanQ, FeiM, PengC. Network‐based T-S fuzzy dynamic positioning controller design for unmanned marine vehicles. IEEE Trans Cybern. 2018;48(9):2750‐2763. |
| [39] | ZhangZ, ZhangS, LiH, YanW. Cooperative robust optimal control of uncertain multi‐agent systems. J Franklin Inst. 2020;357(14):9467‐9483. · Zbl 1448.93069 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
