文献类型：期刊文献

英文题名：Towards wireless time-sensitive networking: Multi-link deterministic scheduling via deep reinforcement learning

作者：Wang, Xiaolin[1,3];Zhang, Jinglong[2,3];Lu, Xuanzhao[3];Li, Fangfei[1];Chen, Cailian[2,3];Guan, Xinping[2,3]

机构：[1]East China Univ Sci & Technol, Sch Math, 130 Meilong Rd, Shanghai 200237, Peoples R China;[2]Shanghai Jiao Tong Univ, Dept Automat, 800 Dongchuan Rd, Shanghai 200240, Peoples R China;[3]Minist Educ, Key Lab Syst Control & Informat Proc, Shanghai, Peoples R China

年份：2025

卷号：261

外文期刊名：COMPUTER NETWORKS

收录：;EI(收录号：20251017995334);WOS:【SCI-EXPANDED(收录号:WOS:001440506900001)】；

基金：This work was partially funded by the National Natural Science Foundation of China under Grants 62303185 and 62173142, as well as the Shanghai Sailing Program, China under Grant 23YF1409500.

语种：英文

外文关键词：Wireless time-sensitive networking; Time-sensitive flow scheduling; Multi-link operation; Deep reinforcement learning

摘要：Wireless time-sensitive networking (WTSN) has gained significant popularity because of its potential flexibility, scalability and bounded latency. Nevertheless, fewer studies have investigated specific scheduling strategies under unreliable wireless media. Besides, the lack of interoperability with current industrial networks and the ability to handle complex wireless network scheduling pose great challenges in WTSN design. To handle these challenges, we first propose a WiFi-based WTSN architecture. The wireless time-aware shaper (WTAS) and deep reinforcement learning based flow scheduling strategy are studied as the core mechanism of the proposed architecture. Specifically, the functionality of WTSN is designed through wireless gate control, control-aware retransmission, deterministic time slot design and delay analysis, and dynamic queue priority mapping. Then, we formulate a multi-link time slot scheduling problem to achieve load balance while considering transmission and control constraints. The soft actor-critic-based flow scheduling optimization (SAC-FSO) algorithm with elaborately designed decision variables mapping and dynamic constraint detection is proposed to efficiently achieve the wireless deterministic transmission. The performance evaluation demonstrates the effectiveness of the proposed WTSN architecture and WTAS modules. Comparison results with other algorithms demonstrate that the SAC-FSO algorithm is more efficient and scalable.