IEEE Transactions on Vehicular Technology

A Hierarchical Game for Physical Layer Security Aware Cooperative Communications with Dynamic Interchangeable Relaying and Jamming

Denghui Liu, Ruoyang Chen, Changyan Yi, Tong Zhang, Xiaolong Li, Juan Li, Ran Wang, Kun Zhu

Published Sep 11, 2024• 35 citations

Abstract

This paper investigates a dynamic game framework for physical layer security (PLS)-aware wireless network with third-party collaborative users (TCUs). In the considered system, legitimate users (LUs) aim to transmit secret signals under the threat of eavesdroppers (EVs). There exists TCUs rationally selecting to form coalitions with LUs or EVs, strategically enhancing the secrecy transmission rates for LUs or increasing eavesdropping rates for EVs to obtain rewards. Due to the unpredictability of wireless systems (e.g., time-varying channel conditions, user mobility), coalitions among the three parties may be unfixed and dynamically changing. A hierarchical game integrating a matching subgame with a coalition formation subgame is formulated to model the interactions among LUs, EVs, and TCUs. In order to derive the optimal long-term strategies while solving the equilibrium of the hierarchical game, we first introduce a constrained Gale-Shapley algorithm which determines the optimal power, mode, and channel selections of TCUs with the known coalition partition, and then propose a coalition selection algorithm for reaching the stability of coalition partitions. Moreover, we develop a deep reinforcement learning (DRL)-based solution to concatenate the aforementioned algorithms, producing the long-term optimal strategies for LUs, EVs and TCUs over multiple time slots. Simulations evaluate the performance of the proposed scheme, and demonstrate its superiority over counterparts.

DOI: 10.1109/tvt.2024.3457777

Related papers

A Three-Party Hierarchical Game for Physical Layer Security Aware Wireless Communications With Dynamic Trilateral Coalitions

Ruoyang Chen, Changyan Yi, Kun Zhu +3 more

In this paper, a novel hierarchical game framework for physical layer security (PLS) aware wireless communications with dynamic trilateral coalitions is studied. In the considered system, legitimate users (LUs) aim to transmit secret data to associated base stations (BSs) via uplink communications under the threat of eavesdroppers (EVs), while there also exists jammers (JAs) which may choose to form coalitions with either LUs for increasing their secrecy transmission rates or EVs for increasing their eavesdropping rates in exchange for potential rewards. Different from the existing work, we explore such complicated while dynamic coalition relationships under uncertainties of wireless systems (e.g., time-varying channel conditions), and formulate a hierarchical game integrated with a dynamic trilateral coalition formation game to model strategic interactions among LUs, JAs and EVs. Particularly, we first analyze stability conditions of the trilateral coalitions and propose a hedonic coalition selection and formation algorithm for reaching the stable coalition partition in each time slot. On top of this, we propose a deep reinforcement learning (DRL) based solution, which can achieve the equilibrium with long-term performance guarantees for the hierarchical game running over multiple time slots with dynamic evolutions. Simulations evaluate the proposed solution and show its superiority over counterparts.

IEEE Transactions on Wireless CommunicationsOct 16, 202368 citations

A DRL-Based Hierarchical Game for Physical Layer Security with Dynamic Trilateral Coalitions

Ruoyang Chen, Changyan Yi, Kun Zhu +2 more

In this paper, a novel hierarchical game framework for physical layer security (PLS) with dynamic trilateral coalitions is studied. In the considered system, legitimate users (LUs) aim to transmit secret data to associated base stations (BSs) via uplink communications under the threat of eavesdroppers (EVs), while there also exists jammers (JAs) which may choose to form coalitions with either LUs for increasing their secrecy transmission rates or EVs for increasing their eavesdropping rates in exchange for potential rewards. Different from the existing work, we explore such complicated while dynamic coalition relationships under the uncertainties of wireless systems (e.g., time-varying channel conditions), and formulate a hierarchical game integrated with a dynamic trilateral coalition formation game to model the strategic interactions among all three parties, i.e., LUs, JAs and EVs, in PLS. Particularly, we first analyze stability conditions of the trilateral coalitions. On top of this, we further propose a deep reinforcement learning (DRL) based approach for reaching the equilibrium with long-term performance guarantees for the hierarchical game. Simulations evaluate the proposed solution and show its superiority over counterparts.

International Conference on CommunicationsMay 28, 202321 citations

A Repeated Coalition Formation Game for Physical Layer Security Aware Wireless Communications With Third-Party Intelligent Reflecting Surfaces

Haipeng Zhou, Ruoyang Chen, Changyan Yi +4 more

In this paper, we introduce third-party intelligent reflecting surfaces (TIRSs) into the physical layer security aware wireless communication system, where a central legitimate transmitter is designed to transmit secret signals to a group of legitimate receivers in the presence of the threat from an active eavesdropper (EV). Due to the channel reshaping ability of TIRSs, they are able to not only help legitimate pairs (LPs) enhance the secure transmission rate but also assist EV in improving the eavesdropping performance. Furthermore, with the potential selfishness, TIRSs may dynamically choose to ally with LPs or EV in exchange for potential benefits (e.g., payoffs). This leads to complex dynamic ally-adversary relationships among LPs, EV, and TIRSs under unpredictable wireless channel conditions. To address this issue, we formulate a repeated coalition formation game (RCFG) with dynamic decision-making to model the long-term strategic interactions among LPs, EV, and TIRSs. In particular, we theoretically analyze the existence of Nash equilibrium in the formulated RCFG, and then propose a switch operations-based coalition selection along with a deep reinforcement learning (DRL)-based approach for obtaining such an equilibrium. Simulations examine the feasibility of the proposed approach and show its superiority over counterparts.

IEEE Transactions on Wireless CommunicationsApr 24, 202527 citations

Secure Cooperative Communications in 6G Networks: A Constrained Hierarchical Reinforcement Learning Framework with Hybrid Action Space

Xiaosi Tian, Zulin Wang, Yuanhan Ni

With the rapid evolution toward 6G networks, ensuring robust physical layer security (PLS) in highly dynamic and heterogeneous wireless environments has become a key challenge. Traditional security methods often struggle to adapt to time-varying channels, especially in the absence of perfect channel state information. Furthermore, the dynamic nature of node selection and power allocation in heterogeneous networks creates a complex hybrid action space operating across multiple timescales, significantly complicating the design of efficient and adaptive security strategies. To address this, this paper proposes a novel constrained hierarchical reinforcement learning (CHRL) framework for secure cooperative communications in next-generation wireless systems. The framework is designed to optimize secrecy performance within a hybrid action space comprising both discrete node selection and continuous power allocation, operating at different timescales. By hierarchically decoupling the joint optimization problem, the upper layer performs risk-aware node selection to maximize long-term secrecy capacity (SC) while guaranteeing a stable and secure link. At the lower layer, we develop a constrained MiniMax Multi-objective Deep Deterministic Policy Gradient (M3DDPG) algorithm that optimizes power allocation considering worst-case conditions. Lagrange multipliers are integrated to enforce a strictly positive SC constraint throughout transmission, effectively preventing security outages. Simulation results under time-varying Rayleigh fading channels demonstrate that the proposed CHRL framework outperforms existing HRL methods, achieving up to 17% improvement in SC while strictly maintaining security constraints. These results validate the effectiveness of the proposed approach for enhancing PLS in next-generation cooperative wireless networks.

EntropyApr 4, 20261 citation

Secure transmission in cooperative wireless networks: A two-level coalitional game approach

Feiwen Li, Shunliang Zhang

In this paper, we propose a novel hybrid beamforming and jamming strategy to secure the transmission in wireless cooperative networks. It enhances the secrecy capacity by cooperatively using distributed multi-antenna techniques to maximize the secrecy capacity, as well as nullify the information leakage at the eavesdropper and the interference at the legitimate users. The optimum intermediate relays and jammers selection is modeled as a two-level coalitional game problem. A distributed coalition formation algorithm based on merge-and-split rules is devised to solve the problem. The approach enables the intermediate nodes self-organize into independent disjoint coalitions and requires much less computational complexity. Then the optimal relaying and jamming coalitions are selected to secure transmission in a cooperative way. Extensive simulations demonstrate that the proposed coalition formation method can improve the secrecy capacity significantly compared with the existing non-collaborate relaying and jamming nodes selection scheme and random selection approach.

Jun 1, 20211 citation

Enhancing Physical Layer Security Through Cooperation in Wireless Networks

Jovana Božović, Enis Kočan

Physical Layer Security (PLS) provides a promising complementary approach to cryptographic methods for protecting wireless communications from eavesdropping. This paper investigates secrecy enhancement through cooperative relaying and jamming in a wireless network with two legitimate users, one eavesdropper, and five potential relay nodes operating in amplify-and-forward mode. Three relay–jammer selection strategies are considered: random relay and jammer selection, best-SNR (signal-to-noise ratio) relay with random jammer selection, and best-SNR relay with a jammer chosen based on the strongest channel toward the eavesdropper. The secrecy performance of these strategies are evaluated in terms of secrecy rate and secrecy outage probability. The results demonstrate that intelligent relay and jammer selection can significantly improve PLS compared to random selection, highlighting the benefits of cooperation in secure wireless systems.

Feb 24, 20260 citations