D3QN-Based Joint Power and Reflection Optimization for Energy-Efficient Anti-Jamming against Dynamic Jamming Attacks in Backscatter-Enabled 6G IoT Networks
DOI:
https://doi.org/10.54654/isj.v2i28.6393Keywords:
6G IoT, Anti-jamming, Backscatter communication, D3QN, Energy efficiencyTóm tắt
This paper develops a Dueling Double Deep Q-Network (D3QN) framework for joint transmit-power and reflection-coefficient control in backscatter-enabled 6G Internet-of-Things networks subject to random, reactive, and time-varying jamming. The problem is formulated as a jammer-aware Markov decision process with a 20-action power–reflection space and a normalized reward that balances spectral efficiency, transmit-power consumption, and low-SINR outage. The proposed method is evaluated against DQN, DDQN, PPO, TD3, SAC, random selection, and fixed control over five independent seeds with 95% confidence intervals. Under random jamming at Pj = 30 dBm, D3QN improves spectral efficiency by 19.83% and reduces outage probability by 6.99% relative to DQN. Under a common dynamic-jamming trace, it provides a 2.12% spectral-efficiency gain while using an average transmit power of 0.427 W, with the maximum-power action selected in only 17.6% of the slots. The 20-action design also improves spectral efficiency by 4.21% over a 9-action grid while using 59.18% fewer outputs than a 49-action grid. Under strong reactive jamming, D3QN improves energy efficiency over DQN by 2.54%, but exhibits lower spectral efficiency and slightly higher outage, revealing a rate - energy - reliability trade -off. Overall, the proposed framework offers a practical balance among communication performance, energy use, and action-space complexity
Downloads
References
D. C. Nguyen, M. Ding, P. N. Pathirana,
A. Seneviratne, J. Li, D. Niyato, O. Dobre, and
H. V. Poor, “6G Internet of Things: A comprehensive
survey,” IEEE Internet of Things Journal, vol. 9, no. 1,
pp. 359–383, 2022.
F. Guo, F. R. Yu, H. Zhang, X. Li, H. Ji, and
V. C. M. Leung, “Enabling massive IoT toward 6G:
A comprehensive survey,” IEEE Internet of Things
Journal, vol. 8, no. 15, pp. 11 891–11 915, 2021.
M. Vaezi, A. Azari, S. R. Khosravirad,
M. Shirvanimoghaddam, M. M. Azari, D. Chasaki, and
P. Popovski, “Cellular, wide-area, and non-terrestrial
IoT: A survey on 5G advances and the road toward
G,” IEEE Communications Surveys & Tutorials,
vol. 24, no. 2, pp. 1117–1174, 2022.
L. H. Hiep and H. H. Ngo, “Adaptive multi-mode
DRL framework for intelligent RIS-assisted antijamming in 6G wireless networks,” Journal of
Communications Software and Systems, vol. 22, no.
, pp. 295–307, 2026.
S. Basharat, S. A. Hassan, H. Pervaiz, A. Mahmood,
Z. Ding, and M. Gidlund, “Exploring reconfigurable
intelligent surfaces for 6G: State-of-the-art and the
road ahead,” IET Communications, vol. 16, no. 12, pp.
–1372, 2022.
T. Jiang, Y. Zhang, W. Ma, M. Peng, Y. Peng,
M. Feng, and G. Liu, “Backscatter communication
meets practical battery-free Internet of Things: A
survey and outlook,” IEEE Communications Surveys
& Tutorials, vol. 25, no. 3, pp. 2021–2051, 2023.
W. Wu, X. Wang, A. Hawbani, L. Yuan, and W. Gong,
“A survey on ambient backscatter communications:
Principles, systems, applications, and challenges,”
Computer Networks, vol. 216, p. 109235, 2022.
L. H. Hiep and H. H. Ngo, “AI-driven jamming
detection and DRL-based anti-jamming for ambient
backscatter communications in 6G networks,”
VNU Journal of Science: Computer Science and
Communication Engineering, vol. 42, no. 2, pp.
–114, 2026.
U. S. Toro, K. Wu, and V. C. M. Leung,
“Backscatter wireless communications and sensing in
green Internet of Things,” IEEE Transactions on Green
Communications and Networking, vol. 6, no. 1, pp. 37–
, 2022.
L. H. Hiep, “Probabilistic analysis of anti-jamming
frequency hopping in backscatter IoT networks,”
Journal of Science & Technology on Information and
Communications, vol. 11, no. 1, pp. 19–33, 2026.
Y.-C. Liang, Q. Zhang, J. Wang, R. Long, H. Zhou,
and G. Yang, “Backscatter communication assisted by
reconfigurable intelligent surfaces,” Proceedings of the
IEEE, vol. 110, no. 9, pp. 1339–1357, 2022.
M. Sayem, M. Z. Chowdhury, S. R. Hasan, and
Y. M. Jang, “Reconfigurable intelligent surface assisted
BackCom: An overview, analysis, and future research
directions,” ICT Express, vol. 9, no. 5, pp. 927–940,
L. H. Hiep and H. H. Ngo, “RIS-assisted anti-jamming
backscatter communication using deep reinforcement
learning,” Journal of Science and Technology on
Information Security, vol. 1, no. 27, pp. 70–86, 2026.
M. Hua, Q. Wu, L. Yang, R. Schober, and H. V.
Poor, “A novel wireless communication paradigm for
intelligent reflecting surface based symbiotic radio
systems,” IEEE Transactions on Signal Processing,
vol. 70, pp. 550–565, 2022.
L. H. Hiep and L. X. Hieu, “An energy-efficient deep
reinforcement learning-based anti-jamming strategy for
next-generation wireless networks,” TNU Journal of
Science and Technology, vol. 231, no. 7, pp. 35–43,
L. H. Hiep and H. H. Ngo, “D3QN-based joint power
control and reflection adaptation for anti-jamming
ambient backscatter communications with mobile UAV
jammers,” International Journal of Robotics and
Control Systems, vol. 6, no. 5, 2026.
L. Jia, N. Qi, Z. Su, F. Chu, S. Fang, K.-K. Wong, and
C.-B. Chae, “Game theory and reinforcement learning
for anti-jamming defense in wireless communications:
Current research, challenges, and solutions,” IEEE
Communications Surveys & Tutorials, vol. 27, no. 3,
pp. 1798–1838, 2025.
L. T. H. Van, N. Q. Minh, P. V. Huong, and
N. H. Minh, “A novel approach for 1D-CNN
hyperparameter optimization in IoT attack detection
using particle swarm optimization,” Journal of Science
and Technology on Information Security, vol. 1, no. 24,
pp. 53–71, 2025.
H. Pirayesh and H. Zeng, “Jamming attacks and
anti-jamming strategies in wireless networks: A
comprehensive survey,” IEEE Communications Surveys
& Tutorials, vol. 24, no. 2, pp. 767–809, 2022.
W. Li, J. Chen, X. Liu, X. Wang, Y. Li, D. Liu,
and Y. Xu, “Intelligent dynamic spectrum antijamming communications: A deep reinforcement
learning perspective,” IEEE Wireless Communications,
vol. 29, no. 3, pp. 60–67, 2022.
L. Jia, N. Qi, F. Chu, S. Fang, X. Wang,
S. Ma, and S. Feng, “Game-theoretic learning antijamming approaches in wireless networks,” IEEE
Communications Magazine, vol. 60, no. 5, pp. 60–66,
A. Gouissem, K. Abualsaud, E. Yaacoub, T. Khattab,
and M. Guizani, “Accelerated IoT anti-jamming:
A game theoretic power allocation strategy,” IEEE
Transactions on Wireless Communications, vol. 21,
no. 12, pp. 10 607–10 620, 2022.
L. H. Hiep, D. M. Tran, and N. N. Duong, “Adaptive
reflection control for anti-jamming backscatter
communication under dynamic interference,” Vinh
University Journal of Science, vol. 55, no. 2A, pp.
–126, 2026.
A. Pourranjbar, G. Kaddoum, A. Ferdowsi, and
W. Saad, “Reinforcement learning for deceiving
reactive jammers in wireless networks,” IEEE
Transactions on Communications, vol. 69, no. 6, pp.
–3697, 2021.
X. Li, J. Chen, X. Ling, and T. Wu, “Deep
reinforcement learning-based anti-jamming algorithm
using dual action network,” IEEE Transactions on
Wireless Communications, vol. 22, no. 7, pp. 4625–
, 2023.
N. Van Huynh, D. T. Hoang, D. N. Nguyen,
and E. Dutkiewicz, “DeepFake: Deep dueling-based
deception strategy to defeat reactive jammers,” IEEE
Transactions on Wireless Communications, vol. 20,
no. 10, pp. 6898–6914, 2021.
C. Liu, Y. Zhang, G. Niu, L. Jia, L. Xiao, and
J. Luan, “Towards reinforcement learning in UAV relay
for anti-jamming maritime communications,” Digital
Communications and Networks, vol. 9, no. 6, pp. 1477–
, 2023.
Q. Zhang, Y.-C. Liang, and H. V. Poor, “Reconfigurable
intelligent surface assisted MIMO symbiotic radio
networks,” IEEE Transactions on Communications,
vol. 69, no. 7, pp. 4832–4846, 2021.
H. Yang, Y. Ye, K. Liang, and X. Chu, “Energy
efficiency maximization for symbiotic radio networks
with multiple backscatter devices,” IEEE Open Journal
of the Communications Society, vol. 2, pp. 1431–1444,
L. Xiao, Y. Ding, J. Huang, S. Liu, Y. Tang, and H. Dai,
“UAV anti-jamming video transmissions with QoE
guarantee: A reinforcement learning-based approach,”
IEEE Transactions on Communications, vol. 69, no. 9,
pp. 5933–5947, 2021.
L. H. Hiep, V. T. Hoang, and H. H. Ngo, “RLIoT:
Reinforcement learning based network resource
optimization using IoT sensor data,” International
Journal of Computer Networks & Communications,
vol. 18, no. 4, pp. 1–16, 2026.
J. Qi, H. Zhang, X. Qi, and M. Peng, “Deep
reinforcement learning based hopping strategy for
wideband anti-jamming wireless communications,”
IEEE Transactions on Vehicular Technology, vol. 73,
no. 3, pp. 3568–3579, 2024.
Z. Lv, L. Xiao, Y. Du, G. Niu, C. Xing, and W. Xu,
“Multi-agent reinforcement learning based UAV swarm
communications against jamming,” IEEE Transactions
on Wireless Communications, vol. 22, no. 12, pp. 9063–
, 2023.
Z. Shao, H. Yang, L. Xiao, W. Su, Y. Chen,
and Z. Xiong, “Deep reinforcement learning-based
resource management for UAV-assisted mobile edge
computing against jamming,” IEEE Transactions on
Mobile Computing, vol. 23, no. 12, pp. 13 358–13 374,
A. Feriani and E. Hossain, “Single and multi-agent
deep reinforcement learning for AI-enabled wireless
networks: A tutorial,” IEEE Communications Surveys
& Tutorials, vol. 23, no. 2, pp. 1226–1252, 2021.
H. Ke, H. Wang, and H. Sun, “Deep reinforcement
learning-based power control and bandwidth allocation
policy for weighted cost minimization in wireless
networks,” Applied Intelligence, vol. 53, pp. 26 885–
906, 2023.
H. Yang, Z. Xiong, J. Zhao, D. Niyato, Q. Wu,
H. V. Poor, and M. Tornatore, “Intelligent reflecting
surface assisted anti-jamming communications: A fast
reinforcement learning approach,” IEEE Transactions
on Wireless Communications, vol. 20, no. 3, pp. 1963–
, 2021.
Y. Liu, K. Xu, X. Xia, W. Xie, N. Ma, and J. Xu, “Joint
power control and passive beamforming optimization in
RIS-assisted anti-jamming communication,” Frontiers
of Information Technology & Electronic Engineering,
vol. 24, no. 12, pp. 1791–1802, 2023.
F. Yao, B. Zhao, J. Zhao, F. Shu, Y. Wu, and X. Cheng,
“Anti-jamming technique for IRS aided JRC system
in mobile vehicular networks,” IEEE Transactions on
Intelligent Transportation Systems, vol. 25, no. 9, pp.
550–12 560, 2024.
Y. Sun, K. An, J. Luo, Y. Zhu, G. Zheng,
and S. Chatzinotas, “Outage constrained robust
beamforming optimization for multiuser IRS-assisted
anti-jamming communications with incomplete
information,” IEEE Internet of Things Journal, vol. 9,
no. 15, pp. 13 298–13 314, 2022.
F. Xu, T. Hussain, M. Ahmed, K. Ali, M. A.
Mirza, W. U. Khan, A. Ihsan, and Z. Han, “The
state of AI-empowered backscatter communications:
A comprehensive survey,” IEEE Internet of Things
Journal, vol. 10, no. 24, pp. 21 763–21 786, 2023.
D. Balasubramaniam, S. Anbalagan, K. S. Thivya,
and S. Suresh, “Advancements in IoT system
security: A reconfigurable intelligent surfaces and
backscatter communication approach,” The Journal of
Supercomputing, vol. 81, p. 183, 2025.
L. H. Hiep, M. V. Ho, and D. M. Tran, “RISassisted deep reinforcement learning for intelligent
anti-jamming communications in 6G networks,” TNU
Journal of Science and Technology, vol. 231, no. 6, pp.
–428, 2026.
Q. Zhou, Y. Niu, P. Xiang, and B. Wan, “Intelligent
anti-jamming decision algorithm for wireless
communication under limited channel state information
conditions,” Scientific Reports, vol. 15, p. 6271, 2025.
H. Ding, Y. Niu, Q. Zhou, and X. Peng, “A novel
intelligent anti-jamming communication algorithm
based on proximal policy optimization,” Physical
Communication, vol. 65, p. 102366, 2024.
K. Jia, D. Chen, and X. Sun, “Soft actor-critic based
power control algorithm for anti-jamming in D2D
communication,” in IEEE Int. Conf. Control, Electron.
Comput. Technol. (ICCECT), Jilin, China, 2023, pp. 1–5.
Downloads
Published
How to Cite
Issue
Section
License
Open Access Policy
The Journal of Science and Technology on Information Security provides open access to its published articles to broaden opportunities for high-quality research findings to be available and widely disseminated free of charge, contributing to the greater exchange of knowledge.
Open access statement: CTUJoS permits everyone to read, download, copy, distribute, print, search, or link to the full texts of the published articles without registration, price barriers, or asking for permission from the Journal or the author.
Proposed Policy for Journals That Offer Delayed Open Access
Authors who publish with this journal agree to the following terms:
1. Authors retain copyright and grant the journal right of first publication, with the work [SPECIFY PERIOD OF TIME] after publication simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
