Preliminary results of OLSR based MANET routing algorithms: OLSRd2-Qx reinforcement learning agents and ODRb

Maret, Yann, Wagen, Jean-Frédéric, Raza, Mohsin, Wang, Junyuan, Bessis, Nik and Legendre, Franck (2021) Preliminary results of OLSR based MANET routing algorithms: OLSRd2-Qx reinforcement learning agents and ODRb. In: 2021 International Conference on Military Communication and Information Systems, ICMCIS 2021. 2021 International Conference on Military Communication and Information Systems, ICMCIS 2021 . The Institute of Electrical and Electronics Engineers (IEEE), NLD. ISBN 9781665445863

Full text not available from this repository. (Request a copy)

Abstract

In MANETs, congestion typically occurs on the interconnecting nodes between two or more groups of nodes. Routing to avoid the congested nodes via alternate, perhaps longer paths, allows more throughput, e.g., 50% more in the canonical 9-node 2-ring scenario. OLSR-Q is based on the routing protocol OLSR and a reinforcement learning (RL) agent to learn the most appropriate link states or "Directional Air Time"metric to avoid the congested nodes. The challenges for the RL agent are (1) to avoid congestion before packets are dropped and (2) to minimize the number of real valued or discrete observations or states. In this paper, three simplified OLSRd2-Qx versions are presented and compared to OLSRd2 and a centralized ODRb, Omniscient Dijkstra Routing-balanced, algorithm. The proposed OLSRd2-Qload algorithm provides the expected 50% increase in throughput on the 9-node 2-ring scenario with a specific test traffic scenario. On the NATO IST-124 Anglova scenario, and using an acknowledged message application, the Q-learning agents remain to be improved. The superior results of the centralized load balancing approach taken in ODRb will be investigated to train multi-agents systems including OLSR-Q.

Item Type: Book Section
Additional Information: Publisher Copyright: © 2021 IEEE.
Uncontrolled Keywords: artificial intelligence,computer networks and communications,computer science applications,hardware and architecture,information systems,information systems and management ,/dk/atira/pure/subjectarea/asjc/1700/1702
Faculty \ School: Faculty of Science > School of Computing Sciences
UEA Research Groups: Faculty of Science > Research Groups > Cyber Intelligence and Networks
Related URLs:
Depositing User: LivePure Connector
Date Deposited: 18 Jun 2025 14:30
Last Modified: 19 Jun 2025 13:32
URI: https://ueaeprints.uea.ac.uk/id/eprint/99635
DOI: 10.1109/ICMCIS52405.2021.9486409

Actions (login required)

View Item View Item