ProSky: NEAT Meets NOMA-mmWave
in the Sky of 6G
Ahmed Benfaid∗, Nadia Adem∗, and Abdurrahman Elmaghbub∗∗
∗University of Tripoli, Tripoli, Libya, E-mail: {a.benfaid,n.adem}@uot.edu.ly
∗∗ Oregon State University, OR, USA, Email: elmaghba@oregonstate.edu
Abstract—Rendering to their abilities to provide ubiquitous
connectivity, flexibly and cost effectively, unmanned aerial vehi-
cles (UAVs) have been getting more and more research attention.
To take the UAVs' performance to the next level, however,
they need to be merged with some other technologies like
non-orthogonal multiple access (NOMA) and millimeter wave
(mmWave), which both promise high spectral efficiency (SE). As
managing UAVs efficiently may not be possible using model-based
techniques, another key innovative technology that UAVs will
inevitably need to leverage is artificial intelligence (AI). Designing
an AI-based technique that adaptively allocates radio resources
and places UAVs in 3D space to meet certain communication
objectives, however, is a tough row to hoe. In this paper,
we propose a neuroevolution of augmenting topologies NEAT
framework, referred to as ProSky, to manage NOMA-mmWave-
UAV networks. ProSky exhibits a remarkable performance im-
provement over a model-based method. Moreover, ProSky learns
5.3times faster than and outperforms, in both SE and energy
efficiency EE while being reasonably fair, a deep reinforcement
learning DRL based scheme. The ProSky source code is accessible
to use here: https://github.com/Fouzibenfaid/ProSky
Index Terms—Deep reinforcement learning (DRL), millime-
ter wave (mmWave), neuroevolution of augmenting topologies
(NEAT), non-orthogonal multiple access (NOMA), unmanned
aerial vehicle (UAV).
I. INTRODUCTION
Despite the unprecedented advancements in telecommu-
nication technologies in recent years, around half of the
world's population, mostly living in rural and developing
areas, still has limited or no access to cellular communication
services [1]. Providing connectivity to those underprivileged
areas could unequivocally enhance the quality of their lives.
One of the envisioned, must-be-met, requirements of 6G is
enabling ubiquitous geographical coverage anywhere, anytime.
Due to the lack of essential cellular infrastructures in rural
areas and the high cost of establishing them, along with the
incapability of terrestrial base stations (BSs) to cover hotspot
areas during special events or disaster scenarios, unmanned
aerial vehicles (UAVs), thanks to their flexible 3D mobil-
ity and ease of deployment, are envisioned to be a major
part of the 6G wireless networks, acting as flying BSs [2].
Allowing sharing same spectrum resources among multiple
wireless nodes simultaneously, non-orthogonal multiple access
(NOMA) is emerging as another 6G enabler offering massive
device connectivity without exhausting spectrum resources [2].
The emergence of NOMA-aided UAV networks necessitates
a careful investigation of optimal UAV 3D deployment, and
power allocation (PA) management [2]. Due to the high
complexity of such an optimization problem, authors in [3],
for example, approached the UAV placement and PA problems
disjointly, whereas the number of served users was limited to
two in [4], [5], and the UAV mobility was restricted to a 2D
plane in [3]–[5]. There have been some attempts to address
the UAV 3D placement problem, but these have primarily
been accomplished by disjoining the UAV placement and PA
problems, as done in [6].
Furthermore, due to the high probability of line-of-sight
(LoS) links UAVs offer, the vast millimeter wave (mmWave)
and terahertz spectrum can be utilized to satisfy the ma-
jor 6G data rate enhancement requirement [2]. Nevertheless,
managing NOMA-mmWave-UAV network resources to satisfy
dynamic, heterogeneous, and massive needs adaptively yet
fairly and efficiently is a complicated challenge, which con-
ventional and even machine learning methods fail to handle.
The good news, however, is that deep learning and, more
generally, artificial intelligence (AI) technologies have the
strong potential to handle multi-state network statuses and
demands. After proving their effectiveness in solving problems
with a large degree of freedom in various fields, AI techniques
are proposed to be a key enabler for self-organizing, self-
optimized networks in the 6G era [2].
Inspired by the remarkable successes of incorporating deep
reinforcement learning (DRL) into different fields, a DRL
model has been used to solve the placement problem of
UAVs that fly at a fixed height [7]. More interestingly, our
previous work, AdaptSky [8], unlike any other work, jointly
solved the non-convex optimization problem of the 3D de-
ployment and the PA of a NOMA-equipped UAV BS in the
mmWave spectrum. Another AI tool that has recently shown
outstanding performance in a variety of applications, including
robotics and gaming [9], is neuroevolution of augmenting
topologies (NEAT) [10]. Furthermore, although fairly limited,
NEAT has been recently used in the area of communications,
for example, in [11] to improve beam management in vehicle-
to-vehicle communications. To the best of our knowledge,
no work has studied the use of NEAT to manage UAV-
based communications. In this work, we propose ProSky,
a novel NEAT-based framework that jointly optimizes 3D
deployment and PA for NOMA-aided UAV BSs operating in
the mmWave spectrum. The main contributions of this work,978-1-6654-5975- 4/22 © 2022 IEEE
arXiv:2210.11406v1 [eess.SP] 13 Oct 2022