
Data offloading is considered as a potential candidate for alleviating congestion on wireless networks and for improving user experience. However, due to the stochastic nature of the wireless networks, it is important to take optimal actions under different conditions such that the user experience is enhanced and congestion on heavy-loaded radio access technologies (RATs) is reduced by offloading data through lower loaded RATs. Since artificial intelligence (AI)-based techniques can learn optimal actions and adapt to different conditions, in this work, we develop an AI-enabled Q-agent for making data offloading decisions in a multi-RAT wireless network. We employ a model-free Q-learning algorithm for training of the Q-agent. We use stochastic geometry as a tool for estimating the average data rate offered by the network in a given region by considering the effect of interference. We use the Markov process for modeling users’ mobility, that is, estimating the probability that a user is currently located in a region given its previous location. The user equipment (UE) plays the role of a Q-agent responsible for taking sequence of actions such that the long-term discounted cost for using network service is minimized. Q-agent performance has been evaluated and compared with the existing data offloading policies. The results suggest that the existing policies offer the best performance under specific situations. However, the Q-agent has learned to take near-optimal actions under different conditions. Thus, the Q-agent offers performance which is close to the best under different conditions.
Computer network, Artificial intelligence, Computer Networks and Communications, Next Generation 5G Wireless Networks, QA75.5-76.95, Beamforming Optimization, Intelligent Reflecting Surfaces in Wireless Communications, Computer science, Engineering, Cooperative Diversity in Wireless Networks, Electronic computers. Computer science, Physical Sciences, Computer Science, FOS: Electrical engineering, electronic engineering, information engineering, Wireless, Telecommunications, Electrical and Electronic Engineering, Wireless network, Smart Radio Environments
Computer network, Artificial intelligence, Computer Networks and Communications, Next Generation 5G Wireless Networks, QA75.5-76.95, Beamforming Optimization, Intelligent Reflecting Surfaces in Wireless Communications, Computer science, Engineering, Cooperative Diversity in Wireless Networks, Electronic computers. Computer science, Physical Sciences, Computer Science, FOS: Electrical engineering, electronic engineering, information engineering, Wireless, Telecommunications, Electrical and Electronic Engineering, Wireless network, Smart Radio Environments
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
