Multi-Armed Bandit Learning for Computation-Intensive Services in MEC-Empowered Vehicular Networks

Impact Factor:5.978

DOI number:10.1109/TVT.2020.2991641

Affiliation of Author(s):Southwest Jiaotong Univ, Sch Informat Sci & Technol

Journal:IEEE Transactions on Vehicular Technology

Key Words:ServersTask analysis,Cloud computing,Computer architecture,Real-time systems,Processor scheduling,Edge computing,Computation-intensive services,distributed scheduling,multi-armed bandit learning learning,mobile edge computing,vehicular networks

Abstract:Mobile edge computing (MEC) is an emerging paradigm to offload computations from the cloud to the MEC servers in vehicular networks, aiming at better supporting computation-intensive services with requirements of low latency and real-time processing. In this work, we investigate a new service scenario of computation offloading and workload balancing in MEC-empowered vehicular networks, where the computational resources of MEC/cloud servers are cooperatively utilized. Then, we formulate a distributed task assignment (DTA) problem by considering heterogeneous computation resources, high mobility of vehicles and uneven distribution of workloads, targeting at optimizing task assignment among MEC/cloud servers and minimizing task completion time. We prove that the DTA is NP-hard. Further, we propose a multi-armed bandit learning algorithm called Utility-table based Learning. For workload balancing among MEC servers, a utility table is established to determine the optimal solution by online learning of real-time workload distribution, which is updated based on the feedback signal of task assignment. For optimal computation offloading, a theoretical bound is derived to determine the ratio of workload assigned to the cloud. Lastly, we build the simulation model and conduct an extensive experiment, which demonstrates the superiority of the proposed algorithm.

Co-author:Penglin Dai,Zihua Hang,Kai Liu,Xiao Wu,Huanlai Xing,Zhaofei Yu,Victor CS Lee

Document Code:10.1109/TVT.2020.2991641

Volume:69

Issue:7

Page Number:7821-7834

ISSN No.:0018-9545

Translation or Not:no

Date of Publication:2020-07-28

Included Journals:SCI