To Improve Service Reliability for AI-Powered Time-Critical Services Using Imperfect Transmission in MEC: An Experimental Study

TY - JOUR

T1 - To Improve Service Reliability for AI-Powered Time-Critical Services Using Imperfect Transmission in MEC

T2 - An Experimental Study

AU - Liu, Jianhui

AU - Zhang, Qi

PY - 2020/10

Y1 - 2020/10

N2 - The emerging time-critical Internet-of-Things (IoT) use cases, e.g., augmented reality, virtual reality, autonomous vehicle, etc., involve computation-intensive tasks powered by artificial intelligence (AI) techniques. Due to the limited computation resource at IoT devices, it is challenging to fulfill the latency and reliability requirements. Offloading computation tasks using mobile-edge computing (MEC) are a promising solution. The service reliability in AI-powered time-critical services can be modeled by the transmission reliability, timeout probability, and inference accuracy. To improve service reliability, the state-of-the-art work emphasizes on transmission reliability and requires error-free transmission. We show that the AI-powered time-critical services can tolerate small image distortion and still remain the inference accuracy. Therefore, to improve service reliability, it is more important to minimize the timeout probability by shortening transmission latency than perfect error-free transmission. Motivated by this insight, we study the feasibility of user datagram protocol (UDP)-based offloading for such services in the MEC system. A prototype is developed and a series of experiments are conducted to understand how image distortion affects inference accuracy. We measure the latency and transmission reliability of transmission control protocol (TCP)-based and UDP-based offloading in real-life environments and evaluate the service reliability both experimentally and numerically. The evaluation results demonstrate that compared with the TCP-based offloading, the UDP-based offloading can improve the normalized service reliability by up to 70% for time-critical services. In addition, we propose an early termination of image reception (ETR) offloading scheme which can further improve the normalized service reliability by up to 10%, compared with the baseline UDP-based scheme.

AB - The emerging time-critical Internet-of-Things (IoT) use cases, e.g., augmented reality, virtual reality, autonomous vehicle, etc., involve computation-intensive tasks powered by artificial intelligence (AI) techniques. Due to the limited computation resource at IoT devices, it is challenging to fulfill the latency and reliability requirements. Offloading computation tasks using mobile-edge computing (MEC) are a promising solution. The service reliability in AI-powered time-critical services can be modeled by the transmission reliability, timeout probability, and inference accuracy. To improve service reliability, the state-of-the-art work emphasizes on transmission reliability and requires error-free transmission. We show that the AI-powered time-critical services can tolerate small image distortion and still remain the inference accuracy. Therefore, to improve service reliability, it is more important to minimize the timeout probability by shortening transmission latency than perfect error-free transmission. Motivated by this insight, we study the feasibility of user datagram protocol (UDP)-based offloading for such services in the MEC system. A prototype is developed and a series of experiments are conducted to understand how image distortion affects inference accuracy. We measure the latency and transmission reliability of transmission control protocol (TCP)-based and UDP-based offloading in real-life environments and evaluate the service reliability both experimentally and numerically. The evaluation results demonstrate that compared with the TCP-based offloading, the UDP-based offloading can improve the normalized service reliability by up to 70% for time-critical services. In addition, we propose an early termination of image reception (ETR) offloading scheme which can further improve the normalized service reliability by up to 10%, compared with the baseline UDP-based scheme.

KW - Computation offloading

KW - Internet of Things (IoT)

KW - edge intelligence

KW - image classification

KW - mobile-edge computing (MEC)

KW - reliability

UR - http://www.scopus.com/inward/record.url?scp=85086993104&partnerID=8YFLogxK

U2 - 10.1109/JIOT.2020.2984333

DO - 10.1109/JIOT.2020.2984333

M3 - Journal article

SN - 2327-4662

VL - 7

SP - 9357

EP - 9371

JO - IEEE Internet of Things Journal

JF - IEEE Internet of Things Journal

IS - 10

M1 - 9051992

ER -