ORB-Net: End-to-end Planning Using Feature-based Imitation Learning for Autonomous Drone Racing

TY - GEN

T1 - ORB-Net

T2 - End-to-end Planning Using Feature-based Imitation Learning for Autonomous Drone Racing

AU - Pham, Xuan Huy

AU - Heiß, Micha

AU - Tran, Dung

AU - Nguyen, Minh Anh

AU - Nguyen, Anh Quang

AU - Kayacan, Erdal

PY - 2023/9

Y1 - 2023/9

N2 - Deep learning-based methods have enhanced the performance of many robot applications thanks to their superior ability to robustly extract rich high-dimensional features. However, it comes with a high computational cost that often increases the latency of the overall system. On the other hand, traditional feature extraction methods, such as oriented FAST and rotated BRIEF (ORB), can be computed efficiently and remains the backbone of some critical robot algorithms, e.g. ORB-SLAM for robot state estimation. In this work, the usefulness of the aforementioned features for a robot navigation task is investigated. The features are experimentally incorporated with a deep-learning method, called ORB-Net, which allows an agile aerial robot to learn a motion policy to complete a racing track in an autonomous drone racing context. The experimental studies demonstrate that it can be beneficial to reuse these computed features for end-to-end motion planning for the agile quadrotor, as the proposed method using combined input of ORB feature position and RGB images outperforms the baseline methods which use only RGB images.

AB - Deep learning-based methods have enhanced the performance of many robot applications thanks to their superior ability to robustly extract rich high-dimensional features. However, it comes with a high computational cost that often increases the latency of the overall system. On the other hand, traditional feature extraction methods, such as oriented FAST and rotated BRIEF (ORB), can be computed efficiently and remains the backbone of some critical robot algorithms, e.g. ORB-SLAM for robot state estimation. In this work, the usefulness of the aforementioned features for a robot navigation task is investigated. The features are experimentally incorporated with a deep-learning method, called ORB-Net, which allows an agile aerial robot to learn a motion policy to complete a racing track in an autonomous drone racing context. The experimental studies demonstrate that it can be beneficial to reuse these computed features for end-to-end motion planning for the agile quadrotor, as the proposed method using combined input of ORB feature position and RGB images outperforms the baseline methods which use only RGB images.

M3 - Article in proceedings

SN - 978-3-8007-6140

SP - 16

EP - 21

BT - ISR Europe 2023

PB - VDE Verlag GmbH

ER -