Assisted Physical Interaction: Autonomous Aerial Robots with Neural Network Detection, Navigation, and Safety Layers

Andrea Berra, Viswa Narayanan Sankaranarayanan, Achilleas Santi Seisa, Julien Mellet, Udayanga G.W.K.N. Gamage, Sumeet Gajanan Satpute, Fabio Ruggiero, Vincenzo Lippiello, Silvia Tolu, Matteo Fumagalli, George Nikolakopoulos, Miguel Ángel Trujillo Soto, Guillermo Heredia

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Abstract

The paper introduces a novel framework for safe and autonomous aerial physical interaction in industrial settings. It comprises two main components: a neural network-based target detection system enhanced with edge computing for reduced onboard computational load, and a control barrier function (CBF)-based controller for safe and precise maneuvering. The target detection system is trained on a dataset under challenging visual conditions and evaluated for accuracy across various unseen data with changing lighting conditions. Depth features are utilized for target pose estimation, with the entire detection framework offloaded into low-latency edge computing. The CBF-based controller enables the UAV to converge safely to the target for precise contact. Simulated evaluations of both the controller and target detection are presented, alongside an analysis of real-world detection performance.
Original languageEnglish
Title of host publicationProceedings of 2024 International Conference on Unmanned Aircraft Systems (ICUAS)
Number of pages8
PublisherIEEE
Publication date7 Jun 2024
Pages1354-1361
Article number10557050
ISBN (Print)979-8-3503-5789-9
DOIs
Publication statusPublished - 7 Jun 2024
Event2024 International Conference on Unmanned Aircraft Systems - Center of Mediterranean Architecture, Chania - Crete, Greece
Duration: 4 Jun 20247 Jun 2024

Conference

Conference2024 International Conference on Unmanned Aircraft Systems
LocationCenter of Mediterranean Architecture
Country/TerritoryGreece
CityChania - Crete
Period04/06/202407/06/2024

Keywords

  • Visualization
  • Pose estimation
  • Neural networks
  • Lighting
  • Object detection
  • Autonomous aerial vehicles
  • Aircraft navigation

Fingerprint

Dive into the research topics of 'Assisted Physical Interaction: Autonomous Aerial Robots with Neural Network Detection, Navigation, and Safety Layers'. Together they form a unique fingerprint.

Cite this