Real-Time Object Detection and Tracking for Unmanned Aerial Vehicles Based on Convolutional Neural Networks

Shao Yu Yang, Hsu Yung Cheng, Chih Chang Yu

Research output: Contribution to journalArticlepeer-review

6 Scopus citations

Abstract

This paper presents a system applied to unmanned aerial vehicles based on Robot Operating Systems (ROSs). The study addresses the challenges of efficient object detection and real-time target tracking for unmanned aerial vehicles. The system utilizes a pruned YOLOv4 architecture for fast object detection and the SiamMask model for continuous target tracking. A Proportional Integral Derivative (PID) module adjusts the flight attitude, enabling stable target tracking automatically in indoor and outdoor environments. The contributions of this work include exploring the feasibility of pruning existing models systematically to construct a real-time detection and tracking system for drone control with very limited computational resources. Experiments validate the system’s feasibility, demonstrating efficient object detection, accurate target tracking, and effective attitude control. This ROS-based system contributes to advancing UAV technology in real-world environments.

Original languageEnglish
Article number4928
JournalElectronics (Switzerland)
Volume12
Issue number24
DOIs
StatePublished - Dec 2023

Keywords

  • PID control
  • ROS
  • UAV
  • convolutional neural network
  • deep learning
  • pruned network
  • target tracking network

Fingerprint

Dive into the research topics of 'Real-Time Object Detection and Tracking for Unmanned Aerial Vehicles Based on Convolutional Neural Networks'. Together they form a unique fingerprint.

Cite this