Unmanned Aerial Vehicle Control Using Hand Gestures and Neural Networks

Jack Nemec, Rocio Alba-Flores

Research output: Contribution to book or proceedingConference articlepeer-review

3 Scopus citations

Abstract

Neural Networks are a series of data manipulations inspired by how neurons perceive information in the brain. This technology is useful for accomplishing tasks that conventional computers do poorly, but people do accurately. Neural Networks are utilized in this project to control an Unmanned Aerial Vehicle (UAV) with hand gestures. For this case the model produced by TensorFlow will take twenty-one different hand points on a user's hand using MediaPipe and distinguish which of eight gestures the user is signaling. This data is received through a camera on the UAV and once ran through the model the flight path will be controlled. The hand points are logged as two-dimensional coordinates in relation to the pixel they are in the frame. This creates a model with forty-two inputs and nine outputs. The model can run at around twenty frames per second due to the low number of inputs. The UAV can handle efficiently due to an acceptable processing time of its commands.

Original languageEnglish
Title of host publication2022 IEEE International IOT, Electronics and Mechatronics Conference, IEMTRONICS 2022
EditorsSatyajit Chakrabarti, Rajashree Paul, Bob Gill, Malay Gangopadhyay, Sanghamitra Poddar
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665486842
DOIs
StatePublished - 2022
Event2022 IEEE International IOT, Electronics and Mechatronics Conference, IEMTRONICS 2022 - Toronto, Canada
Duration: Jun 1 2022Jun 4 2022

Publication series

Name2022 IEEE International IOT, Electronics and Mechatronics Conference, IEMTRONICS 2022

Conference

Conference2022 IEEE International IOT, Electronics and Mechatronics Conference, IEMTRONICS 2022
Country/TerritoryCanada
CityToronto
Period06/1/2206/4/22

Scopus Subject Areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Software
  • Information Systems and Management
  • Electrical and Electronic Engineering
  • Mechanical Engineering
  • Modeling and Simulation

Keywords

  • artificial intelligence
  • machine learning
  • Neural Networks
  • neurons
  • Unmanned Aerial Vehicle (UAV)

Fingerprint

Dive into the research topics of 'Unmanned Aerial Vehicle Control Using Hand Gestures and Neural Networks'. Together they form a unique fingerprint.

Cite this