Welcome to DroneVis’s documentation!

DroneVis is a full compatible drone library to automate computer vision algorithms on parrot drones. The library and computer vision alogirthms were built with real-time constraints on-mind.

All of the implemented real-time data, inference, and detection achieve a minimum fps >= 4.5 on an Intel core 8 CPU.

Github repository: https://github.com/ahmedheakl/drone-vis

Check out the Installation section for further information, including how to install the project.

Main Features

• Unified state-of-the art computer vision algoritms

• Full control over the drone

• PEP8 compliant (unified code style)

• Documented functions and classes

• Tests, high code coverage and type hints

• Clean code

• Multiple implementations for the same models

Computer Vision Models

Drone Controls

The library supports all of the following drone controls. The drone can be controlled using the keyboard or the GUI.

• Right ➡️, Left ⬅️

• Up ⬆️, Down ⬇️

• Forward ▶️, Backward ◀️

• Takeoff 🚀, Land 🛬

• Reset 🔄, Emergency 🚨

• Rotate Left ↩️ /Right ↪️

• Hover 🔍, Calibrate 🔧

• Camera Stream 📹/Record ⏺️

• Hand Gesture Control 🖌️

User Guide

• Installation
  • Prerequisites
  • Linux, Windows, MacOs
  • Development version
  • Docker
• Getting Started
  • 1. Graphical User Interface
  • 2. Command-Line Interface
  • 3. Hand Gesture Control

Connections

• Drone Connection
  • Main Structure
  • Command Connection
  • Video Connection
  • Navigation Data Connection
• Drone
  • Drone class
• Command Thread
  • Sending Commands
  • Command Class
• Video Thread
  • Video Specs
  • Command Class

Object Detection

• Detection Algorithms
  • Detection on Your Web Camera
  • Different Model Implementations
  • Abstract Models
• Single Shot Detector
  • SSD Torch
• YOLO
  • YOLOv5 Torch
  • YOLOv8 Interface
  • YOLOv8 Detection Torch
• Faster R-CNN
  • Faster R-CNN Torch

Instance Segmentation

• YOLOv8 Segmentation

Pose Estimation

• MediaPipe Pose
  • Example
  • MediaPipe Pose Class
• YOLOv8 Pose
  • Example
  • YOLOv8 Pose Class

Face Detection

• Face Detection Models
• MediaPipe Face Detection
• Haar Face Detection
• HOG Face Detection
• Dlib CNN Face Detection
• OpenCV DNN Face Detection

Crowd Counting

• Cascaded MTL Crowd Counting

Depth Estimation

• GLP Depth Estimation

Action Recognition

• Action Recognition Models
• Time Space Transformer (TimeSformer)
• Video Vision Transformer (ViViT)
• Video Masked Autoencoders (VideoMAE)

User Interfaces

• Graphical User Interface
• Command-Line Interface
• Gesture Recognition Control

Indices and tables

• Index

• Module Index

• Search Page