Research Project

Human-Inspired Vision Technology for Real-Time Wide-Angle Aerospace Video Processing

This project develops perception-driven video processing technologies for drones and autonomous systems, using models of human visual perception to improve real-time wide-angle video transmission under bandwidth and edge-computing constraints.

Aerospace Embedded Vision Human Visual Perception Visual AI Drones
Human vision-based wide-angle aerospace video processing project

Research Team

Abstract

Current wide-angle aerial and robotic vision systems are constrained by limited transmission bandwidth, onboard computational capacity, and real-time processing requirements. Existing video compression methods are not optimised for large fields of view or for the way humans actually perceive visual information, resulting in unnecessary transmission of visually redundant data.


This research investigates a new generation of perception-driven video processing technologies inspired by the human visual system. Our recent work demonstrates that integrating psychovisual perception models into video compression pipelines can reduce transmitted data by up to 80% while maintaining perceived visual quality. The system prioritises information that is visible to humans, enabling more efficient video transmission in constrained communication environments.


The project aims to develop real-time 180-degree immersive vision technologies for drones and autonomous systems. Current drone operators typically use only a small fraction of the available visual field, which reduces situational awareness, navigation precision, and operational safety in complex environments. The proposed approach supports low-latency wide-angle visualisation in headset-based piloting systems while also contributing to more efficient artificial intelligence and machine vision workflows.


Applications include beyond visual line-of-sight drone operations, environmental monitoring, ecosystem restoration, emergency response, search and rescue, remote inspection, and industrial monitoring. The project also contributes toward future embedded AI systems capable of perception-aware video understanding under real-world bandwidth and edge-computing constraints.

Publication

This project has been published as: “Enhancing Wide-Angle VR Video Transmission Using Human Perception”.
View the publication on IEEE Xplore.

Visual Results

Comparison of perceptually optimised wide-angle video and reference video
Perceptually optimised transmission retains visually relevant information while reducing unnecessary visual data.
Wide-angle video examples showing original and perceptually optimised data
Wide-angle video examples comparing original visual data with perceptually relevant information retained by the proposed method.
Perceived quality and bitrate comparison across video optimisation methods
Experimental results show the perceived quality and bitrate performance of the proposed method compared with reference and foveated compression approaches.

Research Focus and Expected Impact

Technical Focus

  • Embedded AI and real-time vision systems for UAVs, robotics, and autonomous platforms.
  • Hardware-software co-design integrating embedded computing, sensing, FPGA-based video capture, and intelligent video processing.
  • Mechatronic integration of stabilisation systems, gimbals, and perception-aware visual pipelines for low-latency operation.
  • Human-vision-inspired modelling to reduce bandwidth demand and support real-time operation under computational and energy constraints.

Application Areas

  • Drone operations and beyond visual line-of-sight situational awareness.
  • Search and rescue in complex terrain and remote environments.
  • Environmental monitoring and ecosystem restoration.
  • Industrial inspection, remote infrastructure monitoring, and applied aerospace systems.

Research and Industry Collaborators

  • Trust Tairawhiti
  • New Zealand Police
  • Land Search and Rescue New Zealand
  • National Marine Pacific
  • Eastland Port
  • Qube
  • LeaderBrand
  • SPS Automation
  • Eastland Group
  • Stardustme
  • The University of Auckland
  • Lancaster University, United Kingdom
  • Institute of Radio and Information Systems, Austria

Dataset Access

Access to the complete annotated dataset is available upon request from amozhaeva@eit.ac.nz.