Research Project

NRspttemVQA: Real-Time Video Quality Assessment Based on the User’s Visual Perception

This project developed a deep learning-based non-reference video quality metric incorporating psychophysical features of human visual perception. The metric supports stable prediction of subjective video quality ratings across independent datasets.

Video Quality Assessment Human Perception Non-Reference Metric Real-Time Video Computer Vision

Abstract

This work created a new non-reference video quality metric that incorporates psychophysical features of the user’s video experience. The metric is designed to predict subjective video quality without requiring access to an original reference video, making it suitable for real-time video monitoring and practical streaming environments.


The proposed NRspttemVQA approach integrates spatio-temporal characteristics of human visual perception into video quality prediction. Experimental results show stable performance across three independent video datasets, demonstrating consistent correlation with subjective quality ratings and improving the reliability of perceptual video quality assessment.


This project contributes to human-centred video processing, real-time media quality monitoring, and future embedded vision systems where computational efficiency, subjective quality prediction, and user experience are critical.

Research Contributions

Technical Contribution

  • Non-reference video quality assessment without requiring access to the original video.
  • Psychovisual modelling of spatio-temporal human visual perception.
  • Real-time quality prediction for streamed and compressed video sequences.
  • Stable metric behaviour across independent benchmark datasets.

Application Context

  • Streaming video quality monitoring for real-world media systems.
  • Embedded and edge video systems where reference video is unavailable.
  • Human-centred visual AI focused on user-perceived quality.
  • Video transmission systems operating under bandwidth and latency constraints.

Publication, Code and Data

Publication

This project has been published as “NRspttemVQA: Real-Time Video Quality Assessment Based on the User’s Visual Perception” at the 38th International Conference on Image and Vision Computing New Zealand.

Visual Results

Overview of NRspttemVQA video quality assessment method
Overview of the proposed NRspttemVQA approach for real-time video quality assessment based on human visual perception.
Example of spatio-temporal quality maps for a video frame
Example of spatio-temporal quality maps generated for a frame of the video sequence.
Correlation interval of non-reference video quality metrics across datasets
Correlation interval of non-reference video quality metrics on CSQ, LIVE-NFLX, and KoNViD-1k video datasets. The proposed metric shows consistent high correlation across the tested datasets.
Visualisation of NRspttemVQA results on LIVE-NFLX database
Visualisation of NRspttemVQA results on the LIVE-NFLX database.

Contact

Primary contact: amozhaeva@eit.ac.nz.