Objective Video Quality Assessment — Towards Large Scale Video Database Enhanced Model Development

Marcus BARKOWSKY  Enrico MASALA  Glenn VAN WALLENDAEL  Kjell BRUNNSTRÖM  Nicolas STAELENS  Patrick LE CALLET  

Publication
IEICE TRANSACTIONS on Communications   Vol.E98-B   No.1   pp.2-11
Publication Date: 2015/01/01
Online ISSN: 1745-1345
Type of Manuscript: INVITED PAPER (Special Section on Quality of Diversifying Communication Networks and Services)
Category: 
Keyword: 
video quality assessment,  large scale database,  reproducible research,  

Full Text: FreePDF(1.9MB)


Summary: 
The current development of video quality assessment algorithms suffers from the lack of available video sequences for training, verification and validation to determine and enhance the algorithm's application scope. The Joint Effort Group of the Video Quality Experts Group (VQEG-JEG) is currently driving efforts towards the creation of large scale, reproducible, and easy to use databases. These databases will contain bitstreams of recent video encoders (H.264, H.265), packet loss impairment patterns and impaired bitstreams, pre-parsed bitstream information into files in XML syntax, and well-known objective video quality measurement outputs. The database is continuously updated and enlarged using reproducible processing chains. Currently, more than 70,000 sequences are available for statistical analysis of video quality measurement algorithms. New research questions are posed as the database is designed to verify and validate models on a very large scale, testing and validating various scopes of applications, while subjective assessment has to be limited to a comparably small subset of the database. Special focus is given on the principles guiding the database development, and some results are given to illustrate the practical usefulness of such a database with respect to the detailed new research questions.