Alert button

Disentangling Aesthetic and Technical Effects for Video Quality Assessment of User Generated Content

Nov 09, 2022
Haoning Wu, Liang Liao, Chaofeng Chen, Jingwen Hou, Annan Wang, Wenxiu Sun, Qiong Yan, Weisi Lin

Figure 1 for Disentangling Aesthetic and Technical Effects for Video Quality Assessment of User Generated Content
Figure 2 for Disentangling Aesthetic and Technical Effects for Video Quality Assessment of User Generated Content
Figure 3 for Disentangling Aesthetic and Technical Effects for Video Quality Assessment of User Generated Content
Figure 4 for Disentangling Aesthetic and Technical Effects for Video Quality Assessment of User Generated Content

Share this with someone who'll enjoy it:

User-generated-content (UGC) videos have dominated the Internet during recent years. While many methods attempt to objectively assess the quality of these UGC videos, the mechanisms of human quality perception in the UGC-VQA problem is still yet to be explored. To better explain the quality perception mechanisms and learn more robust representations, we aim to disentangle the effects of aesthetic quality issues and technical quality issues risen by the complicated video generation processes in the UGC-VQA problem. To overcome the absence of respective supervisions during disentanglement, we propose the Limited View Biased Supervisions (LVBS) scheme where two separate evaluators are trained with decomposed views specifically designed for each issue. Composed of an Aesthetic Quality Evaluator (AQE) and a Technical Quality Evaluator (TQE) under the LVBS scheme, the proposed Disentangled Objective Video Quality Evaluator (DOVER) reach excellent performance (0.91 SRCC for KoNViD-1k, 0.89 SRCC for LSVQ, 0.88 SRCC for YouTube-UGC) in the UGC-VQA problem. More importantly, our blind subjective studies prove that the separate evaluators in DOVER can effectively match human perception on respective disentangled quality issues. Codes and demos are released in https://github.com/teowu/dover.

* 12 pages, 7 figures  
View paper onarxiv icon

Share this with someone who'll enjoy it: