Title： Advancements in Visual Quality Assessment for Interactive Media: From Mobile Cloud Gaming to Holograms and Digital Human Expression
Date: 2024-12-13 15:40-17:00
Location：CSIE R103
Speakers: Yu-Chih (Berrie) Chen, Ph.D.student ,UT Austin
Host: Prof. Lung-Pan Cheng
Abstract:
With the rapid growth of interactive media, including mobile cloud gaming, hologram videos in virtual reality (VR), and digital human expression, also known as avatar expression reconstruction, this dissertation comprehensively explores the domain of visual quality assessment across these diverse applications.
First of all, the study introduces Gaming Video Quality Evaluator (GAMIVAL), a novel No-Reference Video Quality Assessment (VQA) model, optimizing streaming gaming VQA through spatial and temporal gaming scene statistics, a neural noise model, and deep semantic features. Utilizing support vector regression, GAMIVAL achieves superior performance on the LIVE-Meta Mobile Cloud Gaming Database.
Shifting focus to VR and augmented reality (AR), the dissertation presents a newly introduced subjective human study database LIVE-Meta Rendered Hologram VQA Database, investigating the impact of distortions on human perception of digital holograms. To address the scarcity of datasets, this database, containing hologram videos processed under various encoding parameters, enables the evaluation of VQA models, including the novel HologramQA, optimizing trade-offs between perceptual quality and data volume in compressed hologram videos.
Extending into digital human face expression reconstruction, the dissertation aims to fill the existing gap in metrics aligned with human perception, proposing an algorithm informed by a subjective human study.
By unifying these projects, the dissertation significantly contributes to the understanding and enhancement of subjective VQA in diverse contexts, addressing challenges within each domain and advancing multimedia technology for interactive and immersive user experiences.
Bio:
Yu-Chih (Berrie) Chen received her B.S. degree in Computer Science and Information Engineering from National Taiwan University of Science and Technology, Taipei, Taiwan, in 2017, and her M.S. degree in Engineering Science and Ocean Engineering from National Taiwan University, Taipei, Taiwan, in 2019. Currently, she is pursuing a Ph.D. degree with the Laboratory for Image and Video Engineering (LIVE) at The University of Texas at Austin. Her research interests include perceptual image/video quality assessment, deep learning, and image/video processing and computer vision.