WNCG Seminar: Audio-Visual Quality Assessment Methodologies for Multimedia Applications

Friday, April 12, 2019
EER 1.516 (North Tower)

The great progress achieved by communications in the last twenty years can be attested by the amount of audio-visual multimedia services available nowadays, such as digital television and IP-based video transmission. The success of these kind of services relies on their trustworthiness and the delivered quality of experience. Therefore, the development of efficient real-time quality monitoring tools that can quantify the audio-visual experience (as perceived by the end user) is key to the success of any multimedia service or application. Although the research in audio and video quality assessment (tackled as individual modalities) is mature, there are still several issues that need to be addressed in the area of audio-visual quality. For instance, modeling how humans perceive audio and video signals (altogether) is a challenging task, especially when we consider the interaction in the perception of audio and video signals. In this talk, I will briefly discuss state-of-the-art research of audio-visual quality metrics. Then, I will present a no-reference pixel-based audio-visual quality metric, which uses autoencoders to generate a set of descriptive audio and video features. The method is based on the assumption that the autoencoders are able to produce a set of features that can describe the complex audio and video interactions. When tested on available datasets, the proposed method achieves a good performance. Finally, I will discuss some of the challenges faced by the area of audio-visual quality and potential research directions.


picture of Prof. Farias
Associate Professor
University of Brasilia (UnB)

Mylene C.Q. Farias received her B.Sc. degree in electrical engineering from Federal University of Pernambuco (UFPE), Brazil, in 1995 and her M.Sc. degree in electrical engineering from the State University of Campinas (UNICAMP), Brazil, in 1998. She received her Ph.D. in electrical and computer engineering from the University of California Santa Barbara (UCSB), USA, in 2004 for work in no-reference video quality metrics. Dr. Farias has worked at CPqD (Brazil) and for Intel Corporation (Phoenix, USA). Currently, she is an Associate professor in the Department of Electrical Engineering at the University of Brasilia (UnB). Her current interests include video and image quality, no-reference quality metrics, quality of experience, video processing, and visual attention. Dr. Farias is a member of IEEE, the IEEE Signal Processing Society, ACM, and IST.