Algorithms for Quality Optimization in Omnidirectional Video
Citation:
Croci, Simone Maurizio, Algorithms for Quality Optimization in Omnidirectional Video, Trinity College Dublin.School of Computer Science & Statistics, 2022Download Item:
Abstract:
Omnidirectional video (ODV) is a recent imaging technology, which is currently getting increasingly popular thanks to its ability to create an immersive and interactive viewing experience. Nowadays, viewing ODV is becoming easy and affordable, thanks to relatively cheap head-mounted displays and the possibility to view ODV with widespread devices like smartphones and tablets. Moreover, ODV technology has reached a level that is mature enough to attract content producers.
Even if the ODV technology has reached an adequate level of maturity, it is still developing. There are several challenges during ODV production that can introduce artifacts in ODV even with the current technology. Moreover, for the coding and transmission of ODV, the current solutions could be further developed and improved.
Therefore, the objective of this thesis is to develop technologies that can help to improve the quality of ODV and be applied during ODV production and for the development of better coding and transmission methods. Three research areas characterize this thesis: artifact detection, artifact correction, and quality assessment.
Regarding artifact detection, we propose a general framework that extends artifact detection methods for stereoscopic 3D (S3D) standard images to S3D omnidirectional images (ODI), which can be used by artists in the post-production workflow in order to optimize the quality. Moreover, methods for the detection of two common artifacts in S3D ODIs, namely color and sharpness mismatch, are also proposed. For the evaluation of the artifact detection framework, a new dataset of S3D ODIs with visual attention data was created.
For the second research area, i.e., artifact correction, the thesis proposes three different solutions for the correction of color mismatch. One solution is based on traditional visual computing techniques, and the other two solutions are based on deep learning. The evaluation of these methods shows their effectiveness.
Finally, for quality assessment, a framework that extends full-reference quality metrics for standard video to monoscopic ODV was developed. For the development and evaluation of the framework, a dataset of monoscopic ODVs with subjective quality scores and visual attention data was created. The evaluation of the framework shows that it has a better quality assessment performance than the commonly used quality metrics for monoscopic ODV.
Sponsor
Grant Number
Science Foundation Ireland (SFI)
Description:
APPROVED
Author: Croci, Simone Maurizio
Sponsor:
Science Foundation Ireland (SFI)Advisor:
Smolic, AljosaPublisher:
Trinity College Dublin. School of Computer Science & Statistics. Discipline of Computer ScienceType of material:
ThesisCollections
Availability:
Full text availableKeywords:
Omnidirectional video, 360-degree video, Omnidirectional image, 360-degree image, Stereoscopic 3D, Quality optimization, Artifact detection, Artifact correction, Objective quality assessment, Quality metrics, Subjective quality assessment, Quality of experience, Sharpness mismatch, Just noticeable sharpness mismatch, Color mismatch, Voronoi patches, Visual attention, Deep learningMetadata
Show full item recordLicences:
Related items
Showing items related by title, author, creator and subject.
-
Technical Paper on Measurement of Multidimensional Quality of Life in Ireland : An analysis of the Central Statistics Office (CSO) Survey on Income and Living Conditions (SILC) Special Quality of Life Module 2013
Watson, Dorothy; Maître, Bertrand; Whelan, Christopher T.; Russell, Helen (Department of Social Protection. Social Inclusion DivisionIE, 2016-07)In this paper we develop a multidimensional Quality of Life (QoL) index using the Alkire and Foster methodology (2007, 2011a and b, Alkire et al., 2015) and the 2013 EU-SILC data for Ireland. The Index is composed of 11 ... -
Quality services better outcomes : a quality framework for achieving outcomes
Childhood Development Initiative (Childhood Development Initiative, DublinIE, 2019) -
Processes to Support Quality, Emotional Intelligence, Performance and Achievement of Outcomes. Quality Services, Better Outcomes, September 7th 2011
Smith, Gráinne; Murphy, Aileen (Childhood Development Initiative, DublinIE, 2011-09-07)