A Self-regulating Spatio-Temporal Filter for Volumetric Video Point Clouds
Citation:
Moynihan M., Pagés R., Smolic A. (2020) A Self-regulating Spatio-Temporal Filter for Volumetric Video Point Clouds. In: Cláudio A. et al. (eds) Computer Vision, Imaging and Computer Graphics Theory and Applications. VISIGRAPP 2019. Communications in Computer and Information Science, vol 1182. Springer, Cham.Download Item:
Abstract:
The following work presents a self-regulating filter that is capable of performing accurate upsampling of dynamic point cloud data sequences captured using wide-baseline multi-view camera setups. This is achieved by using two-way temporal projection of edge-aware upsampled point clouds while imposing coherence and noise filtering via a windowed, self-regulating noise filter. We use a state of the art Spatio-Temporal Edge-Aware scene flow estimation to accurately model the motion of points across a sequence and then, leveraging the spatio-temporal inconsistency of unstructured noise, we perform a weighted Hausdorff distance-based noise filter over a given window. Our results demonstrate that this approach produces temporally coherent, upsampled point clouds while mitigating both additive and unstructured noise. In addition to filtering noise, the algorithm is able to greatly reduce intermittent loss of pertinent geometry. The system performs well in dynamic real world scenarios with both stationary and non-stationary cameras as well as synthetically rendered environments for baseline study.
Sponsor
Grant Number
Science Foundation Ireland (SFI)
15/RP/2776
Author's Homepage:
http://people.tcd.ie/smolica
Author: Smolic, Aljosa
Sponsor:
Science Foundation Ireland (SFI)Other Titles:
Computer Vision, Imaging and Computer Graphics Theory and ApplicationsPublisher:
Springer International Publishing, 2020,Type of material:
Book ChapterCollections
Availability:
Full text availableKeywords:
Point clouds, Upsampling, Temporal coherence, Free viewpoint video, Multiview video, Volumetric videoSubject (TCD):
Creative Technologies , Digital Engagement , Computer Education/Literacy , Data Analysis , Information technology in education , Multimedia & CreativityDOI:
10.1007%2F978-3-030-41590-7_16Metadata
Show full item recordLicences: