Facial reconstruction

Search LJMU Research Online

Browse Repository | Browse E-Theses

INVESTIGATION ON THE USE OF NeRF FOR HERITAGE 3D DENSE RECONSTRUCTION FOR INTERIOR SPACES

Murtiyoso, A, Markiewicz, J, Karwel, AK and Kot, P (2023) INVESTIGATION ON THE USE OF NeRF FOR HERITAGE 3D DENSE RECONSTRUCTION FOR INTERIOR SPACES. In: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives , XLVIII. pp. 115-121. (2nd International Workshop on Evaluation and Benchmarking of Sensors, Systems and Geospatial Data in Photogrammetry and Remote Sensing, 23rd October - 24th October 2023, Krakow, Poland).

[img]
Preview
Text
isprs-archives-XLVIII-1-W3-2023-115-2023.pdf - Published Version
Available under License Creative Commons Attribution.

Download (1MB) | Preview

Abstract

The concept of Neural Radiance Fields (NeRF) emerged in recent years as a method to create novel synthetic 3D viewpoints from a set of trained images. While it has several overlaps with conventional photogrammetry and especially multi-view stereo (MVS), its main point of interest is the capability to rapidly recreate objects in 3D. In this paper, we investigate the quality of point clouds generated by state-of-the-art NeRF in the context of interior spaces and compare them to four conventional MVS algorithms, of which two are commercial (Agisoft Metashape and Pix4D) and the other two open source (Patch-Match and Semi-Global Matching). Three synthetic datasets of interior scenes were created from laser scanning data with different characteristics and architectural elements. Results show that NeRF point clouds could achieve satisfactory results geometrically speaking, with an average standard deviation of 1.7 cm in interior cases where the scene dimension is roughly 25–50 m3 in volume. However, the level of noise on the point cloud, which was considered as out of tolerance, ranges between 17–42%, meaning that the level of detail and finesse is most likely insufficient for sophisticated heritage documentation purposes, even though from a visualisation point of view the results were better. However, NeRF did show the capability to reconstruct texture less and reflective surfaces where MVS failed.

Item Type: Conference or Workshop Item (Paper)
Subjects: N Fine Arts > NA Architecture
T Technology > T Technology (General)
T Technology > TA Engineering (General). Civil engineering (General)
Divisions: Civil Engineering & Built Environment
Publisher: Copernicus GmbH
SWORD Depositor: A Symplectic
Date Deposited: 23 Oct 2023 15:59
Last Modified: 23 Oct 2023 15:59
DOI or ID number: 10.5194/isprs-archives-XLVIII-1-W3-2023-115-2023
URI: https://researchonline.ljmu.ac.uk/id/eprint/21741
View Item View Item