Scene reassembly after multimodal digitization and pipeline evaluation using photorealistic rendering

Research output: Contribution to journalJournal article – Annual report year: 2017Researchpeer-review

Standard

Harvard

APA

CBE

MLA

Vancouver

Author

Bibtex

@article{5d142dfee60e4528871ad71ab1260e58,
title = "Scene reassembly after multimodal digitization and pipeline evaluation using photorealistic rendering",
abstract = "Transparent objects require acquisition modalities that are very different from the ones used for objects with more diffuse reflectance properties. Digitizing a scene where objects must be acquired with different modalities requires scene reassembly after reconstruction of the object surfaces. This reassembly of a scene that was picked apart for scanning seems unexplored. We contribute with a multimodal digitization pipeline for scenes that require this step of reassembly. Our pipeline includes measurement of bidirectional reflectance distribution functions and high dynamic range imaging of the lighting environment. This enables pixelwise comparison of photographs of the real scene with renderings of the digital version of the scene. Such quantitative evaluation is useful for verifying acquired material appearance and reconstructed surface geometry, which is an important aspect of digital content creation. It is also useful for identifying and improving issues in the different steps of the pipeline. In this work, we use it to improve reconstruction, apply analysis by synthesis to estimate optical properties, and to develop our method for scene reassembly.",
author = "Stets, {Jonathan Dyssel} and {Dal Corso}, Alessandro and Nielsen, {Jannik Boll} and Lyngby, {Rasmus Ahrenkiel} and Jensen, {Sebastian Hoppe Nesgaard} and Jakob Wilm and Doest, {Mads Brix} and Carsten Gundlach and Eiriksson, {Eythor Runar} and Knut Conradsen and Dahl, {Anders Bjorholm} and B{\ae}rentzen, {Jakob Andreas} and Frisvad, {Jeppe Revall} and Henrik Aan{\ae}s",
year = "2017",
doi = "10.1364/AO.56.007679",
language = "English",
volume = "56",
pages = "7679--7690",
journal = "Applied Optics",
issn = "1559-128X",
publisher = "Optical Society of America",
number = "27",

}

RIS

TY - JOUR

T1 - Scene reassembly after multimodal digitization and pipeline evaluation using photorealistic rendering

AU - Stets, Jonathan Dyssel

AU - Dal Corso, Alessandro

AU - Nielsen, Jannik Boll

AU - Lyngby, Rasmus Ahrenkiel

AU - Jensen, Sebastian Hoppe Nesgaard

AU - Wilm, Jakob

AU - Doest, Mads Brix

AU - Gundlach, Carsten

AU - Eiriksson, Eythor Runar

AU - Conradsen, Knut

AU - Dahl, Anders Bjorholm

AU - Bærentzen, Jakob Andreas

AU - Frisvad, Jeppe Revall

AU - Aanæs, Henrik

PY - 2017

Y1 - 2017

N2 - Transparent objects require acquisition modalities that are very different from the ones used for objects with more diffuse reflectance properties. Digitizing a scene where objects must be acquired with different modalities requires scene reassembly after reconstruction of the object surfaces. This reassembly of a scene that was picked apart for scanning seems unexplored. We contribute with a multimodal digitization pipeline for scenes that require this step of reassembly. Our pipeline includes measurement of bidirectional reflectance distribution functions and high dynamic range imaging of the lighting environment. This enables pixelwise comparison of photographs of the real scene with renderings of the digital version of the scene. Such quantitative evaluation is useful for verifying acquired material appearance and reconstructed surface geometry, which is an important aspect of digital content creation. It is also useful for identifying and improving issues in the different steps of the pipeline. In this work, we use it to improve reconstruction, apply analysis by synthesis to estimate optical properties, and to develop our method for scene reassembly.

AB - Transparent objects require acquisition modalities that are very different from the ones used for objects with more diffuse reflectance properties. Digitizing a scene where objects must be acquired with different modalities requires scene reassembly after reconstruction of the object surfaces. This reassembly of a scene that was picked apart for scanning seems unexplored. We contribute with a multimodal digitization pipeline for scenes that require this step of reassembly. Our pipeline includes measurement of bidirectional reflectance distribution functions and high dynamic range imaging of the lighting environment. This enables pixelwise comparison of photographs of the real scene with renderings of the digital version of the scene. Such quantitative evaluation is useful for verifying acquired material appearance and reconstructed surface geometry, which is an important aspect of digital content creation. It is also useful for identifying and improving issues in the different steps of the pipeline. In this work, we use it to improve reconstruction, apply analysis by synthesis to estimate optical properties, and to develop our method for scene reassembly.

U2 - 10.1364/AO.56.007679

DO - 10.1364/AO.56.007679

M3 - Journal article

VL - 56

SP - 7679

EP - 7690

JO - Applied Optics

JF - Applied Optics

SN - 1559-128X

IS - 27

ER -