TY - JOUR
T1 - Surface reconstruction from structured light images using differentiable rendering
AU - Jensen, Janus Nørtoft
AU - Hannemose, Morten
AU - Bærentzen, Jakob Andreas
AU - Wilm, Jakob
AU - Frisvad, Jeppe Revall
AU - Dahl, Anders Bjorholm
PY - 2021/2/2
Y1 - 2021/2/2
N2 - When 3D scanning objects, the objective is usually to obtain a continuous surface. However, most surface scanning methods, such as structured light scanning, yield a point cloud. Obtaining a continuous surface from a point cloud requires a subsequent surface reconstruction step, which is directly affected by any error from the computation of the point cloud. In this work, we propose a one-step approach in which we compute the surface directly from structured light images. Our method minimizes the least-squares error between photographs and renderings of a triangle mesh, where the vertex positions of the mesh are the parameters of the minimization problem. To ensure fast iterations during optimization, we use differentiable rendering, which computes images and gradients in a single pass. We present simulation experiments demonstrating that our method for computing a triangle mesh has several advantages over approaches that rely on an intermediate point cloud. Our method can produce accurate reconstructions when initializing the optimization from a sphere. We also show that our method is good at reconstructing sharp edges and that it is robust with respect to image noise. In addition, our method can improve the output from other reconstruction algorithms if we use these for initialization.
AB - When 3D scanning objects, the objective is usually to obtain a continuous surface. However, most surface scanning methods, such as structured light scanning, yield a point cloud. Obtaining a continuous surface from a point cloud requires a subsequent surface reconstruction step, which is directly affected by any error from the computation of the point cloud. In this work, we propose a one-step approach in which we compute the surface directly from structured light images. Our method minimizes the least-squares error between photographs and renderings of a triangle mesh, where the vertex positions of the mesh are the parameters of the minimization problem. To ensure fast iterations during optimization, we use differentiable rendering, which computes images and gradients in a single pass. We present simulation experiments demonstrating that our method for computing a triangle mesh has several advantages over approaches that rely on an intermediate point cloud. Our method can produce accurate reconstructions when initializing the optimization from a sphere. We also show that our method is good at reconstructing sharp edges and that it is robust with respect to image noise. In addition, our method can improve the output from other reconstruction algorithms if we use these for initialization.
KW - 3D scanning
KW - 3D surface reconstruction
KW - Differentiable rendering
KW - Structured light
U2 - 10.3390/s21041068
DO - 10.3390/s21041068
M3 - Journal article
C2 - 33557230
AN - SCOPUS:85100259403
SN - 1424-8220
VL - 21
SP - 1
EP - 16
JO - Sensors (Switzerland)
JF - Sensors (Switzerland)
IS - 4
M1 - 1068
ER -