Viewpoint selection for material reconstruction using inverse rendering of geometric models

V. V. Sanzharov^a, V. A. Frolov^ab, V. A. Galaktionov<sup>b

a</sup> Lomonosov Moscow State University
^b Keldysh Institute of Applied Mathematics of Russian Academy of Sciences

Abstract: Viewpoint selection methods for 3D scenes are used in computer vision, computer graphics and scientific visualization to obtain views that are most suitable for the problem at hand. In this paper, a method for viewpoint selection based on inverse rendering is proposed for material reconstruction. The proposed method solves the problem of selecting arbitrary views (i.e., not from a predefined set) based on various view quality estimates using geometric characteristics of the target 3D object. The proposed method allows using both differentiable rendering-based and gradient-free optimization implementations of inverse rendering. The proposed method was tested on an open dataset for 3D reconstruction. Testing showed an increase in reconstruction quality when using the proposed method with various view quality estimates compared to naive viewpoint selection strategies.

Keywords: inverse rendering, materials reconstruction, viewpoint selection

DOI: 10.15514/ISPRAS-2025-37(4)-20