Fixed Viewpoint Mirror Surface Reconstruction under an Uncalibrated Camera
Kai Han1Miaomiao Liu2Dirk Schnieders3Kwan-Yee K. Wong3
1University of Bristol   2Australian National University   3The University of Hong Kong


Paper (TIP'21) [PDF]    Supplementary [PDF]    Paper (CVPR'16) [PDF]    Code [MATLAB]




Abstract

This paper addresses the problem of mirror surface reconstruction, and proposes a solution based on observing the reflections of a moving reference plane on the mirror surface. Unlike previous approaches which require tedious calibration, our method can recover the camera intrinsics, the poses of the reference plane, as well as the mirror surface from the observed reflections of the reference plane under at least three unknown distinct poses. We first show that the 3D poses of the reference plane can be estimated from the reflection correspondences established between the images and the reference plane. We then form a bunch of 3D lines from the reflection correspondences, and derive an analytical solution to recover the line projection matrix. We transform the line projection matrix to its equivalent camera projection matrix, and propose a cross-ratio based formulation to optimize the camera projection matrix by minimizing reprojection errors. The mirror surface is then reconstructed based on the optimized cross-ratio constraint. Experimental results on both synthetic and real data are presented, which demonstrate the feasibility and accuracy of our method.


BibTex

        
  @article{han21fixed,
   title   = {Fixed Viewpoint Mirror Surface Reconstruction under an Uncalibrated Camera},
   author  = {Kai Han and Miaomiao Liu and Dirk Schnieders and Kwan-Yee K. Wong},
   journal = {IEEE Transactions on Image Processing (TIP)},
   year    = {2021}
  }

  @inproceedings{han16mirror,
   author    = {Kai Han and Kwan-Yee K. Wong and Dirk Schnieders and Miaomiao Liu},
   title     = {Mirror Surface Reconstruction under an Uncalibrated Camera},
   booktitle = {IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
   year      = {2016}
  }
        
        

Acknowledgments

This project is supported by a grant from the Research Grant Council of the Hong Kong (SAR), China, under the project HKU 17203119 and a grant (DE180100628) from Australian Research Council (ARC).


Webpage template was originally made by Phillip Isola and Richard Zhang for a colorful ECCV project; the code can be found here.