TR2012-033

Convex Bricks: A New Primitive for Visual Hull Modeling and Reconstruction


    •  Chari, V., Agrawal, A., Taguchi, Y., Ramalingam, S., "Convex Bricks: A New Primitive for Visual Hull Modeling and Reconstruction", IEEE International Conference on Robotics and Automation (ICRA), May 2012, pp. :770-777.
      BibTeX TR2012-033 PDF
      • @inproceedings{Chari2012may,
      • author = {Chari, V. and Agrawal, A. and Taguchi, Y. and Ramalingam, S.},
      • title = {Convex Bricks: A New Primitive for Visual Hull Modeling and Reconstruction},
      • booktitle = {IEEE International Conference on Robotics and Automation (ICRA)},
      • year = 2012,
      • pages = {:770--777},
      • month = may,
      • url = {https://www.merl.com/publications/TR2012-033}
      • }
  • Research Areas:

    Computer Vision, Robotics

TR Image
Abstract:

Industrial automation tasks typically require a 3D model of the object for robotic manipulation. The ability to reconstruct the 3D model using a sample object is useful when CAD models are not available. For textureless objects, visual hull of the object obtained using silhouette- based reconstruction can avoid expensive 3D scanners for 3D modeling. We propose convex brick (CB), a new 3D primitive for modeling and reconstructing a visual hull from silhouettes. CB's are powerful in modeling arbitrary non-convex 3D shapes. Using CB, we describe an algorithm to generate a polyhedral visual hull from polygonal silhouettes; the visual hull is reconstructed as a combination of 3D convex bricks. Our approach uses well studied geometric operations such as 2D convex decomposition and intersection of 3D convex cones using linear programming. The shape of CB can adapt to the given silhouettes, thereby significantly reducing the number of primitives required for a volumetric representation. Our framework allows easy control of reconstruction parameters such as accuracy and the number of required primitives. We present an extensive analysis of our algorithm and show visual hull reconstruction on challenging real datasets consisting of highly non-convex shapes. We also how real results on pose estimation of an industrial part in a bin-picking system using the reconstructed visual hull.

 

  • Related News & Events

    •  NEWS    ICRA 2012: 3 publications by Yuichi Taguchi, Srikumar Ramalingam, Amit K. Agrawal, C. Oncel Tuzel and Ming-Yu Liu
      Date: May 14, 2012
      Where: IEEE International Conference on Robotics and Automation (ICRA)
      Research Area: Computer Vision
      Brief
      • The papers "Voting-based Pose Estimation for Robotic Assembly Using a 3D Sensor" by Choi, C., Taguchi, Y., Tuzel, O., Liu, M.-Y. and Ramalingam, S., "Convex Bricks: A New Primitive for Visual Hull Modeling and Reconstruction" by Chari, V., Agrawal, A., Taguchi, Y. and Ramalingam, S. and "Coverage Optimized Active Learning for k - NN Classifiers" by Joshi, A.J., Porikli, F. and Papanikolopoulos, N. were presented at the IEEE International Conference on Robotics and Automation (ICRA).
    •