Representation and Coding of Large-Scale 3D Dynamic Maps

    •  Cohen, R.A., Tian, D., Krivokuca, M., Sugimoto, K., Vetro, A., Wakimoto, K., Sekiguchi, S.-I., "Representation and Coding of Large-Scale 3D Dynamic Maps", SPIE Conference on Applications of Digital Image Processing, DOI: 10.1117/​12.2237755, September 2016, vol. 9971.
      BibTeX TR2016-116 PDF
      • @inproceedings{Cohen2016sep2,
      • author = {Cohen, Robert A. and Tian, Dong and Krivokuca, Maja and Sugimoto, Kazuo and Vetro, Anthony and Wakimoto, Koji and Sekiguchi, Shun-ichi},
      • title = {Representation and Coding of Large-Scale 3D Dynamic Maps},
      • booktitle = {SPIE Conference on Applications of Digital Image Processing},
      • year = 2016,
      • volume = 9971,
      • month = sep,
      • doi = {10.1117/12.2237755},
      • url = {}
      • }
  • MERL Contact:
  • Research Area:

    Digital Video


Large-scale 3D maps of indoor and outdoor environments can be created using devices that provide localization combined with depth and color measurements of the surrounding environment. Localization could be achieved with GPS, inertial measurement units (IMU), cameras, or combinations of these and other devices, while the depth measurements could be achieved with time-of-flight, radar or laser scanning systems. The resulting 3D maps, which are composed of 3D point clouds with various attributes, could be used for a variety of applications, including finding your way around indoor spaces, navigating vehicles around a city, space planning, topographical surveying or public surveying of infrastructure and roads, augmented reality, immersive online experiences, and much more. This paper discusses application requirements related to the representation and coding of large-scale 3D dynamic maps. In particular, we address requirements related to different types of acquisition environments, scalability in terms of progressive transmission and efficiently rendering different levels of details, as well as key attributes to be included in the representation. Additionally, an overview of recently developed coding techniques is presented, including an assessment of current performance. Finally, technical challenges and needs for future standardization are discussed.