Real-time High Resolution 3D Data
on the HoloLens

The recent appearance of augmented reality headsets, such as the Microsoft HoloLens, is a marked move from traditional 2D screen to 3D hologram-like interfaces. Striving to be completely portable, these devices unfortunately suffer multiple limitations, such as the lack of real-time, high quality depth data, which severely restricts their use as research tools. To mitigate this restriction, we provide a simple method to augment a HoloLens headset with much higher resolution depth data. To do so, we calibrate an external depth sensor connected to a computer stick that communicates with the HoloLens headset in real-time. To show how this system could be useful to the research community, we present an implementation of small object detection on HoloLens device.

Paper

Mathieu Garon, Pierre-Olivier Boulet, Jean-Philippe Doiron, Luc Beaulieu, and Jean-Fran├žois Lalonde
Real-time High Resolution 3D Data on the HoloLens
International Symposium on Mixed and Augmented Reality (ISMAR), 2016.
[BibTeX, PDF pre-print, 11.7MB]


Poster

You can download the poster presented at ISMAR'16 in PDF format.

Video

CAD models

We provide the CAD models used in this project free of use. If you use them, please cite our paper.

Realsense mount

HoloLens mount

Acknowledgements

The authors gratefully acknowledge the following funding sources:


Ulaval logo
Frima logo