Visualization and labeling of point clouds in virtual reality

Jonathan Dyssel Stets, Yongbin Sun, Scott W. Greenwald, Wiley Corning

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review


We present a Virtual Reality (VR) application for labeling and handling point cloud data sets. A series of room-scale point clouds are recorded as a video sequence using a Microsoft Kinect. The data can be played and paused, and frames can be skipped just like in a video player. The user can walk around and inspect the data while it is playing or paused. Using the tracked hand-held controller, the user can select and label individual parts of the point cloud. The points are highlighted with a color when they are labeled. With a tracking algorithm, the labeled points can be tracked from frame to frame to ease the labeling process. Our sample data is an RGB point cloud recording of two people juggling with pins. Here, the user can select and label, for example, the juggler pins as shown in Figure 1. Each juggler pin is labeled with various colors to indicate different labels.
Original languageEnglish
Title of host publicationProceedings of SA '17 SIGGRAPH Asia 2017
Number of pages2
PublisherAssociation for Computing Machinery
Publication date2017
Article number31
ISBN (Print)978-1-4503-5405-9
Publication statusPublished - 2017
Event10th SIGGRAPH Asia - Bangkok, Thailand
Duration: 27 Nov 201730 Nov 2017


Conference10th SIGGRAPH Asia


  • Virtual Reality
  • Point Cloud

Cite this

Stets, J. D., Sun, Y., Greenwald, S. W., & Corning, W. (2017). Visualization and labeling of point clouds in virtual reality. In Proceedings of SA '17 SIGGRAPH Asia 2017 [31] Association for Computing Machinery.