HoloLens Projection proof of concept applies augmented reality to the human body

Kit McDonald

Microsoft HoloLens can do some pretty amazing things, from useful contributions such as training mechanics and pilots for Japan Airlines to helping provide a new dimension of entertainment. Now it’s being used in collaboration with Kinect to superimpose the skeletal structure of a human body on the figure.

Consulting firm Valorem has been a partner with Microsoft for a while now. It excels in providing consultation across clouds and analytics. This time, however, they got their their hands on the augmented reality device HoloLens. Their most recent video shows the result of them putting together their own tracking method to show off the human skeleton in action.

Our proof of concept demonstrates how to use the HoloLens to project augmented information onto a human body. The person’s live body movements are being tracked by an external sensor & the tracking data is then sent to the HoloLens. The HoloLens wearer can see a virtual 3D model of a skeleton overlaid onto an actual body. The HoloLens and the external sensor space coordinates need to be aligned in order to have a matching overlay. Our solution utilizes a customized, intuitive calibration process & as a result we are able to achieve the matching overlay without requiring any additional references.

The HoloLens Projection for skeletons isn’t the only video they’ve revealed about their experiences with HoloLens. They also added another that used the Kinect to build a virtual 3D avatar. It’s more than likely that this is what inspired the fully visual skeletal image on the person’s body.

The skeleton is even able to move along with the human figure, albeit at a small delay. The possibilities of super imposing skeletal images over a person’s body can even lead to future medical advances. Suppose the HoloLens is used with other devices to determine the location of a balance anomaly. On a more tame level, it could assist with teaching medical students more precise anatomy.

The video notes that their consultation is a work in progress. It will be very interesting to see more come from their findings in the near future.