VR Procedural Virtual Hand Mesh Animation Using OpenXR Hand-Tracking - Part 2
Hands! We use them for everything: typing, eating, waving, and... well, let’s just say they’re versatile tools.
Today, we will keep building on what we did in the previous tutorial: Animating Virtual Hand Meshes Using OpenXR Hand-Tracking Data.
If you’re new to this series, I highly recommend checking out the first video before diving into this one. We have already covered the fundamentals of hand-tracking using OpenXR and Unreal Engine, which you’ll need to understand before this tutorial.
In order to keep the video duration short, I’ve decided to split this second tutorial into two parts.
So, it's time to grab your VR headset, fire up Unreal Engine, and let’s get started!
Building on the Introduction to Virtual Reality, OpenXR Hand-Tracking, and Gesture Recognition in Unreal Engine tutorial, this slightly more advanced tutorial will dive deeper into the following topics:
Transitioning seamlessly between motion controller and hand-tracking modes in Unreal Engine.
Adding custom debugging gizmos to improve development and testing workflows.
Visualizing debug virtual hands by incorporating the custom gizmos.
Animating virtual hand meshes with OpenXR hand-tracking data, moving beyond basic joint representation with cubes.
Re-using and adapting the gesture recognition code from the introductory tutorial to integrate with the new animated virtual hand meshes.
This guide will help you take your VR projects to the next level with polished and practical implementations.
00:00:00 - 00:00:40 Intro
00:00:41 - 00:01:12 Prerequisite Tutorials
00:01:13 - 00:01:36 Picking Up Where We Left
00:01:37 - 00:17:33 Update XR Hand Function
00:17:34 - 00:34:05 Bone Names
00:34:06 - 00:42:58 Get Hand Mesh Bone Names Function
00:42:59 - 00:48:30 Fixing the Distorted Hand Meshes
00:48:31 - 00:56:53 Get Hand Mesh Bone Location And Rotation Function
00:56:54 - 01:00:05 Experimenting with the Animation Bone Correction Rotation Offset
01:00:06 - 01:09:18 Check Gestures Function
01:09:19 - 01:09:36 Final Results
01:09:37 - 01:10:15 Conclusion
Introductory tutorial: • Introduction to Virtual Reality, OpenXR Ha...
Part 1: • VR Procedural Virtual Hand Mesh Animation ...
This blog post contains the links to the project source files on Microsoft Azure DevOps Repositories and GitLab: https://www.babaei.net/blog/unreal-en...