MediaPipe4U is an UnrealEngine plugin that integrates Google Mediapipe technology for motion capture and puppeteering 3D avatar through webcam, videos, and images in realtime
Project page:
https://github.com/endink/Mediapipe4u...
Note:
Its only support UE 5.0.x, dont use it to UE 5.1 or UE 4.X.
There is an license file in the plugin (More info about it, please read doc), which will expire at the end of December, but I will upload the new license file on github pages before it expires, which means that for personal users it is free, but it is difficult to use for commercial projects.
PS: This is a long nanny-level tutorial that starts with creating a project to help you get started quickly with MediaPipe4U to drive Metahuman, covering motion capture, finger capture, expression capture (no Apple required, no Nvidia GPU natural face patch, ARKit 51 compatible BS)
00:00 Project creation and plugin installation
07:32 Metahuman Import
11:00 Motion Capure Configuration
23:00 Motion Capture Problem Handling
26:14 Ground IK Configuration
30:54 Face Capture Configuration