Motion Capture from an Anime Character
In the video, the central Hatsune Miku avatar is driven by optical motion capture of a real person on the left, while the Hatsune Miku on the right is driven by video motion capture based on the central Hatsune Miku.
You can see real-time motion recognition in the bottom left corner of the screen.
(Using anime characters as inputs for video motion capture is not best practice and is just for fun)
The motion is captured using Dollars MONO and streamed to Unity in real time.
(The original video was edited to retain only the cartoon character parts.)
Dollars MONO:
Real-Time Facial and Full-Body Motion Capture with Finger Tracking Using a Web Camera or Video Files
https://www.dollarsmocap.com/mono
Hatsune Miku Model on the right:
3Dモデル「止丸式初音ミクNT」
https://booth.pm/en/items/3226395
#miku #mmd #animation #mocap #motioncapture