Getting Blendshapes: How to Bring Face Tracking Data From VTubeStudio Into Your Own Program
This is my documentation.
00:00 Introduction
00:21 Part I: Network Communication
01:10 Computers are connected
02:11 How VTube Studio Communicates
03:29 Timing
05:30 Part II: This is Graphic Stuff
07:03 cgltf to the rescue
07:28 "Shape Keys" (in Blender)
09:12 (cgltf) Data Structure (Attributes/Hierarchy)
10:24 Side note about Buffers, Vertex Buffers
11:11 The Hierarchy Comparison
11:32 Models in Raylib
12:35 Part III: Blendshapes (finally)
14:37 glTF Extensions
15:38 How Blendshapes are Computed
16:09 The Loop
17:12 Most applications, ever.
18:49 Optimizing: The Beginning
19:31 Part IV: Multithreading
21:10 Closing Remarks & Bug Fixes
22:02 I'm Done!
22:22 Future Directions
Send Message to Port 21412: {\"messageType\":\"iOSTrackingDataRequest\",\"sentBy\":\"SoftwareName\",\"sendForSeconds\":1,\"ports\":[50506]}
OpenMP (in Visual Studio): https://learn.microsoft.com/en-us/cpp...
VSeeFace: https://www.vseeface.icu/
VTubeStudio Wiki: https://github.com/DenchiSoft/VTubeSt...
Sending Data to VSeeFace: https://github.com/DenchiSoft/VTubeSt...
glTF Morph Target Spec: https://github.com/KhronosGroup/glTF-...
glTF No Morph Targets, use Extensions: https://github.com/KhronosGroup/glTF/...
Raylib: https://github.com/raysan5/raylib/tre...
RayGUI: https://github.com/raysan5/raygui/blo...
Assigned TCP/UDP Ports: https://en.wikipedia.org/wiki/List_of...
cGLTF: https://github.com/jkuhlmann/cgltf/bl...
JSMN C JSON parser: https://github.com/zserge/jsmn
time.h: https://cplusplus.com/reference/ctime/
Visual Studio Debugger is sometimes wrong, apparently: https://developercommunity.visualstud...