Project Dynamo (Monthlies)
Another monthly project at the UTS Animal Logic Academy.
Nathan Le wanted to try integrating a CGI robot into live action footage, so we went to Cockatoo Island. The robot was stolen from Sketchfab, then rigged and animated by Nathan.
https://skfb.ly/oBIMJ
I tried rebuilding the environment with Gaussian Splatting and NeRFs, but our dataset was too small so I did it manually based on point clouds from COLMAP. I also used Nuke's camera tracker for the first time.
Next I tried Ian Hubert's LUT maker to match our camera curve, but we didn't record log footage so it wasn't very effective. Ruben Luzaic did a fantastic job matching the lighting manually.