Photogrammetry with Metashape and Nuke
Taught by Hugo Léveillé
- Course Number:
- Software Version:
- Original Run Date:
- December 2019
- 6 hours 15 minutes
The course covers two projects. The first one will be an introduction to how you can use photogrammetry along with Nuke. In the second one, you’ll take what you learn, get serious, and push things to the next level. This is the perfect training for anyone wanting to learn Metashape or any compositor that want to learn several advanced tricks in Nuke!
Hugo Léveillé is currently head of compositing at Mels Studios in Montreal. With over 15 years of VFX experiences, he also shares his work time by creating and integrating pipeline tools for Nuke.
Class 1: The basics of photogrammetryAn examination of the important camera settings to make sure we get the best results in Metashape. Then, a sneak-peek of everything that will be covered in the upcoming course.
Class 2: Metashape OverviewA dive into Metashape with a look at the various steps needed to reproduce our object. We examine the important aspects of the interface as well as the various navigation tools. We go through the solving of the cameras, generating the sparse point cloud and dense point cloud and then generate our 3D mesh and how to generate a texture. The class ends with a look at how the batch processing of Metashape can be used to automate the workflow.
Class 3: Staring on Project OneWe prepare our first project in Nuke. We see how to track our shot using Nuke’s 3D camera tracker. A look at how to manage the lens distortion and how to set up proxy geometry so that we can validate our camera move before importing our model.
Class 4: Getting the object into NukeHow to import the geometry from Metashape as well as the solved cameras. Then, using the undistorted photos, we see how to do a re-projection of the object directly inside Nuke. Then, we’ll see how the edit geo node can sometimes help to modify the geometry without going back in a 3D software to do minor fixes.
Class 5: It’s time to compNow that our scene is ready and we know how to import our mesh, let’s put all this together. We see how to integrate the mesh in the scene while learning some tricks like using the position pass and some edge techniques to blend the object in the composite.
Class 6: Advanced MetashapeNow that we know our way around Metashape, it’s time to get serious. This project will require many objects out of Metashape so we inspect what we will be using and learn other tricks like masking and editing geometry directly in Metashape to delete portions of the object and fill some holes. Then, we plan our shot in Nuke and start the tracking process, this time, using the overscan camera. We also cover how to modify our elements to accommodate this technique.
Class 7: Project Two: Foreground ElementsWe use projection techniques to blend our objects on the ground, re-project shadows, and use the FillMat node to holdout portions of our objects. The elements are integrated by re-projecting different textures, adding fire elements, as well as generating a heat shimmer effect for the fire.
Class 8: Project Two: Fixing ProblemsNot everything is perfect, so it’s time to fix modelling problems from Metashape directly inside Nuke by using the deformGeo node. We also see how to extend our wall with the editGeo node.
Class 9: Finishing touchesWe put all the pieces of the puzzle together. We see how to add reflections in our scene, fake shadows, re-project the original plate with a new camera, and finalize the shot by adding motion blur.