Now with an insanely accurate tracker! Lockdown is a revolutionary new plug-in that allows you to track warping surfaces inside After Effects.
Perfect for beauty retouching and other previously difficult cleanup jobs!
I’d just like to stress that Lockdown for Resolve is currently in Beta, and there are expected to be issues, potential crashes, etc… since this is our first broad testing of the plugin. Please make sure to send in help tickets and log reports for anything you find, and we’ll patch issues as quicklty as we can! Thank you.
Choosing a Lockdown Frame
To set the frame you’d like to paint or apply graphics to, press the “Set Lockdown Mesh/UV Frame” button. It will create a green bar in the popout timeline. The Lockdown frame is no longer set by the “Lockdown!” Button. This is honestly the slowest and most boring tutorial I’ve ever made, but if you’re even slightly confused by the concept of what the “Lockdown frame” is, please watch it. This feature will release with Lockdown 2.5.
Pre-composing and setting up your footage/composition for tracking (After Effects)
The layer that Lockdown is applied to, and the Composition that layer is in, must have the same resolution and framerate for Lockdown to work. If you arenโt 100% sure how to set that up on your own, just press the Pre-compose button at the top of the plugin. The script will pre-compose your layer and set everything inside the pre-comp to all the correct settings, and you can work with Lockdown in there.
Tracking algorithms and how to tweak them
There are two tracking modes:
Accurate 1.6: Fast, and good for simple shots with lots of detail.
Extremely Accurate: Slow, but better than ‘Accurate 1.6’ in every other way. Increasing Tracking Scale can slightly improve the results of Accurate 1.6 when objects are moving quickly, however you won’t get much better results above 25 pixels, except in extreme cases. At that point, you’re better off just using “Extremely Accurate”.
Tracking Target Resolution: There are two steps to tracking, one of which is tracking the general motion of the shot, the second is finding a pixel accurate match. Lowering the ‘Tracking Target Resolution’ ONLY reduces the resolution of step 1. Some people assume tracking a 4k shot at 540p will reduce quality, and the vast majority of the time it will be a pixel perfect match against if you had run the process at 4k, because the secondary processing to pixel match is at 4k for both cases.The summary- track at 540p as often as possible. Sometimes you may want to bump it up to 1080p because the Accurate 1.6 mode isn’t as good at working with low resolution video, and this might prevent points from skipping around. But again, ‘Extremely Accurate’ is probably a better solution than tinkering with Accurate 1.6.
Track Adjustment
When a point drifts away from itโs target, click and drag it to put it back in place. Adjustment keyframes are an additional layer of animation that adds on top of your base track. Itโs a very fast way to fix drifts.
Track Refinement
Refinement is for when Adjustment isnโt enough, and you have to deal with a track thatโs going in the completely wrong direction. itโs a hugely important concept, please see this video
Tracking Offscreen Objects, and Expanding Your Mesh
The two different interpolation types (tracking planar surfaces, or non-planar surfaces)
Tracking behind overlapping objects
And please check ot this video if you have any difficulty setting up the masks in Resolve. The short summary is your RGB channels should be completely unaffected going into Lockdown, and your alpha channel needs to be below 50%.
Stabilized Tracking
This feature will release with Lockdown 2.5, thank you for your patience.
Caching Track data (Make high res video track quickly)
In short, just open the options menu, and enable the disk cache. This will make it so after you’ve tracked a shot once, it maintain that tracking data, and track very quickly every time following. This uses as much disk space as you allow, which is why it’s off by default.
Customizing a mesh
Sometimes it makes sense to draw your mesh manually, to conform to natural borders in your shot. The geometry on the left may deform better than the geometry on the right, especially when the mouth opens, or when imported into a 3D application.
Select a point, then Ctrl-Shift-Click another point to connect the two with an edge.
Alt-click an edge to delete it.
Alt-shift-click and drag to draw a line which deletes all edges in its path.
Auto-Triangulate Mesh will triangulate all points can, but will NOT bisect any quads. (This is good because quads render better than triangles in 3D software)
Clear Mesh will remove the entire mesh.
Video Summary:
Locking down your mesh and applying a texture (After Effects)
This button sets up a texture to apply to your mesh.
It creates a “Lockdown Graphics Composition” with a stabilized copy of your mesh inside, and a still frame of the frame you’ve chosen to stick graphics to. It creates a checkerboard for preview purposes. The stabilized layer is created as a non rendering guide layer.
It places this composition in the Lockdown Graphics Comp slot to reference the texture.
It duplicates your layer as a background layer.
If youโre applying graphics, just drop graphics into the stabilized pre-comp. If youโre painting the layer, you should apply paint directly to the stabilized video layer inside the Lockdown Pre-comp. You must first make it not a guide layer, this video explains why:
UnLockdown! (After Effects)
This undoes the Lockdown process, allowing you to refine tracking points.
Please note that if you Lockdown, then UnLockdown a shot, you must press Lockdown on the same frame you had originally, or the graphics will not match. Pressing Lockdown chooses the current frame as the projection frame, so it’s important to keep track of that.
Optional Tracking Filter (After Effects)
This optional button applies effects that sometimes allow our tracker better identify textures. It’s basically an edge-detect with a lot of contrast. You should be in 16 or 32-bit mode when using this filter. Running a denoiser on the original footage, and again on the final result also improves trackability. This is great for a shot where lighting is changing, because it brings out details in cracks and surfaces, and tends to ignore larger gradients. Itโs great for faces, where there is tons of detail to be tracked in the pores of the skin. Without the filter, the tracking points may follow shadows and highlights sliding across the face, rather than the skin. With this filter, they will lock onto pores and skin details. Keep in mind this filter becomes far less effective with compressed video, like mp4. This video explains:
Rotoscoping using Lockdown
The short summary is that when you stabilize your composition, you can create masks over the stabilized footage, which will follow the motion of your shot. Here is a fast overview.
Exporting To Alembic (Cinema 4D)
Advanced Controls (After Effects):
Stabilized
This is automatically set by the Plug-in and script, you should never have to think about it. However, for advanced users, it simply toggles whether the mesh is stabilized or moved. Useful if you change a few tracking points on your stabilized comp, then want to copy and paste your Lockdown effect to your un-stabilized comp. You can just paste then toggle Stabilized to off.
Internalize Selected Points
This puts all the points INSIDE the plug-in away, from your view. This is going to make every step of working with Lockdown faster. Tracked points are internalized by default.
Externalize Selected Points
This takes your selected points, and exposes them as normal position keyframes at the bottom of the Lockdown Plug-in, under the “Externalized Points” dropdown. You should only ever externalize points when you notice errors in the track and want to modify them. Whenever you’re done editing points and want to start building a mesh, re-internalize them. It’s not recommended to use expressions with these points, or connect them to outside rigging, at this point it’s something we haven’t tested. We are currently allowing externalized points to be used as part of a mesh with the hopes that eventually this will become advantageous, but please just internalize your points in all normal situations.
Externalized Points
You are given 4 total points which you can manually edit within the typical After Effects graph editor. This used to be 500, but we found that it was causing significant slow down with user interaction speeds.
To get points in from Mocha, you can paste the four corner position data into the externalized points. Upon pasting, an externalized point will be created. Again, please internalize these as soon as possible.
Internal Keyframe time ref
This is a reference keyframe. A big problem with Lockdown’s internalized keyframes is that they are ‘oblivious’ to what timecode they should appear at. Whenever you track, Lockdown takes this keyframe, and places it at the in-point of the shot. All the internal keyframes look at this keyframe and say “I should appear x frames after this reference keyframe” in order to stay in sync with the rest of the project. Please note that you should never have to touch or think about this parameter if you use the script and follow the steps from 1-9. The most common place this may be useful is if you’re conforming color footage, and the timecode changes on a clip when you do a footage swap. For a simple example:
You track some raw footage which is 45 seconds long. Your in-point is at 30 seconds in. When you track, Lockdown places the “internal keyframe time ref” here, at your in-point. Now you receive some new footage back from a colorist, but it’s only 10 seconds long. If you paste Lockdown to the color footage, the timecode isn’t the same, so Lockdown doesn’t know which frames it’s keyframes should be on. You can find the same exact frame in the color footage, and slide this “internal keyframe time ref” to its position, and now the tracking will match exactly, even though the timecode is different.
Leave a Reply
You must be logged in to post a comment.