We’ve got a new version of Beauty Box, our AI based digital makeup and retouching plugin, coming soon! It’ll be released before NAB, but we’ll definitely be showing that off. The big new feature uses AI to whiten teeth. We’ve always used AI in other ways in Beauty Box, but this is a much more sophisticated version. We’ve put a lot of work into it and we’re pretty excited about it.
There will also be a couple other announcements/release around April, so stayed tune for that. If you haven’t chatted with us lately, come by the booth and say hello. You can learn about all the new stuff. Including Data Storyteller which we released a few months ago and won a Best of NAB 2023 from Videomaker!
Beauty Box’s settings are resolution dependent. This means the same settings you have for HD may not work for 4K. On a basic level, it’s similar to applying a blur. A Gaussian Blur of 1.0 might be too much for a low res, 640×480 image, but might be almost unnoticeable on a 4K image.
Also, the ‘right’ settings may depending on the framing of the shot. Is the footage a tight close up where the talent’s face fills most of the frame? Or is it pulled back to show three or four actors? The settings that are ideal for one of those examples, probably won’t be ideal for the other one.
The default settings for Beauty Box are really designed for HD. And even for HD they may be a bit heavy, depending on the footage.
Often they aren’t the ideal settings for 4K (or 12K or whatever).
So in this post we’ll talk about what to do if you have 4K footage and aren’t getting the look you want.
Mainly I want to focus on Skin Detail Smoothing, as I think that plays a bigger role than most people think. AND you can set it negative!
Skin Detail Smoothing
As you might expect from the name, this attempts to smooth out smaller features of the skin: pores and other small textures. It provides sort of a second level of smoothing on top of the overall skin smoothing. You generally want this set to a lower value than the Smoothing Amount parameter.
If it’s set too high relative to Smoothing Amount, you can end up with the skin looking somewhat blurry and blotchy. This is due to Skin Detail Smoothing working on smaller areas of the skin. So instead of the overall smoothing, you get a very localized blur which can look blotchy.
So, first off: Set Skin Detail Smoothing to a lower value than Smoothing Amount. (usually: there are no hard and fast rules with this. It’s going to depend on your footage. But most of the time that’s a very good rule of thumb.
Negative Skin Detail Smoothing
With 4k and higher resolutions it’s sometimes helpful to have a slightly negative value for Skin Detail Smoothing. Like -5 or -10. The smoothing algorithms occasionally add too much softness and a slightly negative value brings back some of the skin texture.
In the example, the area around her nose gets a bit soft and using a negative value, IMO, gives it a better look. The adjustment is pretty subtle but it does have an effect. You may have to download the full res images and compare them in Photoshop to truly see the difference. (click on the thumbnails below to see the full res images)
This definitely isn’t the case for all 4K footage and, as always, you’ll need to dial in the exact settings that work for your footage. But it’s important to know that Skin Detail Smoothing can be set negative and sometimes that’s beneficial.
Of course, I want to emphasize SLIGHTLY negative. Our Ugly Box free plugin makes use of negative Skin Detail Smoothing in a way that won’t make your footage look better. If you set it to -400… it’s good for Halloween but usually your clients won’t like you very much.
We here at Digital Anarchy want to make sure you have a wonderful Christmas and there’s no better way to do that than to take videos of family and colleagues and turn them into the Grinch. They’ll love it! Clients, too… although they may not appreciate it as much even if they are the most deserving. So just play it at the office Christmas party as therapy for the staff that has to deal with them.
Our free plugin Ugly Box will make it easy to do! Apply it to the footage, click Make Ugly, and then make them green! This short tutorial shows you how:
You can download the free Ugly Box plugin for After Effects, Premiere Pro, Final Cut Pro, and Avid here:
Of course, if you want to make people look BETTER, there’s always Beauty Box to help you apply a bit of digital makeup. It makes retouching video easy, get more info on it here:
We have a new set of tutorials up that will show you how to easily create masks and animate them for Beauty Box. This is extremely useful if you want to limit the skin retouching to just certain areas like the cheeks or forehead.
Traditionally this type of work has been the province of feature films and other big budget productions that had the money and time to hire rotoscopers to create masks frame by frame. New tools built into After Effects and Premiere Pro or available from third parties for FCP make this technique accessible to video editors and compositors on a much more modest budget or time constraints.
How Does Retouching Work Traditionally?
In the past someone would have to create a mask on Frame 1 and move forward frame by frame, adjusting the mask on EVERY frame as the actor moved. This was a laborious and time consuming way of retouching video/film. The idea for Beauty Box came from watching a visual effects artist explain his process for retouching a music video of a high profile band of 40-somethings. Frame by frame by tedious frame. I thought there had to be an easier way and a few years later we released Beauty Box.
However, Beauty Box affects the entire image by default. The mask it creates affects all skin areas. This works very well for many uses but if you wanted more subtle retouching… you still had to go frame by frame.
The New Tools!
After Effects and Premiere have some amazing new tools for tracking mask points. You can apply bezier masks that only masks the effect of a plugin, like Beauty Box. The bezier points are ‘tracking’ points. Meaning that as the actor moves, the points move with him. It usually works very well, especially for talking head type footage where the talent isn’t moving around a lot. It’s a really impressive feature. It’s available in both AE and Premiere Pro. Here’s a tutorial detailing how it works in Premiere:
After Effects also ships with Mocha Pro, another great tool for doing this type of work. This tutorial shows how to use Mocha and After Effects to control Beauty Box and get some, uh, ‘creative’ skin retouching effects!
The power of Mocha is also available for Final Cut Pro X as well. It’s available as a plugin from CoreMelt and they were kind enough to do a tutorial explaining how Splice X works with Beauty Box within FCP. It’s another very cool plugin, here’s the tutorial:
We’re excited to announce that Beauty Box Video 4.0 is now available for Avid and OpenFX Apps: Davinci Resolve, Assimilate Scratch, Sony Vegas, NUKE, and more. This is in addition to After Effects, Premiere Pro, and Final Cut Pro which were announced in April.
Beauty Box Video 4.0 adds real time rendering to the high quality, automatic skin retouching that Beauty Box is famous for. It’s not only the best retouching plugin available but it’s now one of the fastest, especially on newer graphics cards like the Nvidia GTX 980. We’re seeing real time or near real time performance in Premiere Pro, Resolve, and FCP. Other apps may not see quite that performance but they still get a significant speed increase over what was possible in Beauty Box 3.0.
Easily being able to retouch video is becoming increasingly important. HD is everywhere and 4K is widely available allowing viewers to see more detail on closeups of talent than ever before. This makes skin or makeup problems much more visible and being able to apply digital makeup easily is critical to high quality productions.
You can also incorporate masks to limit the retouching to just certain areas like cheeks or the talent’s forehead. (as can be seen in this tutorial using Premiere Pro’s tracking masks)
So head over to digitalanarchy.com for more info and to download a free trial and free tutorials on how to get started and more advanced topics. You’ll be blown away by the ease of use, high quality retouching, and now… speed!
Wherein Jim Tierney rants and opines about After Effects, Premiere Pro, Final Cut Pro, and other nonsense