Definitely yes, and probably not, in that order…
AI Video UpResing: A Game Changer?
Didn’t get the focus right on your footage? Filmed in HD but want a 4K output? Need to sharpen up those low-res AI-generated shots?
As always, there’s an AI for that! And, as always, it’s… ehhh, so-so.
There’s a plethora of software that promises to upres your video. I’ve been experimenting with Topaz Video AI and HitPaw. Topaz delivers slightly better results and offers more control, but can be fairly unstable.
Overall, both tools have their pros and cons:
- Yes, they make footage sharper, but often not in a way that looks naturally photographic. The results can sometimes appear uncanny.
- The colors and values of the footage can change significantly, as sharpening filters are applied to make the image pop and seem higher resolution. Your footage might look sharper, but it will feel different.
- Chroma keying on sharpened footage is nearly impossible. So, if you’re thinking you could sharpen soft green screen footage for a better key, think again!
Another common complaint is that most AI software is designed to be plug-and-play, which is great when you’re starting out, but gets pretty limited when you want to refine your results. Topaz Video AI is definitely more professional, giving you a reasonable amount of control (hence the higher price), whereas HitPaw offers a few options but doesn’t even allow you to reduce the strength of the effect.
The idea of plugging in HD footage and getting 4K back is exciting, but honestly, HD footage that feels nice is far more useful than weird-looking 4K. Resolution is overrated, I say.
I’m critical of video upresing, and maybe that’s unfair. It’s definitely impressive, and will get better. Good, not great, is my feeling on it right now. Most tools offer a free trial with a watermark, so give it a go and let me know if your experiences are better!
AI Image UpResing: YES
The technology for AI image upresing has been around for years, and it’s fantastic! I use it primarily in two ways:
- Promo Images: When you need images of at least 10k resolution for promotional purposes, rendering at that resolution can take forever. Running a lower resolution render and then upresing it can save a lot of time.
- Texturing: Whether you’re making and painting your models from scratch, downloading them from stock websites, creating photogrammetry scans, or using AI tools like Meshy, achieving enough detail in the texture can be challenging. I often use a mix of Topaz Sharpen and Topaz Gigapixel to add detail to textures, which can be a real lifesaver when your models and textures need to hold up in close-up shots.
I ran the texture that came with Blinky, the AI generated Gremlin from last week, through Topaz, and here’s the before/after:
Stay creative and keep experimenting! Let me know your thoughts and experiences with AI upresing.
Happy VFX-ing!