Research at NVIDIA: Transforming Standard Video Into Slow Motion with AI

Follow by Email
Researchers from NVIDIA developed a deep learning-based system that can produce high-quality slow-motion videos from a 30-frame-per-second video, outperforming various state-of-the-art methods that aim to do the same. Learn more: Hockey footage courtesy of Spartan Vision.

Comments from Youtube

Agiver Reviga : Nvidia has some very innovative works but I guess we will never see them as downloadable software.

ALchannel : For everyone who is complaining: just take a break to wrap your head around the fact that for each individual frame this AI generates seven(!) new frames completly out of nowhere, and the output still looks decent; it just amazes me.

maxiboy211 : Obviously this is not perfect yet and you can see some visual artifacts but wow I'm impressed, well done guys!

Yeet Fam Dab No Chill Savage Bruh Squad Goals : I was wondering when this would happen. About time.

Mekl Vo : You mean I can use my outdated 2015 phone to record videos in 30 fps, use the program in increase frames, then have it run at 60fps or more? I like.

Alexander Anderson : I absolutely love the AI research Nvidia is doing, keep up the good work!

L Lawliet : Looks wonderful

Leo Dei : What would be an interesting view is to remove all the *actual* frames from a vignette or even longer piece and show an entirely *reality inspired* piece. Brave new world, indeed. Please be good. Seriously.

Dipqi Ghozali : That super slowmo using Optical Flow / Twixtor xD

xorinzor : It loses a lot of it's details though, and sometimes I can see some artifacting / blurring as well

Caesar : I was about to say Twixtor did the same thing for about a decade, until I saw how the hair and the dress looks at 0:37, or that racket pattern between the liquid at 1:25 ... Fantastic achievement! 😲

Chaitanya Singh : Wonder if it'll help at research because 'predicting' the frames while recording unpredictable scientific phenomenon will be misleading. Excited to see this integrated slomoguys tho

tiagodopke : just imagine the complexity of the interpolation this AI is doing

StoKI : Great, now develop Oculus's ASW like solution for standard gaming

zea nine gaming : I'd love to see fight scenes in films with this kind of tec

Liran B : Is the endless wait for *artifact-free* realtime frame interpolation as a plugin / media player feature to smooth our miserable 24fps movies coming to an actual end?

DarkBlade : Imagine if we could do this realtime, and smooth out gameplay on low budget PC's hitting only 30fps

Pranxter : Well..... So much for twixtor

o0shad0oo : So long as this isn't conflated with physical frame rates. With the latter you might see effects that the interpolation would gloss over.

Sanji : HOLY this is awesome ! Good Job Nvidia

Advection : Ai builds the inbetween frames... pretty damn cool :D

Fennie : i was thinking of this idea for years AND FINALLY SOMEONE THOUGHT OF IT TOO!

Nuclear Cactus : I know it's artificial added frame but the prediction is so good this is innovation!

mikakami93 : It's time for Nvidia doing SoC for smartphones

CaptainMcShotgun : Novideo Technology for Observing Their Nuclear Blasts in Slow-Mo

KJ911TT : The result's clearly aren't as good as real slo-mo though. The hockey players skates turns into a blur. The ballerina's arms turn into a blur etc. Still a lot of work to do on this front.

Les Cookies : WTF I LOVE YOU SO MUCH!!! This is insane :3

epicwarding : screw your twixor i use SVP 24fps anime in to 144hz anime

Rackie : 0:23 It needs some more work!

Blaž Bohinc : My Kodi video playback software already does conversion from 24 to 60. That's all I need tbh hahah.. But this looks insane

Nic Mey : Legend has it that it can turn an Intel into a GTX on ultra.

Abram Carroll : 60/120 FPS Netflix with a 2000 series please :)

NitroWolf : That slomo guys footage slowed down x4 was nearly perfect! Well done! Amazing!

Cameron Sherwood : This is utterly amazing AI. Imagine how this could help the animation industry.

Àlex Gil : That's very useful for smartphones, imagine recording i 4k 60fps and getting a slowmo of 480

Abstrax Media : You can easily do this with an After Effects plug in

Bee Stinger : Nvidia need to research on how to make the image still sharp, not blurry like this.

Nicholo Poriol : So i can play 4k 60 fps using my gtx 1050 ti if using this program? Well that's impressive nvidia! What an innovation!

Noah Dancaster : This is -in my mind- truly revolutionary. Thank you, Nvidia!

Aerobic Dragoon : But guys, we need the manual slowmo for memes

Furkan Ayas : it is make more perfect than real happens

Ray Fai : Ain't adobe had been doing this with optical flow since 2016?

d00mfish : You can still see some glitching but overall it's amazing!

R6ex : Time to apply this to Sharon Stone's infamous leg crossing scene! ;p

534daro534 : WOW you've just discovered Twixor pro and GoPro Flux!

MR BOLEUS : Well, maybe 5 years ago, I asked my self next: What if there’s a program that creates video frames between actual frames of video. That should be this. Cool.

CHIPSET : Neural network video interpolation. Now this is exciting!

PyroDoktorHD : I need this in my personal computer!!! 😍😍😍This is just amazing for editing it is super amazing!!!

Amrit Bal : I need that gtx1080ti for my rig😍😍