Create Cinematic AI Videos with Runway Gen-3

in this video I am going to show you how to create the most cinematic AI video possible using Runway gen 3 let's hop in so if you're not already familiar with Runway they are leaders when it comes to AI video they create incredible tools like videoo video automatic roto scoping tools and they became really popular with their image to video model that dropped just last year and for a while image to video using a tool like Runway Gen 2 was the norm well that has completely changed in the last few weeks Runway Gen 3 is

here and it has been knocking our socks off there are a ton of really impressive examples of Runway 3 in action online but we didn't have image to video until right now and that's super important to you as a filmmaker because by using image you can get more consistency with your shots and tell more compelling stories without image to video it's very challenging to create an AI film so in this video we are going to break down the entire process of creating a really cinematic video but first I want to show you a quick example

of this AI video technique in action let's take a look [Music] okay so as you can see the shots from Runway gen 3 are really impressive and because we were able to use image to video we were able to have a consistent character that looked a lot like me so let's get into how you can create cinematic AI videos for yourself it all starts inside of mid Journey I'm using the online version of mid Journey that you can access if you created at least 100 images inside of the Discord version of mid Journey so we

have this prompt here it's basically a cinematic extreme closeup of an alien version of a Cambodian Market shot on 35mm film in the style of IMAX films teal and orange muted color grading now that's fine but without having a style as a reference the images are going to be fairly inconsistent so in order to do style reference inside of mid Journey I'm going to click on the image icon on and I have this image here of this sci-fi Market that basically has the Cinematic aesthetic that I'm looking for if you don't have a cinematic aesthetic

just yet that's totally fine you can generate images inside of mid Journey until you find one that really embodies the style that you're going for so rather than using image reference which is this super tiny icon right here I'm going to click on style reference and style reference will play on the color palettes the motifs and really more of the style rather than the composition of the image so when you're ready to create an image all you have to do is go ahead and click enter now if prompting Insight of mid journey is a little

scary to you don't worry we actually have an AI film making course over at curious Refuge where we get into a lot more complex techniques using AI image and video tools so if you want a crash course in that you'll find a link below this video okay let's take a look at our images so I'm going to click on this first one here looks pretty good I like the lighting this one I really like that looks awesome this one's cool and that one's cool too but I think I like this one the best not only

is the character more original I like that he's holding bread so he's like shopping around the market I like his like jetpack thing back here he looks just really cool so before I download this image I'm actually going to go ahead and click this subtle upscale button and that will basically upscale the image directly inside of mid journey to get you maximum pixels so that when you go to your AI video tool you have more pixels to work with and just more sharpness basically if you don't want to use the upscaling feature inside of mid

Journey because it can eat into your hours you can also use other tools like gigapixel or magnific to upscale your image I should note that if you want to follow along with the videos that we're creating inside of this tutorial you can download a folder that has all of the images and videos from this lesson so now let's hop over to Runway that's Runway ml.com and go ahead and click the try Runway button and go ahead and hop over to gen 3 so you'll see we have this big box here to drag an image or

we can upload it that's basically self-explanatory just drag and drop your image so we have this image of this alien character here we'll drag and drop it into our box and now it's time for us to describe our shot now there's a very specific way that Runway recommends prompting inside of their tool I'm going to basically show you how to do that yourself the first thing that you need to do is you need to prompt in the camera movement that you're looking for so is it a drone shot is it handheld is it a tracking

shot is it a tripod shot anything that describes the cinematography goes first so for this shot we can say a handheld shot and then do colon and now you get to describe your scene so we can say for this one I think I really don't want the character to walk around I think I kind of want him to be like looking around like maybe he's like suspicious of something so we'll say an alien character looks around a crowded market now if you go down here you can see you can change the duration of your clip

there's 5 seconds and 10 seconds in most circumstances 5 seconds is all you need it's very rare that a shot in a film is longer than 5 Seconds typically but you do have that option it can be helpful if you're doing a dialogue log scene to do 10c clips and cut between them if you want your characters to talk to each other and you can also go to your settings over here make sure that removed Watermark is checked cuz obviously you don't want to have the water mark inside of your final film and you can

fix the seat if you want I'm not going to get into that in this video but again we have Advanced Training over at curious Refuge that goes into the ins and outs of advanced settings like this so once you're ready go ahead and click generate I like generating three to four Clips at a time so that I have more options to look through so we'll do 1 2 3 and four these Generations usually take about a minute but while we wait I want to let you know about our AI courses at curious Refuge we have

the world's best online courses for AI film making advertising and documentary production our courses are used by artists at Netflix Disney and every major Studio we have students in over 125 countries and they land jobs every single week so if you want to learn more you can find more info over at curious refuge.com okay Our Generations are done let's take a look at our results so let's take a look at the first one oh no oh no oh that's great so AI does not get it right most of the time in the very first generation

let's take a look at a few of the other results so we have this one here it's a little too static I'm not loving that one we have this one looks like he's kind of walking backwards so I don't dig that you might be able to reverse the speed and that might look pretty cool but at least in the way that it is right now it's not great we have this one here and his face like morphs into like an alien baby so definitely not what we're looking for if this shot here okay that one

looks good I like the camera movement slowly getting close to his face looks really Dynamic there's some weight in his step so I really dig that one then finally we have this clip here oh no he looks so sad oh no he's very sad in the market he's like a a baby alien that's great so once you're ready you can go ahead and download your video clip from Runway now you can stay around to the end of this video where I'll show you a pro tip for how to get even more cinematic quality from videos

inside of Runway but first I want to show you a comparison of Runway versus other tools because I think it's very helpful to know when you should use one tool versus another tool and I think the best way to illustrate this is to show you a video clip that was created inside of the major AI video tools that are out there so we have one generation from cing one generation from Luma and the other one from Runway gen 3 so let's start with cling [Music] [Music] okay so as you can see the movement inside of

cling looks pretty good but when you really zoom in on the video you can see that the quality inside of clean is not very good they say they're going to have a more improved version very soon but at this point I'd say that clean is not worth it this next clip was created inside of luma Labs Luma Labs has made a splash in the last few months by introducing their dream machine AI video tool let's see how it [Music] [Music] [Music] performed so as you can see the video clips inside of luma labs are really

great for dynamic movements they can hallucinate so you see that some of those shots like the shot of the Viking on the boat cut to a different Viking that's because Luma literally created an entirely new scene I didn't prompt that so those hallucinations can pop up but Luma is a really interesting tool now I should note that the generations that you get from Luma are actually pretty small they're less than HD so the video clips that I was getting were 704x 1344 so you need to use an AI video upriser if you want to get

them even into an HD quality and that brings us to Runway gen 3 let's take a look at the [Music] [Music] [Music] results wow so as you can see Runway did the best job when it comes to Dynamic camera movements lifelike faces and just generally it seems more realistic and cinematic now Runway is not perfect obviously it still has hallucinations and the results can get kind of weird sometimes but generally speaking Runway is your best option for creating cinematic AI videos and it also has more pixel resolution the videos were 768 by 1280 and there

was even less fuzziness in the videos that were created in Runway versus the videos that created inside of luma now from a price perspective Luma is significantly cheaper it costs about 41 cents per minute of AI video generated to create videos inside of luma and inside of Runway it can cost you around $7 so Runway is a much more expensive tool but it is the best tool so if you have professional applications I highly recommend using Runway they also have an unlimited plan that has unlimited Generations I highly recommend checking out that op option so

we have this video clip of this Viking woman here and again it's around 720p but you can see that the quality looks pretty darn good you can see the wrinkles on her face you can see each individual hair strand it really does look like very nice cinematic footage but what if you wanted to export this video clip in 4k or even 8K well there's an awesome tool called topaz video AI let me show you how to use it so all you have to do is drag and drop your original clip from Runway directly inside of

topaz video you can do multiple clips at the same time which is really helpful for batching now this tool runs locally on your machine so if you don't have a powerful laptop or desktop computer it may be challenging to use this tool honestly I recommend just downloading the trial to see how it works on your machine before you purchase the software now what we're going to do is go over here to our output and you can see there's all sorts of different resolutions that we can select I'm going to go ahead and select 4K I

always recommend selecting an option that's one level higher than the export option that you're going for so if you're going for HD use 4K if you're going for 4K use at least 5K if not 8K if you can and for the settings most of the default settings look pretty great but for the video model you have multiple options that you can select from in most cases protus is a great option the default model model is absolutely fantastic but the rehea model is actually more advanced and gives you even more cinematic quality it's also super intense

on your computer so it can crash from time to time but if you want maximum quality that is the model that you should look for so I'm going to go ahead and select rehea for the video format we can go down here and select this button right here and you can select whichever format you want if you want to use like an editing codec you can use prores h264 is fine for online distribution but if you're in the editing process you want to use prores for this example I'm trying to just keep it light on

my computer I'll use h264 and when you're ready you can go ahead and click the export button okay that took about 90 seconds on my computer let's take a look at our result so you can see this is just crazy sharp there's tons of Fidelity in her jacket her face looks incredibly realistic you can see the lines the wrinkles on her face are assistent throughout the entire video and by far this is just one of the best AI video Generations that I've seen up to this point okay I hope you enjoyed this video if you

have any questions at all be sure to leave them in the comments of course you can like And subscribe here on YouTube to get the latest AI tutorials and news directly here on the platform and you can subscribe to our email list over on curiousreason along with access to a Weekly Newsletter that will get you up toate on all of the latest AI tools and techniques you need to know about thank you so much for watching this video I wish you the best of luck with your projects