Unknown

[Music] hello and welcome to day three this is a launch we've been excited for for a long time we're going to launch Sora our video product and we'll talk a lot about why this is so important and so exciting but first it's so cool we just want to show to so um we'll look here at a little bit of what the sore product looks like this is the feed uh you can see videos that users have been generating and we'll talk much more about this later but uh just couldn't wait to to show you a

little bit so video is important to open ey for a lot of reasons but I'll talk about three here one we love to make tools for creatives it's important to our culture uh it's important to how we hope humans will use Ai and this is one in particular where there's a new kind of co-creative dynamic that we're seeing emerge between early testers that we think points to something interesting about AI creative tools and how people will use them second we don't want the world to just be text uh if the AI systems are you know

primarily you interact with by text I think we're missing something important we want our AIS to be able to understand video and generate video and I think it really will deeply change the way that we use computers and third this is critical to our AGI road map video will be an important environment where we're going to learn or the AI is going to learn a lot about how to do things that we we need in the world so uh I'm going to hand this over now to adya who leads Sora and Bill who leads Sora

research they're going to tell you a little bit about what went into this um and then after that we will uh have the product team come up thanks Sam guys today is finally the day that Sora will be available we're launching Sora both in the United States as well as most countries internationally later today you can access the model at sora.com this is a completely new product experience from open AI built for the ground up for video generation the best part is that if you have a chat GPT Plus Pro account that's all you need

to get started you don't have to pay extra for Sora we're including it in the accounts you already have you know to do a deployment this broad the Sora research team had to do a ton of work finding ways to make the February model we previewed way faster and cheaper they really delivered and today we're launching Sora turbo this is a new high-end accelerated version of that original Sora model and it has all the capabilities that we talked about in our tech report on world simulation earlier this year this includes things like generating videos from

text animating images and a ton of to video features like remixing into new Styles extending forwards and backwards in time Etc some other folks are going to show you this in just a few minutes as Sam alluded to you know we started the Sora project at open AI to build AI systems that really deeply understand the world and its physics we're really just getting started here you know this early version of Sora will make mistakes it's not perfect but it's already at the point where we think it's going to be really useful for augmenting human

creativity and we can't wait to see what the world is going to make with Sora starting later today ad hi I'm ad yeah um I'm really excited for this release open AI has had a multi-year long history of training state-of-the-art models that have pushed the boundaries of what's possible to do with visual generation however we feel like for further advances in visual generation we need breakthroughs both in machine learning and in human computer interface design so it's for that reason that I'm really proud of the product that we've built and I'd like to hand things

over to Rohan and Joey who can tell you more about it Sam heyan hey Joey hey what's up Sam I'm excited to show this product off go ahead let's do it I'm ran I lead our Sora product team and I'm Joey I'm the product designer on Sora all right Joey get us started all right I'll kick it off by talking a little bit more about explore explore is the place for inspiration it's a feed of videos shared by the community where everyone can come together and explore the capabilities of this powerful new model and we

know that the models especially the first time you use them it can be hard to understand just everything that you can do with them so creating a space where people can come together learn share techniques share methods felt really exciting but also really important to us and so you can see just scrolling through here you can be inspired by all of these amazing videos and I saw one up here if you see one that's particularly interesting to you you can click into it and view it in a light box and at the bottom of this

light box it'll show you the exact method that was used to create this video whether it's simple text prompt an image extension video extension or one of our other more powerful creative tools you can take this methodology and learn how to incorporate it into your own creative workflow so without further Ado I'll kick it back to Rohan to do our first generation all right let's head to our library you can think about this as your home base in Sora where you can view all your Generations you can slice The View here a couple different ways

a grid view a list view you can create folders you can favorite things look at bookmarks from the feed all minor organizational touches but show that we really care about empowering storytelling and and real use of this product all right down here you'll see our simple composer here you can create a video by simply describing it with text or uploading an image uh Sam you got an idea for us how about some woly mammoths uh in the desert all right woolly mammoths walking through the desert love it uh let's say woolly mammoths walking through the

desert landscape let's maybe make it a wide shot cool and before we fire this off I want to touch on some of the options you'll see down here aspect ratio so Sora can generate from horizontal aspect ratios to square to Vertical can generate in resolutions from 480p up to 1080p can generate from 5 Seconds up to 20 second videos and you can also generate multiple variations at once so you might not know exactly what you want out of this description and S might take in a couple different directions variations let you see a couple of

options we'll do a four video uh variation here and last but not least there's presets sometimes you might find an aesthetic or style that you really love and you want to capture that in a reusable component and apply it to a ton of generations you can do that you can create your own we have a couple defaults here stop motion balloon world a crazy one highly recommend it um but let's fire off this gen and then I'm going to hand it back to Joey to talk about storyboard another really awesome feature we have awesome thank

you Rohan so Rohan just showed how you can take a general idea and send it to Sora and have it create an entire set of beautiful videos but today we're excited to talk about an entirely new creative tool that we're introducing a more advanced tool that's still very early but something we're calling storyboard that lets you direct a video with multiple actions across the sequence using a familiar timeline so I'll click in right here and I'll tell you a little bit about storyboard at the top of the screen you see the storyboard cards this is

where you'll describe the environment the characters and the actions you want to occur at a particular point in your video below that is the timeline you can see the outline of my entire clip and this is where I'll sequence the actions in my video and then below that is the creation settings that Rohan just went over so I'll pop back up to the storyboard and I'll set my first uh storyboard card in the scene so I'll say a beautiful white crane stands in a creek let's give it a Yellow Tail stands in a creek so

here I can write as little or as much as I want and the less I write the more Sora will fill in the details and the more I write the more Sora will try to adhere to my dire ction so in this video I want this crane to be standing at the beginning and then dip its head in the water and pick out a fish so I'll come down to my timeline and I can click anywhere within the outline of my clip to add an additional card and give sore of those actions so I'll come

up here and I'll say the crane dips its head into the water and pulls out a fish so looking back at my timeline I can now see at the start of my timeline I've set the scene and then at five seconds the crane will dip its head into the water and you'll notice that there's space between these two cards within the outline of my clip that space is important for Sora to connect this first set of actions with the second set of actions I can always adjust where I want these actions to occur but giving

Sora adequate time to connect these ideas is really important if you want a continuous shot you can also have it make cinematic cuts by moving them closer or move them further away and let Sora do even more filling in of the details so I'll move this back to 5 seconds and I'll fire it off and we can review this in a minute but there's one more storyboard feature I want to show um that's really really cool and that's using image to create video so in this first storyboard card I'll go ahead and upload an image

that I have on my desktop this image is of a lighthouse and you can see the Sora automatically put that first image into the first card and then it created an entirely new card and this is a continuation caption s has looked at that image and it is added an additional and understanding the movement that we might want to make with this image and it has filled out a caption for to continue or to turn this image into a beautiful video so much like with the text I can come up here and edit anything in

this card I can adjust its position um but for now we'll fire this off and we can see how it looks so I'm going to kick it back to Rohan to review some of these videos that we made Let's Do It Let's see uh let's check out those woolly mammoths let's see what we got here amazing pretty good pretty good um so here we can hover over our you know our variations of this generation kind of get a feel for which one we might like best um and then we can continue to refine this with

Sora so I think I like maybe top right me too yeah all right let's take a look at the top right um now this is cool but now that I'm seeing the scene I think it would be cooler if these woolly mammoths were robots what do you guys think great all right let's do it so remix lets you just describe changes to the video and Sor will do the rest so I'm going to click remix here and simply say replace the woolly mammoths with robots you'll see a couple familiar options here you can create multiple

variations you can change the resolution you can also tell Sora the strength of the remix you want so if you want a big change in the scene this is probably a significant change we'll tell Sora hey give this a strong remix if it's something subtle like say you just wanted a little bit more wind in this background of the scene or more sand kicking up you go with a mild or subtle remix for now we'll kick off a strong remix all right should we take a look at your storyboard J let's see how the CR

came out all right let's do it all right so here let's pop into one of these and we can see all right so we see about halfway through my crane is dipping its head into the water can see if it grabs a fish oh looks like it missed on that one can review another one of these too but you see that Sora has taken my direction and it's done a pretty good job at understanding exactly where it wants to go and both of these cranes they may have missed I got a little fish that one

yeah I got a little fish um but this is again something I want to point out which half of the half of the story with Sora is taking a video editing it and building on top of it so the beginning of this video right when the Crane's head splashes in I love this part so I'm going to go ahead and use another editing tool here called recut that allows me to take my video trim it down and extend it in a storyboard with even more Direction so clicking recut has taken me into a new storyboard

and Sora has imported this video of the crane and now I can see on the timeline my video here I can scrub through it to review it and I can also trim my video so I think I like actually I'm going to take this H first few seconds right until its head splashes into the water I like that and so much like in the other storyboard examples any area that I leave empty here story will seamlessly continue from whatever storyboard card I have in there so if I want an entirely New Ending I can leave

the end blank and I can go ahead and hit create if I want an entirely New Beginning let's say I wanted this at the end of my scene I can leave this here and maybe it will the camera will stay on the crane for a little bit more in the beginning I can also move it into the middle and generate entirely new endings and Beginnings for all of my videos and much like the rest of the storyboard I can always click to add more cards and give it more a Direction so let's generate a new

ending to this video and we can see um how it turns out awesome cool thanks Joey while that's going see if we got some robots oh my God we did amazing all right we'll see that Sora hair these are sort of like willly Mammoth is robots yeah yeah it's kind of cool um so yeah that one Walks Like amazing actually yeah that is pretty cool it's amazing um so s took our prompt of replacing the woolly mammoths with robots and did just that we click in we can see the original one here this is a

strong remix and we replaced the Wily mammuts with robots pretty awesome uh let's take a look at a couple other features actually quickly let's look at your uh image to video Generations here Joey pretty cool some nice Ambiance with this Lighthouse top right one's pretty yeah you get a couple different shots here with different sort of camera motion um and as you can see you know you might not know exactly what you want you could throw an image in there and see what Sora does kind of like this top this bottom right one rather um

I think it would be cool as a Loop so one of our awesome features is if you really like a generation you can tell Sora hey I want this to endlessly repeat because it's so beautiful and you can do just that with Loop so if you click into Loop you can tell Sora where do you want the start of this Loop to be where do you want the end of it to be and Sora will fill in the gaps to create this sort of seamless repeated scene um you have a couple options here Sora can

add fewer frames if the beginning and the end are already pretty similar or you can tell it to add lots of frames to try try to connect maybe two more disparate beginning and endings and but Sor will do the heavy lifting it's a really really awesome feature um a lot of the artists in our Alpha really love Loop um cool last but not least I just want to quickly touch on another feature blend so you can think about blend as giving Sora two scenes and Sora will create a net new scene that is a cohesive

version of both of those it's almost like smashing two videos together in another dimension and bring it back to this one it's I I've never seen anything like it until I use blend with our model um so if you click into blend you can choose another video from your library you know we could blend the robots with the woolly mammoths that could be a cool one and there's a couple options here I won't go into a ton of detail right now but long story short you can kind of dictate to Sora how you would like

it to sort of blend these two scenes together some really awesome Advanced features for um yeah for our heavy users and power users trying to make a lot of awesome cre can we do that yeah we can run this one for sure um I think yeah transition B blend is probably a good one for the woolly mammoths and the robots let run it all right awesome cool so to wrap it all up I'm going to come back to the featured feed and you'll remember Joey was scroll scrolling through these videos earlier you might have seen

at the bottom storyboard now you know what that is you can kind of uncover each of these Generations in the feed and see how they created I love the feed because you can just find inspiration and then run your own remix of someone else's video in addition to inspiration I just find it like so compelling to just watch like it's amazing what people are doing it's crazy yeah it really is wild um and that's Sora that's kind of the end to-end product where we're really excited to see what you create and add more features here

and and do something amazing uh do more amazing things with Sora but uh yeah Sam you want to tell us about availability yeah so this is going live today in most of the world um except uh most of Europe and the UK will be a while uh we're going to try our hardest to be able to launch there but we don't have any time need to share yet and there are some other countries that we're not able to operate in if you have an open AI Plus subscription you get 50 Generations a month if you

have an open AI Pro you get uh unlimited Generations in our sort of slow que mode um and 500 normal faster Generations you can also have get fewer Generations at the higher re at higher resolution so and and anybody with any account can just uh enjoy the feed we're really excited to see what you all will create um we're really excited to see kind of all of the new ways that this sort of new kind of entertainment uh and and Tool will be used uh you all did incredible work on this I'm super proud of

the team I love the product and um yeah any closing thoughts um yeah I mean Joey and I are just representatives of an amazing team here uh I just want to shout out the research team that built this in crazy mo incredible model and got it to a place where we could actually serve it to the world and our product team is a group of like five or six product Engineers that build this entire product in a matter of months um and obviously a village at openai to support us to get to this this point

um and quickly on um just kind of Abuse Prevention and safety that's something obviously is in our DNA at open Ai and we really care about um we obviously have a big Target on our back as opening ey so we want to prevent legal activity of Sora but we also want to balance that with creative expression we know that's something that will be an evergo ongoing challenge we might not get it perfect on day one we're starting a little conservative and so if our moderation doesn't quite get it right just give us that feedback we'll

be iterating um yeah really really really excited to see what you create Joey any other final thoughts yeah I think maybe my final thought is um I think if you come into Sora with the expectation that you'll just be able to click a button and generate a feature film I think you're coming in with the wrong expectation Sora is a tool it allows you to be multiple places at once try multiple ideas at once try things that are entirely impossible before um but really we think it's something that's super super special in an extension of

the crater who's behind it and so we can't wait to see what you create and uh we'll be watching in the feed yeah to come back to the gpt1 analogy it's early like it's going to get a lot lot better so uh but we've always been surprised when we put things out even in an early state that people are able to get amazing performance and real value out of them and yeah we can't wait to see what you do in the feed later today thank you thank you [Music] [Music]