Unknown

[Music] hey everybody and welcome to day four I'm Kevin I lead product at open aai so yesterday we launched Sora and the demand has been off the charts uh the team has been was working late last night they are in already this morning we are doing everything we can to get you access to Sora as soon as possible and we can't wait to see what you create today though we're talking about canvas which is a product that we've had in beta for plus users for the last couple months canvas allows you to collaborate with chat

GPT on writing and coding that goes beyond simple chat so we're launching three things today first we're bringing canvas to everybody and integrating it into our main model so it just works second we're enabling you to run python code inside your canvases and uh so you see the output whether it's text or graphics and third we're bringing canvas to custom gpts so you can imbue all of your custom gpts with the power of canvas so with that let's dive in all right thanks Kevin Hey everybody my name is Lee and I'm an engineer helping you

collaborate with chbt hey everyone my name is Alexi and I'm also a product engineer working on chat GPT so Lee are your kids excited about Christmas coming up oh boy yes um you know I thought it'd be fun if we could maybe make a story for them Christmas Story and use canvas try it out yeah let's check it out okay so so if I go to chat BT you'll notice starting today there's a new button in the composer that lets us see all the tools available one of which is canvas so I'm going to click

that and now anything that I type here is going to create a canvas so let's write that story um help me write a Christmas story about silly elves for my kids and I'm going to send that off to Chach gbt and it's going to get started right away on making a campus for us so um there's a handful of things that we should explain what's going on here the most significant thing that's different is you have the side-by-side view where on the left is the chat as you're used to it and on the right is

canvas and in canvas right now chat gbt is busy writing the story for us this is pretty different from what would happen if you wrote this kind of prompt before you know chpt is good at doing this sort of creative writing work but it would write it directly in line and chat and sometimes it's hard to piece out what's the document and like what's the Preamble or the what comes after um or especially if you wanted to make any changes along the way things tend to get lost but now you have this side by side

so um let's take a look at what Chachi PT made for us the silly elves in the Christmas catastrophe no not a catastrophe in the snowy Village of tinsel toown nestled at the edge of the North Pole lived the silliest group of elves you ever could imagine all right this is looking pretty good um you know I uh I could make some changes I think this title is a little long so I'm going to you know maybe take this part out uh actually otherwise this pretty good so you can so chat GPT can edit and

you can edit sort of side by side yeah so I can type in here you know I've been editing the title I'm kind of making it for my kids um so this is a collaborative document and just like you might be used to in other document editors you can come in here you can add text you can bold text you can do lots of things you can do in other document editors you can edit chat GPT can edit um I could go over back to chat and just similar like I would do in any other

um chat GPT workflow I could give it feedback I could ask for changes and it's going to come in and make those changes directly into the canvas um but rather than show you that I thought it' be interesting to show this button in the bottom corner which has a handful of commonly used shortcuts that's based on things that we know people do in chbt suggest edits ask chat GPT for feedback about what it we might want to change about this adjust the length might make this longer or shorter maybe I want to you know a

shorter bed time story reading level will change this to make it you know more sophisticated language or simpler language in case I wanted to you know make it easier to read for my uh my younger kids ad final polish is really helpful especially when you bring your own content check for spelling mistakes grammar things like that and then add emojis that sounds fun yeah yeah we love emojis let's try it um so if I click add emojis you I've got some options about where I want to put them words sections list let's try words I

click that and Chachi is going to you know get to town putting emojis into my doc look at that so um what you're seeing here is chat BT now making a revision to the document in canvas it's starting at the top it's writing a new version of the doc and it's sort of streaming in on top of the previous version just to make it a little bit easier to see in context what's changing and alongside this in the chat you know it's you're seeing that it's editing and you're noticing that uh you know we have

our instructions back and forth um but otherwise it's not getting sort of cluttered up with the different revisions that are happening kind of looks like when my 8-year-old gets a hold of a phone yeah I think your kids are going to love this Lee there's definitely a lot emojis that I put in here that did a pretty good job um okay so that's how you get started with canvas you know canvas will trigger in a couple different scenarios you can ask chat gbt to just start collaborating with you on a piece of content whether it

be writing or code and it will open a canvas for you automatically or like I just did here in the interface I'll show you again is this button in the composer to view the tools you just click canvas and that's going to create a new canvas every time amazing so in addition to storytelling a lot of people use chat PT to help with their own writing learning how to be a good writer is hard and today we're really excited to Showcase some new features in canvas to make it easier to get feedback on your work

so in my spare time I'm a bit of a physics Enthusiast and so I have an essay here that I've been working on titled Santa SLE exploring the role of dark energy in reindeer propulsion I'm going to copy this from my from my text editor and paste it into the prompt area in chat GPT because I put in a substantial amount of text we now have a new button in the upper right that says open and can if I click this the content from The Prompt is put into the canvas and this is the same

editable surface that Lee was demonstrating so could you like bold that title maybe yeah so I can go in here and make a change if I wanted to um before I send it off to chat gbt so this hasn't been sent yet so when you made that bold change what just happened correct yeah this is all still a draft document so until I send a message I can edit it as much as I want um and chpd hasn't seen it yet and it's attached to the comp exactly so I'm going to go in here and

I'm going to ask uh chbt can you leave some comments on my essay from the perspective of my physics Professor nice okay so um maybe it's going to give you some like technical tips yeah hopefully we'll see what it comes back with but previously you know it would be hard to connect what the feedback chat TBT is giving you to your own work because it would all be inine in the chat but not with canvas chat GPT is able to select specific portions of your work and leave comments in line which makes it really easy

to connect what the suggestions are to your work yeah I'm looking at these These are pretty good feedback consider linking this introduction more explicitly to the scientific exploration of dark energy to immediately establish the physics connection but it didn't just like respond to that in chat it selected Santa slay and his flying reindeer have long fascinated people blending mystery magic okay so it's like picking out sentences that it wants to give you feedback on and then writing the specific feedback per sentence exactly and each of these comments I can have an apply button and so

clicking apply would allow chat GPT to go through and apply the edit as it sees fit and of course I could then reject that edit if I wanted to but since this is my own essay I'm going to go in here and make changes on my own so um I like this comment you may briefly elaborate briefly on why dark energy is mysterious to provide context um I'm going to say we don't know oops why the universe expands and we don't know why Santa is so fast in his sleigh I'm curious about these cool the

mysteries of the universe the mysteries of the universe I'm going to dismiss this comment because I feel like I've addressed it and when I'm ready to take my sa out of chat GPT I can click this copy button and send it off to my professor great I'm sure your professor is going to love these changes know this is some Cutting Edge research here but in addition to writing in chat PT we know a lot of people also use it for programming and we've made some really exciting improvements to programming in canvas as well let's check

it out so I've also been helping Santa with some logistics for toy manufacturing and I've been learning some data science tools in Python so you're an open AI engineer you're also a dark energy researcher and you're helping Santa with Logistics yeah I mean Santa could be everywhere as once we really try to as well here at open a so I have some example code that I've been working on locally so this is my local IDE but something's not working and I want some help debugging it I'm going to copy that and then paste it into

chat gbt I see the same open and canvas button I click that and now I have a canvas open but this time it's actually a code editor so chat GPT has recognized that this is python code I get python syntax highlighting and even some basic autocomplete nice um I know this code isn't working so I'm going to ask chat gbt can you help me debug this code what might be going wrong chbt sees the code looks like it identifies that plot. Lael does not exist in map plot lib um it provides an example corrected code

um we could trust this and and take it back locally but one of the new features we want to demonstrate today is the ability to actually run your python code within canvas so in the upper right we have this button titled run let see if PBT finishes we'll click run and see what happens click run and it looks like right away actually we see that uh label is not defined so chbt was correct about that we see the exception and right away anything in the console is shown to chat BT so chat BT sees this

exception and it actually leaves a comment on it and it looks like this corroborates what the because label is not a valid function and mat plot lib you might likely use title instead this is great I feel like I'm always trying to learn new libraries and uh this is exactly the kind of errow I get all the time um just like forgetting the API for something and um it's pretty amazing that it just picked that out right away yeah and just like comments in the document there's a fixed bug button to let chat PT fix

it for you so when I click fix bug we show chat PT the exception and your code and it's able to edit the canvas to make that correction that was pretty fast so maybe we want to see like exactly what chat PT changed yeah and there's this great show changes button in the canvas header clicking that will give you an inline diff that should be familiar to people who use git to show you exactly what changes were made that's cool um and show changes works not just for good but for documents as well exactly yeah

Works across both of the document both of the editors um so now that we have this fix in place we can try clicking run to see if it works now and wow that was fast we really fast have our line chart now rendering in the console so can you explain a little bit about exactly what happened because um that python execution happen very quickly yeah so within canvas we actually load a web assembly python emulator which allows us to load almost any python library and run your code almost instantly so you get immediate feedback you

can collaborate with chat gbt effortlessly and really have a tight feedback cycle all within chat gbt including generating Graphics including generating Graphics so Santa particularly is interested in some sanki flow diagrams to kind of track how toys are flowing through his s those are the ones with there's like arrows in and arrows out honestly I'm not even sure Santa asked me for this yeah I'm trying to learn so he's always challenging us I'm going to ask chbt to add a sanki flow diagram for Santa's toys please use appropriate colors see if we get something uh

Santa themed interesting so chat GPT is going to go through and edit our code again um and now it's adding example two a sanki diagram cool so we got total toys delivered to Children distributed to stores defective okay so it's added a handful of lines of code creating a sinky um adding data finishing it and then saying show yeah let's uh try running this oh no uh looks like there's been a problem with the colors um but Chach PT has an idea of how to fix that um use a single color per flow let's try

it let's try it this is kind of Awesome this is exactly what happens when I'm trying to learn something new is I will go search for example code I'll run it it inevitably won't quite work uh and then I will try again and then uh go through this Loop and try to read the inscrutable python errors and figure it out for myself oh there we go all right looks like maybe Matt plot lip has some bugs in its sanky layout but we got a graphic so there there we go we got a graphic and we

can keep refining this with chat PT even dragging this image into the prompt air if you want to show chat PT EX exactly what this image looks like to help find so those are some of the new programming features in canvas amazing all right there's one last thing that I want to show and that is bringing canvas into custom gpts so gpts in case you're not familiar are a way to give chat gbt custom instructions custom context and a lot of really distinct and specific behavior to whatever particular task that you have at hand and

then you can share them with other people so they can benefit as well there's a GPT store full of the things they're really interesting and uh I decided to make one for Santa you know Santa gets all these letters and he has to respond to all of them and I figure that's got to be a lot of work and it might be helpful if you just had you know just like a first draft something to start with he could decide if he likes it or didn't like it you could edit he could go from there

and then send on his uh so you're also a part of North Pole operations uh I can neither I can neither confirm nor deny this all right if Santa comes out with a Frontier Model I'm going to be very suspicious so um Alexi I'm to notice that you wrote your letter to Santa and left it out on your desk oh I meant to mail that already I can't believe you found it yeah um well I snapped a picture of that and I figure um maybe we could use that as a a bit of an example

here so let's bring that if I can figure out how my mouse works okay there we go so we've got our picture into Chachi BT let's open it up real quick just to get a look a bike a GPU and some dark matter that tracks yeah that's right there that looks like my letter okay um you know I also figure Santa has some context on you know whether you've been naughty or nice that's uh you know one of the things he keeps track of and in addition to taking a picture of the letter we probably

want to add that in so I'm going to let Santa drafter know that Alexi's been nice this year really appreciate that Lee yeah okay Alexi has been nice this year so let's send this off to our custom GPT and um hopefully will get back a canvas all right here's our custom GPT starting to write out our letter nice it says Dear alexie ho ho ho thank you for your letter I put a big smile on my rosy cheek face let's see what do we have here first off a new bike excellent choice all right looks

like you're getting that bike great h100 GPU Mrs Claus tells me it's quite the PowerHouse running AI models the elves in the tech Workshop are tinkering away on that one for you as well so that's promising and dark matter M he's s admitting that might even Beyond his capabilities in the Toy Factory so I sounds like maybe you shouldn't get your hopes up for that one yeah I don't know how you put that one in stocking either so um but this is a pretty great first draft and you know Santa could come in here and

you know change this up as much as he wants make edits um as much as he wants and then as soon as he's ready you know write this out and his characteristic handwriting style and send this letter back out to you hopefully this will save Sant some time and so you know we should talk a little bit about what's actually happening here you you might have noticed that I didn't click the canvas button I didn't mention to create a canvas it just made a canvas so this is an example of chat PT determining that canvas

would be the right thing to do but how did know to do that yeah well um when I built this custom GPT I put that in the custom instructions so um do you guys want to see how I made this did you show yeah yeah please so if we go up here into the GPT excuse me um and hit edit and that should take us to the configuration page so this is how you set up a GPT it's really pretty straightforward you can get a picture and a name and a description so people in the

store if you choose to share it um can see what it's about the important part here is the instructions so I wrote here your tool for Santa to help write first draft responses in canvas to the letters that he gets every response be written in Santa's characteristic style and humor and your job is to write responses to the letters using the canvas tool so in instructions I told it to use the canvas tool so I'm going to expect that it will use canvas pretty much to every um every put thing that I put in there

which is exactly what I want this to do that's going to be the right tool in addition to that down here at the bottom is a list of checkboxes on your capabilities so this is the set of tools in chat GPT that are available in gpts and there's the new one here canvas which is uh you know starting as we were at today uh will be on by default for new gpts existing gpts we're going to leave this off that way we don't disrupt the behavior of any existing uh gpts that people have created um

but if you want to add canvas to your existing GPT very easy to do that you just go into this configuration screen you'll see that check box and you can check it and then you'll have canvas available in your GPT amazing amazing yeah so this is canvas that's the handful of things we wanted to show you today we've got canvas rolling out to all web users regardless of plan as a default experience in 40 so whether you're on a free plan or a paid plan you'll have canvas we've got using your own content in chat

GPT or using your own content in in canvas we've got code execution and we've got canvas and custom gpts it's awesome so we're super excited to see what you do with it like uh like Lee said we'll be rolling this out today uh before we go though let's end with a Christmas joke okay are you ready yeah we're ready all right how does Santa take photos all right let's hear it with a North Polaroid all right see you tomorrow everybody [Music]