The Ultimate Cinematic Prompting Guide for Kling AI Video (And Are Pro Features worth it?)

19.73k views1391 WordsCopy TextShare
CyberJungle
KLING AI Official Prompting Guide: https://docs.qingque.cn/d/home/eZQDvlYrDMyE9lOforCeWA4KP#section=...
Video Transcript:
clink AI just dropped their official prompting guide and I went deep 12 hours of non-stop testing hundreds of promps and countless video Generations later I cracked the Cod for Next Level AI video creation forget basic moving images I'm talking about cinematic camera movements for both image to video and text to video additionally in this video you will find answer to the question is clink AI Pro work since they extended the he the price campaign what's the difference between standard versus Pro modes I'm about to save you hours of trial and error in the next few
minutes let's get started I will start with image to video since I believe it's the most popular use case for clink primarily because it offers greater control over the video creation process according to the official clink guidelines recommended prompt structure or as they call clink spells looks like this here the subject is the main focus in the video serving is an important embodiment of the team it can be people animals plants objects Etc movement element is description of the subject's movement not the camera movement the most fundamental elements of the prompt structure are the subject
and moment prompt starts with the subject and everything happening in the scene is described in relation to the subject in contrast to text to video which necessitates scene description image to video is already provided with a scene that's why it only requires the depiction of the subjects in the image and the intended M for these subjects that's why clink prompts different from the prompting style of Runway Genry in Runway we start the prompt with camera movement and describe the event in the scene now the main question is how to incorporate camera movement to The Prompt
structure on clink first of all we are trying to maximize our creative control from beginning to the end as much as we can that's why camera control starts from image generation step if you are using mid Journey or flux you can leverage Atomic prompting structure for this job by this we are arranging the first frames of the story which means we have the first shot now we need the camera control for AI video on cling AI first I tried to put the camera movement to the beginning of my prompt similar to Runway but I didn't
get a nice silky smooth Zoom in effect then I changed the structure closely following suggested best practices guideline from clink team subject comes first and then movement is described in relation to the subject that's why I decided to incorporate camera movement to the second part of the prompt in relation to the subject in a similar way in the prompt the woman walks while the camera is following her I use the same method the camera movement again described in relation to my subject it's it can be also that my subject is static but camera is moving
not that I maxed out relevant slider all the way up to 0.9 0.9 to5 levels for maximum loyalty to my prompt I tried the same structure with other camera movements as well camera moves up down right and left and I confirmed this method works well for image to video camera controls one issue though I struggled with zoom out I tried many keywords like zoom out camera moves back shows more of the background wide shot pans back Etc but I didn't get the zoom out movement then I used zoom out feature on Mid journey and I
added this image to clink as the end frame and managed to get better results however I think this workflow is too long generation time with endframe feature takes 100% longer in the future clink team needs to improve this and we should be able to zoom out just by typing it as a prompt let's take a look at more tips from cling guideline if you want to incorporate elements moving in the background of the scene we can do so by this structure if you want to create great action and motion scenes use the keyword motion blur
on Mid journey and sense of speed keyword in your clink prompts next it's mentioned in the guideline that if there are several subjects in the scene with various movements list them sequentially when it comes to takt to video clink team's official guideline suggests following prompt structure the most fundamental components of this prompt structure are the subject description subject movement and the setting which constitute the most straightforward and essential units for depicting a video scene similar to image to video the subject is the main focus in the video descriptions of the subject's appearance details and body
posture can be listed using multiple short sentences for example hairstyle and hair color clothing accessories facial features body posture and so on next is subject movement descriptions of the subject's movement including static Stillness and of course motion the setting represents the environment in which the subject is situated this can be foreground background other elements of the scene like year era location or simply indoor setting and outdoor setting optional elements are lighting and atmosphere lighting examples can be ambient lighting Morning Light Sunset interplay of light and Shadow or artificial lighting atmosphere means overall mood and tone
for example cinematic we don't have camera motion control in the prom structure since in the text to video mode camera motion can be selected from camera control menu on clink it's quite intuitive to use these camera controls with a variety of basic options and it's working quite good you you can also set intensity of the movement and see a preview here however if the camera motion you want to have isn't on the list you can add camera language to the very beginning of our prompt according to the guidelines for example take a look at this
prompt here starts with a shot type camera language can be defined with shot type it can be ultra wide angle shots closeups low angle shots high angle shots aerial views or it can be defined with camera movement here's an example with camera movement being mentioned in the beginning of the prompt so only the difference between image to video and text to video is in image to video we described camera movement in relation to the subject in the second part of the sentence in text video we start with camera movement in my tests by these methods
I get the most optimal results at this stage of the product I'm not recommending to have both shot type and camera movement in the same prompt since it gets way too confusing for the model to decode and reflect correctly if you add camera language to your prompts I recommend to keep camera control selection in default or the camera language you mention is one of this here of course you can select it to further enforce your prompt next what are clink AI Pro features and are they worth it when it comes to visual differences of generated
videos between standard and pro modes I observed for standard mode motion in the scene appears natural however the details are not very pronounced in prom mode details are richer and the camera movement is more stable here for example the Sals conform to the physics of the motion better giving it a cinematic quality and the camera movement is more stable flow of the water feels more natural when it comes to more complex Dynamic scenes both standard and PR modes struggle from features and workflow perspective 10 seconds generation isn't available with standard mode you can remove watermarks
only in paid options and PR mode has Advanced Camera controls in the text to video downside is pro mode Generations take much longer due to enriched visual quality my conclusion would be if you will mainly use image to video with properly upscaled images you don't need to purchase clink Pro hopefully this video was truly helpful for you to explore clink AI further if you felt a spark of inspiration show your support with a thumbs up and click here to learn more about me Journey or AI videos
Copyright © 2024. Made with ♥ in London by YTScribe.com