Master Camera Control in MiniMax Hailuo With This Simple Prompting Technique

4.95k views1670 WordsCopy TextShare
CyberJungle
Link to Minimax AI Video Generator: https://hailuoai.video/ In this video, learn how to expertly co...
Video Transcript:
in this video I will show you how to control the camera in your Minimax AI video Generations like a pro since the image to video mode launched on Minimax I've been experimenting extensively and spending some of my credit so you don't have to I applied a single prompting structure that boosted my Minimax generation success rate by up to 75% and dramatically reduced my average rroll rate this technique comes from the prompting guidelines of another Chinese AI video tool you might be familiar with clink these models are perfectly localized to English but their core model training
is still in Chinese that's why while prompting we need to take Chinese language structure into account to improve our AI video Generations when describing a cinematic scene with camera Motion in Chinese the camera motion naturally comes in the second part of the sentence the idea is in Minimax we always start with describing our initial scene and subject first in comparison to Runway subject and scene description requires little bit more detail then add camera Motion in relation to our subject in the second part of the prompt connect these with a connecting words like while simultaneously or
at the same time and for the second part describing the camera Motion in the correct way is also very important to reach your desired shot type for this I will show you some examples in this first example I started with this full body shot of a man in a corridor then I wrote The Prompt man is walking naturally simultaneously camera slowly pulls in you can also use while instead of simultaneously as a connecting word and what we do is basically we start with our subject we are describing what's happening in the scene and then we
are adding the camera motion to the second part of our sentence by this way I managed to get the natural walking movement of our character and in the same time I had a subtle camera pull in zooming to our subject in traditional film making this shot corresponds to Dolly inshot and best way to describe this doly inshot is writing camera slowly pulls in in the next example I started with the prompt woman is naturally floating while simultaneously camera moves back the first part is very clear I just described what's happening in the scene for the
second part I wanted to have this dolly out effect where camera actually moves back from the subject I tried different wordings as well like camera pulls out or or camera pulls back but I didn't have much of a success when I specified the camera moves bad I got the best result in this next example I started with this original image of a king talking to a group of people and I wanted to have camera motion of pan right as you can realize I'm using naturally or dynamically quite often we had unfortunate little bit of Str
struggle with the king's hand here but I managed to get a natural talking motion even though camera motion didn't start simultaneously I managed to get the camera pan right moment I added part horizontally just to give Model A little bit of a more clue it's not always necessary for you to add horizontal to your prompts in this next example I started with this initial image and I wrote The Prompt a bird lands on a woman's shoulder while simultaneously camera pans left I couldn't manage to get that bird lands on the shoulder I had a very
subtle camera pan left effect and in this similar example I had a stronger pan left effect then I added horizontally to my prompt so if you're going to really do pan right or pan left I would probably recommend you to add horizontally to your prompt again I struggled with bird landing on woman's shoulder and just as a reminder in all of the examples I will show you I always turned on prompt enhancer because in the versions I didn't turn on the motion looked less smooth and uh less fluid I'm also showing you examples where I
failed and couldn't manage to get the desired camera Motion in this example I struggled a lot with this vertical camera tilt up motion it just didn't look up and whatever I tried it always stayed static of course I tried rephasing and use synonyms as well like camera moves up instead of tilt up also tried camera looks up vertically all I wanted was man is raising his arm and camera is looking up focusing on the fist maybe and I even specified that that I want to see the fist up in the air but this was a
big struggle that I couldn't get the shot I wanted in this next example I wanted to simulate the handheld shots which is a very raw shot where camera is holded by an operator at the first part of my prompt I specified the scene and my subject's action that she's repairing the robot I I used while as a connector word and I mentioned CA is handheld with a shaky movement I came close to what I imagined as a handheld shot it's definitely not a static shot I think this example can be concluded as a success I
wanted to ensure that this camera handheld with the shaky mement works perfectly so I tried with another image and you can see uh she looks at the sky while camera is handheld with the shaky movement worked quite well I think this is a textbook handheld shot and I can assure you that if you want to use the handheld shot this particular prompt part works extremely well in this next example I tried to simulate tracking shots where camera follows the subject's movement I wrote She Walks naturally while camera follows her movement behind her and I managed
to get what I required in the second try the first try was much more of a static shot the dynamic movement of camera wasn't there so I got rid of this part and I simply used camera follows her movement behind her and this worked much better this is another example he walks while camera follows his movement closely behind him it's a textbook tracking shot worked quite well and I wanted to also simulate the leading shot where camera actually follows the subject in a leading position in front unfortunately this ended up with a static shot and
didn't work that well so I think it's very difficult to simulate leading shots on minia Max and I also wanted to show you this because you will realize that at the beginning of the video everything stays still almost like time stops this is something I observe very often in Minimax it may be a bug or a particular issue that they probably need to fix if I would want to use this shot I would probably cut the beginning because it just almost looks like time is Frozen and you will observe this very frequently on Minx in
this next example I wanted to simulate the crane upshot as you know in this particular shot type you have the camera connected to Crane and then it ascends the camera up vertically shows the landscape or environment and what's going on around him so you can see at the first part I wrote he is giving a speech while the camera climbs up to high angle to show was crowd in the conference Hall I think this worked out quite fine only problem is we have some kind of like morphing faces and the the initial crowd at the
front looks like much more fancy and rest looks much more casual so there were some struggle with coherence but the camera motion worked out quite well only thing is I would highly recommend you to mention climb up and high angle if you really want to simulate the crane upshot in your videos in this example I started with this initial image and I wanted to simulate the orbit sh I have the man with beard is in the forest as subject description and then I have camera dynamically orbits around him with a again prompt enhancer on and
from my perspective this worked out quite okay of course it's not a steady action like steady circular motion but I can say that the orbiting at this half orbit was there so I wanted to give little bit more details and tried another prompt the first part is same second part changed camera dynamic orbits around him hyper Dynamic movement in orbiting motion subject in Focus but it didn't work out well I think it confused the model a little bit and I didn't get this initial nice smooth orbiting camera Motion in this version at least by the
way if you found this video helpful don't forget to give it a thumbs up and subscribe for weekly in-depth AI tutorials back to video the last thing I want to show you is how great the Minx is with displaying realistic emotions and face Expressions I think one of the strongest suits of Minimax is that nature looking emotions are realistically rendered only problem is that just character keeps talking and it looks like character is moving their mouth for example woman feels joy and every time you write that you will realize that character is talking right so
you may need to specify that she's silent and not talking so mouth doesn't move because maybe it's a scene where a character doesn't talk because minimex is tend to make character talk especially in closeup shots or in portrait shots so you really need to specify that she's not talking hopefully this video was truly helpful for you if you want to learn more about AI creativity click here
Copyright © 2024. Made with ♥ in London by YTScribe.com