Today it’s all about video. A first look at Midjourney V7 and a workflow for animating sketches.
Hector & AIxC team
01 / NEWS
Midjourney Video is Legit
A long time in the making, Midjourney finally launched their video model. As expected, and a big win, they launched with keyframe support. An even bigger win? They’re allowing you to upload external images
The best way to animate your Midjourney images is to click into your generation. After that, select Manual > Low or High Motion. That will populate your prompt field and you’ll be able to edit your prompt to tell MJ what you want it to animate.
They also give you an Auto > Low or High Motion option that will let MJ provide the direction. I don’t see why i’d ever use this and not feel like I’m burning credits, but it’s there.
The results? It’s really good. I tried animating a sketch scene, animating a character and the other things you see in the video and it just seems to get what I’m looking for. It missed on the helicopter and chair scenes, but the rest of the results were what I had in mind.
It’s also really fast.
I don’t know how I feel about four videos being generated every time. It’s useful, but also feels wasteful. Conflicted.
External image support is something I was hoping for and it’s available right out of the gate. Below is a still from a photoshoot I took part in:
And here is an animation of this photo, completed in about 1 minute:
Not perfect, but pretty good physics.
The downsides? It’s low resolution at 480p and only 5 seconds, but there are solutions for both. You can always upscale with another tool like Topaz. For length, you extend the video 4x, 4 seconds each, for an additional 16 seconds of animation.
Midjourney just stepped into video in a big way.
02 / FOR PAID SUBSCRIBERS
Bringing Sketches to Life
I recently posted an animation of a sketch of mine and there was a lot of interest in the results and how it came to be. I outlined the general idea on Linkedin, but below is a detailed explanation of the process.
Sign up below for access to the AIxC R&D Lab board and this workflow documentation and the detailed breakdown with prompts. Link and password behind the paywall. Please note the new password for the month!