Control EVERYTHING with Multiple Motion Brushes in Runway Gen-2

Published 2024-02-03
🎬🍿 AI Film-Making COURSE ?? tokenizedhq.com/courses/aifilms JOIN the waiting list
📙 Midjourney COURSE mastersofmidjourney.com/ Beginners to Advanced
🚀 FREE Midjourney Cheat Sheet tokenizedhq.com/freebies/mj-cheatsheet
🔗 FREE Supporting Material tokenizedhq.com/freebies/video-material Folder: 2024-01-20 – Think Like AI
🔗 Promptalot Web App promptalot.com/
🔗 FREE Promptalot Extension promptalot.com/extension

–

📰 AI Newsletter 👉 Your Inbox tokenizedhq.com/newsletters/ai
🐤 Follow me on Twitter twitter.com/ChrisHeidorn
💼 Follow me on LinkedIn www.linkedin.com/in/christianheidorn/
📸 Follow me on Instagram www.instagram.com/christianheidorn/
💬 Join the Tokenized AI Discord tokenizedhq.com/invite/discord

–

📺 Recommended Related Videos & Playlists 📺
Commands, Syntax & Parameters:    • Commands, Syntax & Parameters in Midj... …
Prompting Methods & Experiments:    • Prompting Methods & Experiments in Mi... …
Character Design Series:    • Character Design with Midjourney  
Storytelling:    • Storytelling with Midjourney  
Watch Me Prompt:    • Watch Me Prompt in Midjourney  
This Brand Does Not Exist:    • This Brand Does Not Exist  
Midjourney for Merch:    • Make Money with Midjourney T-Shirt De...  

–

If Midjourney's been able to dazzle you over the past 1.5 years, then you're not alone.

Anyone who's gotten really deep into AI art has undoubtedly dreamt of bringing their very own stories to life.

Let's face it. AI image generation is going to transform the entertainment industry.

There's absolutely no doubt about it.

Many of us have already experimented with AI animation and possibly even full AI trailers in the past year.

Gen-2 by Runway and Pika were already massive step forward, allowing us to bring our images to life in ways we never would have imagined.

But things are about to get a little crazy.

Runway recently released its new Motion Brush feature into public beta.

It lets you select a specific area of an image that you want to enimate and you can even control in which diretion it should move.

That in itself is already huge leap in terms of control.

But Runway went one step further by upgrading the feature to a total of 5 separate Motion Brushes.

In other words, you can now select up to 5 different parts of your image and give each one of them entirely different motion settings.

You want your subject to move to the left? No problem.

You want the background to shift to the right? Easy peasy.

Those birds in the sky should move towards the camera? Done!

I was blown away by how much fun and how easy motion brush is.

Sure, you still need to go through a lot of generations until you get the right now but it's a huge step forward.

I was able to put together a simple 30 second teaser video within just 2 hours.

Let that sink in.

And today, I'll walk you through the entire process so you can start doing the same.

–

⏰ Timestamps ⏰
00:00 Animate Everything
00:38 Selecting the Right Music
01:44 Creating the Image Assets
07:19 Animating the Assets
16:10 A Teaser Video in Under 2 Hours

-

Music Credits for Trailer
Track: "Follow the Leader (Action Trailer Glitch Intro)"
Author: @soundbay
Link: pixabay.com/music/main-title-follow-the-leader-act…

#runway #runwayml #motionbrush #midjourney #midjourneyv6 #aifilms #aifilmmaking #aimovie #aitrailer

All Comments (21)
  • Man, I'm a long time traditional artist(graphite 13 years) just nowxentering the digital space and I'm being blown away by all this... organizing my productivity has been an issue bit it's exciting to see what's possible as I've been playing with this stuff good jo!
  • @WilliamSheck
    Great Job, Christian. (Another) new era dawns. Honestly, one year ago I thought we were five years out on this frontier. Things are moving at Warp speed.
  • @hakosho2003
    In the case of motion, I prefer Pika Art, RunAway cannot generate sudden or "speed" movements. In Pika Art, if you remove the background of the character, it is easy to generate someone running or walking without deforming the legs. The same does not apply to RunAway
  • @morgangitonga
    Nice tutorial...an eye opener too. Thanks for sharing
  • @HansJoachimNolte
    i like your honesty. unlike many other authors, you state in the video itself that the ai doesn't really work perfectly. others write exaggerated headlines to generate visitors. i don't think the quality of the video itself is really great. you can see in every scene that it's AI. i think it will take a little more time until the results are perfect. but: your video was definitely enough for inspiration...;-)
  • Man this is so eye-opening I’ve tried using pika , but as you said it keeps creating weird motions , this brush tool is definitely a game changer I can feel my creative juices flowing just by watching this video
  • Nice work, Chris. I've started using Runway just before their 5-brush rollout. I agree in what a game changer it is. I keep hoping there will be a gradual lengthening of their 4 & 8 second limits on film -- yet as you demonstrated, by having a sequence of related video clips -- albethem short - it's possible to stitch them all together in a compelling way by using the right background music. Again, nice job.
  • @RLeaguer_Saint
    I always enjoy your videos, and learn a lot - this one was no different. However, you convinced me that I'm not ready for Runway yet. It's one thing to produce a trailer, where everything is disjointed by design, because you don't want to give away the plot, so there really is no plot. And for that, the multi-brush tool in Runway is very impressive. But for anything more, like if you wanted to link images into a meaningful story, it would be an enormous amount of work to produce anything of any length and quality. It's an extremely impressive and cool effect that Runway have pulled off with AI here, but, it seems to me, it's a long way from troubling film designers and graphic artists at this point, where you would need much finer grained control that the slight panning and zooming that is availble here. That said, I really enjoyed watching you play with it, and as always, I learned a lot, so thank you for the fascinating video. I think by the time it becomes truly useful (and I'm sure they'll get there), it will become so complicated that it'll be another tool that professionals have in their toolbox, but likely out of reach of most of us. Time will tell...
  • @chariots8x230
    16:03 It’s cool, although I’m surprised it took about 2 hours to create such a short trailer. I thought it would take much less time, but maybe the technology isn’t there yet to speed things up to that level.
  • @storytellerHD
    Oh this is definitely inspiring on so many levels. You're crushing it. I'm impressed by how you're considering the story elements that engage the senses, i.e. the sound track. The money and resources it would take to create a "like for like" studio version of this trailer would be exponential, not to mention the time. Speaking of time...can you please comment on the average rendering speed for each clip? We have a very good feel of what to expect from MidJourney for stills (paid pro version) but still trying understand what Runway output times would yield. We're hearing that it's really, really slow. We can't validate those claims. I'm also hearing that their support is ultra slow to non-responsive. Again, these are just posts on various forums. Before we subscribe to the Runway Unlimited or Enterprise version we'd like to know more. What say you, Christian? How has the render time fared for you?
  • @MrRoopu
    Amazing 🎉 it’s really wonderful
  • @johnleighdesigns
    its great stuff - a different workflow compared to traditional shooting footage oneself or creating video from stock footage or a mix - I can see fantastic opportunities to use AI video generation for creating animated style comic books, storyboards, bedtime stories, trying ideas and concepts for proofs of concepts - ive been trying a few approaches and thinking about combining traditional parallax image/card cutouts in after effects and/or blender along with some AI video footage too
  • @LL-vd3qi
    WOW! Great instructional info and your final video was awesome! Thanks for taking the time & effort to post this for us! 🙏👍
  • The Teaser was SO GOOD!!! But I have a question: What's the website where you create dose images?
  • @ianmeizoso2072
    Amazing! When you say the face kept deforming, but you didn't have enough time to fix it... What would you have done to fix it with more time?
  • @thewebstylist
    So Amazing! And great to see you back our amazing Ai brotha and teacher 100