Create Cinematic AI Videos with Runway Gen-2
Vložit
- čas přidán 30. 07. 2023
- In this video, I'll show you how to get maximum quality from Runway Gen-2 using a few lesser-known methods for retaining video quality using Topaz Video AI
Explore our AI Filmmaking Course: curiousrefuge.com/ai-filmmaking
Get Topaz Video AI: topazlabs.com/ref/2155/ - Zábava
And so it begins
what?
’
@@lypsyrobotti4326 it
@@lypsyrobotti4326the beginning of the beginning of the beginninging
@@jameelbarnes3458from beginning
is it really possible now to create professional video using AI?
Thanks man. Had no idea that turning off interpolate and upscale made such a big difference. Currently re-rendering all my shots with this format
Your explanation of adjusting settings such as interpolate and upscale was incredibly helpful in helping me grasp how to achieve optimal results.
Thanks for the kind words! I am so glad it was helpful (:
Right?! So well presented!
"This is not about replacing you, it's about elevating you..."
Unless you are an actor, set designer, set manufacturer, prop director, motorcycle manufacturer, costume creator, lighting engineer, gaffer, stage manager, makeup artist, boom operator, etc. 😂
But honestly, great video and great explanation of the Topaz settings
This genuinely terrifies me
I doubt it’ll replace those people. It isn’t good enough yet by a long shot. It opens up possibilities for hobbyists who can’t afford to pay for a crew for simple projects though.
@@farmersuiticles It's currently cutting into concept art pretty hard. Quite a few of the folks I know who made a living doing concept for pre-pro and pitches have seen a decent amount of that dry up with clients saying they've swapped to MJ or similar. Other guys are saying they're being handed MJ images and asked to "tweak" for a fraction of the time they would normally work/be paid for. I think costume design isn't too far behind that - set design will take a minute longer just because its so specific to the stage/action that it's hard to find enough data to support design efforts for crew/directors that make sense. What I think is more likely is that audiences start seeing film as a boutique art form - shows like Barbie and Oppenheimer over your average rom-com or comedy fare - and most folks do more of what's occurring now: seeking entertainment from games and creator content online. Source: I'm a set designer and art director in film, tv, and theme parks.
His last line is "...homemaker."
But my condolences to the jobs you mentioned.
Thank you, this looks simpler than the workflow I was attempting.
DUDE😮 Immediate subscribe. Such valuable content, so clearly presented-and loving your non-lazy use of adjectives ! 😃 Thanks! 🙏🏼
You guys are the best! Thank you for this great content Caleb!
No problem. I'm glad you dig it!
Your attention to detail for explanations is much appreciated for beginners like me.
Glad it was helpful!
Some of the outputs I have seen have a dreamlike quality to them. I feel like there could be a style choice to use the footage as is for some situations.
It's crazy to see how far we have come. Looking forward to see the next steps!
Completely agree!
I just made one too, if you can take a look, thanks
not "we" just corporate companies who can make videos without any people
Wow! This is insane. Really interesting stuff, great walkthrough 👏
Glad you enjoyed!(:
I just made one too, if you can take a look, thanks
what a time to be alive
I remember struggling with the first non-linear editing software, way, way back when I was doing my Masters in Film. In the end we had to give up because it crashed so much! After having a long, long break from ambitious filmmaking, I love that you make this look so easy. I'm excited to start playing with AI!!
Thanks for watching! We're wexcited to see what you create!
Great job. Very professional presentation
That was awesom - thanks.
Glad you enjoyed it!
Thanks a lot, very helpful with the settings!
Glad it helped!
I am taking his course and its ABSOLUTELY FANTASTIC!!! 😍😍🥰
Thank you so much! So glad you dig it. ❤️
Great pace, really good teacher.
that's brilliant, man
How do you get consistent source frames for each shot?
This is incredible
Glad you like it! :)
Thank you very much for this class, hugs from Brazil.
How did you make those several photos in Midjourney using the same theme and palette?
Thanks for the good sideinformations!
You bet!
Thank you for sharing!
No problem!
good use of the tool. How did you keep is from warping the image, and do you have to pay for a sub to get more than 4 seconds?
It's incredible! Imagine how games will have graphics like this in a few years, generating everything in real time.
Is... is this a joke?
@@The.Sky.Driver Why would it be? Can't you abstract from its current state and extrapolate its development? Take Wolfenstein 3D from 1982 as a base and extrapolate the advancement of technology to Assassin's Creed, et voilà, it was not a joke, only limited people could have thought it in 1982.
@@The.Sky.DriverIt was just introduced in Nvidia's Event: czcams.com/video/3qSQjRaseos/video.html
At the BYD section. It still doesn't run on a usual GPUs, it requires hundreds of Teraflops yet and huge amount of RAM but they did it with a car commercial video, real-time. Give it time, and it will run in your desktop PC.
honestly I prefer the current aspect of video games (like the last of us) it could become very disturbing if it becomes this real
I have the same mindset as merion and so do many researchers (there are papers talking about this possibilities), glory to machines, glory to the Universe.@@The.Sky.Driver
this is amazing
Woo,this really burst my head when I saw it
Next class I intend to be in, for this is the future of things to come
Sounds awesome. Can’t wait to have you in the session. Cheers!
Just wanted to thank you all for these tips. It made creating my first "Movie trailer" a smoother experience 💙
Great to hear!
This was very helpful
Glad you enjoyed it(:
stumbled across this and must say THANK YOU!...this will unbottle a couple of ideas...#sub
This video deserves more attention, all the best insh'Allah (very modest by the way 👊👊👊)
Thank you! Hope it was helpful. :)
A great cinematic peace, love to see a fellow ai video creator work magic
Thank you so much :)
Great sharing.❤
Awesome video, very informative
Glad it was helpful!
Currently writing a paper on AI, your video was super helpful in breaking down things, and I like your take as well. Thank you.
Can't wait to read it!
ive been playing with runway, blasted through about 500 seconds worth of credits. I wasnt using photorealistic images of people, but there was about 50 or 60% of the videos rendered had really poor results. a lot of collapsing into nothing, or stretching. I've also had some awesome results too. Point is, its a bit of a gamble so if you dont have money to blow on attempts and brainstorming pick your images carefully.
Have you tried processing the video with Runway's super-slow-motion plugin and then speed it up in your video editor? I found that it helps with the choppiness as well (though not with the upscaling) and might be an initial solution for those who just want to play around a bit and get slightly better results than the raw image-to-video output - without paying an extra 300 for Topaz. But yeah, for professional purposes, your process certainly is the way to go.
That’s a great tip. I’d also be concerned with frame rate jitters using that method but would love to see results to compare.
Are you referring to changing shape of the object in Runway Ml? My issue is when i tried to created a video , which shows a huge disposable cup flying.. the texture of the disposable cup changes as it fly... really annoying... by the way, I tried in in the Runway free option... i tried countless time .. did not come right... i even tried Pika .. the quality of Pika is just not right
@@user-xj1gb9od8o I think you are referring to artefacts of sorts. Sometimes, a random color or shape takes a life of its own and is taken to be an object when it is not. If that is what you are referring to, the above is not related this issue. If you are starting with an image rather than a prompt, it may help to crop the image a bit. Sometimes that is enough for the algorithm to treat the content differently. But it does not always work.
@@andreasfalke2 thanks
it' incredible !
Is it best to upload a photo with a solid background, even green screen?
I like your attitude. Subscribed.
Anyone have any advice on what prompts are best for making a character look as if they're speaking> I've tried just about everything I can think of to no avail.
There are lipsync apps that specifically warps the mouth to fit audio.
Great video question since I’m a UE5 user if anyone render out a video from unreal can I use the AI for a better quality render instead of using path tracing? Please do a tutorial.
I love and am grateful you made this video, cheers for this. I do have 1 question... how necessary would you say the Topaz Video Ai is to creating great cinematic videos? You are correct after checking it is a little pricey for me at the moment. Are there any alternatives you'd recommend? and if not, do you implement the Topaz software in your course? Again, LOVE your channel. Can't wait to see more.
Hey there! Thanks for the kindness friend! I would say if quality is your goal, Topaz is 100% necessary, but if you’re just playing around with AI you don’t have to use it. I also cover AI Topaz in the course, but I also provide all the upresed assets so it isn’t 100% necessary.
@@curiousrefuge Thank you Caleb, like so many others have said, I love your work and your demeanor. Looking forward to seeing what you do in the future. Currently saving up for your course. It looks fantastic. I love the work you've showcased on your website. Very inspirational. Cheers again.
Whats your experience with the seed?
It’s freaking awesome! When movie!
Not long before we see a whole movie.
There is already a South Park episode created 100% with AI! It is also good and has some issues, but those are honestly small. Check it out, it will scare the crap out of you and at the same time totally impress you!
Thanks! Do you know if there is a way to have for example a 30 second video and then put on tip of the video an IA skin? Im doing a CiFi movie and im trying to do the outside world look futuristic but i want to use real city footage and only put like a “skin” on it. Thank u very much
Yep! You have many options from using Keiber to using your original image as reference to generate from in Midjourney.
@@curiousrefuge do you know of any video about it? And is it only posible with stills images or also video?
would you recommend this for architecture? my firm has been using midjourney to help clients visualize features color schemes and styles early on. I'm trying now to get an understanding if Gen-2 is smart enough to do partial rotations. Where Midjourney is unable to think in 3D, where we can't pivot and rotate, this seems to have some sense of corners. Tell me more!
Yes it does do partial rotations. In fact images with good geometry and leading lines tend to do better in gen-2. But it will still be about a 50/50 shot to get something usable.
But I would recommend using it.
@@curiousrefuge I'll take more advise if you have it. 3D models of houses are easy to make look great in SketchUp and Revit, but the land always looks cartoony. any recommended AI tools you have your eyes on that take simple geometry and extrapolates?
What aspect ratio was used on those Midjourney prompts?
-ar 16:9 surely?
@@farmersuiticles I'm thinking the same, that or 2:1. Thanks for your response 🙂
10:13 for a quick story board/prototype to get the idea across its pretty good
Can I actually write a script, and make an animated video with dialogues using this? Or combination of other AI tools???
So without a text prompt Gen 2 still changes my initial image into a totally different one. How to I have it actually animate what I put in vs using it as solely a prompt?
excellent video
Glad you liked it!
If we want to create video like this then how any tutorial available?
Thank you 10/10
Glad you like it(:
One day we will look back and say "wow remember when you could only generate 4 seconds of AI generated frames?!" in the same way we look back at a main external storage device held 2.8 MB of data!
Totally, in 3 months we'll look back and laugh.
I'll check back in 4-5 years.
Good content.
Glad you enjoyed it
I would use some film grain and little color grading...nice
i wish not interpolating in the gen 2 generation reduced the compute costs. currently I think it costs you the same whether you interpolate or not, which can't be right. anyway, great vid.
does the free version of Topaz suck for you as well? I tried it and it was so slow and actually froze my computer. First time I think that's ever happened.
Max quality is the goal, and kudos if you have figured it out, because hours of work using it has looked like garbage, despite the super high quality of the starting images.
Great video. How much an improvement do you see? It is hard to tell without a side-by-side comparison. It would do good to do a side-by-side comparison of upscaling using Topaz and upscaling being done by Gen-2.
Topaz Video AI is $300, so not a trivial cost unless one plans on doing a lot of video processing.
Solution: Press 5:13 & 9:51
It's on sale for $249 until August 4th
Topaz Video AI has been very useful to upscale and clean up video for me. I prefer the one time cost to the subscription model so many other are using. Topas updates the software often, like every other week, it feels like.
I've been using Runway for the past month or two now. Loving what I am capable of doing with it but do you happen to have any info on Image + Description?
Some shots I get that come out super good and others just poop. Which sucks because as mentioned these renders are not free. I probably spend roughly $20-$30 per video I've done (which honestly is super cheap when you think about it) but yeah I've been having some issues on my recent project that I'm currently working on and with Runway short film contest coming up this weekend, I figured id dive in and see what other users out there could potential provide some helpful insight. if you have any food for thought please feel free to respond.
That all said great video breakdown and I hope more is to come!
Cheers
excellent tutorial by christoph waltz
Haha I get that all the time.
Do you know how can i find all the generated videos and images that i've done with Runway? i only can found the ones that i downloaded
Good question - we'll check! How far back were some of these images?
Thank you
Thanks for all 💎👍👍👍🔔💓
I tried it and it wasn't so good, but I'll try it again next year 🙂I imagine it will get a lot better with time.
Yeah there are already improvements even since this video came out.
Thank you for all of the information/explanation.
Great video, and great content. Only realised yesterday that I should be skipping the interpolate and upscale option in Runway, (*if using Topaz AI).
Glad you enjoyed the video! (:
I just made one too, if you can take a look, thanks
Thanks for this! Is the process the same now with the new version or do you also have a recent video?
The process is the largely the same, but please check out all of our new videos to see how it has all advanced since here!
As someone who wants to get into filmmaking but not invest the time or money on equipment and actually shooting and post-production, this is a godsend. Thanks for all you do!
No lol. It means there is not filmmaking to get into.
that means you dont want to get into filmmaking bro wtf
Wait, but I thought shooting and post-production IS filmmaking? If you don't wanna do it, doesn't that mean you don't want to get into filmmaking?
What exactly regarding filmmaking that you DO want to do?
If you don't want to invest your effort you shouldn't. Meaning you gonna make shitty film anyway.
@@wisgarus He just wants to create videos, not film making. I guessed
You are like a young Christoph Waltz, my AI generated friend!
Does this work on iPads?
Thank you for your video. I am just getting into this. Why do you suggest not adding a description to your image, i.e telling the AI in runway what you want it to do? How do i give it somewhat specific commands/suggestions to an existing image?
We go through all of this in our course. However, description are vital because the images are based on your description (prompt). This is the mechanism behind nearly all generative AI tools :)
Is there an AI filmmaking Discord?
This was exactly the video I was looking for. Thank you so much for making and uploading. Great presentation. Oftentimes I tend to skim over or skip parts because the presentation of the workflow is boring. I did not do so with your video. You've gained a subscriber. Well done, friend.
Glad it was helpful! Glad to have you apart of the community(:
can we do it? create professional animation using AI? please tell me
I just made one too, if you can take a look, thanks
@@BeyondJourney. thanks, I had a look, perry awesome as to the wide shot, characters and scenes look decent too. Good news for me. but close up and characters seem not easy to control. what are your thought ? do you think this tech is ready to be used to create professional videos now?
This is why actors are striking lol
How you can add voices ?
There's a few different options... D-ID and heygen do pretty well.
Thanks so much! It’s so hard fighting with the blackbox that runway is…. Can’t even comprehend how I didn’t start with all basic settings turned off..
Thanks for watching!
Very interesting, but I cannot neither create my account nor find all the tools you showed.
Great video. I am wondering how to make a video for instagram reels. I cant find the settings to do this...
You can change the ratio in Midjourney by using the "--ar x:x" like "--ar 16:9" or "--ar 9:16" . That will help get everything started (and don't forget to adjust settings in your video editor too) :)
The future is whatever you make it
ℹSINOPSIS:
1. Explica cómo generar VIDs fm IMGs vía Runway Gen-2.
- PRO: Puedes generar muchas IMGs (no hay que esperar a que se genere cada vídeo).
- CON: Quitar la marca de agua es de pago.
2. Te explica cómo quitar pequeños saltos/cortes de esos VIDs con Topaz Video AI (de pago).
Actually blown away wow
And this was an old demo too!
Awesome!!!!
Thanks.
You're welcome!
I think the classic approach for film making is far more efficient. AI tends to...miss the point quickly, redrawing all frames and reinventing the missing parts... what's the point if you have an exact solution for far less effort?
it's a pretty nice and educational video, but are there any AI tools that we can use for free or that you can recommend as alternative to these tools? thank you
Thanks for the video
Our pleasure!
i've only just started watching the video but is Caleb AI?
How can i make a consistent character in runway for example i am putting together a movie about a person, how can i use the same character for different role or scene
In our course we teach how to get consistent characters. It largely comes down to the types of prompts you use when generating your images. Feel free to check us out at our website! www.curiousrefuge.com
I'm back :) can yo make (pleeeease) a similar cinematic for AKIRA (katsuhiro otomo), all the best insh'Allah
wow
In the end, the key is how to make the story interesting.
But "runway gen2" is the best tool.
True, storytelling is the most important aspect of any piece of content!
Can you do one for a street clothing brand photo shoot?
Totally