AI Video Motion Goes x5! New Video Generator / AI Sound Effects, & More!
Vložit
- čas přidán 1. 07. 2024
- Today we've got a look at some Gamechanging AI Video Tools, Learn more about Invideo's GPT at invideo.io/i/TheoreticallyMedia
From AI-powered motion enhancement to dynamic sound design and beyond, join us as we unveil the revolutionary tools making waves in the industry.
Discover the latest in AI video generators, delve into the magic of AI-driven sound effects, and witness how blurring lines between reality and AI are shaping the future of film. Whether you're a filmmaker, an AI aficionado, or simply curious about the digital evolution of cinema, this video is your front-row ticket to the future.
🔥 Featured in this episode:
Motion Brush's game-changing update for nuanced AI motion control.
The new restyle visor for that perfect animated aesthetic.
Sonic Vision's breakthrough in AI-generated sound effects and Foley.
The remarkable video deblur tool marking the end of out-of-focus footage.
LINKS:
InVideo: invideo.io/i/TheoreticallyMedia
PIXVERSE FREE AI VIDEO GENERATOR & VIDEO UPSCALE: • New FREE AI Video Gene...
🙏 Support the Channel:If you'd like, please join the Patreon Here: patreon.com/TheoreticallyMedia
Like, Comment, and Subscribe if you enjoyed the video.
Hit the bell icon to stay updated on our latest uploads.
00:00 -Intro
00:35 - Gen 2 introduced an updated motion brush that allows up to five separate motion brushes to be applied to an image reference, providing precise control over motion in AI video.
02:15 - The updated motion brush in Gen 2 enables creative possibilities, such as animating different elements of an image independently, as demonstrated in a reel showcasing five brushes.
02:53 🦖 While motion control is powerful, it may take several generations to achieve the desired result, as shown with an image of Godzilla.
03:53 🎬 Video maker by Invideo AI allows the creation of entire videos from a prompt, including script, narration, video clips, stills, and titles, and it can be accessed through the Chat GPT store.
06:18 Pushing VideoMaker for Creative Results
07:50 📹 Domo AI is a Discord-based AI video generator that offers unique animation styles for video clips, allowing for creative transformations.
08:31 📺 Domo AI can apply different styles to existing video clips, turning them into animations, including anime-style animations.
09:22 🎶 Sonic Vision LM generates sound effects for videos based on prompts, providing an efficient way to add Foley effects to videos.
10:16 🌧️ Sonic Vision LM can recreate sounds for scenes that didn't originally have them, such as adding sound effects to scenes from movies.
10:31 📷 FMA net is a tool that can effectively de-blur out-of-focus shots in videos, improving the overall quality of footage. - Věda a technologie
I must say that out of all the new CZcams channels where people talks about AI, your videos are the only ones that I can actually sit and watch through. All the others are just too gimmicky and does not deliver enough value. Your summaries are great and my creative brain is already buzzing from all the possible ideas. Thank you!
Oh, thank you so much! Really appreciate that! And hey, man-- that Despacito piano cover on your channel is KILLER!
I agree. I don’t watch many videos, but his videos are informative and straight to the point without wasting time.
The other AI CZcamsrs are so painfully excruciating to watch. This is my sanctuary right here ha
@@TheoreticallyMedia omg, my despacito cover 🙈 that video is from so long ago. I really meant to get into CZcams but never found the time. Maybe this year. 😅
And bro, YOU DA MAN. Please keep your videos coming! 💪🏼
Thank you so much , I follow you from Iraq
Godzilla a freak 🤣🤣🤣 Thank you for always keeping us updated on key breakthroughs. Stay awesome!
Thank you! And seriously, who knew Godzilla had such a wild side?!
Great video as always, Tim. Thanks for the shout out. That sound fx AI is a game changer too.
Dude, thank you so much for that awesome reel! I got super behind today with some other research (plus the kids were ALL OVER ME today)-- Thankfully, as soon as I saw your video, I was like: "Well, I'm not going to do better than THAT!"
Yeah-- the SFX thing is INSANE. The timing on the footsteps was a tad off-- but I mean, that is so nitpicky.
Also, Rose totally killed Jack.
@@TheoreticallyMedia Great video as always ! but have you the link of Sonic Vision LM plz? I didn't found it ...
@@BrunoCaillouxI can’t find it either :(
Now if the sound thing could generate that stuff and put each individual audio file it used on separate tracks to then be able to manipulate, it would be a sound editors dream.
Completely. Basically, like a sound effects library right at your fingertips. I think to get to true pro work, that'll need to happen, as sound designers will want to add reverb and other effects as well...
@@TheoreticallyMedia Where this would really take off is if the AI could analyze the footage, then use the database of the editor's sound library to cut. A sound designers library is their bread and butter, because they've compiled and recorded most of it themselves over many years. I'm already using AI for dialogue work in film. Speeds things up a ton.
@@gnarlymode I’m actually surprised that hasn’t happened yet! Seems like between metadata and tagging, that’s a job AI was born to do!
This is fire man! 🔥
I'd love an upscaler being used with the last one.
That is totally something I can't wait for either! Once those two tools are combined? Man...huge!
I didn't actually know that about sizzling bacon being used for rain sound effects during a foley session, learn something new every day! Great job as always mate! Hope you're doing great! :)
Yup! Picked that one up from a sound design guy years ago, and now I can never NOT HEAR IT. Sorry, I might have either ruined rain, or improved bacon for you!
Good video thanks. Here’s my dilemma - these tools are in a horse race. This week it’s Runway, last week Leonardo, week before Pika. I need to subscribe somewhere but with the rate of changes coming exponentially how do I place my bet. Changing is not hard but still, we develop a feel on how to use a product over time. Really dunno how to approach. What are other people doing?
I hear you-- I've been saying its a bit like the Streaming Wars. At this point, to reasonably do it on a budget is to ala-carte them month to month. Netflix, binge, cancel, Disney, binge, cancel, etc.
You almost have to juggle them...or-- maybe give up grocery shopping?
(kidding, of course. I also have kids-- they eat EVERYTHING...)
I am loving how Gen 2 and some of the other AI video programs are evolving, but the next step I will be really excited about will be the ability to maintain photo resolution. I’ve done a couple of spec projects for clients using photos and they really disliked the the overall blurry, softness, and loss of detail with AI animated videos.
Same! I’m hoping that’ll be worked out fairly soon. From what I’ve seen in the research pipeline, I’m thinking anywhere between 3 and 6 months.
@@TheoreticallyMedia sounds like a realistic timeline. 😂
One of the most interesting channels I've subscribed to recently. Well presented, thank you
Thank you! That means a lot!
I really like what Runway is doing because it is not just another "make video" AI but rather a tool for making motion from images. We had some VERY nascent tools for doing that before the AI craze but they weren't very good and kind of died off. As a Photographer I really enjoy these tools as they let me get more life out of my work.
Do you remember that whole Tumbr craze of lightly parallaxing a portrait? I mean, that's basically a lot of this stuff. Nothing really new, just a TON easier.
I think stuff like motion brush is the thing that will really push us into the next era. Particularly when you can prompt for action in the brush. Combine that with a merging of 3d (which I think is going to be big this year)-- and I mean...let the good times roll!
On the photo side, man-- that Ambient slider in Gen2 is REMARKABLE for landscape shots.
Great piece, excited to try them all!
Your upload schedule consistency is very admirable! Great video as always😊
Thank you! I'm really pushing for Tues/Thurs this year. I've experimented around, and that seems to work best for me. I've tried pushing 3 videos a week, but that takes a pretty heavy toll and starts to border on burnout-- For me, 2 a week seems to be the sweet spot!
Short and to the point. These are good summaries.
Thanks! I do hate the whole 40 minute video thing. I know that CZcams tends to like it, but man-- I've got to edit these things, and I can't take myself for that long!
lol the 2 second slow horses totally got me off guard and it had a super great I should watch it effect on me
It’s pretty great! Gary Oldman is such a cranky character! Totally hilarious- but, the show does tension incredibly well also.
Also, gotta love the shorter format. I think the first season is like, 6 episodes, so it’s super easy to binge through!
Good morning Tim, good work I always have a question, if you notice in architecture animation how they move the building when they walk through, is any idea or any chance to give us a clue how that can be happened in AI? I am really confused and interested at the same time, grateful to you
Ayo!!! Ur funny, U are my guy TIM, quality content every damn time. The lil tidbits you add are so useful also! You are appreciated.
Oh, bless you! Thank you so much! And glad to hear! It was probably the weather, but I think I was a little extra spicy today!
Jeffs a champion, I'm a big fan of his work he's always pushing the boundaries, Huge news on the sound fx front I can't wait to try this.
I would love to see a duomo deep dive. I'm most interested in style transfer consistency between different shots.
Noted! I actually do want to dive into that as well. I saw some promising stuff when I was experimenting.
Great video.
(3:30) A "paw" is an animal hand or foot that has nails or claws. So that checks out.
(6:29) Watch the background in that pan shot with the guy in the suit. It is stunning that none of those business signs morph or dissolve. That is incredible.
You just answered the most important question of all time.
Godzilla has a paw.
Wow.
@@TheoreticallyMedia I do what I can.
Cheers, Tim!
“Godzilla like it round”!!!!😅😂🤣😂🤣😂🥰👏👏👏❤
Even Godzilla got to shout!
Really excited about the motion brush changes, but the morphing is still the biggest issue. Although I just sent off a music video to a band in the UK that I created entirely with MJ & GEN2 and because they play stoner rock, the morphing actually helped match the trippy music.
Hah, I feel the same! I think when you have a technical challenge (like morphing) the best case is just to lean into it. Turn it into an asset. But, yeah-- I also listen to (and have played in) a bunch of psychedelic and stoner bands, so I totally get that lava lamp visuals matching perfectly there.
But, I also think if you can ramp down the morphing, it also works for like, Lofi, meditation, etc. I did see a guy put together a REALLY cool Synthwave track with Kaiber visuals that were all beat matched to the morphing. That was really cool.
🤣
As always, you rule! Perhaps a deep dive to compare Kaiber to Domo? And I had to pause the vid to go and see the new Runway update, it's RAD!
Totally! I need to circle back to Kaiber! It’s been a minute since I’ve played with it and there have been a lot of improvements over there!
Runway is insane!!!
You give the most interesting ad read by providing a tutorial on how to use the product
Oh, thanks! Yeah-- I wanted to do something a little different-- I know there have been a few other channels that have covered Invideo, but none of them went full Zombie! Haha
9:44 Is there an AI that does the 'opposite'? Identify sounds and generate text and or images/video from it?
I haven’t seen that yet, but I’m sure someone out there is working on it. If I do see it, I’m totally going to make some movies out of some old public domain radio drama broadcasts!
Yes please for a deep dive on Domo!
Noted! I'll put it on the to-do list!
Where can we find Soinc Vision LM?
Very cool mate..
Thank you!
LOL @ Godzilla booty. 🤣 5 brushes kind of awesome and a very cool step forward for Runway. Now it is possible to extend movement in a serious way beyond just the background. 👍
I keep imagining a text prompt box under each of those brushes. When that happens? Man...TO THE MOON!
At 3:30, you talk about correcting godzillas phalanges. That would be an awesome video if you're able to walk us through the process. If there is a resource you can direct me to, I would greatly appreciate it, as well. Thank you for all the awesome videos you have been creating.
Oh, for sure-- I'll try to sneak that into a video soon. The basic idea is that you take your "Good" Godzilla shot and then put the better "paw" one on top of it. (I was informed it is a claw, but I want to keep calling it a paw, because that's funny.
They should more or less line up, provided you keep the same motion controls.
From there, you use your mask tool to "cut out" the top video of everything except the paw section. So, you've got one small portion of the paw video playing over the top of the "Good" shot.
Does that make sense?
Like I said, I'll try to pop that into a video soon though!
Link to Sonic Vision LM? Can't find it
man, I have friends in the Foley industry. this is sad for them whilst at the same time great for independents (pros will be impacted hugely and the jobs lost will not come back).
Oh, I hear you. It was kind of bound to happen at some point. That said, there is always going to be a need for recording, and they have transferrable skills.
Funny story: An old pal of mine was an audio editor and once had a client that made libraries of ducks squaking. Litereally, someone was out in the field, recording all manner of ducks-- which, my pal had to edit, and categorize by duck types and calls. 8 hours a day...listening to ducks.
For him, that's a job he'd rather have AI do! haha
@@TheoreticallyMedia ya foley (or any) grunt work can be a pain but also the creativity like the frying bacon could be the magical result maybe those duck sounds will become the sound of EV scooters so they don't get hit by cars. My wee story, i was visiting the studio once and my belt made it onto the big screen as a slap sound effect (not as creative as the bacon sound but it was my belt). thanks for this video and your others. We live in wild times with technology and you help give some direction.
Could you use AI to separate the smoke into a layer? Clearing up the image could help with the AI animation of Godzilla, then add the animated layer of smoke back in. I've never used video editing, but I'm curious if someone who knows what they're doing could test that idea.
Thanks
Oh man, thank you so much!! Really appreciate that!!
A Bruce Lee Terminator movie would be awesome 😆
Oh, totally. It was an example from this video I did on Plotdot, which is a AI Screenwriting Tool! It was a fun video, and I really DO want to see this movie:
czcams.com/video/aAdOCKn8f40/video.html
Thank you for the video - the biggest problem for me is that after 2 seconds a video quality drops - I wander why they can not fix it.
Yup, and on an extend, it gets even fuzzier. I think that'll be solved by mid-year. Fingers crossed!
this is a matter of time:)@@TheoreticallyMedia
"Flow guided Dynami.. I'm not reading that whole thing" im dying
Haha, I'm not naming names, but you KNOW there are other AI channels that would have read that whole thing off for the extra ad time! Not me-- mostly because I have to edit myself, and-- no way am I going to bore myself reading that!
Multi motion is great!
It's really nuts! I need to spend some more time with it, but I got buried under a bunch of other research! Luckily, it looks like a pretty major snow day tomorrow, so I'll have some time to...
All Work and No Play Make Jack a Dull Boy...
...sorry, what was I saying?
Godzilla has a claw
Thank you! I don't know why I blanked on that-- but...also, Paw is hilarious, so I might just keep saying Paw!
Man yesterday i cancelled my runwayml subscription and today we have the new brush. Anyways i dont understand why they dont use controlnet with pose. Thats the best currently to get realistic motion
Another good video mate
Thank you! I had a pretty stupid amount of fun putting this one together. The return of scandalous Godzilla!
His twerking is getting better @@TheoreticallyMedia
runway is painful, it's like those carnival games where only one out of 30 balls actually get in the hoop and it takes a long time.
Not gonna lie, it takes a lot. It's getting better every day, but our current state can be a bit rough. I think we'll see something like "Video Referencing" at some point, where you can take a short clip of video and tell the model: "I want this action"-- and via something like ControlNet and Depth Segmentation, it'll know what you're looking for, but that might be a year or so off.
Maybe sooner? AI Time does move pretty fast!
Thanks for being so fast
The morphing gets me too angry
Leonardo ai and stability ai are still better with motion from image prompts
Oh for sure-- I actually need to do a Leo Deep Dive really soon. SO much has changed over there, and I feel like folks really need to know how amazing it is! So much to do!!
link to runway?
runwayml.com/
how close is it to getting what you actually want.
I don't know if they do it on purpose or not, but I'm working with DALLE now and it can't follow instructions.
It CAN generate some really interesting graphics.
But it won't follow instructions.
Also, do they "stamp in" any metadata or stuff to say it was generated with AI and you have essentially no protection.
I tried Adobe's firefly, and it's VERY rudimentary at this point, AND they throw in this notification with every generation that it was marked as generated with AI (and thus you have no protection on it even if you are just having it modify a very small portion of your graphic)
Beyond the watermark, I’m not sure. I think when I looked at the file sizes, I saw something related, but ultimately, if you take video generated with any AI platform and then edit it in a NLE (Final Cut/Premiere ect) any file data will get wiped out
@@TheoreticallyMedia - yeah, I gotcha about the re-rendering in something else which is what I do anyways for touch ups and adding things, but I just think the law needs to change around AI. Some can take an entire day to generate the image you want. We don't want people just saying - I'm going to use it too because it was made with AI. a 3 word text prompt is one thing. I full page prompt and not using any celebrities and such, and even using control net or comfy UI to get more control over your art generations. I just don't understand the law on this...
Have you worked with a GPT called Image Generator yet? Wow -- it's like having a chat with Bard and discussing every little nuance you want in a pic -- then it generates the image exactly as you agreed. I had Image Generator spit out 8 pics for me yesterday in about 15 minutes, and none of them needed "fixing". That's NEVER happened to me before!
Sound cool. CN you share a link
Love your videos, but Godzilla has hands at the ends of those stubby arms, not paws. Other than that, great video. And yes, I have watched too many Godzilla marathons.
Haha, someone was saying that he has "Claws"-- but technically, I feel like that's just the fingers part. Hands, I guess?
I don't know-- I didn't expect to go this deep on Godzilla anatomy!
Still dying to see Minus One!
@@TheoreticallyMedia You never know what's going to trigger a deep dive on CZcams. The hand vs paw discussion has raged for a very long time. In the broadest terms- a hand can grasp, a paw cannot. Simple right? No. You have the hand is singular, so if a creature has to use two to grasp then it's a paw, crowd. The no thumb- not a hand group, Oh, it's padded, not a hand faction, and all sorts of variations.
If you really ever want to create chaos, go to a symposium of wildlife biologists ask for their opinion on hands. You'll have a riot on your hands (or paws, perhaps).
Personally, I think it's primate bias. People are happy saying Opossum's and Raccoons have paws. But, members of the primate family that use their hand/paw in the same fashion have hands.
More DOMO please.
Noted! On the list it goes!
Domo deep dive please
Check!
3:20 😂 😂😂
Love Scandalous Godzilla!
Where is the links at?
in the description.
All I see is a affiliate link for Invideo.
Fantastic video! 👍 The AI Foley assistant looks like such a productive, efficient, and creative solution. Runway = 🤯
What was it - 'Godzilla likes round'? 🤣🤣 Always a pleasure watching your videos Tim. Keep those endorsements coming. We don't mind. We're happy! 💯
Dude, that AI Foley-- well, it's kind of like the the thing I did on AI Hands (czcams.com/video/ln9BZB3wDuw/video.html), its such a small thing, and by no means "flashy" headline in the onslaught of AI News, but-- I mean, it is the pebble ripple in the water. At some point we'll open Adobe Premiere and have an option to Gen-Fill SFX for our videos-- and this is where it starts!
Thanks much on the sponsored comment too! I think I'll have to do a few of them to keep the channel's profit margin-- namely so I can hire someone to take a bit of the load off-- but, I'm always going to strive to keep the sponsors either relevant or helpful to you all. Like, no hyper insane energy drinks or anything!
Great video Tim. That deblur tool is immediately going in my editing workflow. And if you want to know why Rose really didn’t let Jack on the door check my page, I just did an AI video about it ✌️
Oh, I'll check that out for sure! Haha, and man-- that deblur tool would have saved my bacon a few times over the years! Can't wait to see it integrated into NLEs!
Emojis will never be the same
chapters incorrectly refer to invideo ai as Nvidia AI
Ah-- haha, can you tell I used a bot for those chapters? Haha-- Thank you, will update!
@@TheoreticallyMedia thank you for all you do! Chapter keywords are important for SEO, I hope it helps
Most definitely British :)
Ta! (I learned that from Gary Oldman in Slow Horses!
👋
The video has been graced by the lucky yellow hand!!
A claw.
CLAW! Yes...haha, I don't know why I blanked on that! But-- Paw? I mean, c'mon, that's funny.
You don't mention the biggest...most crucial, most requested, and thus the most interesting...feature in AI video generation, with a single word. Maybe because you don't know what it is?
I mean, I don't know-- there's like, a laundry list of them. Longer shot generation, better language understanding, dialogue with lip sync (although do-able via kit bashing).
To be honest, there isn't anything you can't currently do, although it might be limited in its current incarnation.
@@TheoreticallyMedia You know. And it's even the first thing you write: Longer shot generation.
@@JimmyMarquardsen yeah, I’m seeing some stuff in the pipeline that should solve that by mid-year.
What I’ve been thinking about lately is, how long do we actually need? Most TV/Film (modern) shots are around 3 to 7 seconds. So we aren’t far off as is.
Granted, I love a good 5 minute one’r shot. Gonna be a long time before we see that!
First!
The Chicken Dinner Award is in the mail!! (I wouldn't eat it though!)
Claw
Claw. Thank you! Wait, is the claw just the hand part? Or does that extend to his stubby arms to?
I mean, yeah, I could ask ChatGPT, bur comments are more fun.
Also fun: Saying Godzilla has a Paw.
@@TheoreticallyMedia I think you could get away with calling it claws. But it’s perhaps best to call it a paw, because thats where the claws are attached.
Yo anyone actually making vids and making money off homies suggestions should post the links here in comments if that allowed?
I mean sure-- as long as it isn't anything scammy. I'd say to link YT vids only, otherwise the algo will bury your comment. Algo hates external links.
.
#?!
DOMO is a NO NO!
Why's so? Don't like it?
Yeah, curious for some context on why