AI Video ONE YEAR LATER - Runway GEN-3
Vložit
- čas přidán 2. 07. 2024
- AI Video Generation is getting very very good so with the release of Runway's Gen 3 AI model we're going to take a look at their AI Video results and try it out for ourselves.
😁 Subscribe to Joshua M Kerr
🔗bit.ly/3l4U9wo
---------------------------------------------------------------
🎦 JOIN THE DISCORD COMMUNITY
🔗bit.ly/3kUzqvj
For someone, the perfect output may be exactly that what came out, ...BUT, ..I would guess, more detailed input needed for what you/us would want..
.I would do different input..something like:
--Ambient: Space, in orbit distance between Moon and Mars
--Action: Battle between Space spaceships from movie "Starwars" alike, against Space battleships from movie "Startek" alike
--Shot using 3 cameras Panavision 70 lenses , with random closeups , editing, cinematic, (and other stuff you know better than i do, for sure)
--Main actor, a "Brad Pitt" look alike, inside cockpit, helping by piloting and fighting with one of the smaller battleships of "Darth Vader", with dedicated 2 Cameras Panavision 70 lenses, (1 inside cockpit filming his face and body, and one exterior spaceship medium closeup filming him with his intense scared facial expressions
--Individual duration shots of each camera before cut to another camera : 3 seconds
--Total videol duration of video : 30 seconds
--Keywords and sentences to be used as global movie thematic/storyguide :
--cinematic,
--teal and orange predominant colorization,
--lasers used as weapons of spaceships,
--laser colors blue to be used from "Startrek" warships,
--Red color lasers to be used from "Starwars" battleships,
--Green laser colors to be used from main caracter / actor in "Darth Vader" space battleship,
--freedom to Artistic free AI ideas generated by AI model, like effects, anamorphic lenses, and surprising, showicasing Runway GEN-3 potential of most used and less explored or secret potential, during last 10 seconds of movie, with free range, but using inputs given before
--on last 10 seconds of movie, AI model allowed to go crazy, exploring new ideas and concepts for movie ending
It's gonna be so funny watching people try to art direct AI video, changing one word of a prompt and watching the entire video change lmao
Haha...yeah not yet at least. I tried and ...no
It's this sort of thing that continues to convince me that Generative ai is just the R&D for how AI will influence technology and software tools in the future.
yea the forest and bear part took me out lmfao
Haha yeah...seeing that was an actual treat
im glad more youtubers are showcasing it, its an amazing tool!
Simply put, it's a completely different artistic experience. As someone who enjoys making short films with generative AI, I genuinely appreciate your perspective and traditional skills. Even though you joked about being a novice, your knowledge and skillset position you to create truly amazing and innovative work in the GenAI space. It's really just the current limitations of the tools that are holding you back. For example, once you have control over angle, lighting, lens, and camera, anything you dream up will be possible, even if it's just for previz purposes and not the final cut. Text-to-Video tools are fun, but most people making GenAI videos start with Image-2-Video (and then use tools to animate from there).
I love your channel! I hope to see some videos in the future where you mix GenAI with Unreal to create some really cool stuff :)
I'm quite interested in the hybrid video to video idea from Gen1. Filming some shots in real life or using renders form Unreal and then using Gen AI to either add new elements or bring extra realism to renders...default cube the movie. Glad you're enjoying the videos.
You take this stuff You take VP especially on the lower end of the budget scale, green screen, digital video iphones, unreal engine, cheap mocap, editing software for free like Davinci. Add in ai audio music generation. You have right there full suite of stuff which gives anyone access to the tools to make anything. CZcams even distributes it for and pays you if the results are popular. Still need a good script, and good storytelling skills and thats something that AI can't do yet, but scriptwriting has been devalued for years anyway by Hollywood especially. Its still the most vital component. But, I think, by the end of this year (2024) maybe early next year this stuff will be at a level (esp Runway) that anyone with the desire will be able to match Hollywood on production level. Dune is mentioned earlier, I am sure, it will be good enough to generate that level of imagery with consistency. And that's one person hitting a prompt, and eventually enough prompts to create a movie that will visually rival the Hollywood version. Still need the storytelling skills. Its an elite business, the tech might change but the guys who are best at it, are the best at delivering story.
I tried the tool straight away because the examples look fantastic. The results were more than disappointing. At first I thought it was the prompts. Then I tried a few original prompts from the website. Unfortunately, they rarely produced the same result. They really need to improve that.
cool vid, the videos keep getting better by the month
I think these current tools are really good for Previs/Story boarding, Stock Footage, Background Footage etc.
Major issues with these current Ai Models are Random Nature (more like Hallucination or Dreaming), *lack of control over output, even making minor changes is very hard*
Surely you can use inpainting or modify prompt or use multi-model approach to improve control over output, but it is still far too limiting.
This will certainly improve with time.....
Certainly agree. Although the dreamy aesthetic might lend itself to very specific visions. But otherwise, it's going to be a waiting game for production quality. It's great for idea generation, but it's still a bit difficult for testing ideas because prompts are so wildly difficult to control.
Yea, I really don't know how this is going to pan out for the world of video entertainment. It will certainly open a LOT of doors for story telling. But, it may also completely disrupt the industry as a whole.
AI videos have an understanding of the laws of physics (usually) which means that a 3D model exists in its algorithm. OTOY is working on a way of extracting that data to give us the 3D modeled scene.
Thats very interesting. Good to know otoy are on the case.
I'll check back in a couple years. It might be promising technology but has a long way to go to be production ready. Certainly not worth the price right now, I'd say it's pre-alpha.
try image to vídeo Gen3.... Differents results
I thought that was only available on Gen1...Consider me interested
Seems like AI tools will significantly lower the entry point into film making, at least on the indie side. They will give the ability to actually focus on the substance, on the art of storytelling, rather then figuring out the technical implementations. So maybe we could see some interesting projects from books and manga come to life. But I'm still skeptical if it will be possible to shoot a traditional looking film or animation using just AI text generation. Can't imagine Dune or Lord of the Rings level movie being made with this
Maybe not yet but as I say the only factor is time. Genarative AI is big business right now so theres no shortage of funding and a lot of financial motivation to keep improving the models. Totally agree about lowering the barrier to entry. Also 10 seconds is a prety good length to generate especially given the decreaing average shot length of a movie, we just need a bit more consitency in the results and we're off to the races.
I love your point about lowering the barrier to entry, toally agree and I'm here for it.
Not too impressed with the results yet except for that bear clip. I don't know how it is where you live but here, we see flying bears all the time.
Oh that was just real footage haha
It's sad when you can see past the ghosting and artifacts to see where the LLM is ripping the reference from. Like your climber prompt, it was clearly spider man for about half a frame or so. And that spaceship couldn't have looked more similar to the majority of open world spaceship games out there.
I estimate in a maximum of five years, we're gonna have the first good Star Wars movie for adults in over forty years and the one who'll make it is a guy nobody's heard of. He won't be able to charge anyone for it, but he'll never have to work a day again his in his life with all the money he'll make from Patreon. Disney will then have to decide if they should hire him or if they should instead go on not making money on ideological cringe bombs. They'll of course chose the latter and CNN will make up a story the Star Wars guy and all his fans hates women.
It all looks the same.
In what sense the same?
@@JoshuaMKerr Something with the way its being lit, everything has a rim lighting on it and high contrast etc. Im just a hater though don't mind me :)
. hm- usfl vid. aware .f ths nw-
i. luf- ths cmnt