How I generated a full CG Short Film with AI
Vložit
- čas přidán 17. 07. 2024
- I use a number of cutting-edge AI technologies and tools to create a full animated short film.
Sorry for the audio quality, this is my first project in this direction and not everything worked out as I imagined. The next ones will be better, I hope you like it anyway!
Please link me if you use this video as inspiration for your own projects!
Buy me a coffee:
ko-fi.com/mickmumpitz
INSTAGRAM: mickmumpitz?hl=de
TIK TOK: tiktok.com/@mickmumpitz
Twitter: / mickmumpitz
MickMumpitz is a channel that is all about understanding new technologies from the worlds of digital art, film and games in a playful and project-oriented way.
TOOLS USED IN THIS VIDEO:
Idea
www.plot-generator.org.uk/
Screenwriting
GPT 3 - text-davinci-002 (beta.openai.com/playground)
Character Designs & Concept Art
craiyon (www.craiyon.com/) & Midjourney (www.midjourney.com/home/)
Character Modeling
PIFuHD (shunsukesaito.github.io/PIFuHD/)
Voice Acting
Replica Studios (replicastudios.com/)
Environments
Midjourney + 3dphoto.io (3dphoto.io/uploader/)
Facial Animation
Nvidia Omniverse - Audio2Face (www.nvidia.com/en-us/omnivers...)
Rigging & Animation
Adobe Mixamo (www.midjourney.com/home/)
Would be interresting to reapeat this project in a year to see the progress.
Yeah thats an amazing idea.1 year changes a lot in Ai industry
@@MEMUNDOLOL ayo😳😳
@@MEMUNDOLOL You would probably need to do it with soil and no longer asexual worms if it became a full-on nuclear war.
@@MEMUNDOLOL Nop! The rocks and sticks will be reserved for the 4th war.
Yesss
This feels like it's going to be used as a reference point for just how bad AI was back in 2022. It would be fun to see you do this next august and see what the progress is.
This.
Imagine you get a full blockbuster movie trough just a prompt and it just created everything you desired
I mean, I know this was 2 months ago, but this is using the worst of the worst of AI. Stable Diffusion can produce completely photoreal images. At the time Dall-E could have done WAY BETTER.
@@RichardServello Still, this is the first time I’ve seen someone combine the image generation with generating a 3D model from an image, and then automatic rigging and animation of the model etc.
Of course, there are the models creating video directly, but I imagine this method would have much higher character consistency between shots.
lol people were saying this 20 years ago
There's a lot of crazy things you can do with AI these days. A lot of the tools you showcased are very useful for video game developers.
Please explain
@@I-VisiBomb-I the ai for generating voices. Honestly, I can write an entire essay about this so I'm not going to spend too much time elaborating about it in the comments.
@@I-VisiBomb-I Getting a 3d model out of 2d things is a God-given thing. Usually, you sketch it first for hours and sculp it for other hours. Now all you have to do entering a prompt and then make the ai sculp according to the prompt. You can instantly animate it with one or two steps. Also, the voice acting is a tight spot for indie games. First, it is a very difficult process,second, you need money to pay the proper voice actor but they do not have that money so they either ask their friends and families or just don't put voice acting at all. So yeah they are just amazing tools
@@exosproudmamabear558 What do you mean by ‘God-given thing’?
@@leejerrett8268 It is an idiom for saying it is very useful or good like It is good as God gave.
I could easily see a CZcams animation house where they have a few people working on this style of video's with one person per task cranking out some insane stuff on a weekly basis using this.
It'd be popular too
I won't be surprised if it became popular really
Honestly that thought makes me a bit sad
and plenty of people losing their job hooray
thats kinda a horrifying thought, especially for artists
Better than anything I've ever done on blender.
bro wtf LMAO
lmao. saaaaaaaaaaaaaaaaaaaaaaaaaame. im actually really excited to try this. the results were hilarious
Yjooooooooo same🤣🤣🤣🤣🤣
I thinking the same thing lol
Same lol
"Let's see where it goes". That's a really good summary of what it's like to work with AI. You have no control over what you get. All the "good results" you see on the internet are cherry picked from a list of random results you have little to no control over.
maybe look into vasynth for the voices. It uses video game characters voice profiles to generate speech. it has sliders for individual letters and phonics so you can really tweak it to your liking. it's pretty popular in the skyrim modding community, but it has so much potential. It also has a tool that allows you to input your voice and then the ai will attempt to match the characters tone, pronounciation and annunciation to match your voice acting. but its a bit finnicky.
This was amazing! The final result was hilarious and it was really fun watching you proceed with your workflow. You definitely deserve way more recognition. Keep it up!
the short film was hilarious :D great project, I really enjoyed seeing your workflow
The short film was better than 60% of netflix- and the jumping jacks were just perfect
Bullshit
@@za-mirza-mirov3886 Netflix = great cinematographer + 0$ writing staff*overactive hr diversity supervisor, teh result is no love whatsoever
Netflix has a few gems but your so right
Jumping Jacks had me rolling 🤣🤣🤣
Awesome work. I didn't think the midjourney render + depth map thing would work, but it kinda does. The kitchen environment actually looks great.
I was shocked to see this was only the second video on this channel and you just have 3k subs. This is amazing, we get to see the birth of a great channel!
Wow ! It's surprisingly looks good ! And I can tell its related to your talent and skills, cause with the same AI tools, I know I wont be able to do it unless I train on the skills I currently dont have !
I wouldn't thought that I would like this animation Soo much, it looks like that the imperfections was intentional at point you could call stylized! That's amazing broo
This is super handy to see what's possible at this point in time, and also that generally, you're still required to direct an come up with ideas. Also, consistency is one of the difficulties, and if you're using assets from different sources, these have to be incorporated, and all this takes time. This is a useful video - thanks.
Your sets look awesome! And I really liked your camera work too.
This is great! It's amazing how nice the opening scene looks considering how it was accomplished. I tried to find an artificial voice for a character a few years ago and couldn't find anything usable. Things have really improved.
I'd like to see more of this.
I second that. It started out like a story of the Smurfs in their cosy little village. 😃
This is really great work, I love the thought process. Thanks for sharing
Great ideas :) I'm here to enjoy how common such stuff will be in the future.
This is so smart! Thanks for sharing the whole workflow, there where some ai tools I wasn’t aware of
smart like a fish
Really great video! Lots of cool tools I didn't know about, I can't wait to try these tools out to speed up my work!
This was fantastic! We laughed our butts off. Awesome use of the tools.
This is so sick! please make full length episodes! of this AI 3d film
This had me cracking up. good work. This was fun to watch.
I loved the premise of this. Awesome job.
Great job with the tools available. I agree with others who mentioned revisiting this same idea next year. In fact, a yearly re-attempt to do this same story from scratch would be a very interesting series.
That would be so cool! A year ago this wasn't possible. Imagine what is possible next year. Or in 5 years?
Such a fun way to direct! LOL for real, this is an interesting approach. Thank you for sharing.
This was awesome! Thanks for all the links!
Klasse gemacht! Please show more projects like this using and showcasing different AI tools 👍
this is amazing thanks , gets me closer to expressing some ideas
Ok, you can't beat this, extremely informative while being brief, hilarious and fun, subscribed! And the ogre was extremely ugly while being extremely sexy at the same time. How is that possible, this man is a genius
Thanks for sharing your knowledge !
its very very much appreciated !
Loved this. Definitely got the wheels spinning.
What a great resource list you find!
This channel is great! I’m an award winning video producer and love what you’re doing as I’m dipping my toes and interest into the pools of AI as well as animation. Please keep making and posting these vids!!
I love this video, you are my hero for this evening !! Thank you !
Wow, great work! Subscribed!
The initial reaction of the woman to Cambria was hilarious! Exciting to see what we can eventually do with these tools.
omg what a great video. thanks so much for sharing
It was amazing
Looking forward to see more
Wow! This was impressive and I want to try this out myself. Thanks for this!
👏🏼👏🏼 good stuff!
Really, really nice Mick, and very interesting.
Amazing! Very interesting - thanks. That means such process will be fully automated in just few years (I hope)
This was so amazing!!
This was incredible, and super inspiring.
Man, this is gold! thanks!!
Loved the video idea and the movie haha Subbed :)
Thanks for the effort and insightful video brother. Very interesting indeed.
Awesome experiment, mate!
I cried tears of joy and laughed loud af when she’s doing jumping jacks on the kid that was hilarious lmao and the squishing sound effects hHaA
Brooo you are actually good at narrating 😂😂😂😂👏👏👏👏, got chilly horror film vibes
Wow, this is great video with a lot of info🤗
Dope bro nice work and very entertaining
You're a pioneer, My friend! Good job. I subscribed
This was amazing :D
Thanks mate, for this experience, very interesting!
Big thank you for sharing those techniques🤝🤝🤝💗 really appreciated depth thingy
Give the world the best you have,
and the best will come to you! I want you to know that I really appreciate your efforts
Hahaha the star jumps got me so good
Bro! This is GOOD!!
That's incredible. Funny end video! 😆😆
how amazing, very inspiring, thank you!
That was just hilarious. I'm far from creating a short film but I've been playing around with AI for a few months and it's definitely something that now has become a realistic goal on my bucket list. Keep it up Mick!
Impressive set of tools, made me smile
Brilliant. I love it!!!! :) :) :) The ending of the film is hilarious.
the surreal style of the short is kinda neat
Fckn sickkkk learnt so many new things damn. that depth thing is the coolest
Dude this is amazing
Dude, this is your only video on your channel?! THis is a great video. Entertaining, informative... where is the old stuff that you reference?
Great job!!
It was hilarious and at the same time so natural. In the end I asked myself: what would I do? I associated myself with the character. So deep. Great experience 10/10
To honest I'm an artist and I think this ground breaking. The reason is that you can see how ai can be used and see what we can do. As this ai starts to advance we will be seeing some home made animations that will be competitive to film industry. And if ai is used right then it will another tool for us artist rather then against us.
yeah that is the objective, that eventually you can use this to make everything you want a reality, albeit it will probably always need some level of manual work
Disagree
unfortunately it is still very unethical right now as it attempts to replace many artists.
well basically be Gods from the knoledge we already know will everyone will be normies lol
@@spectrumace9564 using it for reference is much better than using it as a final output, but if you're suing it away to take 99% of the process of the art it basically strips away the whole point of it. And yes, it does use stolen data. The CEO of Stability AI who made stable diffusion said that he deliberately did the AI just to destroy the illustration industry. It was designed as a replacement. There is plenty of proof that it uses stolen data.
Great video! Very inspiring:)
This is so cool. Please make another movie like this
Thanks for putting in the work my friend 🙂
Amazing. Thank for this fascinatng and entertaining content.
AMAZING!! 💜💜💜
That. Was. Brilliant!
This is so cool! Ingenious workflow and very fun. I think the quality would be a lot better if you started with Midjourney to make the characters and upscaled them. I loved the depthmap idea for the scene, quality would increase a lot if you would add more images as planes with transparant backgrounds to the scene generated by MJ, like trees, benches, bushes etc. and upscaled them if they get a close up. How long did it take you to make this scene?
I’d legit watch a channel that just did these AI generated short films. Watching the progression in quality as the years go by would be the best part. Maybe make a tutorial suite playlist on how to do all this?
Yes, same, great idea.
Great idea, but CZcams won’t monetize it unfortunately.
So, you have a library of motion already done that you just pick from, you type what you want, and a computer craps it out. And you're proud of "your work"? Basically "cut & paste". What a great movement AI is. We'll have so much product on a daily basis that no one will care to watch anything eventually. I'd rather have a robot do my housework and other mundane things so I can spend my time doing real art.
This is very interesting. I was just commenting on another video about AI art generators. And I made the comment, “wait until you can generate full length feature films with AI. Perhaps someday we’ll make movies completely in the box with zero physical assets. Want a famous actor in your film. Just pay the royalty fee and bam, you have a young Jimmy Stewart in your film along side Sally Field and Harrison Ford (Raiders Ford not A New Hope Ford). The future should be interesting.
incredbile and inspiring, thanks so much for posting.
Holy cow… that was so cool!
I have SO MUCH popcorn leftover.
So interesting! Thanks for that
It will be interesting to see history look back on videos like this and realise this was the start of a brand new age
Yeah a brand new age when human stopped being creative and let computers do it.
Damn I enjoy this video so much, learned a lot too! Question, do you have to integrate each head to the body for every dialogue manually?
LOL, Great lesson into creating 3D animation with AI tools available.
Also appreciated that you pointed out that AI did not create it for you,
it just made it easier for you to create.
this is just amazing. Should go as a chapter to "love death and robots"
Great job for a one man enterprise! At @8:30 what tool are you using to bring the body and head together for animation?
grossartig! danke für deine experimentierfreudigketi! xD
thanks for sharing, mate!
one year is up, now your movie can be photorealistic and so can your voices.
Very very cool, well done.
The difference between watching the show before and after the making process 😅EPIC! ❤❤❤
awesome first video, keep it up
Insane content!!
Awesome!