Lip Sync for your AI MOVIES!
Vložit
- čas přidán 1. 08. 2024
- Here are two AI Tools for creating lip sync for your AI movies!
If you like my work, please consider supporting me on Patreon: / mickmumpitz
Follow me on Twitter: / mickmumpitz
Download my FREE Workflow here: / free-workfow-lip-98157565
Tools used in this video:
- Synclabs: synclabs.so/
- Wav2Lip colab.research.google.com/git...
Chapters
00:00 Intro
00:16 Synclabs
00:51 The old method
02:00 Wav2Lip
02:56 ComfyUI Clean up
![Turn your AI images into CG movies [Workflow Video]](/img/n.gif)
Ahhhh perfect timing...was trying to vet my lip sync choices for a project and now indint have to...this looks awesome!
Woot! Looking forward to the next short.
This looks like a great workflow. I can’t wait to try it.
Amazing workflows man, you'r channel ver inspiring!!! thank you👊
Always amazing, man! 💪🏻🏆
Thank you!!
Amazing! Thank you!
nice work!! congrats!!
excellent video man
Great - thank you:)
Thank you very much.
impressive!
Great workflow. I also use Digital Anarchy Deflicker to help with smoothing.
thanks for the heart
Daaaaanke King! Neuen Subscriber, klasse Arbeit! 🤝💖
cool bro
I'm getting this error...
When loading the graph, the following node types were not found:
- Integer
Nodes that have failed to load will show as red on the graph.
All missing nodes were installed, and I can't find any nodes to instal that might be that one.
Not sure how to describe but it is the node for width and height...
Any ideas?
nice work Buddy :-)
I mean this was REALLY useful, especially Google colab thing. What text to speech (free) you think is best ?
i am geting this error in colab ERROR: Could not find a version that satisfies the requirement mediapipe==0.8.11 (from versions: 0.9.1.0, 0.9.2.1, 0.9.3.0, 0.10.0, 0.10.1, 0.10.2, 0.10.3, 0.10.5, 0.10.7, 0.10.8, 0.10.9, 0.10.10, 0.10.11, 0.10.13, 0.10.14)
ERROR: No matching distribution found for mediapipe==0.8.11
My alternative workflow is to lower the position of the mouth in my original video so it's outside of the Synclabs watermark area, take the Synclabs result, crop the mouth part and overlay it on my original clip.
Which software ise for maintain quality
What would be the best platform to Showcase my AI videos for monetization?
Hey can somebody help me. I cannot install the lykosai custom node or the core interference node
How to run this json file
Now my issue is which laptot can be used for this ?
Error occurred when executing ImageScale:
[enforce fail at alloc_cpu.cpp:114] data. DefaultCPUAllocator: not enough memory: you tried to allocate 21026304000 bytes.
I'm getting this error. Any fix?. Ram 16gb rtx 3050ti 4gb.
hey im not that technical person so please can you tell how to open and work with that json workflow file. steps from 2:56
Can it be done to a picture
Please make a Ai Workflow video on making a "Cartoon".
Hi! thanks for your vids! is it possilbe to run SD ComfyUI in a M1 mac? and if it is, how could I install it? Thanks again!
i hope johny sells his game console and buys a PC like normal people. hype \:D/
Hello guys! Maybe someone know how to fix that problem? ♥
SyntaxError: Unexpected non-whitespace character after JSON at position 4 (line 1 column 5)
Can't prompt for this reason :(
same here...
Does it usually take time within the Face Restore Lips Section? I think it might be stuck for me. It just shows "Loading CodeFormer: codeformer.pth
Starting restore_face with codeformer_fidelity: 0.7000000000000001" and then nothing happens for quite some time.
nvm its because my video was 45 seconds long so there is not enough ram to to execute the prompt. looks like I have to cut the video in quarters and then stitch them together again in one file
i have a question regarding the google colab method to lipsync: as the first step says "install dependency and download pretrained model" does this download anything to my computer? i was under the impression google colab is running all of that in a cloud or rather from a different notebook through a cloud or am i wrong?
You do not download anything to your personal computer! But since you are using a cloud computer, the models and code must be downloaded to that machine, as they are removed at the end of the session.
@@mickmumpitz good to know, thanks for clarifying!!
3:00
where is that user interface ?
are people contacting you for work on ai films?
Hey I installed all required custom nodes but it says:
"When loading the graph, the following node types were not found:
• Integer
Nodes that have failed to load will show as red on the graph."
These are the nodes for the width and the height right at the beginning of the workflow. Any Ideas?
Same problem man.
Same issue. Is there a fix or workaround for this?
@@prenzlimpao1444 ??????/
??????
Hi, your video is very helpful! can you tell me from which custom nodes did you take the width and height nodes ? I didn't find them with the 'install missing custom nodes' button! thanks in advance 🙂
Oh they changed that. These are integer nodes. You can add “primitive” nodes instead or create new “integer” ones. But I’m planning on revising this whole workflow very soon because it can be even better now!
@@mickmumpitz thank's a lot for your answer 😀i resolved
@@mickmumpitzcan you give a step by step to do this? I’m having this problem as well
Hey, can you please share this solution? I need this very much!
@@lauraarcangeli2353 What did you do to resolve it?
bro used AI to make his hair look short
yes, one huge issue is the downgraded video quality on almost every app i find along with a trifling watermark. It's a bit of a pain to keep copying and pasting mouths that are hq.
I'm searching for something that correct the lipsinc of a real video, would be very useful in music video
HeyGen does this, every day 1 free token (1min translation and lip sync) it’s perfect
Easy wav2lip 8.1 colab is even better.
That's true. It already uses GFPGAN build-in when syncing the lips.
please share it
@@leemark7739 Just google: Easy_Wav2Lip_v8.1.ipynb
@@leemark7739 Jst google it. Its the one by easymartz.
👍👍
Woman "Hans Bianca He is the toughest hunter on the Island!"
Guy: "What does he hunt?"
Woman: "Ducks!"
ROTFL!
Hey Mickmumpitz, are you related to Samson AI by any chance?
All Germans are related to one another 😂❤
@@theGreatQAwakening dude they both look SIMILAR.
Gpu? 😮
hello ur videos are just awesome, you may shorten your channel's pic ears! 🤣
It was great, until the end of the procedure, where It could not complete the process , because of Nvidia related issues. I don't have Nvidia hardware, I have AMD. Good tutorial anyway.
same here.
666
There is a better lipsinc software available.
Which are u talking about??
@@navedbhati9260don’t just say that and not say what it is
Oh please tell us, mysterious one
hmmm I thought I posted it. Let me go get the link. @@AINIMANIA-greenscreen
Sync Ai
aint no one someone is proud of creating nothing
how many vram do i need