Create Morphing AI Animations | AnimateDiff: IPIVâs Morph img2vid Tutorial
VloĆŸit
- Äas pĆidĂĄn 31. 05. 2024
- đThe first 500 people to click my link will get a 1 month free trial of Skillshare skl.sh/mdmz05241
Learn how to create morphing animations with ComfyUI! From setup to fine-tuning settings for stunning results. Plus, discover tricks to speed up generation.đâš
1ïžâŁIPIV's Morph Workflow: bit.ly/3wvoP04
2ïžâŁList of Necessary files/models: bit.ly/44Qtkin
*Check the pinned message for the list
3ïžâŁMotion Animations: bit.ly/3ylZKVM
âïžFinal workflow: bit.ly/3UzSpcW
âïžMore workflows: bit.ly/3yfwEaH
â How to install ComfyUI: âą How to EASILY Install ...
â How to Write good prompts: âą How to Write A Prompt ?
đ€ Juggernaut Model: bit.ly/3ydr8Wh
Other good models:
- Dreamshaper: bit.ly/4dxdRYr
- RevAnimated: bit.ly/3M4R2zZ
Â©ïž Credits:
Abe's channel: / @abeatech
âČ Chapters:
0:00 Final result
0:08 In this video
0:28 How to start with ComfyUI
0:42 Download & Import workflow
1:59 Settings
8:59 Generate Animations
10:59 Getting creative with ComfyUI
Disclaimer: Some links in the description are affiliate links. If you make a purchase through them, I may earn a small commission at no extra cost to you.
Support me on Patreon:
bit.ly/2MW56A1
đ” Where I get my Music:
bit.ly/3boTeyv
đ€ My Microphone:
amzn.to/3kuHeki
đ Join my Discord server:
bit.ly/3qixniz
Join me!
Instagram: / justmdmz
Tiktok: / justmdmz
Twitter: / justmdmz
Facebook: / medmehrez.bss
Website: medmehrez.com/
#animatediff #comfyui #ai
Who am I?
-----------------------------------------
My name is Mohamed Mehrez and I create videos around visual effects and filmmaking techniques. I currently focus on making tutorials in the areas of digital art, visual effects, and incorporating AI in creative projects. - Kråtké a kreslené filmy
![Tutorial : Character Animation with ComfyUI [Animate Anyone]](http://i.ytimg.com/vi/q7IrozlV6j8/mqdefault.jpg)
![Tutorial : Character Animation with ComfyUI [Animate Anyone]](/img/tr.png)
Need help? Check out our Discord channel: bit.ly/44Qtkin
I've added some solutions and tips, the community is also very helpful, so don't be shy to ask for help
Hey man, the link says its invalid. Could you update it please? :)
Expired link
@@grovemonk fixed
@@AillusoryOfficial thanks for letting me know, just updated the link
@@MDMZ cheers
You are such a master at Comfy UI.. but also just as an educator! Having spent so many hours on youtube, your approach to teaching is just so concise, easy to follow, and generally brilliant... Thank you so much for taking the time to share your knowledge with the world.. You legend!
Wow, thank you!
As always the best tutorial ever, helped reaching dope crazy results thanks bro đ
Happy to help!
Just discovered this workflow today, thanks for the tips!
Happy to help!
Great tuttorial as always! Thank you!
Glad you liked it!
fantastic tutorial. Instant results
Great video and I look forward to trying it. But, do you have a link to the model list that does not require discord?
Great guide thanks. I managed to produce something and this basically is what Krea ai is offering but their output is bit dark and unpolished. Really appreciate the points on using vram.
interesting, I'm gonna try Krea ai
Thank you man! This is dope
Glad you like it!
I have a question that other people might have too. I am new to the AI world and donât know how things work. In your video, you show us how to do everything step by step. But if I want to try new things or use other models, how do I do that? I think we can do more fun stuff in ComfyUI besides just changing the video. Can you make a video about that or write back to explain? This will help many people like me. Thank you for all your hard work!
I get you, I think that comes with experience, try different workflows, you can also look up tutorials on specific nodes and what they're used for
Thank you for this! Any other morph workflows keep the image "exact" rather than reimagining it? I love these morphing loops but would love it to follow my initial images completely. I though I saw a 2 image morph that seemed to not "reimagine" the inputs. Thank you for the detailed settings walkthrough. Improved my results considerably.
I would love to have that too, I don't know of a way to do it yet
hey! i'm also interesting on what you describe! did you find something ?
Donde es esta lista de modelos necesarios. No la veo en discord. Ayuda.
To use juggernaut_reborn, where in the ComfyUI folder structure did you put it? I downloaded it and tried a bunch of different places but it wouldn't show up in the "Load checkpoint" box
hi, all the correct placements of models are included in the full list (link in the description) make sure you use the correct path
anyway to set video combine to download in h264 format because the uncompress is too big also for the images anyway to always save as jpeg or webp not png? ps im not talking about previewing.
u can increase the crf to reduce file size, I think the combine node has options to change codec as well
How long does your full render take and what is your gpu? It takes my 3080 about 1hr to render 720p but fails on the upscale. Any suggestions?
I use 4090, it takes around 20-30 mins to do the whole thing, try reducing the upscaling ratio, don't use your computer when it's upscaling
The king has answered our prayers. Just upgraded to a 4060 ti cant wait to get better quality outputs!
Congrats!! 8 or 16 VRAM ?
@@MDMZ 16!
@@ComfyCott Power đȘ
I can't get rid of the red notifications, and when I try to update or install anything (at video 1:13) I get errors. Reinstalled and uninstalled the program several times already and still errors. Can you please advise me what I am doing wrong?
that's werid, can you share more context on discord please ? easier to share screenshots and resources over there
Hi There! This is so sick, do you do anything paid or know anyone who does this for commision? Just recently have been exploring AI art and am totally new to the field. Thank you so much!
Wow Thanks
Nice
Can you create on a video how we can increase the video length i.e adding more images then 4
I will be experimenting with that
Thanks for this amazing KI Video Information. Many greetings from good old Vienna đĄ đ©
Glad you enjoyed it!
How to open comfyui after installing it all??
This looks similar to sparse ctrl workflows, i'll see how they compare
Great tutoria! Thanx MDMZ!
happy to help!
The upscaling keeps getting stuck and won't generate anything
no errors at all ? did u try upscaling to 720 or 1080 ? trying a lower res might help
hmmm. I must be missing something because I can't seem to get the video to look anything like the original images...any tips?
Fixed it, Lora's did not auto pull in settings! noobing my way through, thanks for this tut!
When I use a real person's image, it completely changes that person's face to a different man. Is there any way to fix that to maintain the same face?
By the way, great video. Keep it up.đ„đ„
check 5:00
@@MDMZ Yes, I caught this the second time I watched the video. Thank you for clarifying this, though.
love your content đ„đ„
Thank you brother for being so kind doing this amazing vid †, sadly i still can't get any results.. i followed all the steps and every file is in it's right place , but i always get an error once i reach to ksampler , would you please help ?
you can share the error on discord, u might be able to get help if u provide more context
hi, what is the resolution of the uploaded photos?
for this particular video 1024x1024, but so far I havent had restrictions with resolution or aspect ration, better quality helps tho
@@MDMZ Are these images publicly available? I can't achieve your result.
@@TheNexusRealm yes they are, together with the workflow
There is no manager option in my comfy ui what should i do now?
did you install the manager ? check this video: czcams.com/video/E_D7y0YjE88/video.html
@@MDMZ much respect for you bro to be very honest you and your community is great i love to be a part of your community.
Can I easily create AI animation with Animate Diff/Comfy UI's help using an Nvidia Geforce 1050TI 4GB graphics card?
4GB is a bit too low
The motion graphic site is down, how can I get the Video? Thx
seems to be working fine now
@@MDMZ I try many times, still can't link the site, pls help, if upload the video to somewhere else(maybe the site block some IP address)
Can u please post your workflows somewhere else? Cuz Patreon not available in many countries...
I believe the unavailability issue affects the payment stage only, I put the workflow there for FREE, can you check if you're able to see the post ?
â@@MDMZ Nope. Patreon is blocked from their side, they decide which nation have privilege to join... If workflow is free, maybe u can link it via google drive?
AMAZINGâ€ïž
Thank you!
Invalid invitation to discord, would it be possible to update the link? Congratulations on the work!!
Just fixed it, sorry about that
@@MDMZ thanks
ìì ìëłŽêł ê°ëčë€
ììë늜ëë€
Better then deforum?
depends who u ask, both can be used for different things
please tell meïŒhow to add 5th or 6th photo or more photosïŒthank U a lot
still looking into this, might need to start off a different workflow
đđđđ
Error occurred when executing ImageSharpen why always like this?
help me please
what does the error say
Amazing results indeed but wow at 1:00min lost me as wayyy to complex to use unfortunately
haha that was my exact reaction when I first saw it, don't get discouraged, it gets easier đ
2.5 for 720p and 3.75 for 1080p, what about 4k?
how long is your rendertime with 3.75? thx
7.5 try at your own risk đ
Can we have a Google colab for this please?
raise Exception("ClipVision model not found.")
make sure you download the correct clipvision files AND... rename them as described in the list
@@MDMZ it's solve but still i get error on cv2
đ„đ„
3.75 is insane
U don't have to go that high, 720p is still good
can you do this for free?
it is free!
People with links to Patreon should be banned for advertising.
I went according to the same links you posted and download *ed the required files, but it gave me an error again, what's the problem?
Error occurred when executing ADE_LoadAnimateDiffModel:
'Hyper-SD15-8steps-lora. safetensors' is not a valid SD1.5 nor SDXL motion module - contained 0 downblocks.
File "D:\ComfyUI_windows_portable\ComfyUI\execution. py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj. FUNCTION, allow_interrupt=True)
File "D:\ComfyUI_windows_portable\ComfyUI\execution. py", line 74, in map_node_over_list
results. append(getattr(obj, func)( ** slice_dict(input_data_all, i)))
File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ ComfyUI-AnimateDiff-
Evolved\animatediff
odes_gen2.py", line 178, in load_motion_model
motion_model = load_motion_module_gen2(model_name=model_name, motion_model_settings=ad_settings)
AAAN
File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-
Evolved\animatediff\model_injection.py", line 1084, in load_motion_module_gen2
mm_state_dict, mm_info = normalize_ad_state_dict(mm_state_dict=mm_state_dict, mm_name=model_name)
AAA
File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ ComfyUI-AnimateDiff-
Evolved\animatediff\motion_module_ad.py", line 136, in normalize_ad_state_dict
raise ValueError(f"'{mm_name}' is not a valid SD1.5 nor SDXL motion module - contained {down_block_max}
downblocks.")
hey, it's possible that the file 'Hyper-SD15-8steps-lora. safetensors' is corrupted, try re-downloading it, you can also share this on discord for more help
Im learning too much from you sir đđ»đŻđ«Ą
Glad to hear it
Error occurred when executing ADE_LoadAnimateDiffModel:
'NoneType' object has no attribute 'lower'
File "C:\Users\piyus\OneDrive\Desktop
ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\piyus\OneDrive\Desktop
ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\piyus\OneDrive\Desktop
ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\piyus\OneDrive\Desktop
ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff
odes_gen2.py", line 178, in load_motion_model
motion_model = load_motion_module_gen2(model_name=model_name, motion_model_settings=ad_settings)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\piyus\OneDrive\Desktop
ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\model_injection.py", line 1066, in load_motion_module_gen2
mm_state_dict = comfy.utils.load_torch_file(model_path, safe_load=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\piyus\OneDrive\Desktop
ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\comfy\utils.py", line 13, in load_torch_file
if ckpt.lower().endswith(".safetensors"):
^^^^^^^^^^
facing this error