AnimateDiff Tutorial: Turn Videos to A.I Animation | IPAdapter x ComfyUI

Sdílet
Vložit
  • čas přidán 17. 05. 2024
  • The first 500 people to use my link will get a 1 month free trial of Skillshare skl.sh/mdmz01241
    Transform your videos into anything you can imagine.
    ⚙️Setting Files:
    bit.ly/3vJNaOZ
    ComfyUI: bit.ly/3LM1hbN
    ComfyUI Manager: git clone github.com/ltdrdata/ComfyUI-M...
    Guide: bit.ly/3ubx4gw
    Important! use this base workflow if you're having issues with IPAdapter: bit.ly/3ITvSlQ
    Models:
    ProtoVision XL: bit.ly/3U8ps9l
    DreamShaper XL: bit.ly/3Sa9h8W
    CounterfeitXL: bit.ly/3OkptmL
    SDXL VAE: bit.ly/4b6NXtv
    IPAdapter Plus: bit.ly/3vLiI78
    Image Encoder: bit.ly/42aaDoC
    Controlnet model: bit.ly/42bmGC2
    HotshotXL bit.ly/3HxJRx0
    How to find prompts: • How to Write A Prompt ?
    ➕Positive Prompt: ((masterpiece, best quality)), Origami young man, folding sculpture, wearing green origami shirt, blue origami jeans, white origami shoes, depth of field, detailed, sharp, 8k resolution, very detailed, cinematic lighting, trending on artstation, hyperdetailed
    ➖ Prompt: (bad quality, Worst quality), NSFW, nude, text, watermark, low quality, medium quality, blurry, censored, wrinkles, deformed, mutated
    🔗 Software & Plugins:
    Topaz Video AI: bit.ly/3t04Otl
    ©️ Credits:
    Sock videos from @PexelsPhotos
    ⏲ Chapters:
    0:00 Intro
    0:24 Install ComfyUI
    1:31 Base Workflow
    1:54 Install missing nodes
    2:22 Models
    4:23 Settings
    10:36 Animation outputs
    Support me on Patreon:
    bit.ly/2MW56A1
    🎵 Where I get my Music:
    bit.ly/3boTeyv
    🎤 My Microphone:
    amzn.to/3kuHeki
    🔈 Join my Discord server:
    bit.ly/3qixniz
    Join me!
    Instagram: / justmdmz
    Tiktok: / justmdmz
    Twitter: / justmdmz
    Facebook: / medmehrez.bss
    Website: medmehrez.com/
    hashtags...
    Who am I?
    -----------------------------------------
    My name is Mohamed Mehrez and I create videos around visual effects and filmmaking techniques. I currently focus on making tutorials in the areas of digital art, visual effects, and incorporating AI in creative projects.
  • Krátké a kreslené filmy

Komentáře • 607

  • @MDMZ
    @MDMZ  Před 3 měsíci +33

    Need help? Check out our Discord channel: discord.gg/jt6FEMNa
    I've added some solutions and tips, the community is also very helpful, so don't be shy to ask for help 😉

    • @bhabasankardagar5810
      @bhabasankardagar5810 Před 3 měsíci

      Thanks, It works with me select_every_nth : 15 and 480-1080, but it is taking too long, I have CP Config with 20GB RAM, Core i3, and Win 11. Let me know if there is any process to fast, I want to create 20-second video, can I upload the image segment in "Keyframe IPAdapter -Load Image" to speedup process?

    • @bhabasankardagar5810
      @bhabasankardagar5810 Před 3 měsíci

      It's taking too long to create videos, so I'm considering generating animated sequence images instead. I'll merge these sequence images using Premiere Pro and create the video myself.

    • @MDMZ
      @MDMZ  Před 2 měsíci +1

      @@bhabasankardagar5810 the process relies heavily on your GPU's VRAM

    • @MDMZ
      @MDMZ  Před 2 měsíci +1

      @@bhabasankardagar5810 that's a good workaround

    • @devonandersson300
      @devonandersson300 Před 2 měsíci +1

      @MDMZ
      Can confirm as of 12/03 that following your tutorial steps work perfectly. Was not a ComfyUI user (InvokeAI) - but I needed a solution that can work with video.
      I will try to combine it with the new 4 step SDXL Lightning or JuggernautXL Lightning models. Seem a PERFECT fit for good quality vs speed IF it works.

  • @MaximusProxi
    @MaximusProxi Před 3 měsíci +20

    Thanks for the video! Most creators forget, to show which models they got and where to put them in the ComfyUi folder. This step by step video helped a lot.

    • @MDMZ
      @MDMZ  Před 3 měsíci +1

      glad it was helpful

  • @randy2d
    @randy2d Před 2 měsíci +8

    Wow this is a great tutorial. It's taking its sweet time on my PC LOL but none the less it is actually working! I've seen so many vid to vid confyui videos, and everyon is jumping from left to right, with no coherency, no explaination about what model, and nodes do what, thanks for being super clear about those things. You single handedly just made this whole thing easy!

    • @MDMZ
      @MDMZ  Před 2 měsíci +1

      that's really great to hear. Thank you 🙏

    • @Aryannnnnn217
      @Aryannnnnn217 Před 27 dny

      Will it work on rtx 3060?

    • @randy2d
      @randy2d Před 27 dny +1

      @@Aryannnnnn217 well mine is a 3060 but the 12 gig version, also I kinda improved a few bits on the workflow and it is actually really good now

    • @Aryannnnnn217
      @Aryannnnnn217 Před 27 dny

      @@randy2d mine is also 12 gig version, but i just shifted to comfyui, in A1111 my 3060 couldn't do controlnet and hires fix in sdxl models.. so im wondering if this workflow will work on my system? thanks for reply

    • @randy2d
      @randy2d Před 27 dny +1

      @@Aryannnnnn217 I never ran videos higher resolution than 960x512 because the upscaler I use I can just set the size I want to upsale to and than send it to the video combine to export

  • @GuyXotic
    @GuyXotic Před 3 měsíci +3

    Your tutorials are one of the best and even beginners can become almost like pros by seeing your videos 🙌🏻

    • @MDMZ
      @MDMZ  Před 3 měsíci +1

      Happy to hear that!

  • @SENAC0R
    @SENAC0R Před 3 měsíci +3

    Incredible man!! Thanks, I was waiting for this! I prefer Comfyui than deforum. you are the best!💪

    • @MDMZ
      @MDMZ  Před 3 měsíci +2

      Glad you like it!

  • @VirtueArts
    @VirtueArts Před 3 měsíci +2

    Excellent explanation! Kudos bro... You deserve millions of subscribers!

    • @MDMZ
      @MDMZ  Před 3 měsíci +1

      Thank you so much 😀

  • @sameeramin822
    @sameeramin822 Před 3 měsíci +2

    You are amazing ya akhi 😎 as always awesome and creative videos 👍🏻❤️

    • @chouaibphenix1082
      @chouaibphenix1082 Před 3 měsíci +1

      frr mahabtch tslahli ma3lich fb tfhmni kimah psk dert kifo mhbtch tmchi mlwl

    • @MDMZ
      @MDMZ  Před 3 měsíci +1

      🙏

  • @Fixerdp
    @Fixerdp Před 3 měsíci +3

    Best lesson ever. It's a pleasure to listen you)

    • @MDMZ
      @MDMZ  Před 3 měsíci +1

      glad you liked the video

    • @handlenumber707
      @handlenumber707 Před 20 dny +1

      It's interesting, but without even paying much attention I can tell it takes a level of involvement comparable with traditional methods. Until so called generative AI offers simplistic prompting, nothing changes. You'll end up having to pay experts to use these systems. I see no benefit to anyone apart perhaps for those owning severs, sifting through endless input codes, searching for some kind of pay-dirt. It's a hard ask. A.I. systems (a fad) will NOT replace traditional techniques.

    • @MDMZ
      @MDMZ  Před 20 dny +1

      @@handlenumber707
      You didn't just write "you'll end up having to pay experts to use it" and "i see no benefit to anyone" in the same sentence 😅

    • @handlenumber707
      @handlenumber707 Před 20 dny

      @@MDMZ Wasn't the whole idea to avoid paying people to do things?

  • @AD-jl5mv
    @AD-jl5mv Před 3 měsíci +2

    Such a useful video, thanks heaps for putting this together.

    • @MDMZ
      @MDMZ  Před 2 měsíci +1

      Glad it was helpful!

  • @TheJPinder
    @TheJPinder Před 3 měsíci +2

    Thanks for the clarity.

    • @MDMZ
      @MDMZ  Před 3 měsíci +1

      Glad it was helpful!

  • @FCCEO
    @FCCEO Před 2 měsíci +3

    4:20 after download everything. Thank you for amazing tutorial!!

    • @MDMZ
      @MDMZ  Před 2 měsíci +1

      Glad it helped!

  • @HeyItChien
    @HeyItChien Před 4 dny

    Thanks for sharing looking forward to trying it out!

  • @jemyt6466
    @jemyt6466 Před 2 měsíci +1

    your the best sir

  • @bdnwfantaziedreams
    @bdnwfantaziedreams Před 3 měsíci +2

    very nice and love using AI for animated features. Great sharing

    • @MDMZ
      @MDMZ  Před 3 měsíci +1

      Thank you! Cheers!

  • @KodandocomFaria
    @KodandocomFaria Před 3 měsíci +8

    One idea to improve vídeo background. Try remove background first. Then apply a specific node only for background generation to avoid flickering. if you see flickering on hands you may use a technique by creating a boundering box that stylizes only hands and uses any hands detailers tools (lora, or node).

    • @MDMZ
      @MDMZ  Před 3 měsíci +1

      great tips!

  • @florentraffray1073
    @florentraffray1073 Před 2 měsíci +3

    the future of art... downloading the newest hard to find files
    Thanks for the tut, it was helpful I don't know how I would have figured out all those steps

    • @handlenumber707
      @handlenumber707 Před 20 dny

      Think of it as modern day gold mining, nothing more than just another scheme to get people to hand over their ideas for free.

  • @omarnawar5497
    @omarnawar5497 Před 3 měsíci +1

    thnaks mdmz for yr effort :)

  • @nitinburli7814
    @nitinburli7814 Před 3 měsíci

    Hi! Thanks for the tutorial. One question, which controlnet model are you using? depth, openpose etc...thanks.

    • @MDMZ
      @MDMZ  Před 3 měsíci +1

      hi, it's depth, as mentioned in the video 😉

  • @dejuak
    @dejuak Před 3 měsíci

    Hey really nice video i have watched it like 10 times on the last month. I have a question, is there a way to only animate the character but keeping the background static? Would be really awesome

    • @MDMZ
      @MDMZ  Před 2 měsíci

      you can rotoscope the subject out of your video first, and run it separately from the background, there may be a way to do it directly on ComfyUI but I haven't looked into it

  • @Paulie1232
    @Paulie1232 Před 3 měsíci +1

    Good information thanks 😊

  • @wagnerfreitas3261
    @wagnerfreitas3261 Před měsícem +2

    brilliant

  • @600baller
    @600baller Před 2 měsíci

    Thank you for the video. Is there a SD1.5 alternative of HotshotXL?

    • @MDMZ
      @MDMZ  Před 2 měsíci +2

      yes, mm-Stabilized_high is a good one

  • @yuyuanwang4785
    @yuyuanwang4785 Před 2 měsíci +1

    Thanks so much for the tutorial! just wondering how to keep the character and background to be consistent and a bit stable? I had kept similar setting multiple times but the outcome of human and background still changing a lot.

    • @MDMZ
      @MDMZ  Před 2 měsíci

      you can try playing with the main settings I mentioned. there's no exact formula, so try different combinations, I've tried to explain what every one of those settings does in the video

  • @AntoninaAndrushko
    @AntoninaAndrushko Před měsícem +2

    Thank you very-very much !❤️👍👍

    • @MDMZ
      @MDMZ  Před měsícem +1

      You're welcome 😊

  • @davidlartigue
    @davidlartigue Před měsícem

    great tutorial! well done!
    In the Video Combine window, I don't have any video formats like your video, only 2 image formats, do you know what that's about?

    • @MDMZ
      @MDMZ  Před měsícem

      make sure you update ComfyUI and all the nodes

  • @erdbeerbus
    @erdbeerbus Před 3 měsíci

    great!! thank you! to integrate a selfmade lora file: is it the best way to put it between the checkpoint and positiv text prompt or what would be your suggestion? thx in advance!

    • @MDMZ
      @MDMZ  Před 3 měsíci

      hi, tbh I'm not entirely sure, I will need to look into it

  • @NikitinaYulia
    @NikitinaYulia Před měsícem

    Thank you very much 👏🏼 One question. Is it possible to make a 15-minute video like this? Or is it only suitable for short videos of a few seconds? Thank you in advance

    • @MDMZ
      @MDMZ  Před měsícem

      I haven't tried a video that long, I haven't encountered restrictions on video duration, but a 15 mins video will surely take so long to process if it works, why not give it a shot ?

    • @shizool2359
      @shizool2359 Před měsícem

      15 minute or 15 sec .15 minute destroy ur pc bro😂😂😂

  • @madcatlady
    @madcatlady Před 3 měsíci +1

    seeing this awesome stuff will eventually wear down my distaste for node based systems, still clinging to A1111 for now,
    as an aside, this same reason I cannot abandon Carrara 3D for Blender 😛it even uses it's lovely shader tree in Octane render keeping those awful nodes hidden unless I choose to torture myself with bricks and spaghetti

    • @MDMZ
      @MDMZ  Před 3 měsíci +1

      I was scared of it at first too, just like any other tools, ComfyUI gets easier the more you used it

  • @sylvansheen8598
    @sylvansheen8598 Před 24 dny

    Thank you for your clean and helpful video. I tried to run this on my local machine but unfortunately I do not have enough vram. Do you have any recommendation on any cloud service?

    • @MDMZ
      @MDMZ  Před 18 dny +1

      Thinkdiffusion is one of them, but I can't guarantee that all nodes are available on online services

  • @seosevilla
    @seosevilla Před měsícem

    Tx 4 video. One question: is it possible to have different animations but with the same character that I'm designing? If I filmed my little reference videos to animate my character, I can have this character with these sequences filmed for a short film ¿?

    • @MDMZ
      @MDMZ  Před 27 dny

      the best way to get the same character is to train a model on a set of images of that character

    • @seosevilla
      @seosevilla Před 27 dny

      @@MDMZ Ok. Have you or know good one video tutorial for that¿? Many thanks

  • @azalaka22
    @azalaka22 Před hodinou

    great tutorial,...!!!! i wanna try, where i can find the original video of dancing man?

  • @kunalverma185
    @kunalverma185 Před 3 měsíci

    Is it alternative of warpfusion because I was going to buy that one, should I use this or wrap fusion

    • @MDMZ
      @MDMZ  Před 3 měsíci

      I find this much more consistent, warpfusion is getting better too

  • @ehsankholghi
    @ehsankholghi Před 3 měsíci +3

    thank for ur great tutorial.is there any limition for frame rendering? i use ur workflow for a 32 seconds video file and its like 30 frames(1000 png) and i got this error after 1 hours render time on my 3090ti: numpy.core._exceptions._ArrayMemoryError: Unable to allocate 6.43 GiB for an array with shape (976, 1024, 576, 3) and data type float32

    • @MDMZ
      @MDMZ  Před 2 měsíci +1

      probably running out of VRAM, make sure your GPU is not being overused by other apps during the process

  • @glebandreychuk1117
    @glebandreychuk1117 Před 3 měsíci +2

    Man you are awesome, thanks for your time and effort❤❤❤ do you know is it possible to use multiple controlnets in this pipeline? Depth+edge detection? I tried to use multi controlnet node but I got error with ip adapter then😢

    • @MDMZ
      @MDMZ  Před 3 měsíci

      theoretically, it should be possible, I haven't tried it myself.

    • @bboyhafan
      @bboyhafan Před měsícem

      i tried to with multiple control net, but it work just with about 20 frames, but when i try to make more frames of video there is error

  • @kewlorsolutions
    @kewlorsolutions Před měsícem

    Great tutorial. Can we do sizes like 1920x1080 and how long would that take ie 5-10 seconds. Is there anyway to have it create a sequence instead of a mp4 incase it fails to continue?

    • @MDMZ
      @MDMZ  Před měsícem

      you can definitely go with other resolutions, time is almost impossible to predict, give it a shot

  • @AeroGamingArc
    @AeroGamingArc Před 2 měsíci +1

    hi, thanks for the tutorial it was a great help for a beginner like me. how can I Add my own custom SDXL Lora to the prompts here? like where do I connect em? thanks in advance

    • @MDMZ
      @MDMZ  Před 2 měsíci

      This would be a seperate tutorial on its own, did you try finding other videos on youtube ?

  • @lee_sung_studio
    @lee_sung_studio Před 3 měsíci +2

    Thank you. 감사합니다.

  • @user-ft9oz3si2p
    @user-ft9oz3si2p Před měsícem

    Thanks for sharing. I have a question I would like to ask. What are the minimum requirements for a graphics card?

    • @MDMZ
      @MDMZ  Před měsícem

      I recommend atleast 12GB of VRAM

  • @inanckalayc4923
    @inanckalayc4923 Před 2 měsíci

    First of all thank you for your efforts for this great information and video.
    i am a mac user. i am using m2. zsh: killed, TypeError: Failed to fetch. does this mean that the RAM is not enough? What are the minimum computer specs I should have. I would really appreciate your help. Sincerely,

    • @MDMZ
      @MDMZ  Před 2 měsíci

      Hi, I can't tell for sure, but I know that it's challenging to make this work on Mac, have you followed the installation guide for MAC on the official guide ? and also, what's the full error text

  • @Dharmatography
    @Dharmatography Před 12 dny

    nice one . .,how long it take u to render,. why in my setting in low v ram its too slow. although i have good gpu. ,2080 super

    • @MDMZ
      @MDMZ  Před 12 dny

      if am not mistaken, the 2080 super has 8GB of VRAM ? which is considered a little low for this, you need atleast 12, it won't be blazing fast even with 24GB

  • @bartekvena413
    @bartekvena413 Před 3 měsíci +2

    Great tutorial! Thank You! Could You please help me with one thing? My "Video Combine VHS" nodes are missing video formats - only "image/gif" and "image/webp" is available. WHat did I miss?

    • @MDMZ
      @MDMZ  Před 2 měsíci +1

      are you using the same workflow from this video? in any case, you can export to webp and convert later

    • @user-kx5hd6fx3t
      @user-kx5hd6fx3t Před 2 měsíci +1

      the node "animatediff combine" change to "video combine" . there are two nodes look like the same one . but different. try it again.

  • @infectioussneeze9099
    @infectioussneeze9099 Před 2 měsíci

    great video, I just want to know how could I train my own model data from my own art set 2:30 and use that as the style reference?

    • @MDMZ
      @MDMZ  Před 2 měsíci

      yeah you can do that, I don't have a video on training your own model, but there are several tutorials on youtube

  • @GALAXIADELNORTE
    @GALAXIADELNORTE Před 3 měsíci +1

    excelente🥥

  • @AndresTamashiro
    @AndresTamashiro Před 3 měsíci +4

    Do you need a video card for this? or can it run on Google Colab? Thank you

    • @MDMZ
      @MDMZ  Před 3 měsíci

      for this method, you need a video card, if you don't have a decent one, you can run it on the cloud(for a fee): czcams.com/video/XPRXhnrmzzs/video.html

  • @AlessandroMDC
    @AlessandroMDC Před měsícem +1

    bien explicado felicitaciones solo una duda , me sale: When loading the graph, the following node types were not found:
    IPAdapterApply
    Nodes that have failed to load will show as red on the graph.

    • @MDMZ
      @MDMZ  Před měsícem

      check the pinned comment, just shared a fix

  • @Cruse1914CODM
    @Cruse1914CODM Před 3 měsíci +1

    Amazing Video. I love it. 😍
    Bro, can you please make a video where I can change the character in the video to my character and transform it ? I am actually looking for somethings like this for long days.

    • @MDMZ
      @MDMZ  Před 2 měsíci +2

      great idea, I will look into it

    • @Cruse1914CODM
      @Cruse1914CODM Před 2 měsíci

      Thanks a lot! You are so kind 🤗. I am very happy that you read my comment and replied. I will stay tuned.@@MDMZ

  • @PercuSoundSystem
    @PercuSoundSystem Před 3 měsíci +1

    Thanks a lot

  • @Hidden-Story-Storage
    @Hidden-Story-Storage Před 3 měsíci +3

    Buckle up, creators! This tutorial featuring ComfyUI IPAdapter + HotshotXL is your ticket to a whole new dimension of video wizardry. Transform your content with the power of A.I., and let the magic unfold! 🌟🤖

    • @handlenumber707
      @handlenumber707 Před 20 dny

      Let me get this right. You take a video of someone moving around. Then you upload the video, paying money to use this service. Then you type in some prompts, and you get an animated character back? You can do this for free on your own computer, without the middleman, and without sharing your ideas. It's called motion capture.

  • @blaspayri
    @blaspayri Před 23 dny

    I am on Mac and this seems to be PC windows only .... but interesting to know about its existence. How would you rate this tool for video stylisation/transformation compared to RunwayML video to video?

    • @MDMZ
      @MDMZ  Před 18 dny

      this in my opinion is much better than RML, there are ways to run it on MAC, but it's huge difference when using an NVIDIA GPU

  • @biggo1261
    @biggo1261 Před 13 dny +1

    Can you share how much time did it take to train and GPU used? I used A6000 for several hrs suddenly saw Kill.. (May be my computer went to sleep) I should have chose 16 versions, Is there anyway to save progress on each steps? Thank you so much!

    • @MDMZ
      @MDMZ  Před 12 dny

      what do u mean by 16 versions ?
      Anyways, it's normal for this process to be a little slow, if it stops running, check the cmd window for errors

  • @user-yg9bk5wr2c
    @user-yg9bk5wr2c Před 2 měsíci

    Thanks for the video! But why do I have a lot of paper cranes on my background, the original video is clean white, how do you make sure that the background is rarely affected

    • @MDMZ
      @MDMZ  Před 2 měsíci

      that shouldnt happen, try reinstalling comfyUI, could be a software issue

  • @MedAmineTN
    @MedAmineTN Před 3 měsíci +1

    Nice 🤩😍

    • @MDMZ
      @MDMZ  Před 3 měsíci

      Thank u bro

  • @jamilmalas
    @jamilmalas Před měsícem +1

    Hi, please I need your help, I just updated the comfyui, did update all, and I lost apply ipadapter within the video reference, and also the ipadapter from the keyframe adapter section.

    • @jamilmalas
      @jamilmalas Před měsícem +1

      I just found your comment about the update, thanks a lot, شكرا يا حبيبي

    • @MDMZ
      @MDMZ  Před měsícem

      u r welcome, glad it worked

  • @hongyongzhang2301
    @hongyongzhang2301 Před 2 měsíci +1

    In order to Apply IPAdapter, can you provide the reference image of Origami

  • @KardinalMoses
    @KardinalMoses Před 2 měsíci +1

    Thank you very much; you explained it really nicely. I'm currently at 50% and curious to see what comes out of it :)
    PS: Can the same thing be done with plants? For example, modeling how a plant grows and continues to change over time?

    • @MDMZ
      @MDMZ  Před 2 měsíci

      have fun! I'm really not sure about your question, sounds like you're talking about generating video from scratch?

  • @laviebreslav4112
    @laviebreslav4112 Před 26 dny

    Is there any way to do it with image to video pose instead of prompt to video pose?

  • @taylorrowson3961
    @taylorrowson3961 Před měsícem

    Maybe a dumb question, but is this at all possible on Mac machines? I have an M3 Pro with 36G of shared RAM and would love to try this out

    • @MDMZ
      @MDMZ  Před měsícem

      the installation process is different, technically, it works, but the power of an NVIDIA GPU is unmatched when it comes to AI processing

  • @Xavi-Tenis
    @Xavi-Tenis Před 15 dny

    iwonder why or where is the controlnet pose ? so how can this get the tracking pose?
    thanks to anybody to answer.

  • @MrReefxl
    @MrReefxl Před 2 měsíci +1

    This guide is so cool. What do I need to change so it will have better result for celebs?

    • @MDMZ
      @MDMZ  Před 2 měsíci +1

      a model trained on celebrity pics would probably help, but sometimes using the person's name in the prompt works fine

    • @MrReefxl
      @MrReefxl Před 2 měsíci

      I have tried that, but I get many artifacts on face and cloths@@MDMZ

  • @choboruin
    @choboruin Před měsícem

    I remember you mentioned a cloud site I could use to run Comfy since my PC takes forever. What was that site? I couldn't find it.

    • @MDMZ
      @MDMZ  Před měsícem

      ThinkDiffusion

  • @edwardtranai
    @edwardtranai Před 27 dny

    What's the most effective way to change the background/scenes?

  • @KaziFaizAhmedDollar
    @KaziFaizAhmedDollar Před 15 hodinami

    Can I easily create AI animation with Comfy UI's help using Nvidia Geforce 1050TI 4GB graphics card?

  • @user-kd8oe1pk1m
    @user-kd8oe1pk1m Před měsícem

    Hey @MDMZ I have installed Comfy UI on my Mac M2. using another tutorial. Then when I came to go through your tutorial It seems I don't have access to the manager tab nor the share tab available to me on that window. I don't suppose you know why that is? Anyway thanks for sharing either way.

    • @MDMZ
      @MDMZ  Před měsícem

      The whole tab is not showing or just the manager button ? Try updating comfyui, there's another solution for the manager button disappearing, in the pinned comment

    • @user-kd8oe1pk1m
      @user-kd8oe1pk1m Před 29 dny

      @@MDMZ Just the manager button.

    • @user-kd8oe1pk1m
      @user-kd8oe1pk1m Před 24 dny

      Ive have figured it out!

  • @jaroslavprokop4280
    @jaroslavprokop4280 Před 3 měsíci

    Thanks for the video! Tell me, is my 4070 video card with 12 gigabytes of memory suitable for this configuration? Because according to your configuration, the video memory is fully loaded and the processing of the video for 100 frames stops at 5% of the progress.

    • @MDMZ
      @MDMZ  Před 3 měsíci

      12Gb should be alright, try rendering at a lower resolution, or lower steps

  • @efarmogeskostas
    @efarmogeskostas Před 3 měsíci

    Thanks for the tutorial bro! Yet i can't run Comfy UI from the batch folder. It shows an error about Nvidia old version and Cuda drive not compaticle with pytorch or something like that. Can you give me tip to solve this.

    • @MDMZ
      @MDMZ  Před 2 měsíci

      make sure your NVidia GPU is up to date, you might find more help here: discuss.pytorch.org/t/cuda-versioning-and-pytorch-compatibility/189777/9

  • @lenny_Videos
    @lenny_Videos Před 3 měsíci +1

    Awesome video 🤩

  • @bartemy8631
    @bartemy8631 Před 3 měsíci

    Can we use it in a vps with a good gpu ? Or google collab pro ?

    • @MDMZ
      @MDMZ  Před 2 měsíci

      yes, checkout thinkdiffusion

  • @AyushmaanDes.
    @AyushmaanDes. Před měsícem

    Hi @MDMZ... Great video... I am running into an error tho that states. "RuntimeError: mixed dtype (CPU): expect parameter to have scalar type of Float" Do you know any solution as it would be really helpful. This happens at ksampler
    Thanks

    • @MDMZ
      @MDMZ  Před měsícem

      I don't think I came across this one yet, I'm adding solved errors to the pinned comment

  • @spadron04
    @spadron04 Před 10 dny

    Hi @MDMZ I'm having problems with "When loading the graph, the following node types were not found:
    MiDaS-DepthMapPreprocessor
    Nodes that have failed to load will show as red on the graph." can you help please or somebody?

    • @MDMZ
      @MDMZ  Před 7 dny

      which node is triggering this error ? can you share more info on discord ?

  • @Oksizamnojzombie
    @Oksizamnojzombie Před 2 měsíci +1

    Thanks, this is an awesome tutorial. 😎
    But I have a question, how did you make the glass man?
    I've already tried a lot of options, but I can't get such a polygonal glass person 🥲

    • @MDMZ
      @MDMZ  Před 2 měsíci +1

      the prompts are available for patreon subscribers, for the glass one, you can use "crystal" keyword

  • @lucho3612
    @lucho3612 Před 3 měsíci

    I have only one problem with this workflow: Following all your settings, the time from when I hit "queue promt" until I see my first frame is too long. What settings can I tweak to make it faster, without affecting it too much? When I find the look I like I'll go back to the high settings.

    • @MDMZ
      @MDMZ  Před 3 měsíci +1

      you can try setting the extract_every_nth to 10 or something higher, this way you'll process less frames and get to see what it looks like in much shorter time

  • @techendofficial
    @techendofficial Před 3 měsíci +2

    First comment ❤❤❤

  • @KaziFaizAhmedDollar
    @KaziFaizAhmedDollar Před 3 měsíci

    Does it need an external GPU to run ComfyUI IPAdapter + HotshotXL? Or it can be used without an external GPU?

  • @menwiththemask
    @menwiththemask Před 3 měsíci +3

    Great tutorial man, but please next time tell us we need to install git from the official page in the first place xD

    • @MDMZ
      @MDMZ  Před 3 měsíci

      oh, I didn't realized it was necessary to do manually, may I know at which step you realized that and how you found out that u need to install it? I will pin the solution fore everyone else who runs into the same issue, thanks a lot!

    • @menwiththemask
      @menwiththemask Před 3 měsíci

      @@MDMZ Ehi there, I needed to install Git when I first run cmd and pasted the link

    • @musicspartan9905
      @musicspartan9905 Před 2 měsíci

      I thought I messed up on the first step, thanks bro

  • @ValeryIvanov
    @ValeryIvanov Před měsícem

    Somebody, plzz adviсe what should i do with this error " Error occurred when executing CheckpointLoaderSimple: 'model.diffusion_model.input_blocks.0.0.weight' "?

  • @Kurdischerjapaner
    @Kurdischerjapaner Před 2 měsíci

    Work this with 3d render cutscenes too? I want shadow of rome looks better

    • @MDMZ
      @MDMZ  Před 2 měsíci

      I don;t see why not, you can try

  • @NEW-BLACKPINK
    @NEW-BLACKPINK Před 2 měsíci +1

    Sir help me, how to fix this Error(s) in loading state_dict for ImageProjModel:
    size mismatch for proj.weight: copying a param with shape torch.Size([8192, 1280]) from checkpoint, the shape in current model is torch.Size([8192, 1024])

    • @NEW-BLACKPINK
      @NEW-BLACKPINK Před 2 měsíci

      Reply me

    • @MDMZ
      @MDMZ  Před 2 měsíci

      Hi, please check the pinned comment

    • @rhyswynn
      @rhyswynn Před 2 měsíci

      I had a similar issue, it was because I didn't select the image_encoder in the Load CLIP Vision node

  • @choboruin
    @choboruin Před 2 měsíci

    Great guide, my PC is fairly decent 3060 GPU and it takes forever to make a video, anything to speed it up? Ty

    • @MDMZ
      @MDMZ  Před 2 měsíci

      update your GPU driver, make sure your GPU is not being overtaken by other software

    • @biggo1261
      @biggo1261 Před 13 dny

      @@MDMZ We can do with 3060 if so why not COLAB T4!! what about 3050TI 4GB RAM

  • @hytalegermany1095
    @hytalegermany1095 Před 21 dnem

    For me it works but sadly temporal coherence appears to be very bad. Do you have any idea how to fix that? Which numbers could I tweak

    • @MDMZ
      @MDMZ  Před 18 dny

      there are several factors so it's all about experimenting, there's not a single setting that you can change to directly control that

  • @sebbo1008
    @sebbo1008 Před měsícem

    Well it runs without any errors for me, but starting at the Video Combine Node all it generates is noise. Fractions of the prompt are even visible, but only so barely. Triple checked all models and settings but still it's like that. img2img same model is fine. ControlNet Preview Image seems fine. Any ideas?

    • @MDMZ
      @MDMZ  Před měsícem

      this happened to me before, I solved it by reinstalling from scratch

  • @ryco_music
    @ryco_music Před 2 měsíci

    i get this error when it gets to the sampler : Error occurred when executing KSamplerAdvanced:
    Expected query, key, and value to have the same dtype, but got query.dtype: struct c10::Half key.dtype: float and value.dtype: float instead.
    any idea what should i do ?

    • @MDMZ
      @MDMZ  Před 2 měsíci

      hi, you can check the pinned comment

  • @denislavrov7766
    @denislavrov7766 Před měsícem

    Hi
    How can i fix that
    "When loading the graph, the following node types were not found:
    IPAdapterApply
    Nodes that have failed to load will show as red on the graph."?

    • @MDMZ
      @MDMZ  Před měsícem

      there's a solution for this in the pinned comment

  • @Nibot2023
    @Nibot2023 Před 2 měsíci

    When using open pose and hed - does that lock you into not changing the style or look of a character? You way seems more creative friendly in design.

    • @MDMZ
      @MDMZ  Před 2 měsíci

      hmm I'm not sure, I haven't tested that

    • @Nibot2023
      @Nibot2023 Před 2 měsíci +1

      @@MDMZ *Edit solved it. I did a git pull on the ipadatper for an update and I made a ipadapter folder in the comfyui/models area and it worked.
      Awesome Tutorial - Going back throw and following along but for some reason I have the Ip adaptor in the same spot but for some reason the node is undefined. What would be the work around for that node to load the ip-adapter-plus_sdxl_vit-h.safetensors?

    • @MDMZ
      @MDMZ  Před 2 měsíci +1

      @@Nibot2023 Nice! thanks for sharing how you solved it

  • @luisgregori3817
    @luisgregori3817 Před 2 měsíci

    I have a rtx 16go, 80go ram, and a i9 9900k, confy ui Works grate when i Just do pictures and its very fast, but with this workflow at the ksampler step it start to be very slow and take an hour to render in the ksampler. Comfyui start to be very laggy and freeze a lot at this moment… do you know why ??

    • @MDMZ
      @MDMZ  Před 2 měsíci

      that's unfortunate, seems like it's heavier on GPU VRAM, although 16 should be enough, you can try reducing the resolution, make sure your GPU driver is up to date, and make sure the GPU is not being overtaken by another application

  • @murtazahashmi3690
    @murtazahashmi3690 Před 18 dny

    Great video I got it to work on an m2 ultra 192gb. currently trying to integrate animatelcm and lcmlora to this workflow for faster generation and enhanced quality . let me know if you have any advice and ill stay tuned for more videos :)

    • @MDMZ
      @MDMZ  Před 12 dny

      that's awesome, i'm really curious, how's the speed on the m2 ?

    • @murtazahashmi3690
      @murtazahashmi3690 Před 10 dny

      @@MDMZ its not super fast but it did get the job done. i ran it in 1 hour. on nvidia gpus i suppose it would be less than 30 mins for the same workflow

  • @antonthomsen4043
    @antonthomsen4043 Před 7 dny

    Using a 3070 laptop gpu. Constantly end up with using all vram/ram. How should i solve this? I have lowered the res for the input vid and the upscale. I have lowered the steps in the ksampler. Hmmm ?

    • @MDMZ
      @MDMZ  Před 7 dny

      that's weird, you may wanna check if your drivers are up to date, and make sure your GPU is not overtaken by other applications, if you're generating and using After Effects or gaming at the same time, comfyui will struggle

  • @sallar7
    @sallar7 Před 2 dny

    Thank you so much for your amazing content! Your tutorials have been incredibly helpful.
    I followed your instructions in the video, but I keep encountering this error:
    Value not in list: ipadapter_file: 'ip-adapter-plus_sdxl_vit-h.safetensors' not in [ ]
    I’ve double-checked that the file exists and is in the correct directory, but I still can’t seem to resolve the issue.
    Could you please provide some guidance on how to fix this?

    • @nicholasescalante9004
      @nicholasescalante9004 Před 2 dny +1

      Hi ran into the same issue. IPadapter changed how it works. You need to move this safetensor and place it into "comfyui/model/ipadapter" instead. Create the folder if its not there.

    • @MDMZ
      @MDMZ  Před 2 dny +1

      you beat me to the answer, thanks for helping out!

    • @sallar7
      @sallar7 Před dnem

      @@nicholasescalante9004
      Thanks for the reply. Yes, I already saw the same explanation on Discord, and it worked. However, now I'm getting another error with "KSamplerAdvanced". Maybe I can send you a screenshot of the error, and you can help me fix it?
      the error says: Expected query, key, and value to have the same dtype, but got query.dtype: struct c10::Half key.dtype: float and value.dtype: float instead

  • @lilillllii246
    @lilillllii246 Před 2 měsíci

    Thank you. no workflow json link?

    • @kietzi
      @kietzi Před 2 měsíci +1

      its in the guide the second file. he shows in the video. maybe watch again ;)

  • @luisgregori3817
    @luisgregori3817 Před 3 měsíci

    actually i have a i9 9900k and 16go ram, i dont have a graphics card. Do i need to get one ? i launch a comfyui video and its still not finish after 3hours. How quick is it with a graphics card ?

    • @MDMZ
      @MDMZ  Před 2 měsíci

      you definitely need one to run without issues, the speed depends on so many factors

  • @croxyg6
    @croxyg6 Před měsícem

    Can anyone suggest other ControlNet Models that would work in this patch instead of the TencentARC t2i-adapter-depth-midas?

    • @MDMZ
      @MDMZ  Před měsícem +1

      you can google "sdxl controlnet depth model" and you should be able to find a few different versions, it's worth mentioning that the model I used in the video still works fine for me

  • @WeekendDive
    @WeekendDive Před 26 dny

    Could you get this sort of output with Automatic1111 as opposed to Comfy?

    • @MDMZ
      @MDMZ  Před 24 dny

      I've tried, it's not nearly as good

  • @NEW-BLACKPINK
    @NEW-BLACKPINK Před 17 dny +1

    how i can fix this ( When loading the graph, the following node types were not found:
    IPAdapterApply
    Nodes that have failed to load will show as red on the graph.

    • @MDMZ
      @MDMZ  Před 17 dny +1

      there's a solution in the pinned comment

    • @NEW-BLACKPINK
      @NEW-BLACKPINK Před 16 dny

      @@MDMZ sir, I want use my GPU for Rendering in comfyUI, GPU is getting 5 so 14% and Ram is getting 80%

  • @nm_675
    @nm_675 Před 8 dny

    Hi, I'm not able to see the models in the checkpoint? I've them downloaded in the same location as done in the video.

    • @MDMZ
      @MDMZ  Před 7 dny

      hit refresh, try restarting otherwise

  • @mauriciogianelli1573
    @mauriciogianelli1573 Před 3 měsíci

    Hi my friend. I was trying to keep a similar face to video origin but I couldn't do it yet. Maybe trying another ip adapter?

    • @MDMZ
      @MDMZ  Před 3 měsíci

      looks up IP-Adapter-FaceID

  • @x7pictures
    @x7pictures Před měsícem +1

    ksampler is not running for me before that the que gets stopped also i can't see any preview video how to fix this ???

    • @MDMZ
      @MDMZ  Před měsícem

      could be a memory issue, check the pinned comment

  • @user-vs3pn9gw6c
    @user-vs3pn9gw6c Před 2 měsíci

    I would like to ask what the configuration requirements of this computer are

    • @MDMZ
      @MDMZ  Před 2 měsíci +1

      there's no official minimum requirements from the developers, but I recommend a minimum of 12GB of GPU VRAM

  • @amitkhadse7087
    @amitkhadse7087 Před 3 měsíci +1

    please help with mentioned bellowed errors, 1070 8gb gpu and ram also 8gb

    • @Fixerdp
      @Fixerdp Před 3 měsíci

      I have a 3060 12 gb, 5 times I get an error that there is not enough memory.

    • @MDMZ
      @MDMZ  Před 3 měsíci +1

      8GB VRAM might be a bit too low for this

  • @DreamerSour
    @DreamerSour Před měsícem

    I tested your workflow and noticed, that it works only with Protovision checkpoint. Can you explain what unique specifies it has ? And what other chekpoints works with that workflow?

    • @MDMZ
      @MDMZ  Před měsícem

      make sure you use an SDXL checkpoint, I tested it with atleast 5 models other than protovision, shouldnt be an issue

  • @RizzlePrivate
    @RizzlePrivate Před 3 měsíci

    I got this error: "could not be loaded with cv" pointing to the image_encoder. After downloading the encoder recommended in the IPAdapter Plus page I got it working. The link in the description points to a G model, while the IPAdapter Plus is an H model. Not sure if this is important, but it seemed to be in my case.

    • @MDMZ
      @MDMZ  Před 3 měsíci

      thanks for sharing, I will look into it, I'm using the same exact files in the tutorial and it works fine for me

  • @MukeshKumar-eo1vf
    @MukeshKumar-eo1vf Před měsícem

    When loading the graph, the following node types were not found:
    IPAdapterApply
    Nodes that have failed to load will show as red on the graph.

    • @MDMZ
      @MDMZ  Před měsícem +1

      check the pinned comment, just shared a fix