Audioreactive AnimateDiff video clips with ComfyUI (AI Music Videos)

Sdílet
Vložit
  • čas přidán 1. 07. 2024
  • Create unbelievable visuals for music videos using this audio reactive workflow for ComfyUI and AnimateDiff.
    Using the audio nodes from SaltAI, masks can react to different audio frequencies following the rythm of the music. In combination with IP Adapter and AnimateDiff, exciting video clips and compositions can be made.
    Unleash the power of Stable Diffusion with ComfyUI and AnimateDiff.
    You can download the video and audio I use in the tutorial here:
    ko-fi.com/s/7d5e1802f1
    💻 AnimateLCM: tinyurl.com/y43bjhee
    💻 IP Adapter plus: tinyurl.com/2zzpuwa2
    📡 Salt.ai: getsalt.ai/
    🕸️ Discord: / discord
    #animatediff #comfyui #stablediffusion
    ============================================================
    💪 Support this channel with a Super Thanks or a ko-fi! ko-fi.com/koalanation
    ☕ Amazing ComfyUI workflows: tinyurl.com/y9v2776r
    🚨 Use Runpod and access powerful GPUs for best ComfyUI experience at a fraction of the price. tinyurl.com/58x2bpp5 🤗
    ☁️ Starting in ComfyUI? Run it on the cloud without installation, very easy! ☁️
    👉 RunDiffusion: tinyurl.com/ypp84xjp 👉15% off first month with code 'koala15'
    👉 ThinkDiffusion: tinyurl.com/4nh2yyen
    🤑🤑🤑 FREE! Check my runnable workflows in OpenArt.ai: tinyurl.com/2twcmvya
    The best ai animation tutorial!
    Learn how to make comfyui animation workflow
    and use controlnet stable diffusion prompts
    ComfyUI: best open source animation software for pc
    ============================================================
    CREDITS
    ===========================================================
    🎵Music
    Song: Bike Box, Artist: Kia, Music by: CreatorMix.com
    It's Our Time, Music by CreatorMix.com
    ✂️ Edited with Canva, and ClipChamp. I record the stuff in powerpoint.
    ========================================================
    © 2024 Koala Nation
    #comfyui #animatediff #stablediffusion
  • Věda a technologie

Komentáře • 9

  • @jagsAImagic
    @jagsAImagic Před dnem

    pretty cool way to sync masks with audio and create a reactive music video. awesome.

  • @PixelsVerwisselaar
    @PixelsVerwisselaar Před 2 dny

    😮 Thats awesome🙏. Will try it soon 😏

    • @koalanation
      @koalanation  Před 2 dny

      @@PixelsVerwisselaar good luck! Many cool things can be done with some imagination!

  • @VaibhavShewale
    @VaibhavShewale Před hodinou +2

    only if i had a good system!

    • @koalanation
      @koalanation  Před hodinou

      @@VaibhavShewale yep, it is heavy. The animation stuff at the end eats a lot of resources...

    • @VaibhavShewale
      @VaibhavShewale Před hodinou

      @@koalanation damn dude the hour of editing you have spent is just on next level