Latent Vision
Latent Vision
  • 27
  • 792 241
Higher quality images by prompting individual UNet blocks
This time we are going to do some R&D and I will need your help to reverse engineer the UNet. Basically prompting each block of the UNet separately with a dedicated prompt we are able to get higher quality generations.
Extension repository: github.com/cubiq/prompt_injection
Discord server: discord.com/invite/W2DhHkcjgn
Github sponsorship: github.com/sponsors/cubiq
Support with paypal: www.paypal.me/matt3o
Twitter: cubiq
zhlédnutí: 11 594

Video

About AI, Art, Ethics and the environment
zhlédnutí 7KPřed dnem
Not a tutorial but this is something I wanted to talk about since a while. Ethics of using AI, the environmental costs and Is AI art? The subtitles are hand edited and corrected. What do you think? Discord server: discord.com/invite/W2DhHkcjgn Github sponsorship: github.com/sponsors/cubiq Support with paypal: www.paypal.me/matt3o Twitter: cubiq TED Talk by Sasha Luccioni: www.ted.co...
How to use Face Analysis to improve your workflows
zhlédnutí 10KPřed 21 dnem
I often use Face Analysis in my workflows but we never actually talked about how it actually works. Here all you need to know. Remember to upgrade the extensions, these are all new features! Check my Discord for the workflows, they are all free for everybody to use. Discord server: discord.com/invite/W2DhHkcjgn Github sponsorship: github.com/sponsors/cubiq Support with paypal: www.paypal.me/mat...
How to use PuLID in ComfyUI
zhlédnutí 23KPřed měsícem
In this video I'm going through some basic PuLID usage and also comparing it to other face models. If you have it already installed remember to upgrade the extension! PuLID ComfyUI extention: github.com/cubiq/PuLID_ComfyUI Face Analysis node: github.com/cubiq/ComfyUI_FaceAnalysis Github sponsorship: github.com/sponsors/cubiq Support with paypal: www.paypal.me/matt3o Twitter: cubiq M...
Animation with weight scheduling and IPAdapter
zhlédnutí 26KPřed měsícem
About time we talked about animations again! I just released new nodes IPAdapter and the Essential that make scheduling IPAdapter, Prompt and controlnet very easy and efficient. Workflows: f.latent.vision/download/scheduled_weights.zip Github sponsorship: github.com/sponsors/cubiq Support with paypal: www.paypal.me/matt3o Twitter: cubiq My Discord server: discord.com/invite/W2DhHkcj...
All new Attention Masking nodes
zhlédnutí 20KPřed měsícem
I just pushed an update to simplify attention masking and regional prompting with IPAdapter. Be sure to upgrade the IPAdapter and the ComfyUI Essential to get access to all the new features. The Essentials can be found here: github.com/cubiq/ComfyUI_essentials Download the workflow: f.latent.vision/download/new_attention_masking.zip Github sponsorship: github.com/sponsors/cubiq Support with pay...
Become a Style Transfer Master with ComfyUI and IPAdapter
zhlédnutí 22KPřed 2 měsíci
This time we are going to: - Play with coloring books - Turn a tiger into ice - Apply a different style to an existing image Github sponsorship: github.com/sponsors/cubiq Support with paypal: www.paypal.me/matt3o Discord server: discord.com/invite/W2DhHkcjgn All the workflows can be downloaded here no strings attached: f.latent.vision/download/style_transfer.zip The SDXL lineart controlnet: hug...
Style and Composition with IPAdapter and ComfyUI
zhlédnutí 25KPřed 2 měsíci
IPAdapter Extension: github.com/cubiq/ComfyUI_IPAdapter_plus Github sponsorship: github.com/sponsors/cubiq Paypal: www.paypal.me/matt3o Discord server: discord.com/invite/W2DhHkcjgn 00:00 Intro 00:26 Style Transfer 03:05 Composition Transfer 04:56 Style and Composition 07:42 Improve the composition 08:40 Outro
IPAdapter v2: all the new features!
zhlédnutí 64KPřed 2 měsíci
I updated the IPAdapter extension for ComfyUI. It's a complete code rewrite so unfortunately the old workflows are not compatible anymore and need to be rebuilt. Sorry about that but I don't have time to maintain old code. IPAdapter Extension: github.com/cubiq/ComfyUI_IPAdapter_plus Sponsor the development of my extensions: www.paypal.me/matt3o Discord server: discord.com/invite/W2DhHkcjgn 00:0...
Build Your Own ComfyUI APP!
zhlédnutí 18KPřed 3 měsíci
This time we are getting our hands dirty into code! I wanted to show you how easy it is to build custom web applications with ComfyUI and absolutely no knowledge of python. Let me know if you'd like more of this kind of content! Comfy Dungeon: github.com/cubiq/Comfy_Dungeon The FastGen extension can be downloaded from here: f.latent.vision/download/fastgen.zip Discord server: discord.com/invite...
Variations with noise injection KSampler (in pills)
zhlédnutí 8KPřed 3 měsíci
This is a kind of experiment I'm doing... I try to pack my videos with a lot of information and sometimes it might feel overwhelming. I was thinking maybe you'd also appreciate shorter videos dedicated to just one concept or even just one node. Please let me know what you think and if you'd like more of this kind of videos. Discord server: discord.com/invite/W2DhHkcjgn Complete video about imag...
InstantID: Everything you need to know
zhlédnutí 50KPřed 3 měsíci
InstantID is a style transfer tool targeted to portraits. It's incredibly easy to create a composition in specific style. In this video I'm showing you how to improve the likeliness, how to make a scene with multiple people and much more! InstantID Extension: github.com/cubiq/ComfyUI_InstantID Face Analysis Extension: github.com/cubiq/ComfyUI_FaceAnalysis Generic Workflows: github.com/cubiq/Com...
ComfyUI: Advanced understanding Part 2
zhlédnutí 27KPřed 3 měsíci
This is Part 2 of my basics series. Last time we learned how to set the conditioning to the whole scene, time to see how to make localized changes. I'm also talking about LCM, Math Nodes and other big and small tricks! As always do let me know what you think and if I should keep releasing "basics" tutorials or you prefer more advanced stuff. Discord server: discord.com/invite/W2DhHkcjgn 00:00 I...
Making Trading Cards with ComfyUI
zhlédnutí 11KPřed 4 měsíci
This time we are playing some card games! This tutorial will show you how to generate very different elements and mix them together into a nice composition. Workflows: f.latent.vision/download/trading_card.zip Discord server: discord.com/invite/W2DhHkcjgn 00:00 Intro 00:53 The Frame 06:22 The Main Character 07:45 The Text Area 11:07 The Symbol 14:36 The Final Composition 16:40 Writing Text 18:4...
Throwing data to your face (models)!
zhlédnutí 17KPřed 4 měsíci
I ran hours of benchmarks to try to establish what is the best IPAdapter face model and this is not a subjective selection: this video is backed by Science :) Workflows: f.latent.vision/download/face_science.zip Discord server: discord.com/invite/W2DhHkcjgn Marco's ComfyUI channel (in German): @ALatentPlace 00:00 Intro 00:17 Models benchmarks 04:53 Ideal Workflow 06:24 Changing hair color 08:22...
ComfyUI: Advanced Understanding (Part 1)
zhlédnutí 64KPřed 5 měsíci
ComfyUI: Advanced Understanding (Part 1)
FaceID Take 2! Even more face models! (IPAdapter+ComfyUI)
zhlédnutí 36KPřed 5 měsíci
FaceID Take 2! Even more face models! (IPAdapter ComfyUI)
FaceID: new IPAdapter model
zhlédnutí 48KPřed 5 měsíci
FaceID: new IPAdapter model
Jellyfish Ballerina Animation with AnimateDiff
zhlédnutí 14KPřed 6 měsíci
Jellyfish Ballerina Animation with AnimateDiff
Image stability and repeatability (ComfyUI + IPAdapter)
zhlédnutí 55KPřed 6 měsíci
Image stability and repeatability (ComfyUI IPAdapter)
Animations with IPAdapter and ComfyUI
zhlédnutí 32KPřed 6 měsíci
Animations with IPAdapter and ComfyUI
Infinite Variations with ComfyUI
zhlédnutí 16KPřed 6 měsíci
Infinite Variations with ComfyUI
Attention Masking with IPAdapter and ComfyUI
zhlédnutí 40KPřed 7 měsíci
Attention Masking with IPAdapter and ComfyUI
Upscale from pixels to real life
zhlédnutí 12KPřed 7 měsíci
Upscale from pixels to real life
From real to anime (with IPAdapter and ComfyUI)
zhlédnutí 15KPřed 7 měsíci
From real to anime (with IPAdapter and ComfyUI)
ComfyUI IPAdapter Advanced Features
zhlédnutí 30KPřed 7 měsíci
ComfyUI IPAdapter Advanced Features
How to use IPAdapter models in ComfyUI
zhlédnutí 91KPřed 8 měsíci
How to use IPAdapter models in ComfyUI

Komentáře

  • @JemyM
    @JemyM Před 2 hodinami

    Wow, I have listened through several beginners guides on ComfyUI and I learned more from this than I done since I began using SD...

  • @geianmarkdenorte9874
    @geianmarkdenorte9874 Před 8 hodinami

    You're a legend!

  • @context_eidolon_music
    @context_eidolon_music Před 8 hodinami

    Thanks for all your hard work and genius!

  • @nvbkdw
    @nvbkdw Před 9 hodinami

    Thanks!

  • @marshy..
    @marshy.. Před 13 hodinami

    Now I just need a faster GPU... Excellent video - thank you.

  • @thomasdaveillans
    @thomasdaveillans Před 18 hodinami

    LIke the others before me. A big thanks for those tuto. It's absolutly fantastic and useful.

  • @muxecoid
    @muxecoid Před 20 hodinami

    What is the hotkey to add the reroutes to a node? Recording future videos with keyboard input capture displayed on screen would be super nice

  • @BrawnyAi
    @BrawnyAi Před 21 hodinou

    I think for SD1.5 that works fine but SDXL has some issues with the IPAdapter, it gives a hazy effect. Changing the weight helps but when it's too low, the result doesn't transfer well, but when it's high, it gives that hazy feel. :(

  • @HooIsit
    @HooIsit Před 22 hodinami

    You are the best! thank you very much. I'm getting error maybe you can please help? RuntimeError: mat1 and mat2 shapes cannot be multiplied (1232x768 and 1024x320)

  • @laps25128301
    @laps25128301 Před 22 hodinami

    Can't find Apply IPAdapter Node.

  • @user-fe3pi9rc9b
    @user-fe3pi9rc9b Před 22 hodinami

    love you😭

  • @cristitanase6130
    @cristitanase6130 Před dnem

    is there a way to keep the head and hair but completely change the pose and the angle? Like for example if the character is in another pose from another angle?

    • @latentvision
      @latentvision Před 10 hodinami

      going from front facing to side is more complicated. You need the reference image in the new pose. Or maybe InstantID is better for that.

  • @Digital_Toolbox
    @Digital_Toolbox Před dnem

    This looks totally mind blowing! Thanks for sharing! Would love to watch a breakdown that is suited more for beginners, especially for the later part.

  • @kikoking5009
    @kikoking5009 Před dnem

    Amazing. Just to note that i get a lower Dist value after upscaling with NNLatentUpscale compared to not upscaling. I mean in the beginning of you tutorial. Even I used the same references like yours and same seed All same but not same Dist! Idk if that's normal or the quality of Pulid gets by Time better. But Amazing Matteo❤

  • @JustAI-fe9hh
    @JustAI-fe9hh Před 2 dny

    Thank you for sharing!

  • @JustAI-fe9hh
    @JustAI-fe9hh Před 2 dny

    First if all. What is ART?

    • @latentvision
      @latentvision Před dnem

      just to be clear, the title in the thumbnail just refers to the ongoing debate between artists (digital or not) and AI "artists"

    • @JustAI-fe9hh
      @JustAI-fe9hh Před dnem

      @@latentvision "addicts"

  • @moezgholami
    @moezgholami Před 2 dny

    I love you

  • @camilovilla8434
    @camilovilla8434 Před 3 dny

    For sure MagnificAI was born from this tutorial. Magnificent information.

  • @fayezhang6085
    @fayezhang6085 Před 3 dny

    Which node in maneger is “Face Warp", or github address? I can't find it.

    • @latentvision
      @latentvision Před 3 dny

      it's in the face analysis extension. You probably need to upgrade it if you have it already

  • @JustAI-fe9hh
    @JustAI-fe9hh Před 3 dny

    Great video! Very informative ❤

  • @chrisfreilich
    @chrisfreilich Před 3 dny

    Amazing!

  • @ai_gene
    @ai_gene Před 3 dny

    Why doesn’t it work so well with the SDXL model? In my case, the result is one girl with different styles on two sides of the head.

    • @latentvision
      @latentvision Před 3 dny

      try to use bigger masks, try different checkpoints, use controlnets

  • @Ymirheim
    @Ymirheim Před 3 dny

    I'm looking forward to experiment with this! One thing that stands out to me out of the gate though. Shouldn't I get the same render if I pass the same prompt to a regular sampler and to the all pin on the injector while using the same seed for both? What is the technical reason for getting two slightly different images rather than two exact duplicates?

    • @latentvision
      @latentvision Před 3 dny

      the results is very similar but not the same because the embeds are applied in different places

  • @zhenyu7152
    @zhenyu7152 Před 4 dny

    is there any demos about advance ipadapter features?

  • @blackfoxai
    @blackfoxai Před 4 dny

    Thank you so much for your lessons, I made a short AI film using your lessons, I set up IPADAPTER and AnimateDiff and got an amazing result, I like it very much czcams.com/video/MFmTsgkLXRA/video.html

  • @andreiparaschiv3101

    the latest IPAdapter node doesn't have a noise input. How do you set the noise in this case?

    • @latentvision
      @latentvision Před 3 dny

      the noise is now handled by the IPAdapter Noise node that you can send to the negative image input. Check my recent ipadapter videos

  • @diqopiasciyks9660
    @diqopiasciyks9660 Před 4 dny

    Why would you want to daosy chain two ipAdapters and two ksamplers in your initial unified loader workflow? Does that help with Fidelity and consistency?

  • @wndrflx
    @wndrflx Před 4 dny

    What does the ConditioningZeroOut do?

  • @makadi86
    @makadi86 Před 4 dny

    do we have tile controlnet for sdxl that may work with comfy?

  • @theGriebs
    @theGriebs Před 4 dny

    Valeu!

  • @pfbeast
    @pfbeast Před 4 dny

    Bring the simplest node as you said in the last of the video

  • @jungsung3911
    @jungsung3911 Před 4 dny

    It was a great education and a great inspiration and lesson.

  • @DreamStarter_1
    @DreamStarter_1 Před 5 dny

    Very interesting, thanks for the great work!

  • @piorewrzece
    @piorewrzece Před 5 dny

    Thank you for all the hard work

  • @YING180
    @YING180 Před 5 dny

    You are the real master and you are so generous to share those techniques. Thank you so much.

  • @benjazeman
    @benjazeman Před 5 dny

    This is something I've been thinking and talking about. Your video was very insightful, and helped me put into words some things I was struggling to describe. Thanks!

  • @jl25735
    @jl25735 Před 5 dny

    Nice work! It doesn't support embeddings :P

  • @thomasmiller7678
    @thomasmiller7678 Před 6 dny

    Hi great stuff, is there anyway to do this kind of attention masking with loras, so I can apply separate loras to separate masks? There's a few things kicking around but nothing seems to work all that well.

    • @latentvision
      @latentvision Před 6 dny

      not really (it would be technically feasible probably but not easy)

    • @thomasmiller7678
      @thomasmiller7678 Před 6 dny

      @@latentvision hmm this is why I have been struggling there are some applications nodes for it but from the stuff I've found haven't had much luck yet, might you be able to help me out or do a lil digging maybe you can pull of some more magic! 😄

  • @adelechelmany
    @adelechelmany Před 6 dny

    Well, it is not easy to find someone you totally agree with everything they say, and you're not an exception. Don't sell yourself short. Your dedication and efforts make you one of the most important individuals in the world of AI. That was my opinion, and today, with your insight and talk about ethics and controversies of the use of AI and its future, I am more convinced.

  • @Sedtiny
    @Sedtiny Před 6 dny

    Matteo's creation of such precise tools elevates technology to the level of art. The specificity inherent in these tools rivals that of art itself

  • @atenore_
    @atenore_ Před 6 dny

    Hey Matteo, thanks for the amazing job you're doing. Following this workflow i get an error: "only integer tensors of a single element can be converted to an index". This is happening when i turn the IPAdapter Batch nodes "weight" widgets to inputs and connect them to the IPAdapter Weights node output. Somehow if i turn back those weights inputs into widgets, the Sampler is able to process them, but ofc i don't get the desired result. Do you know what this might be related to?

    • @latentvision
      @latentvision Před 6 dny

      please post an issue on the official repository adding workflow and complete error message

  • @YouCanDoItTootorials

    i dont have sgm_uniform as a scheduler. can someone point out how/what to get this?

  • @barcob5558
    @barcob5558 Před 6 dny

    Excellent tools, thanks for sharing

  • @RamonGuthrie
    @RamonGuthrie Před 7 dny

    When Matteo says suffer, I just think joy! 😄

  • @CharlesLijt
    @CharlesLijt Před 7 dny

    8:47 that does NOT look alike Korean at all

  • @ThiccNippls
    @ThiccNippls Před 7 dny

    A beginners guide course on comfy ui with everything you know would be amazing!!!!...................most of your videos look like they are geared towards intermediates and experts

  • @lalayblog
    @lalayblog Před 7 dny

    What if the role of each UNet block is different for different unrelated models (like SDXL vs Pony - they are seemingly the same in sense of architecture, but merge of SDXL and Pony gives bad results).

    • @latentvision
      @latentvision Před 7 dny

      from my testing most checkpoints react in the same way. maybe with the exception of heavily stylized checkpoints (possibly merged with a style lora)

  • @eucharistenjoyer
    @eucharistenjoyer Před 7 dny

    Great work as always Matteo. How does PuLID compare to ipAdapter in terms of vram requirements? I can run most of your ipAdapater workflows even on my puny 4gb VRAM, but I imagine PuLID has higher requirements.

    • @latentvision
      @latentvision Před 7 dny

      yeah I can confirm, pulid is pretty heavy. Still lighter than instantid though

  • @yiluwididreaming6732

    Still experimenting. This what I found....Checkpoint Model matters....otherwise its still a bit of a roll of the dice with hentai type models.....even using your direction as per video. In one prompt (2 batches), I asked specifically for a girl with dark brown skin and got....a pic of a curry meal and the other image what I prompted for....LOL . I'm realising there are limitations to the number of words you can use, so no fancy or detailed promoting I'm afraid..... Others I'm getting random images of animals and sometimes classical pictures?? The style prompt in particular (output1) has a big influence on the prompt outcome, need to be very specific with language around style (interesting using words 'digital art') . Think I will wait for further development before incorporating into my other workflows. Thanks for sharing anyhoo

    • @latentvision
      @latentvision Před 7 dny

      I'll work on longer prompts compatibility... well if there's enough interest that is :)

    • @yiluwididreaming6732
      @yiluwididreaming6732 Před 6 dny

      @@latentvision Appreciate your time and efforts in your ability to continue to work outside the box!!

    • @yiluwididreaming6732
      @yiluwididreaming6732 Před 6 dny

      @@latentvision thank you kindly for considering and your ability to keep thinking outside the box.