Build Your Own ComfyUI APP!
Vložit
- čas přidán 1. 06. 2024
- This time we are getting our hands dirty into code! I wanted to show you how easy it is to build custom web applications with ComfyUI and absolutely no knowledge of python. Let me know if you'd like more of this kind of content!
Comfy Dungeon: github.com/cubiq/Comfy_Dungeon
The FastGen extension can be downloaded from here: f.latent.vision/download/fast...
Discord server: / discord
The ComfyUI options to run the comfy from any device in your network are: --listen 0.0.0.0 --enable-cors-header '*'
00:00 Comfy Dungeon Introduction
02:14 Build your own ComfyUI App
15:24 Add CFGRescale
18:05 Outro
Bro this is one of my favorite channels! great videos! Love this! im inspired!
I love it that you made a long video again.
I prefer longer videos.
Best AI content in all internet, is the luck we have having a top programmer sharing knowledge while creating AI art. This man is a legend.
Your channel has a huge quality of content for ComfyUI! Grazie del tuo lavoro!
just doing my part
What you described at 18:42 of "Generating portraits of your entire party and then put them in group settings together" is exactly why I got into ComfyUI! I've been having trouble with composing multiple characters into a single image, so something along those lines would be incredibly helpful!
Thanks for all of your guides! I've followed all of your tutorials and have joined the Discord which has awesome examples and very friendly people.
I'd really like to work on that app, it's really fun to do... but yeah... time...
@@latentvision I'm not too concerned about the standalone app, it seems like a neat gimmick but I think I actually prefer the noodles. I feel more thorough actually seeing the full workflow.
My main problem has been image composition with multiple IPAdapters.
Also I'd like to emphasize that all of the time you put into this is greatly appreciated! There's no way I'd know what I was doing without these walkthroughs. Thank you again!
Dang bro, this is my dream stuff. I always thought about making these things and self hosting to give to people. Thanks a lot
you are welcome! I wish I had more time to dedicate to the Dungeon... it's such a lovely tool :)
This is really neat, Matteo. Thanks for sharing your knowledge!
Amazing as always! Love the longer more informative videos. So useful to help understand the ever changing Comfyui world. Keep it up!
Another excellent video, very informative and easy to follow
Amazing work! I learned so much from your content man! Thanks a ton :]
I can't believe how easy you make these topics appear. Your explanation is so helpful
That's impresive!! Just MASSIVE thanks for your knowledge and help for this amazing community!
Another masterful and re-watchable tutorial by Maestro Latente... BRAVO!!!
Another absolute banger! I see great value in these experimental proof of concept types of videos. Even if some people aren't tech-savvy enough to write it from scratch, they can take your code that's already working and play with it, and especially with the help of modern code copilots and chat AIs that can make it easier to dive into.
you sir are awesome. Took your example and expanded it! added much more races and classes, planning to add 3d and more artstyles
great video again, Thanks so much 👑👑
I appreciate the thought put into these videos, great comfyUI/SD info from someone with a knack for instruction. Please consider releasing an advanced vid2vid long format video utilizing unsampler and ip adapter to maximize consistency. SparseCtrl ControlNet / Advanced control nets would also be appreciated. Thanks for the awesome content!
Thanks! I will talk about video soon. I need to finish the "basics" series first. I think next one will be about controlnets.
Nice. Good to follow someone who knows how the code works. I'm going to try and install this later and make my own UI
Thank you so much for that tutorial, that is exactly what I were wondering about for my project.
Another great knowledge from Laten!. Thanks for showing us
Hey Matteo, great job again :) I'm really looking forward to part 3 of the ComfyUI video
I think it will be next. Controlnets and maybe upscaling if it's not too long
@@latentvisionI'd love to see a comparison (and your opinion) on the various upscaling technologies (hires fix, deepshrink, latent upscale, pixel upscalers, UltimateUpscale, etc).
Hi!
I have been working so hard trying to build apps with comfy and you just gave me a huge gift! I am really excited to start building with your example now! Thank you for the incredible resources you are creating for all of us at all levels!
glad to help!
😍Very much what I need. Thanks for sharing!
This is incredible! Thank you for the amazing tutorial!! Amazing
I will study and learn well from this fantastic lecture. Thank you always.
Great video! Didn't even think this was an option... :o) The group pictures would also interest me very much... :o)
Oh my god, this is so cool again 😮 I loooove every your video, Matteo 😊 I made before a js application using the comfyui API, but I didn't know there was a dev mode and nothing at all about how the api works, so I would just pick the api calls from the browser when using normal comfyui and then adapt them for my application. Its not the smartest way to go. It was a long time ago. I'm always waiting for all your videos, and besides the excellent content and a lot of value, I'm also falling in love with your beautiful accent every time.
lol, the "beautiful accent" made my day. It's excruciating for me to listen :D
Thanks for this video! Just posting here to say I’d love a party/group picture generator, I think it’s a great idea :)
Matteo always has amazing ideas ... thanks for the knowledge.
so good content man, congrats
You are a Golden God! This is amazing stuff Matteo!
I'm not worthy...
Well, I hold you in the highest esteem for the clarity and simplicity you enable us with. Thank you for all you do :)
Wow, thats awesome.thank you so much!!!
thanks! interesting video, thinking of all the things to add :D
thanks so much! this is awesome!
grande matteo!! thanks for sharing: this IS huge :D
Fantastic video!
wish there was automated built in feature for this, just mark the parameters that you want UI to show, and its done.
yeah that wouldn't be too difficult to do actually, I thought about it but I have so many projects going on :)
That's a project I'm looking on developing too.
In the mean timew you can try stableswarmui and ComfyBox which have similar feature
IIRC, mixlab does something like this.
I love this idea for a tutorial video! Thank you so much for making it! :)
I'm working in python and would like something like this using my own app and gui and not using a web browser. Maybe using Raylib.
Do you know any way of doing that? Should I still use Comfy inbetween or try use just python?
hard to say, depends on the application. One very easy solution might be to package everything inside an electron app for example. But if you are skilled with python and the workflow is not terribly complicated you can also check diffusers.
@@latentvision Thank you for the advice!
Great video! Good voice, no need for subtitles. Ahh! RTX 4090, i'm struggling with my gtx 1650 mobile 4gb.
🎯 Key Takeaways for quick navigation:
00:00 *🎮 Introduction to Comfy UI and Confid Dungeon*
- Introduction to a simple demo generating D&D character portraits using Comfy UI.
- Quick overview on changing results, styles, and iterating through character options.
02:04 *🛠️ Enhancing Comfy UI with Advanced Features*
- Ideas for improving the application using IP adapters, ID UPS scalers, detailers, etc.
- Beginning of step-by-step guide on building a similar application.
04:19 *📱 Designing the Base Workflow for a Mobile-Compatible Application*
- Process of creating a super-fast base workflow using specific checkpoints and samplers.
- Saving the workflow in API format and editing in a text editor.
06:44 *💻 Setting Up the Web Application Structure*
- Creation of directories for the demo, including web and JavaScript files.
- Introduction to the 1% of Python code needed for the demo.
08:56 *🚀 Launching and Testing the Application*
- Basic setup of index.html for the application, making the background dark.
- Restarting Comfy and navigating to the newly set up URL to test.
11:44 *🖼️ Handling Image Results in the Web App*
- Managing message types from the server and extracting image data for display.
- Utilizing the Comfi API to retrieve and display generated images on the web application.
12:52 *🌐 Sending Prompts to the Web Server*
- Implementing POST requests to send the full workflow to the server.
- Using a timer to dynamically send requests to Comfy as user types, for instant visual feedback.
14:35 *⚡ Enhancing the Application's Responsiveness and Quality*
- Adjusting timeout for faster image generation and display based on server response times.
- Introduction of high-quality image options and the use of CFG rescale to alter image details.
17:01 *📱 Making the App Accessible from Mobile Devices*
- Configuring Comfy to allow access from anywhere in the user's network.
- Highlighting the potential for mobile access and addressing security considerations for home users.
17:56 *🚀 Final Thoughts and Future Possibilities*
- Recap of app development process and its efficiency in enabling technology use without extensive coding knowledge.
- Potential future improvements and personal reflections on the Comfy UI and Confid Dungeon project.
Made with HARPA AI
I was looking exactly for this
amazing!!!!!!!!!!! love u so much bro
thaaaaaanks!!!!!!! I'm doing my part!
cool, thank you :) i start use it on my mobile ;)
Bravo, Mateo!
Hey Matteo! Good to see you
Thanks for all kindly guides ,your channel provide the most deep profound knowledge about stable diffusion in entire youtube, which worth watch two time ,three time to digest all the useful matter inside, could your think make a comfy basic about the mechanism of ksampler node in your future tutorial , I bet many people don’t have clear understanding of it , especially people lack of computer science background like me and they are ton of them out there , they are definitely the majority,thank you again!!!!
thanks! there are really a lot of topics to cover. I try to talk about a little bit of everything but there's really a lot of material... I need to finish the basics series (2-3 more videos) then maybe we'll go deeper
Awesome tutorial! Thanks for making this. (once again)
Quick question - could you please share what kind of hardware you're using to get those super fast generations?
thanks! 4090, fast ssd and lots or ram
Thanks for everything
Hi Matteo, thanks for the awesome tutorial. You are doing the best and most relaxed tutorials i know. I'am also using Comfy to generate parts of the storyline in a Pen&Paper adventure. I would love to see if it is possible to integrate IPAdapter and FaceID into the workflow. I'am not very good at writing code but so far i managed to integrate a lora selector in your Comfy Dungeon. Still struggeling with the upload of a picture from the interface to the workflow in the moment.
Fantastic video, subscribed.
How challenging do you believe this is for a non-character system? I'm looking to change styles for interior rooms.
people are generally more difficult to handle
Matt3o we love you !
this has been amazing! Thank you...definitely new to a lot of this, but it is so fun to play around with this code and learn from it. I do have a question...I'm banging my head on how to save an image and then load it back into a workflow. I know that you somehow need to move it from the output to input folder and then somehow load the image to a node?
I will add those option in a future update of the comfy dungeon, it's not something that can be explained on a youtube comment :)
good to hear!!!@@latentvision
Thanks for sharing, I am currently at the end of programing course and I wanted integrate generative AI in my final project, so this came out at a perfect time! Do you have any other resources you recommend checking out?
the best way is to read the actual comfyui code. I'm not aware of any API documentation
Crazy stuff! Gracie matteo !
You are my new God!
goat sacrifices only on Friday, thanks
Nice guide bro! By the way, you have a tutorial for front - back - profile view for characters with controlnet and some consistency?
yeah that's something I wanted to do sooner or later
@@latentvision I would appreciate it a lot, I need it for an academic video game project and searching on the Internet there are almost no resources that use Stable Diffusion for it. And although I have managed to create something with controlnet, the differences in outfits and other details are quite noticeable.
I've been working on a complete rewrite of the comfyui / graph (user interface), the goal was to be very hackable with nodes being html instead of drawn canvas.
My tooling I think would complement this sort of workflow greatly, as my goal was to make it so that each graph is itself a python project that can present itself as an API I need a couple more weeks before I can share it, warts and all. but as all projects "I think it's going to be great" ... lol we'll see if that's the case! I wish I could just quit my job and work on this stuff full time!
I know feeling... working on personal projects is so gratifying... but doesn't pay the bills :)
awesome！
Awesome, TY.
great job on this app.... comfyui really needs a mobile app that works with phones, if you can make that happen that would be amazing!!
Brillant
hi matteo, can you make a new ipadapter tutorial video? I want to know what's the new image_negative input in one of your node & how to use it .
Thank you :D
i have a problem, when i try to write a prompt on the fastgen, on the console have this error. 400 (bad request) and dnt do nothing.
👀 🤯 phenomenal
Grazie Matteo!!!
Mateo, what does "burning image" mean? You mentioned it when describing CFG scale
when you increase the CFG the model reiterate on the embeds too much and the image comes out over-saturated. It's like exposing a picture for too long in an old camera, hence the image gets "burned"
hey that's great but how can we access through the web rather the LOCAL adress?
You need to host it somewhere
Last time I took apart one of your 19 minute videos, I got a face swapper, now? I see this potentially saving me from training 5 Lora models.
is there a documentation or description or more examples of comfyui API? for example how to receive the list of available checkpoints from the backend.
there's no official documentation that I know of. check comfy dungeon, I get the list of checkpoints there.
hey, I seems to Have a problem
IMPORT FAILED" error while trying to add or use the ComfyUI HD UltimateSDUpscale nodes in a software application.
do you know how Can I fix it?
Hey for generating multiple images in python I just did that to send multiple post requests and append all PIL images in a array can we do this in javascript (i am using gradio )
Hello, my friend! I am interested in amateur photography and its processing. That's why I paid attention to neural networks. Please tell me, can I change or slightly edit the poses in a photograph or the overall lighting or color scheme without changing the context of the content (face, clothing, body)?
For now, I can change individual elements of the mask (color or type of clothing). If this is possible.. I watched a lot of videos and only saw how they run a prompt for generation through ControlNet/IPadapter. But no one will process the original image. Could you make a short video with examples of real image processing when you have time?
Latent do you know how to add diffrent checkpoints models to pick from..... I tried adding a new entry in the index.html but nothing happened!
This is great, but it sort of exposes the workflow, which may be something you want to keep hidden. It also looks like it cannot scale horizontally. How would you address this?
have you got the link for the sd15 you use in the example?
This is brilliant, Is there any way to connect this to real time camera?
yes with the browser camera API
Fucking fantastic
hey i want to learn everything about comfy but when i try i get confuse ...can u suggest me anything
Do you recommend some no code app for create an UI app using comfyUI workflow api ?
to speed up the development I'd recommend svelte
@@latentvision I mean no code app like Weweb, Glide, Softr etc... who not require code knowledges
amazing, there's a way to include the upload of a reference img2img on it ?
yeah that would be possible, I need to implement the dungeon... when I have time...
You should monetize this app, people would pay for this.
Hah, time to reimplement a1111 on top of comfy!
Do you a have a tutorial for SD Forge?
it would be nice a comfyui sdk able to handle workflow without using hardcoded ids
Cool, thanks Matteo! My wishlist Develop easier way to manage workflows, (more like Reusable Workflow for ComfyUI)
yeah that is something I have in mind since a looong time!
@@latentvision I have a few ideas. It’s probably one of the most wanted features. Having developed a few workflow with LLM. You explained things for mere mortals 😁👏
you mean like saving and organizing workflows?
@@PaulFidika yes to reuse multiple nodes to create the workflow. It’s kind like grouping feature to create workflow. Grouping is already very useful.
@@banzai316 so maybe like, take an entire workflow and turn it into a single node, with its own inputs / outputs / widgets? Like collapse a workflow into just one node? I’ve thought of something along those lines but I don’t think it exists yet
I use similar things with gradio because I know python and it do the thing in less code
👋
马特奥大佬666
fastgen link is broken
fixed sorry, it was missing the "s" in https f.latent.vision/download/fastgen.zip
Coolstuff !
Greetz, #NeuraLunk
look who's here! hello :)
@@latentvisionHi mate ;)
hai patreon or ko-fi? :)
not at the moment... I'm thinking about it
kate 😂
Cool, but overly complicated, if only someone would make a wrapper with flatter and more obvious "nodes" - that would be great
Well I think python is easier for me:(, going for streamlit I guess
.
Less Techsavvy?? You do not need Python? 25 pages of Jason and Javascript later? Supereasy but not for less techsavy people? Try to tech my digibetic ex-wife this to know what less techsavy means, you'ld be in the nuthouse in a rubber room in a straightjacket before the day is over, I do not have a problem with this because I am techsavy, but you set the bar way too high for non-techsavy levels, seriously I had a mental breakdown teaching my ex-wife what folders are in file explorer, THAT is non-techsavy, it took me years and the introduction of smartphones to finally get her to ordinary human levels of computer use, for some reason smartphones and tablets are easier to learn, because 2 year olds can learn it
you don't need any ML skill. just javascript. In AI terms, that's not very low level
I made it to 'gender is of course a slider'......
Finally updated. Without your video tutorial updates, every day seems like a year.😁
ahah thanks... but I either code or make videos :)
"gender is, of course, a sliider" is such a hilarious phrase