Urban Decoders
Urban Decoders
  • 69
  • 197 390
Sketch with 3D with ComyUI
The generation of 3D models with AI holds great potential for form finding and designing 3D assets. Particularly the ability being able to quickly sketch an idea and get a 3D representation within an environment can be a very useful workflow especially as this technology becomes more accurate.
For this tutorial I will be using TripoSR by stability AI for Fast 3D Object Reconstruction from a Single Image . Only three nodes are actually needed for this workflow and has similar results to much more complicated workflows or even paid services.
00:00 Intro
00:55 TripoSR install
01:48 Sketch to Image workflow
02:14 TripoSR nodes
02:52 Background remover
04:30 3D generation in comfyui
05:10 Changing input
06:34 Google 3D Tiles
07:13 3Ds Max
07:35 CRM 2d to 3d model
07:42 Outro
Install: czcams.com/video/nvfmmEUdomc/video.htmlfeature=shared
Part I: czcams.com/video/me30yQnh5jU/video.htmlfeature=shared
Part II: czcams.com/video/VtE6ogyIybY/video.htmlfeature=shared
Part III: czcams.com/video/oGwTMmWXMjc/video.html
Part IV: czcams.com/video/852DQHhFxW4/video.html
TripoSR Models, github and academic papers:
huggingface.co/stabilityai/TripoSR/tree/main
github.com/flowtyone/ComfyUI-Flowty-TripoSR
arxiv.org/abs/2403.02151
github.com/VAST-AI-Research/TripoSR
CRM Models, github and academic papers:
ml.cs.tsinghua.edu.cn/~zhengyi/CRM/
huggingface.co/Zhengyi/CRM
Other 2D to 3D workflows:
Shape-E: GitHub - openai/shap-e: Generate 3D objects conditioned on text or images
Cat3D: CAT3D: Create Anything in 3D with Multi-View Diffusion Models
Instagram account: urbandecoders
#ai #architecture #generativedesign #parametric #stablediffusion #upscaling #animation #comfui #image #design #generativedesign #painting #sketchtorender #styletransfer #sketchtorender
zhlédnutí: 1 192

Video

Advanced AI Sketch to Image: Style transfer with comfyui and IPadapter
zhlédnutí 3,2KPřed měsícem
The sketch to render has been one of the most popular AI workflows using stable diffusion. The original method mainly relied on control nets however this new workflow I will show you has far more flexibility and control particularly when it comes to styling. This is done through the use of ipadapters which are add-on for using images as prompts. You can use it to copy the style, composition, or...
Super fast Image Generations with SD XL Lightning
zhlédnutí 550Před 2 měsíci
SD XL Lightning is a lightning-fast text-to-image generation model. It can generate high-quality 1024px images in a few steps. It is a model that iterates upon the powerful Stable Diffusion XL (SDXL). while retaining all the standard functionality for image to image, inpainting and upscaling but in a fraction of the time. 00:00 Intro 00:28 Lightning Lora Models 00:58 sdxl lightning demo 01:11 W...
Creative and Sharp Upscaling with AI (latent and ultimate upscaling)
zhlédnutí 915Před 2 měsíci
Upscaling your low resolution images is a workflow you will use quite often in your AI image generation. I will go through one of the most effective workflows that not only sharpens but help generate better and more creative details than the original. You can also easily control how closely to keep to the original content or be more creative in the generation. It is a three part combo that begi...
Best Photorealistic Models with ComfyUI
zhlédnutí 1,8KPřed 2 měsíci
I take a Look at two models known for their photo-realism for use with Stable Diffusion XL or sdxl which is great particularly for text to image generation and a huge step up in quality from the standard stable diffusion 1.5 version. The first is RealVisXL V4.0 Juggernaut XL v9. RealVisXL Model: civitai.com/models/139562?modelVersionId=344487 Juggernaut XL Model: civitai.com/models/133005?model...
VR with Google Photorealistic 3D Tiles in Unreal 5
zhlédnutí 586Před 3 měsíci
You can now use google’s photorealitic 3d tiles I combination with VR in unreal engine. I will go through in this video how can combine your own models and use the 3d tiles for context to create immersive VR experiences. You will need to have your unreal engine and PC set up for VR. This includes having your steam VR and occulus apps installed. you can watch my previous video on how to do this....
EASY VR Install for Meta headsets in Unreal Engine 5.3
zhlédnutí 422Před 3 měsíci
The use of XR for architectural visualization and digital twins is becoming increasingly prevalent as the technologies improve and devices get cheaper. In this video I am going to show you how you can set up your meta quest headsets for Unreal engine 5 for you r architectural experiences and apps. I will be doing more videos for VR with architecture and cities so this one is to get the basic se...
Create custom sites with Google Tiles - Quick Streaming (Unreal 5.3)
zhlédnutí 1,3KPřed 3 měsíci
In this video I will go through how to clip sites from Google photorealistic tiles that can be streamed into Unreal 5. You will notice that the google tiles are great for aerial views and use in backgrounds, however when you get close up the quality is very low and difficult to insert your own design. This is why the capability to crop and clip out multiple key areas and replace with other tile...
ComfyUI: Intro to Control Net- Sketch to Render (Part III)
zhlédnutí 5KPřed 4 měsíci
In this video I will go over how you can develop more advance workflows with comfy UI with control net to allow more structural control based on input images and they are use in popular workflows such as sketch to image AI generation. This follows on from a previous video on the basics of comfy so please take a look at that for more background. Control net is a core extension that I often use a...
ComfyUI: Intro to Masking and In-painting (Part II)
zhlédnutí 2,8KPřed 4 měsíci
Part II of ComfyUI for generative AI in architecture and design series In this video I will go through masking and in-painting with comfyUI. This is a very useful additional to your AI workflow to combine with other methods. Often with image generations you will want to selectively manipulate images especially images of buildings in their surroundings where you want to keep the context consiste...
ComfyUI: Getting started for Stable Diffusion AI Generation for Design and Architecture (Part I)
zhlédnutí 6KPřed 4 měsíci
ComfyUI is an amazing flexible node-based interface to create complex stable diffusion workflows without needing to code anything. It can be used for a range of image generation workflows along with video and animation generations to create a variety of outputs. I will be creating a series of videos covering key aspects of using with for architecture and design starting with this video. Install...
One-click installs for Open Source AI tools ( A111, Comfy UI, Large language models)
zhlédnutí 1,7KPřed 5 měsíci
One-click installs for Open Source AI tools ( A111, Comfy UI, Large language models)
ANIMATE your FLY THROUGHS (Google Tiles and Unreal Engine 5.3)
zhlédnutí 524Před 5 měsíci
ANIMATE your FLY THROUGHS (Google Tiles and Unreal Engine 5.3)
Design OPTIONS into UNREAL 5 from various software
zhlédnutí 591Před 6 měsíci
Design OPTIONS into UNREAL 5 from various software
Accurately Locate anywhere in the world in 3D! (Unreal Engine and Google Maps)
zhlédnutí 1,2KPřed 6 měsíci
Accurately Locate anywhere in the world in 3D! (Unreal Engine and Google Maps)
New in RHINO 8: Amazing Dynamic Sections and more!
zhlédnutí 18KPřed 6 měsíci
New in RHINO 8: Amazing Dynamic Sections and more!
How to bring IMAGES to LIFE with AI (Runway Selective Animation)
zhlédnutí 966Před 7 měsíci
How to bring IMAGES to LIFE with AI (Runway Selective Animation)
3D Reality Capture: METAHUMANS + 3D GAUSSIAN SPLATS in Unreal
zhlédnutí 1,2KPřed 7 měsíci
3D Reality Capture: METAHUMANS 3D GAUSSIAN SPLATS in Unreal
How to 3D Gaussian splat from Aerials to Unreal 5 (Free plugin)
zhlédnutí 7KPřed 7 měsíci
How to 3D Gaussian splat from Aerials to Unreal 5 (Free plugin)
Use Google API for SOLAR, POLLEN an AIR QUALITY analysis
zhlédnutí 338Před 7 měsíci
Use Google API for SOLAR, POLLEN an AIR QUALITY analysis
Room SCAN to annotated 3D MODEL (Rhino 3D)
zhlédnutí 988Před 8 měsíci
Room SCAN to annotated 3D MODEL (Rhino 3D)
Dynamic Interactivity with Google Earth and Unreal 5
zhlédnutí 731Před 8 měsíci
Dynamic Interactivity with Google Earth and Unreal 5
Cinematic Animations with Google Earth and Unreal 5
zhlédnutí 1KPřed 8 měsíci
Cinematic Animations with Google Earth and Unreal 5
Cinematic Lighting with Google Earth and Unreal 5
zhlédnutí 2,5KPřed 9 měsíci
Cinematic Lighting with Google Earth and Unreal 5
ENHANCE your DESIGNS: Visual Scripting for Designers
zhlédnutí 513Před 9 měsíci
ENHANCE your DESIGNS: Visual Scripting for Designers
How to CLONE a CITY: The Digital Twin Revolution
zhlédnutí 705Před 9 měsíci
How to CLONE a CITY: The Digital Twin Revolution
INCREDIBLE AI Tools for Architectural plan generation
zhlédnutí 14KPřed 10 měsíci
INCREDIBLE AI Tools for Architectural plan generation
TOP AI prompts for Cinematic Architecture
zhlédnutí 500Před 10 měsíci
TOP AI prompts for Cinematic Architecture
Make your own Google Maps Web App (Cesium JS and Rhino)
zhlédnutí 2,4KPřed 10 měsíci
Make your own Google Maps Web App (Cesium JS and Rhino)
TOP AI TOOLS for ARCHITECTURE and MASTER PLANNING
zhlédnutí 4,7KPřed 10 měsíci
TOP AI TOOLS for ARCHITECTURE and MASTER PLANNING