How I 3D scanned a whole freakin' mountain range with a drone | FULL WORKFLOW
Vložit
- čas přidán 31. 05. 2024
- Thanks to Capturing Reality for Sponsoring! Get 50% OFF 3,500PPI credits by using the code PWNISHER50, and get scanning today! www.capturingreality.com/
Download my Mountain Data Set: drive.google.com/file/d/1yL4_...
Download all my Mountain Scans on Patreon: / asset-massive-69459166
In today's video, i'm rock climbing a mountain and 3D scanning the entire thing from the top. I'll be guiding you through my aerial photogrammetry process, breaking down important tips for you while scanning on-location, and running you through the entire post process in Reality Capture. We'll go over stitching our data set together, meshing our point cloud, and baking hi-res textures to a simplified mesh. And in the end, we'll view our final scans in Unreal Engine 5 after buildilng a customizable master material. So gear up, and let's get scanning!
CHAPTERS:
00:00 Intro
00:33 What is Photogrammetry?
01:33 Aerial Scanning Tips
03:57 Photoscanning a Mountain!
06:31 Intro to Reality Capture
07:55 Processing our Images in Lightroom
10:15 Aligning our Images in Reality Capture
12:47 Meshing our Point Cloud
15:25 Cleaning our Mesh
16:54 Texturing our Mesh
18:35 Simplifying our Mesh
19:28 Unwrapping our Simplified Mesh
20:10 Texture Reprojection
21:16 Export
22:39 Importing our Scan into Unreal Engine 5
24:01 Creating a Customizable Master Material
30:02 Final Results
REFERENCES:
3D Scanning Basics: • The Ultimate Guide to ...
JOIN THE COMMUNITY:
Patreon: / pwnisher
Discord: / discord
InstaGram: / _pwnisher_
Twitter: / _pwnisher_
PRINTS & ASSETS:
My VFX Assets: gumroad.com/clintonjones
Limited Edition Prints: www.noisegrainandlight.com/store
TOOLS I LOVE:
Camera: amzn.to/3ihzNg8
Lens: amzn.to/3cBB6TJ
360 Camera: amzn.to/3w1PKLn
Studio Lights: www.aputure.com/
Desktop Mic: amzn.to/37JmQoN
LAV Mic: amzn.to/3vg9wlh
Monitor Lamp: amzn.to/37JfyBI
How I Learned Cinema 4D: greyscalegorilla.com/join-plu...
MY RIG:
hubs.ly/H0_cR2l0
#RealityCapture #3D #EpicPartner
As an avid rock climber all the work in this video is incredible, mad respect to you and Jan for that adventure and then immortalizing it with the scan!
Man what an experience that was. I'm used to multipitching, but the idea of dropping something hundreds of feet was just utterly terrifying.
@@pwnisher definitely a tradeoff when climbing where you have to sacrifice a little bit of your comfort zone for a great experience!
I don't do 3d work. I have no interest in doing 3d work. And yet I consistently become engrossed by these lengthy-ass tutorials just on the power Clint's specificity and obvious passion. True champ.
Heck yeah!! Thanks so much for checking this out 🙏🏼
Having followed Clint from the beginnings of corridor back to this channel is such a mind-blowing experience. I just can't stop watching and being inspired by Clint in the same way he gets inspired by others. It feels indescribable
Thank you so much for doing this! I'm just getting started with 3d scanning and having access to this incredibly thorough documentation is amazing😁
From start to finish this was a fantastic tutorial, thanks Clint! Also being a rock climber this gets me excited to photoscan some of my favorite outdoor climbs.
Four minutes in, and as I expected, this video is very SPECIAL!!! I can't wait to re-watch it with better internet whenever I get home from vacations at the highest quality. It's clear how hard you worked on this video, and the result speaks for itself. Much love!
You get better results if you export two sets of images from lightroom. One contrasty for Model Generation, one delit for Texture Generation.
It is possible to tell RC to use these sets :-)
Love your channel man! Been getting more into UE lately and its been a ton of fun.
Clint, you are the man. The first portion of this video really made me feel inspired. I love the integration of your hobbies.
That was a superb workflow and thorough explanation! I just started learning UE5 and this was so easy for me to follow. Thanks for uploading!
Impressive work, both the climbing and the art. I like your tutorial style, specially that you cover the details. Keep it up😁!
Currently the best 3D guy on youtube! , you are doing the right things for us , also maintaining an awesome community in discord , man THANK YOU!
Hahahha i try, and can't do it alone! Thanks for your kind words!
Top notch quality content as always pwnisher. Such a great video!
Insane! I love the energy to make something really special and cool. Big probs to you and your team
Ahhh Clint! Epic & chill, this was the best thank you ❤️
Dude! That was awesome. Some great tips here. Thank you
This video couldnt have come at a better time i literally started learning about 3d scanning today 10/10 super usefull great content once again
Fantastic video Clint! Would love to see more stuff like this. It’s cool how this video was technically teased by Jan in the NERF finger video on Corridor. Also we’re only 7K subs away from 1M!!! Omg omg so excited for you Clint
awesome action and results!
Truly amazing work...my hats off in respect for your dedication and ingenuity. I never thought it could be possible to accomplish something like this. 👊😲👍
You guys are awesome for this . Keep posting
Very good so clear in every step how to make 3D scan , We need more great video like this
Great job!! I don't think I'd have the nerve to hang from a mountain to get a scan so mad props there as well! Your end results were super!
Cant wait for you to hit 1 Million!!!!
Shoot it's gonna be SOON too!
That was cool to see how modeling and scanning technology is becoming easier to use
Thank you. This video was so helpful for my business.
After Watching This GREAT WORK I'm Curious about 3D SO MUCH !! Thanks Clint
This is so cool. Great use of aerial tech to get a megascan!
Thanks Matthew!!
Now this is next level... So good!
Damn! Worked like a charm! Thank you soooo much!
That is awesome man, thank's for that, i appreciate this!
Outstanding video!
Thanks bro i got a new thing from yhis video. I hope you make again such kind of contents.👍
Great !! Thank you for your job
wow!! the final scene looks so sick:)
Mr. ANTZ! Yooo wassup! Thanks dude! Yeah all Unreal Engine :D I'm falling deeper in love with the program.
@@pwnisher yeah man unreal is great ! You definitely inspired me to learn unreal:)
This is so cool! I've kinda wanted to do this with climbing for awhile too haha, I think someone is making an app using this too, like a 3d mountain project. I think it was called "rock garden" or something. So rad!
Thanks for lesson number one I'm going to leave ssages on a few of your posts and maybe even a few links to soft I make in the
Just happy I get to see Jan twice in one month also great video 😊
This is such a great video
no way jose... im blown away dude - GGs
If you kept it going till now you have all the respect that I can give
You're doing god's work man! Amazing!
this is sick
You've inspired me to return to The Steens, haven't been in 20 years and I'm going to head back with full tech in hand.
See you guys round the bend.
You are the best man!
Very nice Clint ! :)
I'm currently writing on a thesis about photogrammetry in the construction industry and how to make target-actual comparisons. And AI is becoming a thing. Photogrammetry / LiDAR with drones is a huge new branch and the possibilities seem endless! I'm slightly hyped😎
You are really the GOAT bro
Love the crocs 🫶
Awesomeness!
great stuff
You've got some amazing dedication!! I'll stick with Megascans! Hahahaha! Great video!
This ones needed 👍
love ur videos!
I needs to take out my drone, I'm hoping I can use it today to got a few aerials of the show I'm filming at (Inspecta Deck and Mastah Killa, Wu in the hooouse). Imma have to try this out. I blame you for my addiction to CG work hah. Peace out dude have a great weekend!
Go get it and be safe! Thanks for watching!
@@pwnisher no, thank you!!! For posting Masta Clint! Stay safe keep creatin' and collaborating, and always inspire imagination! Peace
Thank you, it helped but i had a little bit of problems. Good Tutorial
Currently working on a AAA game right now and this is pretty close to how we’re doing rocks and cliffs. But also a lot of cleanup to remove vegetation and some zbrush work to make the asset usable in multiple angles
for gta6
I WAS LITERALLY BORED AT WORK AND STARTED THINKING ABOUT PUTTING A LIDAR SCANNER ON A DRONE AND WONDERING IF THAT WAS A THING THEN I GOT HOME AND WAS RECCOMENDED THIS VIDEO. MY MIND IS BLOWN.
A pwnisher video at its finest
Thank you for sharing all this knowledge with us, that's good karma my friend...cheers from Costa Rica!
Goooood job
Hello friend, everything goes perfectly but the models are seen in black and white, when should I colorize or how can I have the coloring of the model done automatically?
I've been using my DSLR and running the photos through darkroom and meshlab, then editing in blender. Haven't done any scans with my drone yet, although I am planning to at some point. I'm definitely trying out this workflow when I do though!
25:19 Is there a reason to connect channels A and B across each other in Unreal Materials? Does it matter if the order of channel A and channel B changes?
Love the result! I can tell it didn't affect the final result much, which makes me wonder - how important is removing the harsh lighting in the original scan?
In my case, it wasn’t severe because the sunlight only hit like 10-15% of the scan (cause we got there so dang early) but I also chose lighting condition (in 3d) that favored the scan, as well as framed out the pre-baked lighting as best i could.
Almost 1 million
i've never seen a better example of youtube compression then at 20:10
Textbook, son!
Looks pretty detailed! Very good scanning results. One issue I have with scanning big or medium rock-mountain geological formations are the overhanging parts - the bottom part of the overhanging rock is very dark because of the daylight shadow(not the sun shadow) and even with the new tool in Agisoft for delighting and extra Photoshop work- the texture is not really usable for high quality professional work.
well u would need to shoot at overcast days and also try to get a drone that can fit godox ar400 ringflash with a dslr
so that there are no shadows there.
That is cool.
Is this the best way to get control over the textures? I am used to Blenders shader system, which gives you hue and saturation nodes, curves adjustment, as well as a slider for normal intensity. These are such common things to need to adjust that this seems strange to have to do these workarounds to be able to adjust these settings.
OH MANNNN! You deserve a sub after this video
seems like doing an extremply flattend model uving it and generating a heightmap wil make sculpting werry nice.
wtf man this is mental awesome
Would it be better to shoot after sunset or on an overcast day to capture a unlit version? I noticed that your final texture had sunlight baked in
'Why I did it from the side of the mountain' - but how else would you get a feel for the scale of it! Great scans :-) What drone was it? DJI Mini?
Amazing project! I was unclear as to whether the path the drone took was programmed or it was all manual? And if you had to keep clicking off each shot yourself or it was automatic? Thanks!
Amazing tutorial, life changing for me (literally). I'm putting together my first drone setup and I was wondering 1) what drone model are you using and 2) what was the total flight time (for batteries)?
Imagine what a few 100 of these by some corporation could map out. Kinda mind blowing.
good!!!
Thanks
Hey Clint, was wondering what kind of drone you're using here, I'm looking into buying my first drone for photo-scanning buildings pre demolition to preserve the pieces of history that I can. Cliff looks sick, 10/10 would digitally climb that.
The fact that I found Clint's channel RANDOMLY just yesterday after being a Corridor sub for years is a crime. You gotta plug it on the Corridor channel, brother. At least once.
with it in a few weeks or months if I pour enough ti and effort into it. I'll be watcNice tutorialng many more of your videos for tips and inspiration.
25:21 Note: normals should be unit length (i.e.: length of 1, normalized). Blending with a lerp will change their length, which can give unexpected lighting results. You could normalize the final values (so they're length 1 again), or you can use fancier math to rotate the normals rather than blending them.
But really the main question is: are you sure you want to go through all the trouble of getting realistic normals only to flatten them again? Maybe you do, but you should probably at least think about it. Knowing the rules before breaking them and all that.
If there's a better way to set up the normal channel i'm all ears! Thanks for the headsup.
@@pwnisher I wanted to link to a relevant article, but CZcams doesn't like that. Here's attempt 2 without the link.
Best: leave them untouched, unlike bump maps they're already accurate.
Medium: look at normal map blending techniques like the one described in "Blending in detail" by Colin Barré-Brisebois and Stephen Hill (a.k.a.: self_shadow)
Better than nothing: chuck a normalize node at the end. Some normals may still be a weird angles, or 0, but at least the non-zero ones are at least the right length.
@@pwnisher Yep lerping a blue color isn't how to do normal strength, the blue channel on a normal contains no information it's essentially a 50% gray on the blue channel. Lerping in general should be viewed as a gradient switch to blend A and B, if the alpha switch is overshooting value between 0 and 1 you are essentially boosting the A alone in an unpredicting way. You should multiply by the same number your R and G channel then combine it back with it's blue channel, normalize the result and plug that in. Red and Green channel is what containing the normal lighting info in X and Y , which is why there are different formatting (directX OpenGL) based on the software axis system (y-up, z-up). To sum up on your example: (R channel * float "normalStrenght") (G channel * float "normalStrenght") then feed the result back in a "AppendMany" (where the blue come from the original one or just a number 0.5) to construct the resulting normal, normalize node before plugging in. You could also plug in a lerp between the boosted normal and the original giving you even more fine tuning controls as long as you clamp the control value between 0 and 1.
Furthermore, desaturation node works better than choosing a channel from the albedo texture, since the real way of desaturation is to average the channels ((R +G +B)*.33). But this is almost accurate.
Otherwise never ever use a 16k textures in a game engine, when unpacked in memory your 2 textures would be using around 2GB of GPU RAM. it would be really really bad in a gaming context you would have tremendous chugging in streaming and the amount of crash reports on your game would be unmanageable ;). People sometimes mess up their understanding of weight of textures in a realtime context, it's not the compressed size that matters if the file is 138mb it's not relevant at all apart from telling you the size it will require on disk, when opened in memory it's uncompressed and for textures it's ((pixelwidth * pixelheight * number of channel) *1.3 mipmapping) bytes.
@@2Jackrabbit Good addition about the uncompressed size!
As for the R,G channels; I would expect it to be better to decode the normal, rather than trying to manipulate it in its compressed form.
@@RC-1290 No it would be totally fine since shaders works at runtime into what is uncompressed already ;)
But that would still be the way to make a normal intensity, not a lerp with overshooting value in the alpha. That is something I teach about shader math, if you are "boosting" a lerp you either have the input wrong or using the wrong operation.
A quicker way otherwise in unreal is to use the flatten normal node with a negative value.
Cannot find any of the Adobe color profiles in my lightroom. How do you install those?
995K subs. Wow That's alot of it
When I use GMS it's just a loud distortion soft what's up with that?
Very cool vid, can you use this with nanite in ue5 to include all them polygons?
Good video! Nice to teach others!
Side note
Too many UV shells not optimal for real-time engines (break poly strips, limit optimal auto LOD, break GPU data stream).
For good PBR material you need to take out shadows from the albedo - with AI.
I think the ultimate would be to have a swarm of drones doing 3d scans. Like bees, but solar powered and linked to Starlink. Then you let them out into the wild and they scan the whole Earth bit by bit. Then AI is used to fuse and improve all those 3d scans together.
Hello sir is 6700xt will be good in unreal engine 5? Or should i buy 3060?
Woooh man!!
How did you get rid of the shadows from the texture?
Is there any way you can put models from unreal engine online in a way that anyone could view on a website?
23:36 Where did the diffuse map come from? Didnt see that anywhere in the tutorial. Im a 3D noob btw.
So gooooood crack
hence on here a month later. thanks for making feel normal again.
TNice tutorials video is the best tutorial I’ve ever seen about soft soft
It was the sa for , In the GMS I switched the "Program" to "Analog app 1 TE"