3D Gaussian Splatting EASIEST Method (Tutorial)
Vložit
- čas přidán 5. 10. 2023
- How to capture and create 3D Gaussian Splatting scans without worrying about GPU and using command prompt? @polycam6558 recently announced their GAUSSIAN SPLAT VIEWER AND CREATOR. They challenged us to create some dope Gsplats so we went to the desert baby :D In this video, we cover the process of capturing, processing, and even importing it into Unreal Engine for a short cinematic. It's free and accessible through the link below:
Polycam Gaussian Creator: apps.apple.com/app/apple-stor...
3D Gaussian Splatting for Real-Time Radiance Field Rendering Paper:
repo-sam.inria.fr/fungraph/3d...
Join our discord server:
/ discord
If you wanna see us to do cool things follow us here too:
Instagram: / badxstudio
Twitter: / badxstudio
TikTok: / badxstudio
LinkedIn: / badxstudio
Bad Decisions Podcast 🎙️:
podcasters.spotify.com/pod/sh...
Our personal handles: (if you wanna stalk us)
/ farhad_sh
/ farazshababs
/ farhads__
/ farazshababi
/ farhadshababi
/ farazshababi
Media Assets used:
• Mission Impossible 7 T...
• What is Frame Rate? - ...
• 3D in the Dark! Making...
photographylife.com/what-is-a...
www.exposureguide.com/iso-sen...
• Mission Impossible The...
#unrealengine5 #3dgaussiansplatting #3dscan #gaussiansplatting #3d #3drender #nerf #unrealengine #blender3d #blender #drone #ai #photogrammetry #vfx #cgi #polycam
Love your videos. I've been in the photogrammetry world for 15 years, and know about the processes/workflows however you still have me super entertained and are teaching me new things (Polycam etC) thanks guys. Keep smiling, love it.
hey guys !!!! Just wanted to drop a comment. wanted to thank you both for making these awesome and very engaging videos ! The way you combine all the info , the humor , the video editing ! It's just so much fun to watch your videos from beginning to the end ! What a nice new breeze , the gaussian splatting.. so damn cool ! Keep up the good work , i watch all your videos the moment they come out. and i'm sure everybody else does to ! high five
Wow man ...it means so much..THANK YOU ... reading this comment will give us the energy and motivation to stay up and do another 3 videos for next week. We are glad that you guys are learning and at the same time getting entertained.
Seriously, the vibe in this video is so good! you guys really made the effort to turn a boring tutorial into a super fun video. I'm convinced, im taking my best lens, my D810 and im scanning something today, i can't wait!
Wow love this comment man!! Thank you
Thank you so much for your content guys, it's folks like you that make the visual art community so enjoyable to be a part of.
Our pleasure! Glad you enjoy them
Underrated channel
Thanks for the compliment G
I´m starting today guys! You two are awesome. Thanks for your effort!
YESS!!! Let us know how the GSPLATS GOOO
Great series of Gaussian Splat videos, including this how-to! 😍📽👍
BTW I liked the cameo appearance by a crew member on break at 3:16. 🤣
Thank you so much ...Glad you like them!
Great video as always guys, thanks or keeping us so well informed, love from Barbados
Love back to Barbados man
This is amazing. I can't wait to see what this tech will look like in the NEXT three years!
This is awesome! You guys have become my favourite go to channel 😂You deserve a lot more views and subscribers!
Brother means a lot when you say that
Your videos are always wonderful and mind-blowing can't explain more in words!
Thank you so much 😀 Happy you are enjoying them
@@badxstudio 👍🏻👍🏻 Wellcome. 💯
POLYCAM!!! 🔥🙌
YESSIRR!!
What a video👏💯 This duo is on 🔥
Mr Baris!!! Thank you
I enjoyed seeing this amazing technology.
I'm curious if there are any manuals or reference materials for optimizing shutter speed, aperture width, etc. regarding camera shooting.
So far, Gaussian Splatting has been INCREDIBLY unique. Can't wait to see what you'll do with it boys !!
Right dude?? Just imagine the moment these become properly optimised for video games ... Imagine the possibilities for some of the stuff we used to play!!
splatting isn't new, NeRF has existed for a long time, only now though is it properly refined enough, Gauss Splat doesnt even use neural networks
You guys make such a great team... You remind me of "flipped normals" but with a different dynamic. Love those guys too.
Thanks a lot buddy
What a banger ! Always providing high value !
Thanks a lot brother. Glad you liked this one
great video! you guys deserve more like & subs. please do not stop your amazing content! i love it!
Thank you so much! we will never stop ... Don't worry
So would the result be much cleaner if you guys did Still images? With the examples you showed there are lots of blurry areas, I'm just wondering how to get the best quality for actual usage in Unreal for example.
Can I animate the crop? I have a beautiful scene that looks like a painting and I would like to create an animation of this object "expanding". Another question, since each element is converted into a particle, can I animate the particles with small movements? (I know you're not the creators of the plugin ;) but maybe you've already been through these questions).
BTW, thank you for the research and amazing content ;)
This is an incredibly well made video
Thanks buddy
I love the energy you guys have on screen. OK then. Subscribed.
... Oh. I already had.
Hahahaha YES!! Love ya
Wow! Fantastic video again! Really love the Mission Impossible vibes. So funny. Thanks for the shout out again.
Mr Olli!!! Thank you for the love hahaha the mission impossible vibes
Thank you so much guys, this information is amazing!❤🔥😎
Everyone can do own gaussian splatting 😎🔥
Brother
Another banger! I just saw Luma Ai is in the splat game too it's really taking off fast! 🤙🏿
Thank you brother 😍 We gotta do the Buggy ride together when you are in Dubai 🤟🏼 It was COD in real life vibes 😂 and yeah the splats are becoming more and more widely used now
incredible. you guys rock!
Thanks buddy
great vid thank you for simplifying.
No problemooo
This is amazing. Im wondering. If someone took some images from a movie of an actor, front, side, back etc, could a 3d gaussian splatt model head be created? Could it then be animated or converted to a metahuman? It would save tons of hours of work sculpting a likeness, or at least speed on the process. What do you guys think??
The production on these videos IS SICK! . As someone who has no clue who isn't actively in the 3d world, IM STILL HELLA ENTERTAINED
Jassssyyyyy means a lot dude! Wished u could test the buggy yourself! Totally felt like a game IRL!
you guys are friggin awesome!
thank you G
hey guys! just wanted to drop a quick shoutout for this awesome video! Big thanks for sharing those super useful tips and tricks. One thing that could make it even better is if you mention the quality improvements you get from the old method - it's noticeably better!
Thank you very much for your words. Glad you enjoyed the video.
For a fair quality comparison, we need to have both scans generated from the same input. It's a great idea and we are gonna do it in the next video
Looks like my Render came out looking like a choppy grassy field, I kept the subject center and orbited around..? any suggestions why this happened?
is gaussian spatting possible with light source interaction? Might there be possibilities for that soon?
You guys are just amazing damn man
Pratik dont make me blush dude :D
@@badxstudio ❤️😇
Wow so much quality guys! Long life to this channel!
Thanks so much! Glad you like them
Wonder if you could somehow take out the "images" of the say the camels head when it's not still, and generate the angles you want actually and require to make the head appear to be still, and pipe the tweaked/fixed output "images" back into the g.splat process in order to then render out a wholly still camel 🐫 following those steps. As a sort of steps in between the gsplat and control "image/frames" within it that you don't want/want to tweak.
Imagine then modeling/sculpting ontop of that converted out pointcloud file 😳
So responding to both concepts!
First the idea of removing bad inputs is a great idea. We were just afraid of not having enough material so we submitted it all! But you are absolutely right, technically you should yield a cleaner scan that way.
And as for modifying the splats, currently the tool in unreal is not extremely userfriendly and we are speaking of the crop tool on the plugin. The absolute best way would be to manully use a tool similar to a paint brush and edit the ellipsoids. Yes that would be awesome! A Game changer indeed within unreal engine!
really enjoyed the video, and it was quite interesting to see what to expect from this technique. I think it's not quite there yet, but you managed to get some good results nonetheless!
Thank you brother Glad that you enjoyed the vid. Definitely all too experimental at the moment but it's surely going to substantially improve overtime!
that was cool dude! nice tutorial !
Yooo! killed it again guys. can't wait to try it out with my Unreal Engine students. thanks heaps for the tips
Just wondering have you tested the Gaussians Plugin with pathtracing in unreal?
Hey brother! You are absolutely welcome
wait, is the splat static in UE, or can it be a moving video?
Yessss!!! This is great news!
Jonnnyyy tried it alrdy??
Sience when you turn splats into niagara particles you should be able to tell some particles to "die" so you can clean the splats that annoys your scene. Will be a plugin to do it in no time, im sure. Even you can make some kill particle volumes to crop it by hand in a controlled space. God, it seems easy in my head haha , I should try to do it.
There is so much effort in your videos. I think you should start a religion for Gaussian Splatting users. XD
I'm still thinking this is not a production-ready method for most cases, but it is still so cool! I hope it will get better in the future so 3D modeling will be less time consuming.
man, this video was a whole trip
Wait for the next one bro! We are hitting the waters 😉
Can the method be used if people are speaking and their mouths moving, yeknow people in their natural environment at a coffee shop perhaps
awesome! thnx
Wow thats so good
You are sooo good bro
Gaussian splatting is a perfect match for streetview use in Google/Apple Maps 👌
Do you think it will be possible to animate and especially rig a person captured and rendered with 3D gaussian splatting?
In future, yes ...at the moment no
HEROES!!! Thank you
Ma man!! Good to see you here. Have you tested this yourself yet?????
Not yet - just waiting for tomorrow and a trip to the city :) too cool!!! Is it also possible to cut everything off or just have the subject? @@badxstudio
Great question. Right now you can only crop it in unreal with this plugin. But we saw somebody just delete the ellipsoids in unity so that was crazy! @@veithnurtsch1069
Hi there! I noticed a small mistake in the video regarding the relationship between aperture and depth of field. Just for clarity, a larger aperture (smaller f-number) results in a shallower depth of field, whereas a smaller aperture (larger f-number) gives a deeper depth of field. Keep up the great work with your videos!
Great video 👍🏾
Appreciate it
Hello, great video, a question, can the .PLY file be imported somehow without an addon? or somehow free?
The unity or blender addons are free i believe but we tested the blender one and it didnt work on windows .. only worked on linux as far as we are concerned! They are apparently working on it
Thank you very much, and the last question, do you know if those .PLYs can be used in applications created in ureal Engine 5?@@badxstudio
12:08 is the perfect example of why this is awesome. The kind of dope promo shots you can get for content is 🧑🏻🍳👌🏻😘
Exactly mate. And imagine how much they can improve when this technology develops.
I actually subscribed because of the Outro Card 🤣❤
Hahahahhaha SEE WE KNEW YOU WERE NOT SUBSCRIBED YET!!!!
Doesn't luma ai convert to image sequence for you and produce cleaner NERFS 🤔 - why use polycam
Hold up, the best tech CZcamsr @Optimum spotted!
Is there a way currently to convert 3d gaussian splat data into a normal 3d mesh suitable for say a 3d editor or game engine?
I’m hoping there’s some kind of plugin
Well the plugin we use at the end of the video is converting these to niagara particles for unreal engine. But if you are looking for polygons then not at the moment
All I need to know, is this plug-in more stable than Luma’s ai plug-in? Every time I import a Gaussian splat created by Luma, on one of their demo environments UE5 keeps crashing 😢.
Great video Ps. I prefer the Gaussian splats from Luma than polycam. In luma you can import as many photos as you want (or videos). In polycam they have a very low limit on their free version, and I haven’t been impressed enough so far with the results I get to confidently pay their annual subscription.
Yyyyyyyyeeessss! Amazing!!!!
Glad you liked it
0:32 this drama theater in Mariupol is a reminder for everyone of what Russia is
oh.. are the authors of this channel afraid of Russia?
What would be wild, would be to take an AI generated image or sequence and make that 3D using this method.
Then the AI would be able to not only generate the entire image sequence, but also generate the entire 3D environment.
Possible?
No workable on Android?
You meant higher aperture or stopped down. A lower aperture ie 2.8 produces higher depth of field and less focus.
Danke!
Dudeeeeee! This is the first Super Thanks we received
Do you get strikes for using Mission Impossible Themen?
We used the copyright free music ..Link in the description
do we need lidar for gaussian splatting ?
No bro… just ur phone camera is enough;)
Is it possible to make a metahuman from scanning a person with gaussian splats?
No, because you need the face mesh
So gaussian splatting doesnt make any meshes right?
HONEY WAKE UP BAD DECISIONS STUDIO UPLOADED
HAHAHAHA YOU GET A COOKIE FOR THIS COMMENT!!!
Why not shoot stills in burst or interval mode? Then you also can set shutterspeed higher than 1/100 with a good camera app. You could shoot at 1/250 or 1/500 which will increase sharpness even more.
Your still frames are now jpg or raw in 8K and if jpg the image sequence is already done.
You can shoot this way just as quick as video and no need to extract stills from video.
Also no video compression and optionally use raw stills as source.
Raw stills in burst mode. Convert to the highest supported fileformat to convert.
No compression, less artifacts, better splats.
I haven’t tried myself but this would make sense to try:)
GSplat gang:
WTF IS PHOTOGRAMMETRYYYYY💥🔥⭐💯🔥💥
hahahahhahaha
is it possible to export Gaussian splats as obj meshes? :o
Not now! Only .ply!
how big are these downloadable scene? ply. could be hundreds of megs
Not big ...around 20-30mb
Wish you make detailed video of how to add falcon into the scene like that :)
what is camera's resolution you use?
4k on both iPhone and DSLR
thank you!@@badxstudio
Cool!... but how to do it for VR?
We already made a video about it.. check our channel ;)
why can't you cast and or receive shadows from other non gsplat objects in your scene. it's cool, but otherwise if the other objects don't have shadows or get reflected then it's like, why did we even import it into unreal. the re-lighting is ok though. seems more of a tint and exposure thing.
Is there a free plugin for unreal ?
Nope, the one on UE marketplace is paid
Is it coming to blender?
There is a plugin for it but we couldnt get it to run!
that smooth iranian accent
Really enjoy what you both do and share! Would love to work on something fun together someday!
Thanks a lot brother... for sure, hopefully one day
AI suddenly making amazing software possible.
it's so crazy that this tutorial is basically just telling you to use a website. Like. The information in this could fit in a tweet.
Cool video, guys! Can you mix several Gaussian Splattings together into one scene?
Possibly yes but we haven't yet tried it ..gonna do it for a big environment
amazing Sir! can we do this in blender?
Yes, you can. There is a plugin for Blender as well
This is it.
The future is here.
It's crazyyyyy how fast things are moving
Let's goooooo!
Hell yeah baby!!!!
what do you mean 'a specific altered version of Unreal'? It's just unreal 5, with the metashoot plugin :-D. lol. Anyway, great video's guys. Keep going
Sooo...if I shoot a 30s video and convert it into an image sequence, it means I will end up having 720 images. As the maximum images you can upload in polycam is 200...I guess you have to choose between those 720, dont you?..
You are right. You don't need every frame as an image for creating a Gsplat. make sure there are differences between images. We use ImageMagik and probably only taking 2-4 image per second only
@@badxstudio great!!..im trying GS on polycam today!. Thanks for the info and for the content on your channel. I see now the maximum q of images is 250..yessss, the more, the better
🙂
Splat to Meta Human would be a really cool plugin
💯💯💯💯
🙌
Cant wait untill it has some real applications on tv/movie industry, for now it just cant generate any useful mesh that could be used in houdini/redshift/Vray/arnold etc, everything would have to be re-topologized anyways, its great technology but still waiting for some real life practical use that could come handy on cgi work. We use photogrammetry a lot but everything has to be retopologized so its optimized and looks great on physical based render engines
Finally
🙌
Friendly nitpick: At 3:41 you start mentioning "Low Aperture" when it should be "High Aperture", i.e. you want to avoid low f-stop valiues and go for higher values instead. This terminology might be a bit confusing because low aperture values stand for a larger opening on the lens (more light coming in, depth of field is shallower) and high apertures mean that the opening is smaller (less light coming in, depth of field is deeper). So, your explanation is correct but your terminology is a little off 🙂
Afteer I was made like 1831 photo to scan a vhehicle, welp... That's really impressive!!!
Omg thanks to you guys pointing it out, I discovered that there were two ghosts behind me watching the vid as well, and yes those mfers hadn't subscribed 🤦
hahahhah... make sure you get them to Subscribe ;)
I will try if one day I get a camera
You can use your phone camera too
@@badxstudio I have a 12 years old phone, it is not a smartphone the resolution is maybe 240 or less 🥲
"y'all" isn't a word
You + all = Y'all
Chillout.
Hard when on 6 shots of coffee