"Postshot Point Cloud Density Experiment" 3D Gaussian Splatting
Vložit
- čas přidán 11. 05. 2024
- Hello my friends on the internet. If you love 3D gaussian Splatting, stick around and get hypnotized by splats and floaters!
This experiment is to test how a dense point cloud affect 3D gaussian Splat training.
The idea is to use a dense point cloud to assist in converging splats faster. Will it work or will it be a huge waste of time? Let's find out my friends! Here we go!
The left side is a dense point cloud and right side is sparse.
Here is the training in realtime. You can see. The dense point cloud side converges faster. It is approximately one splat per point. The sparse side is blurrier. Look at the text Philtrust Bank and the pillar details!
This took less than 30 seconds. Normally without a dense point cloud, details starts to be clear much later depending on the scene.
Further training, will eventually even out both sides .
Splats, splats, splats are coming. Hey this is just a test. Chillax.. We gonna delete them later ok?
Hope you enjoy this experiment and see you next time!
Software: Adobe Lightroom, XNView, Reality Capture, Metashape Pro, Postshot
Edit: Davinci Resolve
Music: Suno.ai - Věda a technologie
Omg I love the song, which site did you use for it? ❤
Suno.ai is awesome. And thanks! Cool to learn some CG and dance!
@@DaveDFX LOL, that's genious 🤣🤣
Nice!
Thank you! Cheers!
Amazing! How did you use the dense cloud in postshot ?what software did you use to generate it ?
In Reality Capture or Metashape. I'll make a tutorial on that.
@@DaveDFX yes please my lord 😀😀
Amazing! Can it change to 3d mesh and import to 3d software to do further editing?
As of now, it's only point cloud. There are open source research to mesh splats. github.com/francescofugazzi/3dgsconverter . github.com/Anttwo/SuGaR . If i need mesh, I would usually use the photogrammetry for now.
so, the dense one and the sparse one finally reach nearly same quality? the only benefit to use dense point cloud is it converges faster? and I find in the final part, editing floaters is extremely important😂
Yes . Dense is just faster and uses more memory. Both sides will self prune eventually depending on splat settings. I use this for quick preciz.floaters here cuz the data set was not that good in coverage.
Doesn't really matter because they have a point seeding strategy. Read the paper
This initialize faster cleaner with less floaters in Postshot (beta). Also I can get a fast visualization ( takes like a minute only ) so i can save out a PLY and do a camera previz while the project is training. In the past, I have to wait hours for large environments to get a good preview. Eventually the splats prunes depending on the spat density settings. Newer beta is much faster and use less VRAM.
Good point, I seemed to have been a bit salty haha@@DaveDFX
Salty is good. Better than sour haha.. it's all good.. there's a lot of experimentation and the software is evolving fast. Join the Postshot Discord if you are interested in Photogrammetry and 3d Splatting.