3D Gaussian Splatting full tutorial, crop, transform, mesh, import into UE5 & Collision

Sdílet
Vložit

Komentáře • 44

  • @oleksiy2133
    @oleksiy2133 Před 3 měsíci +7

    You`re a hero. It is very hard to find stuff in one place. Looking at gaussian splat as an actual working in-engine thing. I want to try using them with PCG , Thanks!

  • @kedardes
    @kedardes Před 3 měsíci +3

    Thank you for putting together this walkthrough with all the details!

  • @OlliHuttunen78
    @OlliHuttunen78 Před 3 měsíci +2

    Great video. That thing how you build the collision model was pretty smart. Thanks for the tip.

  • @martinwettig8212
    @martinwettig8212 Před měsícem

    That was an excellent overview. Thanks a bunch!

  • @jorgemodek
    @jorgemodek Před 2 měsíci

    Amazing video !
    thank you so much 👏

  • @tobiasdierl4557
    @tobiasdierl4557 Před 2 měsíci

    great video! Thank you

  • @sirens3237
    @sirens3237 Před 3 měsíci

    Amazing thanks so much

  • @thomasshawcroft
    @thomasshawcroft Před 3 měsíci

    Great video kam , really great detail .

  • @danceglass
    @danceglass Před 3 měsíci

    Thank you so much.

  • @alphamineron
    @alphamineron Před 22 dny

    Gosh, what a god! Love you man

  • @FeuerDrache0702
    @FeuerDrache0702 Před 2 měsíci

    Hey man, I recently saw your video on the pulse sensor. I wanted to ask you if you could do more tutorials with the serial comms plugin! Stuff like motion tracking via acceleration sensors is something that I think many people could be interested in :)
    I love your videos man, keep it up!

  • @nicolasportu
    @nicolasportu Před 2 dny

    Outstanding! But as you said, gaussian or nerf without collision automation are useless or hard to work like you genius did. 😮

  • @salomahal7287
    @salomahal7287 Před 2 měsíci +1

    hey s1 else got this error when giving the training command:
    ModuleNotFoundError: No module named 'diff_gaussian_rasterization',
    the rasterization folder is there under .git but i dont know how to resolve this error

  • @alexcawo3826
    @alexcawo3826 Před 3 měsíci

    Thanks! Amazing

  • @dronearon3085
    @dronearon3085 Před 3 měsíci

    nice tuotorial

  • @brappineau4161
    @brappineau4161 Před 27 dny

    I understand you have the invisible mesh, but is the visible object a point cloud running in the game live? Like could this run point cloud environments in VR if I put down an invisible collidable floor?

  • @martinmalmquist
    @martinmalmquist Před 2 měsíci

    This is very interesting! How does it compare to regular photogrammetry? Does it give more detailed meshes?

  • @raymondhardman7286
    @raymondhardman7286 Před 2 měsíci +1

    Thanks!

    • @MrKams1
      @MrKams1  Před 2 měsíci +1

      Much appreciated

  • @olzhas1one755
    @olzhas1one755 Před 8 dny

    It it possible to turn those splats into *textured* meshes? I think I'd probably prefer working with them that way.

  • @voxyloids8723
    @voxyloids8723 Před 2 měsíci

    Wow. But could you give an advice. What if I want to use mesh for generating shadow from GS splats? And what is there a simple way to texture mesh with splats projection to change lighting? Thank you )

  • @isthattrue
    @isthattrue Před 4 hodinami

    I want to capture a room from the inside to watch it later in VR. But 3D Gaussian splatting seems to work best when capturing objects from the outside. My results with Polycam were truly ABYSMAL. How to do it?

  • @MultiMarco9999
    @MultiMarco9999 Před 3 měsíci

    Hello and thanks for your contribution.
    To elaborate the model, I wonder how powerful the Home Computer needs to be? Thank you.

    • @Zagroseckt
      @Zagroseckt Před 2 měsíci

      i sed it in the video but heres the just.
      As far as the PC RAM probly not that important but i'd bet it would eat 16gig easy if anything is processed on the cpu. I would recomend myself a min of 32gig ram better if 64 and up so your not limited to just doing the one thing at a time.
      Now for the important bit.
      For the easiest install and setup.
      You NEED an NVIDA card with 24 GigaBytes of Video memory. You can get away with less Video ram but it will lemit how detaild and large your splats will be and effect the speed of generation if the system has to swap data in and out of the card wich i dont think it can do. yet anyway.
      Good luck.

  • @Pointverse-zs4bs
    @Pointverse-zs4bs Před 23 dny

    Is there any update that simplify this or a equivalent workflow or app can do the same?

  • @AdamaDiallo-sn7mw
    @AdamaDiallo-sn7mw Před 3 měsíci

    Cool!

  • @seanogdevaney
    @seanogdevaney Před 3 měsíci

    Hi there, really enjoying your tutorials, thank you. Is it possible i could contact you to ask some career advice?

  • @pedromachado6253
    @pedromachado6253 Před 2 měsíci

    Hi, nice video. You export in format.stl, but its possible export the textures? the color data? like the old scan softwares?

    • @pkmnjourney
      @pkmnjourney Před 2 měsíci

      im interested in this as well because if you could it would increase the performance for VR

  • @ColiN00B
    @ColiN00B Před 3 měsíci

    Switch from FPS to Trackball to pan. Also there are some keys like u,i,o or p work for panning and rotating? I never use them to be honest. Trackball works fine

    • @MrKams1
      @MrKams1  Před 3 měsíci

      Thank you I never bothered doing any looking into this just went with CC and playcanavs that are great for working with .ply and 3dgs ply

  • @remedytee
    @remedytee Před 2 měsíci

    I believe that the repo you use (inria) has limitations of its own i.e. the software cannot be used for commercial purposes without a license from inria.

  • @luisreynoso9413
    @luisreynoso9413 Před 3 měsíci +1

    That's awesome. I didn't know you could mesh 3DGS. Can you export any textures with that mesh or is it too much to ask? 😂

    • @MrKams1
      @MrKams1  Před 3 měsíci +2

      As I understand it each point has a colour so it will be per polygon texture. I know blender allows you to bake these baked textures to a 2d image but I have not tried with this workflow and would not expect a high res texture

    • @b4rtmod
      @b4rtmod Před 3 měsíci +1

      I was looking for that aswell lol

    • @b4rtmod
      @b4rtmod Před 3 měsíci

      @@MrKams1 Interesting, I`m thinking in use that workflow to 3d modeling, like using a 3d in place to have as a reference, maybe can work even better that just some images , lets see lol

  • @agnieszkatkaczewska1381
    @agnieszkatkaczewska1381 Před měsícem

    Hi, could you advise me what to do if I get this information?:
    (gaussian-splatting) C:\Users\agnie\pinokio\api\gaussian-splatting-Windows.git>python train.py -s input_data/fern
    Traceback (most recent call last):
    File "train.py", line 16, in
    from gaussian_renderer import render, network_gui
    File "C:\Users\agnie\pinokio\api\gaussian-splatting-Windows.git\gaussian_renderer\__init__.py", line 14, in
    from diff_gaussian_rasterization import GaussianRasterizationSettings, GaussianRasterizer
    ModuleNotFoundError: No module named 'diff_gaussian_rasterization'

  • @PuppyAnimationsInc
    @PuppyAnimationsInc Před 3 měsíci

    Having issues with Pinokio closing itself after a few seconds of being open. Is this an issue with the latest dev build of windows 11?

    • @MrKams1
      @MrKams1  Před 3 měsíci

      seems like its stopping at installing something, sees simple but have tried running as admin, also see what it is installing and try manually. They have a discord afaik, give it a go?

  • @emanggitulah4319
    @emanggitulah4319 Před 2 měsíci

    Is that the death of 3d scanners in general?

    • @MrKams1
      @MrKams1  Před 2 měsíci +1

      I would not have thought so, 3D scanners still preferable for scanning smaller precision parts for CAD/manufacture etc, also lidar methods still preferable (with photogrammetry) for larger areas. These methods are simply faster (and cheaper) for VFX/Game/cinematic scans on a budget

    • @Zagroseckt
      @Zagroseckt Před 2 měsíci +1

      Not by a long shot. :) There's no measure of scale in the splats just an estimation. Even with a reference the scale is going to have a huge range of error compared to a scanner.
      Some of the highest end ones can get into the micrometer range and still be a few inches away from the surface it's scanning.

  • @louishancock8154
    @louishancock8154 Před 3 měsíci

    Promo_SM 💔