How to Make 3D Models from NeRFs using Nerfstudio
Vložit
- čas přidán 20. 12. 2022
- In this video, we walk you through the steps to train a NeRF using Nerfstudio and export both a point cloud and textured mesh from the neural network.
For more information on using Nerfstudio, check out their documentation website: docs.nerf.studio/
Tips:
-If you do not see the Export options in Nerfstudio, you need to upgrade your version. You can simply upgrade Nerfstudio using "pip install --upgrade nerfstudio"
-For smaller objects reduce the number of points or faces
-If you don't need normals with point clouds, uncheck the option. The resulting file will be about half the size. - Zábava
Just stumbled upon your channel while investigating NeRF and integrating it into my VFX workflow. Super useful stuff. Good level and length of videos! Subscribed and will be keeping an eye out for future vids. Thanks!
I'm definitely interested in a getting started quick guide for getting started with Nerfs. Been meaning to get into it but it's hard to know where to start so I'd find it super helpful
Would a 15 minute "Getting Started With Nerfstudio" video be helpful?
@@EveryPoint absolutely! I think it would help lots of people. This is really cool tech I think a lot of people would appreciate a straightforward introduction to!
@@EveryPoint I keep running into errors when trying to follow the official nerf studio guide, so a tutorial might help a lot 💯
@@EveryPoint Definitely!
非常感谢，教程演示给了我很大的启发，虽然没有从事相关的工作但我希望能自己尝试成功这一技术
No way I am down this nerf rabbit hole and you are not only doing the remote chance thing I'm researching and now you're modelling my hometown icon.
If you are in the area awesome. We have similar interests!
We are in the Pacific NW, stretched between Salem, OR and Redmond, WA. We drive by this icon periodically!
@@EveryPoint thank you for all of your responses. What an exciting time to be alive with technology!
Dude! Fellow Pacific Northwesterner here, please do a beginner tutorial!!!! I am making a very VFX-heavy pitch and have been relying on the Matrix city released in UE5 and being able to creat a mesh from a nerf of part of a city would be amazing!
Thank You for sharing ...Cheers :)
For sure its very useful. everytime I see a new video from you I know is somethign worth a watch, and this one was no exception.
Glad it was helpful! Also, thank you for the kind words regarding the usefulness of our content.
Fantastic demo. Very useful. Have you played around with some of those default parameters yet? Any improved results, if so what did it?
Not yet! That would make for a great follow up video.
I'll try this. Very useful.
We're glad you found it useful!
Hello! I just discovered your channel and I'm finding it very useful as im also working on a similar project at work, where i have to reconstruct a sort of 3d model from videos pointing to a coast from the sea from a medium distance.
The videos would not go over the entire scene 360 but they will cover just a portion of these angles, mostly front-facing.
I ran over these Neural Fields some days ago and I tried them of linux, and I was just astonished by the performances and speed of the results.
Do you think instant-nerf of nerfstudio (which also includes a spatial distortion technique for unbounded scenes -> similar to the original NeRF's NDC technique for front-facing unbounded scenes) would be a good solution for my task (even if not taking 360degrees videos I could maybe extract a sort of 2.5D model of the scene) ?
Thanks in advance!
Need a getting started video around 15 minutes or less. Segmented and marked on your video so we can follow it easily.
This will blow up
We're on it!
Hi @EveryPoint, I have been following the development of nerve since last year, and over the winter break, I missed all of this. Could you make a video from 0 with the installation of Nerf Studio, please? I'm working on my PhD and this information will be really helpful, In trying to use Nerf to recreate a 3d models of insects.
Great tutorial - I will definitely be experimenting with Nerfstudio!
Have fun! Please share your results with us.
👌🏾cool vid could you do a ' how to train your Nerf video ' Next💯💪🏾
Can we utilize these 3D models for training to use as dataset and further using in MD DL?
if yes then how?
and if not which tools is used commercially for real time dataset of 3D to use in our training purpose?
thanks in advance
If you are using the locally hosted viewer is there a way to set up the command line prompt to give you a link to the locally hosted NeRF viewer link? Or will this just send you a default link to the general web viewer?
Noob question, what program are you using to open the finished mesh? Thx
At 11:47, there are two obj files. How is the mesh.obj generated? Is this part of poisson mesh file or is this an independent mesh generated using other method? if so, which method? Thanks again for the tutorial!
What you are seeing here is two meshes, both generated using poisson surface reconstruction. One mesh is the initial result, the second mesh has been optimized at a target number of triangles.
How is that different from standard point and cloud softwares like WebODM for example?
Can you create a textured mesh from instant NGP?
Do you know of a way to get the 3d mesh info transcribed through an API into a modelling program such as Blenders Geometry Nodes to have it generate assets with adjustable parameters?
Your best option to is reach out to Luma AI regarding their API and integrations.
Hi,
Is it possible to export in STL format and than upload it to 3d printer?
im looking for example using drones taking images of crops
yes please make a video on nerfstudio installation. I found the process simple to follow but tinycudann does not compile properly.
Same issue for me, could you find any solution :(
@@beytullahyayla7401 For me, tinycudann compiled properly but on running 'pip install nerfstudio', pytorch with cuda gets removed and pytorch without cuda support gets installe.This caused the issue with preinstalled tinycudann. Easy way to go around it is by again running commands to install pytorch with cuda. (Tinycudann requires pytorch with cuda to run) Once you do that, it should be resolved. Also use nerfstudio 0.1.18 instead of default which is 0.1.16 [pip install nerfstudio==0.1.18]. Let me know if it helps
@@mohitgupta5000 Thanks for the answer, to be more clear i'm getting this error NameError: name 'tcnn' is not defined because i can't install tinycudann properly. I'm getting this error when i try :× Encountered error while trying to install package.
╰─> tinycudann
note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.
Hello! Do you know if nerf can work with 360 (equirectangular) images? I have many 360 images of a house in diferent position, would like to test to generate a model
You can make NeRFs using cubemapped images from equirectangular output. However, results are mixed. Nerfstudio also supports the fisheye lens outputs from the 360 cameras.
Does anyone know wether its possible to calculate the accuracy of such 3d modeling process? I use photogrammetry for surveying and thats exact math so im able to calculate the accuracy of such process, but this is basically a trained ai to do it for me, so id love to know the math behind it so it could be used for exact replication with calculatable accuracy
hi bro. How much data is needed for the model to perform well like bicycle ? and i have a 2 minute video from which i need to choose what fps per second. please give me your advice
Please makea video about how to use nerdstudio to train a nerf
well that's complicated with all that code. Why can't the software just run those behind the hood with an easy UI?
What happens when you feed it a bunch of data from varying sources of a similar object?
What you are describing is NeRF in the Wild. Check out the project page: nerf-w.github.io/
thanks for helpful tutorials. getting this message the whole time Could not find ffmpeg. Please install ffmpeg
Have you encountered the issue that transforms.json is not created using customer data?
Would you like to share your customer data?
How would you say nerfstudio compares to something like luma? im interested in making nerfs, but the pros and cons of each way to make nerfs are not very clear
Nerfstudio is primarily meant for researches, scientists, and software engineers. It is also useable for creators, however, it has a steeper learning curve. Luma AI is more targeted at creators who want to make VFX and visualizations with limited ability to modify parameters. Both are great options.
hi jonathan recently i got way too old xbox Kinect to scan my entire house but its only capture half of the room . i would like to know is there any other way to scan my entire interior of my house like i tried vslam but its doesnt work . please guide me if you got any idea. My old house gone demolishing within a month ,so i have a plan to capture my entire house in 3d . kind of preserve my nostalgia and happy moments in this way . so let is there any way to capture my house
What video card is worth getting? More vram is better?
More vram allows you to input a greater number of total megapixels into a project. However, a more powerful card speeds up rendering time. Nvidia suggests RTX 20xx or higher. We found that a 3080 or better is ideal. The older cards take a long time to render.
Great. Do you have video from A to Z for noobies? Iwhant to learn this 2d to 3d but how to start?
How to start in to new PC? What must install end how? A to Z?
I cant install nerstudio. I'm getting tinycudann error :(
Make the video please! Beginner here. Thanks
That's very interesting, but this mesh is not usable for any kind of production, unfortunately.
My Assumption is that 3D-Asset-Markets will get flooded with highpoly-meshes, which are totally useless for videogames, unless you want to retopo everything.
Am I wrong with that?
I don't know how to use nerfsutdio.
Don't know how.
No idea what NeRFstudio is.
A nerf collaboration software suite that was started by a group of student at UC Berkeley.
Jay shree ram ❤
Why do you sound like ben shapiro
I don't
do that vid
Be nice to have a complete GUI !!!!!!! So not all the python BS.
Title of the video should be "why you can't make 3d models from nerfs using nerfstudio" ... cmon, this mesh is a joke.
hi hello.. i want to ask, when i train model i got error message "FileNotFoundError: [Errno 2] No such file or directory" how to fix that?