AI 3D Generation, explained

3D generation (text-to-3D, single-image to 3D) has significantly progressed this year. This video tries to summarize several ideas behind this technology and recent trends.
The papers discussed in the video:
• DreamFusion dreamfusion3d.github.io/
• Magic3D research.nvidia.com/labs/dir/...
• Fantasia3D fantasia3d.github.io/
• DreamGaussian dreamgaussian.github.io/
• RealFusion lukemelas.github.io/realfusion/
• NeRDi arxiv.org/abs/2212.03267
• NeuralLift-360 vita-group.github.io/NeuralLi...
• NFSD orenkatzir.github.io/nfsd/
• ProlificDreamer ml.cs.tsinghua.edu.cn/prolifi...
• Zero-1-to-3 zero123.cs.columbia.edu/
• Magic123 guochengqian.github.io/projec...
• DreamCraft3D mrtornado24.github.io/DreamCr...
• SyncedDreamer liuyuan-pal.github.io/SyncDre...
• MVDreamer mv-dream.github.io/
• Consistent-1-to-3 jianglongye.com/consistent123/
• Zero123++ arxiv.org/abs/2310.15110
• Wonder3D www.xxlong.site/Wonder3D/
• SweetDreamer sweetdreamer3d.github.io/
• LRM scalei3d.github.io/LRM/
• Instant3D instant-3d.github.io/
• DMV3D openreview.net/forum?id=H4yQe...

[@qian-yiwu5403]

Thanks for your efforts in summarizing the advance along this topic!!! It is also quite amazing to see such rapid development in one year :)

[@jbhuang0604]

Yes, the field is progressing so fast! Can't wait to see what's next!

[@mityashabat]

Great video. I've been following the text/image - to - 3D field for a while now, and still learned something

[@jbhuang0604]

Very happy to hear that you like it! It's indeed super hard to keep up with such a rapidly progressing field!

[@xk-huang]

Great video with well-illustrated motivation and background knowledge!
(Wow, I am the 1000th subscriber!😁

[@jbhuang0604]

Thanks a lot! And thanks so much for subscribing. More fun videos to come!

[@YashBhalgat]

This was great! Thank you for your effort in making this video!

[@jbhuang0604]

Glad you like it!

[@r00t257]

You are a god of presenting things in such a concise and intuitive way! Thank you very much, Professor! It really, really helps.

[@jbhuang0604]

Thanks so much!

[@luling3687]

Great introduction and explanation!

[@jbhuang0604]

Glad you enjoyed it! Thank you!

[@m_study3831]

Great explanation. Thank you.

[@jbhuang0604]

Glad it was helpful!

[@aakashchaddha6016]

Great!! Appreciate your research!!

[@jbhuang0604]

Thanks for your kind words!

[@stefanguiton]

Great explanation

[@jbhuang0604]

Thank you so much!!

[@idrees2516]

great content! keep it coming🎉🎉🎉

[@jbhuang0604]

Will do! Thanks for the encouragement!

[@Johnx69]

Really great video! I am a beginner in this field and aspire to become a computer vision researcher. Could you please create a video or suggest a learning path for me to start in this field? I am quite confused by the many cross-domain topics in this area. Thank you very much!

[@jbhuang0604]

Thank you!
For computer vision basics, I highly recommend the First Principles of Computer Vision
by Prof. Shree Nayar. fpcv.cs.columbia.edu/
For diffusion models basics, check out my new video here: czcams.com/video/i2qSxMVeVLI/video.html

[@ZheWang-tk5uf]

great video

[@jbhuang0604]

Glad you enjoyed it

[@obezuna]

Is it possible to download it somewhere?

[@jbhuang0604]

Do you mean this video? or the 3D generation software?

[@xiangjungao4627]

Is this voice the professor himself ?

[@jbhuang0604]

Yup, it’s me!