How To Crop 3D Gaussian Splatting On Smartphone And Use It In UE5 | Introducing KIRI Engine v.3.5
Vložit
- čas přidán 20. 06. 2024
- Here is the link to the free 3DGS Plug-in for the UE5: github.com/xverse-engine/XV3D...
If you like what we are doing here at KIRI, please like this video and follow us for more great content :) This would really really help our small team to grow faster
And if you haven't downloaded KIRI Engine app, it's free to use for everyone (but with a subscription option so it can financially support us to keep doing this)
KIRI Engine on Play Store: play.google.com/store/apps/de...
KIRI Engine on App Store: apps.apple.com/us/app/3d-scan... - Věda a technologie
I did a quick scan of my ( real world ) car by walking around it and taking just a few pictures. Another car was parked near the driver's side, so I didn't get any good views on that side.
To my surprise, not only did the app produce a model fully detailed on the side that I could not take photos of, but it correctly modeled the car from the top view, despite me not taking any pictures from that angle !
Also, 3DGS seemed to not have as many problems as other methods when it came to rendering windows.
Other methods try and model the car seats and such, and get confused by reflections and glare on the windows.
So far, this app has been extremely useful.
I scanned my engine bay and other areas, and plan to stitch the detailed scans into a lower poly count model for use in testing the car's drag coefficient using CFD ( Airshaper )
Wow, thank you so much for sharing the experience, I'm so so so pleased to see that KIRI Engine can be of help :) I totally agree with you, 3DGS is indeed a game-changer in terms of robustness comparing to other existing methods
Nice! You made a great Gaussian Splatting editor in your app. I think it is the first tool where you can crop an clean point clouds in the mobile app. Good Job!
Haha thanks, Olli :) And man! I've been watching your recent videos, great stuff! It's so nice to finally speak with you here
@@KIRI_Engine_App Hi! I just made a video where I list 5 interesting Gaussian Splatting things which developement is good to follow on this year. KIRI engine is also in there! You can check the video in here: czcams.com/video/Sxy7tcRZh-8/video.htmlsi=drQ1OaajoOmfGVgQ
Hi Olli!
Love your channel and the latest gaussian Splatting series! Great work. 👍💯
Can’t wait to test it out! Thank you KIRI team
Thank you so so much man! If you got any questions, feel free to let us know
I really like KIRI Engine, it's so powerful and user-friendly... very good job!!
Thank you so much diegoberta!! Feel free to let us know if you got any questions or concerns in the future
Very nice. I love this update as you do.
Keep up the good work! I love your enthusiasm!
Thank you so much :))))
Damn man, all the work behind this, you and your team are impressive!
I would like to know if with the new tools and a good 3DGS scan can be used in software like Fusion 360 to 3D print objects.
I was wondering if i can scan some Car parts and directly 3d print them to make moulds for carbon fiber pieces
Hi there! Thank you so much for the encouraging words, glad you like our software :) But unfortunately, 3DGS is going in separate directions from 3D fabrication :( Basically, 3DGS doesn't have mesh, so you won't be able to 3D print it. But even if in the future there are technologies to convert 3DGS into a mesh file, it would lose all the advantages of being a 3DGS file, and you would find the mesh quality very similar to our existing Featureless Object Scan and Photo Scan modes. So having said that, did you try our traditional photo scanning methods to help you generate 3D mesh for fabrication?
Thanks Kiri. Did you plan to export it on Blender too ?
I tried a 3DGS plugin for Blender, but it's not exactly pretty.
Yup, like reli said. The plugins right now for Blender are not good enough. We are also working on making better plugins
Kiri #3dscanner 💯🔥👍
Yoooo thank you so much!!!
I love y'all. I have a dilemma that you guys would probably have good advice for. I have a promotion from my cell carrier to get an iPhone 15 pro for cheap. I prefer android, but love the lidar that comes with an iPhone. For 3d asset creation, do you think photogrammetry or lidar is better and more accurate? Your software is so good, I'm wondering if I even need lidar. Are there any benefits to lidar?
LiDAR allows for localized photogrammetry, but honestly the algorithm on KIRI is so good that if you don’t mind the uploading and downloading process, it almost makes for no difference
Hey there! Thank you so much!! We love you too
@@KIRI_Engine_App Thank you so much! That's kind of what I was feeling, but I'm definitely no pro, so I really appreciate the info from you guys, including @itsyaboizion7326! So what I learned from this, is that I really should spend that money on replacing my $800 DSLR lens that got stolen instead of a pointless iPhone 🤣! Much love, and I'll most definitely be staying in this community for the long run!
Side note: I'm teaching myself blender and 3D scanning through attempting to make exact replicas (sound recording and all) of my cars to put into games such as Assetto Corsa and BeamNG 🤣 I figured it'd be a very good way to learn cause it's both challenging, and very fun!
Wow, trying to 3D modeling your car for AC does sounds a good motivation, have fun!! And not sure if you've already joined, but feel free to join our Discord community :D It's a lot of fun: discord.gg/Jt2JHG7BAc @@roamthesurface8410
Is it possible to upload 360 equirectangular source images to KIRI engine? I’d like to capture environment scenes more quickly using a 360 camera. I can export to 360 images as flat cube map faces but hoping to skip that step in the workflow and directly upload 360 images. Thoughts?
Hi Dave! Thanks for the comment. We are also experimenting the possibilities of using 360 footage or photosets, but at this moment, it's not supported :(
Hi Kiri team,
Can you give tutorial on how to scan a person. I think it's quite harder when compared to scanning an object.
Hi there! Thanks for the questions! Yes, it is a lot harder than scanning a stationary object because a person would always move slightly. Let me put this topic to my future video, thanks for the suggestion :)
Hi Kiri Team,
could you make a tutorial with the best strategies on scanning a room and not just a plain room, but one with obstacles in the middle of it? Would be awesome. I'm struggling a bit here with a room with lots of detailed and glossy objects in the center of it.
Hey there! More than happy to help :) To make a full tutorial around it, could you let me know what you intend to do with the room scanned? Depend on your use cases, I might recommend different scanning methods
@@KIRI_Engine_App Thank you so much for your fast reply. Ok, this room is a bit more complicated than others, because it's a operation room with a operating table and medical devices in the center. i though about scanning those center objects seperate and combining them later but I'm not able to stay in the center and take images/video of the surrounding walls.
Thank you for any help you can provide.
Best
Marc
@@violentpixelation5486 Hey Marc, thanks for the reply. One more question, are you planning to use the final room scan for display purposes like showing it around to your patients or friends? Or use it as a 3D model so you can do CAD on it?
If former, you can try 3DGS scan, if later, a LiDAR Scene scan might be the best option
@@KIRI_Engine_App it will be used for a digital set for virtual production.
@@violentpixelation5486 Cool! In that case, you gotta try our 3DGS Scan, do you have a KIRI Engine Pro account? Send me an email if you don't, and I'll figure out a solution for you: jack.w@kiri-innov.com
I'm looking at using this technology to scan models where there will be mating parts and therefor dimensions matter. 2 questions, can the dimensions or features be edited post capture on your software? How accurate are the scans positionally?
Hi there! Thank you so much for the question and the clear background explanation. Although software like KIRI Engine won't automatically give you the real-world dimension of the 3D model, you can easily rescale it on pretty much all 3D software like fusion360. And the accuracy can be pretty high if you accurately rescale the model
@@KIRI_Engine_App thank you for your quick reply. I have an older android phone, does having the Lidar capabilities of an iPhone add greatly to Kiri 's modelling capabilities?
@@tyj1234able Great question, and surprisingly, the answer is no :) People have been having this LiDAR hype for a while, but as soon as they actually get their hands on the LiDAR scan, they'll realize the 3D scan quality directly from LiDAR sensor is unusable in any actual use cases. Although our recent Object Capture feature that utilizes the LiDAR data and combined it with photogrammetry to greatly improve the end result, in the end it is no better than our full-power photogrammetry from the Photo Scan mode. So, in short, if Object Capture can generate a good 3D model of an object, Photo Scan will only do better; But if a photo scan can't make a good 3D scan of an object, so won't the Object Capture
Please add create mesh function
Right on! Coming in the next video, stay tunnnnned! :DDDD
I need embed code for VR :(
؟؟؟
怎么解决在UE5中没有阴影的问题？
Great question and unfortunately it doesn't really have shadows at this moment :( 3DGS is still in its early days, and casting shadows is one of our most prioritized tasks in UE plugin development, so please stay tuned :)
All my 3DGS tries failed... i dont get it. I just bought a photobox with light and a electric turntable to make it as smooth as possible. so the photo also failed with that turntable, i created hundreds of photos with the turntable and a stand for the phone. i thought it must be a 4k 3d image.. alway failes.
the only ones who doesnt fails are the ones without box and light and very bad "jump" around the object... curios
Hey ghostfoxone! When using 3DGS scan, you will be more successful when not using a turntable but rather taking a video around the object. The reason why it's better to orbit around the object but not the other way around is that the algorithm are finding feature points across the entire image, and if the object itself is spinning and the background is not, it will confuse the algorithm to calculate camera pose. So, don't use the photobooth and the turntable and try it again :)
Sry, just bought Kiri Pro, saw a loot of vids and do the first tests. Its def. harder. But when i see a young kid on YT with an other app simply create a face in 3d i got a bit disappointed. All tests with faces are not as good as the kid ones.. I keep trying.. at least i have 360 days left with pro :)@@KIRI_Engine_App
What is up with your website, It's super intermittent. Most times it is just a not responding page. I've only been using your app for a day, and 12 hours of that day your site is wonky and rarely can i download my model. I paid for the full year of the pro version. I have sent your support email a notice as well.
Hi Nomis! Thank you for letting me know and I'm sorry for the laggy experience. We are going to do further investigation via our email conversation, but if you have any further questions, please don't hesitate to leave comments here :)
Do you still have this issue? We updated one version but not sure we solved this issue fully.
I did a refund, sorry my first experience was not a good one, I cannot recommend this app.
@@NomisRC Hi Nomis! Thanks for the honesty, I completely understand. We improve our software every day. I hope you can stay tuned and eventually come back :) But no matter what, please don't hesitate to reach out to us if you have any questions or concerns at contact@kiri-innov.com
Not working,please help
Oh noooo, feel free to send us an email at contact@kiri-innov.com, our support team does a good job helping you resolve issues quickly :)
中国的用户怎么下载使用呢？
Thanks for the question, but unfortunately KIRI Engine is not available in China. As a startup, we want to focus on one specific market first and then gradually expand our customer base. I know it's weird, but even though we are a Chinese-based company, we decided to make the appearance in the overseas market first because we think that's what we are good at :)
@@KIRI_Engine_App 非常感谢能得到你们的回复，我遇到一个新的问题，我使用安卓手机能下载到APP了，可是打开后画面一直闪，无法进入，最终是自动退出了。这个问题如何解决呢？使用的手机是华为P30
@@user-yy1mu8nt6h Hi, sorry about the experience. Did you download the app through Google Play Store, or via an APK from the internet? We normally see this issue if an user download KIRI Engine APK from a third-party
Why is it the future when it’s happening now
Great question! Because 3DGS isn't really fully compatible with game engines yet, but we are working on that
@KIRI_Engine_App Please make a plugin for video users, For Adobe After Effects
That's a great suggestion. Noted on my to-do list haha