Creating a 3D digital double in Blender & Meshroom | Blender Part 1
Vložit
- čas přidán 12. 09. 2024
- Start telling your stories with HitFilm ► bit.ly/3OTLA2o
In Rise of the Dark Side, you will have seen an awesome ragdoll simulation showing one of our rebels getting thrown against a tree! In this tutorial, we're taking a look at how Meshroom and Blender were used to create a convincing 3D digital double of Oli along with info on rigging the model and creating the final simulation.
Part 2: • Compositing Blender si...
BlenderMarket Ragdoll Tools: blendermarket....
Free ragdoll tutorial: • Blender: ragdoll tutorial
Visual Limits Addon: github.com/xbo...
Blender camera data export script: gitlab.com/sch...
Catch the full Rise of the Dark Side playlist here: • Rise of the Dark Side ...
*New Tutorials and How-To Episodes Every Tuesday and Thursday*
Like that? SUBSCRIBE for more HitFilm every week!
www.youtube.co...
Know someone who needs to see this video? FAVORITE and SHARE the love.
• Creating a 3D digital ...
We love feedback and a good debate. Leave us a COMMENT below!
FIND OUT MORE about HitFilm Pro
fxhome.com/hit...
*Come talk to us*
FXhome CZcams
/ fxhomehitfilm
FXhome Twitter
/ fxhome
FXhome Facebook
/ fxhome
FXhome Instagram
/ fxhome_official
FXhome forum
fxhome.com/forum/
Josh’s Twitter
/ iamjoshuadavies
Javert's Instagram
/ javert.valbarr
Tom's Instagram
/ low_comet
Timestamps - big advanced tutorial, fyi CUDA makes the rendering times sane without it plan accordingly, comment stamps you think are important to reference.
Photogrammetry overview - 1:18 Actor T-pose with stands, 1:43 Camera settings
2:53 Meshroom , 4:45 troubleshooting and problem examples
6:38 Blender Import meshroom .obj file and blender mini crash course
8:46 adding the reference mesh rig using Rigify(*free blender addon included in install*) , 9:19 Scaling the mesh/model [1]
11:41 Mesh Extraction, 14:10 Rig visibility and alignment, 16:11 Mesh cleanup
18:05 Physics setup using Ragdoll Tools addon (~$22 blendermarketplace) and 19:18 visual limits addon (free from github). Free method missing
24:58 progress demo
25:03 Animation keyframing
26:49 progress demo - watch ollie fly
26:51troubleshooting shaky glitches by increasing the steps per second to ~120 used by the rigid body world in the scene properties
27:16 Hitfilm export reference image sequence creation and blender import and setup
29:37 Mesh starting pose alignment
32:15 progress demo
32:19 Tree collision setup
34:50 Blender rendering
[1] to change dimensions measurement units from metric to imperial(feet,inches,etc) use the scene tab in the right hand side panel in it's unit section , it's about the ~5th tab down you may want to change this back in case other tools are expecting a specific unit. Keep in mind this can throw things off if other tools in the pipeline are using a different unit
.
Paul Newton, that took some effort. Thanks!
Great tutorial!
I am having problems editing with HitFilm express. After i got the latest version, i finished editing my video but when the video finished exporting there was a transparent yet visible overlay of the HitFilm logo and a repeating lo-pitched Ding sound. Is it removable?
@@thegreatestrussianspy6739 That descriptions seems like you have Hitfilm Pro installed and the trial has run out possibly, either you need to un/reinstall hitfilm express or check your activation licenses. If that doesn't solve it go ask on the fxhome forums for help.
@@thegreatestrussianspy6739 Per a comment from FXhome elsewhere in the comment section:
"You'll need to activate the program in the File -> Options -> Activation menu.
- Javert"
I very much appreciate your willingness to provide tutorials on software that FXhome does not create. It is truly in the spirit of creativity that we all share, and just makes me more fond of the company and community you foster. Thank you so!
Being free and doesn't compete directly may be an important part.
I think it's a really nice thing you guys did there. Posting a tutorial that is almost 100% Blender, a great Open Source software that does a lot of things Hitfilm doesn't. However you did it in a way that it can be later integrated into Hitfilm's pipeline and you didn't even had to mention it. It was humble and with the intent of teaching us. You don't see other software companies doing that kind of stuff these days. Thumbs up and keep it up :)
Thanks for the support!
- Javert
How have I never heard of this channel?!
Same
Hey Matt! It's from the people that developed HitFilm Express (free) and HitFilm Pro the video editing/VFX software. They have plugins as well. Lots of great stuff. They did a couple of projects with Ryan Connolly too (Film Riot). Keep up the great work BTW.
"How much do you weight?"
"Beans, soy"
as someone who uses Blender this is pretty good, and my next project is using both Hitfilm and Blender
BTW, Oli looks like a N64 character you would expect from Goldeneye, which is still good :)
𝕀 𝕜𝕟𝕠𝕨 😂
this is the best blender tutorial I've seen in my life. every other is just way too confusing
they've massively improved the software in 2018-2019 so that might be part of it. the UI is wayy more intuitive now for new users lol
@@bubbly6379 true
Wow, this tutorial gave me more knowledge and better understanding of Blender than many Udemy courses. Thank you guys!
Great to hear!
- Javert
If your using cycles you can also make the tree and ground shadow catchers which will make them transparent except for the shadows that come from your ragdoll
Oooh, a super informational tutorial on Blender. I love it. Already picked up tons of tips on Pose mode I did not know. Also, I played with Meshroom once but can see where I went horribly wrong here.
This is so good! I feel like going in a manually fixing some of the topology of the model would help with the final quality and make it almost perfect.
For sure! I just didn't want to go into that too since the Tutorial is already so long ^_^
@@ChangorooStudio Also, for the final shot, "Oli" is far enough away that the mesh didn't need to be super clean.
Calver, while I've got you in this response, I'm trying this myself (with a sub goal of also being able to take the digital double into Mixamo), in terms of workflow, is there a reason you lined up the mesh with the bones before trimming away the excess geometry? It seems it would be easier to get rid of the excess geometry before aligning. Eaiser to see, fewer polys for Blender to push. Now my machine is an aging 2014 laptop, so I'm getting plenty of lag in Blender, and Meshroom is taking 3-4 hours to compute, so, unless you had a specific reason for aligning to the bones, first, I think I want to trim.
@@HitfilmUniversity You can also delete unnecessary geometry first, before aligning it.
@@ChangorooStudio TY! Although the way the first set of photos came together... If I retexture the missing bits of my head and limbs, it would be a good zombie.
Guys. This is awesome. Keep up an amazing tutorials.
Thank you!
- Javert
Very effective and great tutorial! It's so convincing that I almost feel sorry for the poor rag doll 😧🤔🙄🙂
OMG that view navigation wasd part was SUPER helpful, Jebus!
Glad it was helpful!
- Javert
This is such a complicated tutorial. Didn't even try to actually follow this pace, but just enjoy watching it somehow.
One of the best vfx tutorials we have ever seen. Great work!
Happy to hear that!
- Javert
I have looked for a tut like this for so long, thank you guys, this was amazing!
Glad you liked it!
- Javert
Excellent video!
awesome tutorial! Answered a lot of questions! Tons of steps, but was very clear.. thanks!
Glad to hear you found it useful!
- Javert
Breath-taking tutorial !!!
You're breathtaking!
- Oli
Absolutely awesome tutorial! This has got my brain cogs whirring like mad! Can't wait for part two, thank you so much guys!!
Glad you liked it! Part 2 is here: czcams.com/video/VN01CqgGuE0/video.html
- Javert
Fantastic work!! Really cool techniques
Glad you liked it!
- Javert
OMG, it's production crate!
This is simply amazing and insane tutorial! Much better than a lot of vfx courses, thanks so much!!
Great to hear you liked it!
- Javert
Very good info. Well done HitFilm crew....
This tutorial is pure dynamite!
Well... Trying this myself now... Meshroom is doing it's thing...
Can I just say that the final model of Oli looked like he'd already hit the tree? ;-)
thanks I'm learning about 3D scanning & photo digitization 😁
@fxhome
did you delete the groin hit box?
This is a very generous tutorial. Keep it up, you have my all support!
Glad you liked it!
- Javert
since it was really not a very close up of the digi double... i would recommend to use a simple low poly base mesh and project the subjects pictures onto the mesh. And warp the mesh with soft selection according to the subject.. This would be more time efficient and really fast smooth looking simulations.
Happy New Year Guys
I wasn't expecting this video but i'm happy it came out =)=)=)=)=)=)=)
Wowsers! this is dope work, love your animation work flow. Subbed
Great to hear!
- Javert
I can't tell you how long I've been looking for a tutorial for this exact type of scene
Glad we could help!
- Javert
Thanks. I'm just now starting to work on this so this was helpful.
Cool! I'd recommend using the Mixamo auto rigging feature to save some time
It would also save a lot of time to use Keen Tool's free add on face builder for the head. Honesty you could just use face builder for the head, and make human or some other programs similar for the body, than you could get to the character and you wouldn’t need to have such a high poly model.
I meet a lot of trouble to use mixamo rig with the ragdoll add-on. The hitbox is always appear like a stick and it take time for me to re-shape it. Do you have any tips?
this is what i wanted , thanks very much
Glad it helped!
- Javert
Congratulations for the high quality of your work and presentation Really vey good and useful
Glad you liked it!
- Javert
I develop for myself engineering models with GLScene Now I am in the phase of transforming my VCL desktop code to run in the web with Delphi + Unigui. The only missing part is the 3D GLscene one. I need to transform the GLscene components to run with Unigui
Great tutorial! Thank you so much!
Glad you enjoyed it!
- Javert
I prefer it without modifiers. Booloen is for example just a modifier :)
this tutorial is a BOMB.
I followed and it works perfectly with my photogrammetry!
Question: lets consider we have a 5 minutes 3d animation in which I want to animate my character using rigging classic stuff. Then I need a scene where my characther is thown in the air like in your tutorial.
You need 2 versions of the character in that case, one for the classic animations and 1 for the "phisiques" scenes, right ?
Because I see that you control some keyframes at 31:47, but of course that is not the most suitable way to animate a character if it is intended for a 5 minutes animation.
Thanks for all of your work!
Great work
Quite informative! Good job!
Very informative tutorial.
This tut is gold!
Glad you like it!
- Javert
ok that was SO cool like I'm gonna do that and probably fail...but ill keep trying cuz imma boss
Absolutely awesome tutorial!
Finally i find a useful video for my project ✌🔥
Totally have to try! I'm gonna make a bunch of clones!!
OMG. information level 9999!
That was so awesome.
Also... I've never heard a German use the words "spaz out" 😆😆😆
I have done a lot of videos on 3D scanning and Meshroom is one of the apps I tested. I was going to do a video of it but I just couldn't get good results out of it.
Excellent tutorial - thank you.
Glad you liked it!
- Javert
Incredible tutorial thank you!
Glad it was helpful!
- Javert
Lovely
Great overview of the workflow used! #photogrammetry #3dscanning #3dsimulation #3danimation #vfx
Glad you liked it!
- Javert
Im having trouble with calculating mass for the rig. Everytime I apply the beans (soy) weight, the rig is pinned and starts glitching out. Anyone know the cause for this?
🤔Why 24mm or lower for the lens?
Isn't the distortion minimal when using tele lenses?
Yes, you will have less distortion, but also less paralax, which is also very important for Photogrammetry.
@@ChangorooStudio Ohhh get it, thank you very much😉
@@benni2294 Also the sensor in the EOS M is APS-C, so 24 mm will be equal to 38mm aprox. in a full frame camera
Very good
This actually looks kinda real. Great work
Very good tutorial, tks guys!
Glad you liked it!
- Javert
Deep tutorial 👍
I wonder if it would be better to build a circular rig with multiple cameras to take multiple pictures at the same time so that they would all match?
That would be ideal! But very expensive ^_^
Got a video on how to do that setup card over the computer?
I wish they met me before the Photo shoot. I can think of a few ways to make it less time consuming.
how pls?
I actually don't doubt that, and I am very interested.
Where downloaded "mushroom"? thank you
You can download Meshroom here: alicevision.org/#meshroom
- Feyi
You can use the Kinect for easier scanning
I did try that too, but it delivers a very low res result in my exprerience. Also Kinect 2 for Windows.
The quality of Kinect is horrible though.
LIDAR cameras have come far. (www.intelrealsense.com/lidar-camera-l515/)
Only the lens info is kinda missleading, When you have focel lenght of 24mm or lower, the angle is getting really wide, the wider the lens, the worse the geometrical distortion of the image is
Would it be an idea to use an infrared camera for the scan? The light would be more even
SHUTTER ON 100 BECAUSE FRAME RATE HAS TO BE 50 - 180 DEGREE RULE! SHUTTER SPEED = 2X FRAME RATE 🔥🔥
You said you would give us a link to do the rag-doll bit without the addon, where can I find that link?
they posted the link in the description for a full tutorial on manual ragdoll rigging made by BlenderShortTests
awesome video! wish I had Nvidia for mushroom
Glad you enjoyed!
- Javert
Now I see why Pixel Gun Studio uses 1000 camera at once to Photoscan for 2k games, you don't confuse the system lol
That’s some ghetto 3D mapping 👍🤗
LOL das schaut man ein zufälliges Video und dann ist das vor der Haustür gedreht :) grüße aus FHain
nice tutorial but bit faster for newer blender user can you please slowit down and make more detailed... and suggest me another tutorial of cg double please . and in c4d
greetings, could you help me out please, when I generate hitboxes, I get thin and small cilinders instead of those boxes you got, any tip ?
I just purchased the Ragdoll Tools addon but the little "generate hitboxes" window in 19:59 is not showing up. Anyone knows what could be the problem? Thanks!
I see can one instead of using the meshroom texture, project the photos into a new uv map for "faking" the detail? Or is it just not worth it?
I don’t have a camera, would it be okay if I used my iPhone camera for this?
You just have to make sure you can Set All automatic setting to manual.
Calver ok thanks
If you have above an iphone 7 or something it would probably be better tbh. There's apps that do exactly this in 10% of the time.
Evan Poliquin oof I have a 6s
Look for the display.land app. It's a photogrammetry app for phones. Using display.land you should be able to use your camera to shoot, generate the geometry directly in the app, then download the textured OBJ from the display.land website and go right into your 3D modeling program.
Now, I will say I've tired display.land on my Android phone, and it does work, but I have gotten much cleaner results with my DSLR and Meshroom. Some of this will depend on how close you want the double to camera. In this short, "Oli" is pretty far away, so they could get away with a somewhat ugly model that looked like Oli AFTER hitting the tree....
Will meshroom work at all on a laptop w no gpu?
Hello, so if you have problems with your ragdoll just flying around out of control I have a janky method of fixing it.
Go to the ragdoll pie menu and then do "Set limits" what you want to do is change the mode to location and rotation and you can do that with shift m. If it's still outta control, I have no idea how to help you. Good friggin luck..
I am having problems editing with HitFilm express. After i got the latest version, i finished editing my video but when the video finished exporting there was a transparent yet visible overlay of the HitFilm logo and a repeating lo-pitched Ding sound. Is it removable?
You'll need to activate the program in the File -> Options -> Activation menu.
- Javert
When I play the animation the hitboxes fall apart which is not the effect I was going for.
i wonder if i can make a mod in gta v where i make myself as a 3d model and replace the character with my model
My mesh is hollow and doesn't rig how do I get it filled?
Nice!! Is there way to get 3d camera data (location etc.) from Hitfilm to Blender?
Nope, but you CAN get 3D camera date from Blender to Hitfilm. There are tools to do camera solves in Blender, so you'd just be better off doing the Camera Solve in Blender
When i move the sceleton the mesh doesnt move wit it, but i did everything like in the toutoria, pls help
I’ve seen people use a Kinect for the 3D scan. How much more effective is that instead of a bunch of pictures?
I wouldn't say it's more effizient. I Could get good result with it.
I think I will do this and animate with blender
Can you use an already made video
@Fxhome -Missing- Link in description for 18:53 Manual Ragdoll Setup
GeeeeeeeeZ!!!!!!!!
It look's like Joseph Seed Character lol.
The "load model" button won't appear. Any ideas what that might be?
Edit: Found out what the problem was. If anyone has the same problem you can just double click the "Texturing" node to load the model.
@0:04 tfw: you try to close the caption bar because youtube ads :/
Can you make a video about face change. İ want to add a 3d face (ex. Cartoon character or a movie star’s face) and it will move with my face movement at the same time.
There's actually ALOT of work involved in doing that as you basically need to model the subjects face, digital double, and animate it then link the animations to another model.
Try looking into "KeenTools FaceBuilder for Blender 2.8+
" there are lots of tutorials being made on it, very advance stuff though.
There's also facebooks SparkAR that has a desktop tool to let you build Augmented reality filters to do stuff like that but it's mostly targeted at being a phone app so you'd have to figure out how to get your results into video , probably by screenscapture. goodluck.
@@TheNewton i did face chage but just 2d. i want 3d face change . can you give an link about this
@@Karadenizligamer cgmatter just did a tutorial that i think relates to this, might be worth looking up :D (got a wavy red sphere as his pfp)
Bubbly thanx
meshroom does not work it just frezes at a different point depending on what version i'm using
What is your graphics card?
@@GabrielsLogic geforce rtx 2060 super
@@evilkoolade wow? That's weird I have a PC card Wich means it's baaaaad and it worked.
My arms don’t show up when making the model
part 2?
czcams.com/video/VN01CqgGuE0/video.html
- Javert
Would this be a way of making textures and/or models for games like Squad, Post Scriptum etc? A way even to create and implement better ground textures?
For games you're generally going to want quite low resolution meshes. For game work you'd be doing a complete retopo over the scan. Photogrammetry is pretty amazing in terms of being able to create a mesh of anything you can scan, but it does generate ugly, unoptimized meshes.
@@HitfilmUniversity When I understand correctly I d be able to but it would be visueally not pleasing and unoptimized.
For a "rough draw" although with the idea in mind of improving meshes later it would be a good way to go?