VRChat - Streaming Avatar Motion To Multiple Worlds In Game

Bit different from my usual content, as you can see, I've gone down a VR rabbit hole. Still doing my ragdolls, and main game dev work, but this whole area has fascinated me recently, so you may see me post some of my experiments for VR every now and then.
Content:
So what's this video showing, I've been working on a way, to let you stream out player motion, so you could then play them back, as a livestream or recording, in game, into multiple world instances at any time.
The idea came to me while going to VRChat events, and finding it a shame that, if you couldn't get into the main world instance, you would have no way to see the host/performers 3D models in game.
How It Works:
This method, tracks the player in the "Green box's" armature positions and rotations, and converts them to a pattern that I can record/stream in game as a video using the stream camera. I can then upload that video, and stream it back into the game's videoplayer, which I can then use to drive a in world puppet that can reenact my motions, it can even have sound from the video emit from the head.
It still requires a bit of set up, the Avatar used to record has to match the one used on the other end, and there is a little positional warping, but right now it syncs enough to be just about usable.
Along with performances, this could be;
- A fun way to record karaoke sessions and play them back later.
- Watch back your own dances or acts as they are seen in world.
- Do a one person performance, by recording yourself in multiple roles and play them all together.
- Having a easy to update, in world animation for a news cast hologram.
Just some things I think would be cool to use it for from the top of my head.
What Next:
While I've started to make Avatars for the game (Commissions & Pre-links below), I'm not really sure how the whole world making bit works. I've been having fun doing tech experiments for myself like this (god I have 4 different ones now) , but unlike Avatars which is easy to put up for sale, i'm not sure how to make this viable?
Still, for now I'm just doing this when I can for fun, nice to finally be able to show this one off. Hopefully I can come up with a world idea to put all my experiments together in. I would like to be able to put more time into this, so if anyone has any advice, i'm all ears, and let me know if you think this little prototype is cool.
Shilling:
My VRChat Premade Avatars: hatgremlin.gum...
My VRChat Avatar Commissions Page: www.fiverr.com...
Shilling My Game Dev Work:
store.steampow...

[@INeatFreak]

Watching someone explain what they've done in a 3D virtual world, while being inside that said world walking & pointing at stuff is really mind boggling.

[@BirdmaskStudio]

I know, this whole VRChat thing has been a trip so far. First time I'm seeing what I look like, body language and all as that avatar as well.
Still, it's a neat way to present stuff, when I finally get the boss fight game done, could be a fun trailer idea. Me walking around like a nature documentary presenter, as my AI creations are trying to hit me with swords in the background.

[@NexVice]

This would be hot tech for DJs in VRChat that get their instance full all the time! What do we need to do to implement this in a world and it's costs? I'm very interested!

[@FightnWin]

how did you share video onto CZcams

[@Sergio-uo6xv]

Promo-SM