Powered by N64 Hardware | Mario 64
Vložit
- čas přidán 5. 09. 2024
- Brilliant link to get 30 days free and 20% off an annual subscription
brilliant.org/...
I teach you how I created a VR rom hack for Mario 64 that runs on real N64 hardware with an Oculus Rift DK1.
Rom patch to try it out yourself
github.com/lam...
Get Bzzzt on Steam
store.steampow...
Patreon
/ jameslambert
VR powered by N64
• VR powered by N64
How I added a USB port to the N64
• How I added a USB port...
Music by
Jeff Nichter @jtn191
William Benckert
Clarence Reed
Stationary Sign
Christian Nanzell
Marc Torch
Responding to the open question at the end of the video:
I'd love to give it a try....
Unfortunately, I haven't ported all my optimizations from my mod to the base game yet, so this'd be a huge amount of work to fully complete (and I don't have a VR headset either).
Maybe one day in the future! I do plan on porting all these engine improvements back and making my repo open source anyway.
Although, I could see how some of my mod levels render! They are much more detailed anyway and some run near stable 60fps. I think that could be pretty sick to see.
Looking forward to this
Again kaze!? "Full house theme"
That would genuinley be sick.
@@KazeN64 really hope we'll get some level showcase in stereoscopic 3D !
> I won't go into too much detail
Goes into a ton of delicious details.
>all of it goes over my head
I love it.
"when you enter Bob-Omb Battlefield, the performance takes a hit"
Kaze Emanuar: "Hold my beer"
Yeah, Kaze was the first thing that came to my mind.
I love the little "thank you" sent by the CPU to the GPU.
Love the Kaze Emanuar reference!
RAMBUS GO VROOM VROOM
@@carbonium1264 The wheels on the rambus go round and round
James is the kind of guy you meet randomly in a bar. He tells you about his passion, but it's too much for your brain, so you think he's crazy (in a good way). Then you go home, and while sitting on the toilet, your brain processes everything he said. It makes total sense and is super fascinating. You go back to the bar the next day, hoping to see him again, but he never shows up. You start to question your sanity and reality, eventually becoming an alcoholic and dying. It's all dark. Suddenly, you hear someone pressing the power button. You wake up, realizing you are reborn as a character in Mario 64 VR.
hate when this happens man
For indie spotlight, I recommend you try out "Joe Wander and the Enigmatic Adventures." It's an old school N64/PS1 style platformer developed for current gen consoles and PC.
P.S.
Love your videos! I'm sorry about the Portal 64 :(
This is incredible work and amazing, but I spent the whole video staring at Mario's face on your shirt and giggling
I can’t unsee it 😂😂😂
You can cross your eyes and see the 3D effect. This actually looks pretty great.
I thought this was obvious but apparently not.
Yup! Though the depth will be inverted compared to the "proper" way to do it. If you're watching on a phone screen, it might be small enough that you can focus your eyes past the screen instead, in the manner of the Magic Eye books
@@TayoEXEI've always heard this, but crossing my eyes has never resulted in that effect
@polyrobo They have for me ever since I was a kid. Not sure what to tell you.
@@canaconn2388 It's a little bit tricky to get a feel for. I'm sure you've been told this already, but it helps to pick a single feature that's shared between the two boxes. Then you cross your eyes just enough that the features line up. If you hold that for like a second, usually your eyes will adjust focus and the images will be in-focus
If Kaze and you made an original game together, it would be a masterpiece!
Maybe Kaze’s engine would be better suited for this? I’d get in contact, I’m sure they’d be interested!
Edit: whoops! Already mentioned in the video. Still a cool project nonetheless
What sort of silly would comment on a video without having watched it?
@@martymoistmany people.
@@martymoist be actually surprised that they did watch the whole video and had the common sense to edit later and just not closed it right away
@@OrlandoTiquimCommon sense dictates you'd watch the video before commenting on it.
@@CrAzYpotpiewomp womp
For the head tracking, I'm surprised you don't just use the gyroscope by default and only use the accelerometer to reset down when the gyroscope is still. Might lead to less latency on the head tracking.
MEMS gyros accumulate drift at the rates of like 90 degrees per second, it's actually ridiculous. You can't use them for anything other than offsetting jerky rotations.
this is absolutely fantastic, great work
you are not just the portal 64 guy.
you are an incredibly competent developer, and I look forward to all your projects to come.
ALSO WHY IS YOUR MARIO SHIRT WORN LIKE THAT. HIS MOUTH OMG
i definitely could have told you that the flying cap was gonna make you motion sick, but i also definitely couldn't have stopped you. such is the fate of vr development...
This is crazy, I was just playing Mario64 on DolphinVR the other day thinking about how it would be cool if there could be something VR that runs on original hardware, but I thought "nah, that would be impossible"
And here we are!
Awesome work, I want to try it now
Imagine that released in 1998 as an ad on
Vr tech would be insane rn
Virtual boy if it was good
@@MakerManX was good then?
@@niceleverace I don't think so?
@MakerManX oh wait I misread your comment lol.
Shoutout to your brother for good editing and helping with the indie spotlight!
This project is unsurprisingly amazing but oh man, you have my sympathies with the motion sickness. there's no motion sickness quite like DK1 motion sickness. That thing got me so bad that when it hit me, I would be sick for the rest of the day (and genuinely felt not-quite-right for the next day or so). and that was on a modern pc doing modern (at the time) VR development.
Demonstration Super Mario 64 in VR, is like a demo from E3. Fantastic to project, maybe try Doom 64, first person shooter VR
Mario having no nose at 1:29 is just too funny to me!
I have a toy "VR" thing I got ages ago in a box of Nesquik, the kind where you put the phone in front of the toy, like cardboard. I tried to put the video in it, just for fun. The "viewer" was made for smaller phones, so my current 6.7" android phone was kinda large for it, however I still had to zoom in the video. 1.5x zoom in that toy was just about perfect to watch the clips with stereoscopic vision, but the toy has very little field of view, so I was just watching two flat images, it doesn't feel immersive. But hey, it works :P
(I work with VR, I could easily have used an actual headset, but I didn't know this video would release so I didn't bring any home for the weekend.)
Since the width of the side-by-side game play videos are small enough, I can look at your video like those magic eye pictures by crossing my eyes until the two screens overlap on top of each other and be able to watch the game play and see it in 3D just using my own eyes. (Although for the magic eye pictures, you usually un-cross your eyes, not cross them.)
It sorta works, but you only get a small sliver for a screen.
Though I'm still diverging my eyes like I do for Magic Eye, not crossing them. (I actually don't know how to cross my eyes.) And it looks kinda like looking at a 3DS, so it does seem to work.
I believe that the images would need to be swapped for crossed eyes, with the right eye on the left and the left eye on the right.
I've been wanting for years, rom hack of Ocarina of Time that is for VR, where all the levels are designed around the gimmick of using the hookshot for movement. So you'd hookshot from zone to zone, solve puzzles, do first person combat with bows/din's fire, then a new hookshottable surface would appear to unlock more exploration from hookshot pillar, to hookshot pillar. Eventually you unlock the long shot to make movement faster/easier, and eventually the ultra shot (4 time longer than long shot, saw it in another rom hack). If you spread out heart upgrades, items, it could be a full game. Maybe even do a Twinmolds fight with all bow shots. Not sure what other bosses can be done first person.
Anyways, would be cool if someone made this, and your code could be used in some way so those with a VR headset and an emulator could play it. Or maybe one of the new decomp PC ports or something.
Thanks for including the stereoscopic views. When I got far enough back from my monitor I was able to get a feeling of the depth by crossing my eyes and it was super neat!
In scenes where its just the VR View, bring your head closer to the screen and "split" or "unfocus" your eyes, and then merge the new "duplicate Mario" into one, this causes the stereoscopic image to line up, and you can see the 3D Depth view!!!!!
If done correctly you'll see three of the mario's
Nintendo: yea we're gonna have to ask you to stop making our systems do extraordinary things, thaaaanks.
I remember this one vid of a guy who basically went through the entire N64 code to optimize it as nuch as he could. Basically reaching more than double the fps than the original game.
Would love to see VR run on that version.
kaze emanuar?
That's what the shout-out at the end of the video is for... 🙂
I owned a DK1 shortly after they came out and the motion sickness was so bad that even just looking at the DK1 sitting on my desk would give me a migraine. I hope your experience is less awful :D
you had access to much higher resolution and framerate than this, so just imagine
still, the motion sickness thing is VRgin issue. It goes away soon...
My indie spotlight suggestion is "You are Peter Shorts", that game's sorely overlooked.
Give this guy a couple of years and he's gonna have a full Matrix sim running on an N64.
Is there a way to link two N64s and render one eye on each one ? Like you can link 3 PS2s and play Gran turismo 3 on 3 tvs in ultravide.
It would probably be possible through the controller port, with a double-sided controller cable
That's how the Genesis handled system link support in its two games that supported it
I'm not the biggest Mario fan in the world, but I have a love for early attempts at VR from the 90s. What you're doing gives off the feeling those early attempts give off. I like it!
The 3D looked really good. Just had to avoid look at the sky. Good work!
the only Brilliant ad I've ever actually watched
For anyone that doesn't have access to VR equipment, you can just cross your eyes. It takes a little bit of practice, especially to get the focus right, but then you can see the 3D perspective.
Awesome to see this working! I never thought I'd see the day. Maybe the next step is to make it first person from Marios perspective?
Powering through motion sickness is how you build immunity from vr. Take it off when you cant stand it any longer but don't forget to keep using the headset. You will build a tolerance.
I can play games like borderlands 3 and left 4 dead 2 no problem now.
tbh I'd hazard to guess the real issue is he isn't doing any pose prediction. When you're rendering for VR you have to predict the rotation at the time the photons will reach the eye (which includes the render time), otherwise the view will lag behind however many milliseconds.
You did an incredible job, it's surreal to think that the Nintendo 64 can handle this at all.
This makes me wonder if a VR device for the Wii would be possible, especially since it has motion sensors with the Wii Remote.
Stereoscopic free-viewers rise up. 😎
(you can train your eyes to combine side by side stereoscopic images to appear 3D without the assistance of external hardware, "free-viewing", meaning you can just watch the stereoscopic parts of this video on your phone or monitor in 3D)
I've just used the *squint eyes* method. It looks great, nice work!
I don't own a DK1 or a Google Cardboard but I was able to approximate the VR by simply putting my hand perpendicular to the middle of the two screens on my phone and put it close to my face. Saved me from having to do the Magic Eye trick.
Thank you so much for the indie spotlight section. It reminds me a bit of rockleesmiles indie impressions. I really loved that series and got to know so many lovely games because of it. It really is a shame he discontinued it
0:14 right here you can do that one trick where you cross your eyes and merge the images to make a 3d one
Not sure what type of filters you ended up using, but variable strength filters sound like they would work great for something like that.
Essentially the strength of the filter is proportional to the error (output- input) so that small fluctuations are heavily filtered but large changes have a reduced time constant.
This can be based off of a simple exponential filter which makes it fairly inexpensive to implement.
James you're awesome. I don't even understand half of the technical mumbo-jumbos you say in your videos. But I just love seeing your passion in this line of work. Or maybe it's because I'm a huge sucker for anything N64. Either way, keep doing what you always do man.
A game that might be worth checking out is Varney Lake, a short love letter to pulp novels!
The motion sickness thing is kind of a pretty big hurdle. I do remember you showing me this tech back in the day with the demo games that came with the VR headset, and me feeling the sick. It's cool how far it has come but is still an issue for many people.
"You may be able to imitate the view with other vr headsets" NO need. I watched this video on the 3ds!
VR isn't really something im particularly interested in, but your technical wizardry is always fascinating to see nonetheless, im hoping your next proper game project won't be VR focused but either way ill be here for it
You can make it look 3d if your hand is thin enough and you are on a small device by placing it between the left and right view, then putting your head in front
Everything is better in 3D!! love this project
If you don't have a DK1 you can also just stand back and cross your eyes until the two screens overlap.
Love this, amazing to see what is possible on such old hardware, thank you for making these videos!
great video! but i would recommend (this is gonna sound nerdy) turning down the high end frequencies a bit on your talking
Did you at least apply that one optimization flag that gets disabled, that can boost framerates a bit? The one that got turned off out of an abundance of caution, but seems to run fin with the vanilla game?
That was actually the reason I thought you might think to use SM64, knowing it had more headroom once full optimization gets reenabled. I even think there are some versions of the game with the flag enabled.
i dont think it would help much here... the limitation appears to be memory bandwidth given how much is being sent to the gpu, instead of being cpu or gpu limited
Bro is a real life wizard
FWI. Putting a finger between the displays and moving your head near the screen gives a bit of the vr effect.
Recompiling the ROM using o2/o3 seems to have huge improvements to frame rate, so if you haven't done it, it is an easy win
It would be really interesting to see if some of the optimizations you learned during the Portal64 project could be put to work here
Absolutely amazing work you've been doing. Interested to see what you'll cook up next!
It looks like you only updated the camera position for the right eye when you probably should shift both so Mario is visible in both eyes rather than being offscreen when he's on the right side of the screen.
I dont get motion sickness / headaches from any other game system but the n64. Id never dare trying a n64 based vr.
"Or...maybe I'm a giant."
Can confirm, Lames Jambet is a giant.
6:22 me, not owning a VR headset, but a professional in autostereograms: 8)
if i could play perfect dark in VR at the age of ten i think I would have actually died of excitement.
I'm sure Kaze did this a few years ago for Nathaniel Bandy's "24 hours inside Super Mario 64". Might've not been console compatible.
Sign me up for the mass produced USB! I'll be following this progress for sure. I'd love to see this ported to use the DK2 API to try it out myself. Even without using the camera for 6DOF I think it's very similar to the DK1. Some brave souls could possibly get CV1, Vive or Indexes to work. Even Nintendo added VR to Smash Ultimate so I think it's about time Smash 64 or Remix got the same treatment on original hardware!
you can make the VR head tracking a lot better with some more competent filters than LP and some clever control theory magic,
Love the indie spotlight bit!
Life Hack: if you cross your eyes such that the two images overlap, it looks 3D just like in the headset.
Bonus hack: use this technique to quickly find the differences in these "Find all differences" pictures.
Im impressed the framerate is that good. Not bad for an old machine.
The mario shirt fold is silly.
This is so awesome! I love VR.
Is there a way to make this compatible with N64 emulators?
Would be so cool to play not only Mario 64 in VR, but games like Goldeneye and Perfect Dark.
Would probably require a hell of a lot of work to get working though.
This is so cool! So excited to see what other crazy N64 stuff you do in the future :)
Now you’re playing with motion sickness 💪
This is super cool! Now I'm curious if it's possible to do something like this with the Virtual Boy's hardware, that way it will finally be possible to actually play Virtual Reality games with the Virtual Boy :)
that is one ancient ass oculus headset
Hahaha, was just thinking you should team up with Kaze for this and then no sooner than I'd started typing had you mentioned his name.
You don't need a DK1 to see the 3D effect in the video :) just relax your eyes and use your stereo vision!
Did you look at how Mario Kart 64 does split-screen? You could even run each side of the screen as 2 players which are locked to the same controls.
But then each player would need to be invisible to the other player. And no collisions with each other, since they're standing in the same spot at all times.
you can also get a very blurry feel for what this looks like irl by pressing your phone directly up to your face lol
love me some N64 content
using the oculus dk1, wow!
This is beyond impressive. Huge props.
Showed 3 years ago 15 minutes ago. When you're this early. Hi from Romania!
n64 a powerhouse
This man, is our King, now.
6:35 or, you can watch the video cross-eyed like a madman, which is what I'm doing
apologies as I just started the vid, but interesting choice to use og rift, i suppose you dont really need spatial positioning so kudos for the clever usage of old tech. keep it up!
Would be interested to see this come to the PC port with higher resolution and frame rates this could be amazing
Can confirm BZZZZT is a fire game.
Super exciting project
if you don't have a vr headset and kinda wanna see how this looks, just cross your eyes to bring the two screens together
I love this stuff, you just went and lot, made this?? Amazing
would love to see a collab with kaze that would be sick
I don't know if the N64's fixed pipeline would allow for it to happen, but what about async reprojection? I mean that usually gets used to avoid motion sickness in vr games
Great work! Thanks for sharing the progress 😀
Here you go again doin stuff 🎉 thanks
You're so good! Love your videos of this. Wish could have you helping with VR on linux.
Have you tried optimising M64 and then adding the VR side? Someone was working on optimisations and pushed the FPS way above what it was originally on actual hardware.