Hey everyone! This is my first sponsored vid. It's kinda short but it's what I was working on when I got the email. :P It's neat to be approached by a sponsor I actually use lol anyway, here's the link and boilerplate again: czcams.com/users/premium?cc=gstchannel& Monthly paid subscription. Price per month varies. First 2 months free. Terms apply. Cancel anytime. If you subscribe through the link in this post or the banner appearing in this video, I may get a commission.
@@GSTChannelVEVOmaybe with a high-resolution video the first time round it might give some interesting results? almost sounds to me like 4D but i'm not a Physics Man (yet) so i'm not sure... do you have a link to the program that you could put in the description?
The program he's using, "Gaussian Splatting", allows the user to inspect a single frame of a video file by "rendering" it as if it were a three-dimensional environment. However, it isn't magic. Data not fully visible in the frame being inspected will either be misrepresented, missing, or in the case of larger amounts of invisible areas, blurred out violently. It's why he can look around the corner of the room almost flawlessly, but turning around or moving a lot to look at what isn't in the video anymore results in an abstract painting.
"You can't noclip into videos because it's not possible" *Repeatedly shows footage of actually doing it* There may have been some deliberately misleading phrasing there, but the whole thing barely feels like a lie.
@@Scoped211. Noclipping into mp4s and not games 2. This video has near no explanation of whats happening, though the creator of the video normally makes educational vids
Basically an algorithm tries to create a 3D scene from the still frames of the video. Like a crude 3D scan. This data is then explorable in a 3D environment.
@@borstenpinsel it's actually a pretty advanced 3D scan, I was reading about it for school last year. if you take your own photos from multiple angles or find a high-quality video to work with, you can get almost perfectly photorealistic renders in real-time from most angles of the subject. it's cool stuff
@@meILM yeah that sounds right. i was given a recommendation to drop this video at noon today (i was late lol) so i suspect some people received a wall of youtube-sponsored videos in their subscription feed today
The weird thing is that many of us can model these places in our heads, even from an extremely low quality recording. In fact, the quality may not even matter up to a certain point. This means that this concept is actually possible, just not very possible *yet*.
I think our brain is really good at making us feel like it knows the structure, but it doesn't because it's not needed, try rotating a more complex 3d model around, for example of human head, you can't predict the position of features super precisely until you see them (for example draw a dot where it should end up). But it still feels normal and good
@@madghostek3026Counterpoint: the consistency of shape and perspective in dreams, which is not spoiled by lucid dreaming. Things morph, but you can move around no problem.
I'm sorry I was expecting you to go in-depth on like what mp4 codec is and see what the files store inside behind the scenes and visualize it. I was not expecting you to GO IN FIRST FUCKING PERSON and just BEGIN FLYING AROUND. HOLY SHIT LOL
Theoretically, pulling data from a low resolution video should be possible because of the motion and extracting the data from variation in the pixel brightness
absolutely... AWESOME!! i find gaussian splatting and other new technologies awesome, and i really enjoyed how this concept of using it on real videos was executed! props to you, GST. you just earned yourself a sub :D
I'ma be 100% honest I have no clue how I got on this video I set my phone down on Instagram then all of a sudden this was playing but I'm too invested to leave so take my sub
This is what I call trickster tech. It was never designed to truly generate interactivity in video clips, it was only designed to emulate it from the outset, literally emphasizing and digitizing the "fake it until you make it" phrase. A gimmick; nothing more.
I once had a dream where i was in a park area next to a place i used to work (in real life). I suddenly fell though the floor, and was sudden carted sideways like i had landed on a fast moving conveyor belt, being able to look up and observe the land i used to occupy. I woke up suddenly after a couple of moments, as the effect left me feeling like i couldn't breath. I wish my experience of noclipping was nearly as colourful as this.
You are a total artist, you always inspired me to make videos, to upload my music, but in the end I never do more than nothing... Anyways, love your content since Early Sega Genesis Mixes
Great to see people appreciating this. I've been doing this with AGIsoft and Reality Capture for years and LumaAI's Gaussian splatting model does a great job on those cases where the data is too compressed to provide consistent data for photogrammetry.
The other day I found a video I shot with a Nokia 6300 on an old HDD. It's 176 x 144px and 60kbps (yep). We've come a LONG way. Do you know RAW (DNG) image format? You can do wonders with a phone that supports it (Galaxy S line of phones, for instance). Just load that file in Lightroom or Adobe Camera Raw and you can literally make invisible things visible. Also, it's free of post-processing that butchers regular JPGs.
I stumbled across that format when looking for a way to store images with a more-than-8-bit color depth per channel, but haven't actually used it in a camera. seems magical
@@GSTChannelVEVO It is. You can take a picture of a musician on stage in harsh blue light, remove the blue tint and make his face look like a face again. You can take a picture of a dark alley at night and make it look almost decent. There's no noise removal or edge contrast enhancement unless you add it yourself. Everything's inherently sharper. Just make sure that the phone or camera shoots in this format because not all of them do.
This completely messed with my head. It’s like that enhance scene in Blade Runner but in real life. I’m not sure if I should be scared or impressed how soon such a thing has become a reality. Edit: I should clarify what I mean by it being scary. It’s more so the fact that archived footage has been used to be turned into a 3D space. It gives it this uncanny feeling that I cannot describe. I am well aware this technology is nothing new. In fact, Lidar has been around for a long ass time. But that still doesn’t stop me from being impressed on what it’s capable of.
TBH even though I know techniques like gaussian splatting is present, I never imagined that it can technically be used to noclip through videos. Thats pretty impressive. Would be really interested in more videos like these.
Inside a JPEG artefact world someone is taking a photo of someone else “make sure to get my good side”, the good side being the very specific angle they aren’t a disjointed blur spread across a large distance
Thw video is cool but I want to point out you said "Sponsors are middlemen" and described how CZcams is the man in the middle of creators and sponsors.
... oh yeah you've got a point there. I'm not sure what the right word would be if you're cutting out the other party and going straight to the "middleman". that's not even in the middle anymore
I think the idea you might have been going for is that advertisers are in a way a middleman between viewers and creators -- viewers pay advertisers with attention, and then the advertisers pay creators in money (via CZcams, who are also a middleman in this chain). Something like that, perhaps?
@@BrooksMoses yeah that's much clearer huh 😅 youtube is still kind of a middleman in that chain, but it's where i withdraw my money, so it feels like a nice "endpoint" to me. I still think there's an elegance here but I thoroughly fumbled describing it. good thing that fumble is just between you and me and RafaelScarpa... and 83,000 viewers
The music at 4:02 is so different from what I generally hear, that it almost seems otherworldly, though I dont think thats the right word for it. Reminds me of the Vintage storys OST
So I might be off with this thought, but is this substituting the idea that a video is images over time and changing it to images over area. Stitching together the frames like how a panoramic shot works. So moving objects/people would cause blurring and other artifacts along with any issues caused by not having a stable frame of reference.
we all know this is all just some nice Gaussian Splatting! but the idea of using this technique to generate a 3d perspective from other peoples videos is just so cool and I think I thought of this idea but never really done it before also I think it should be called freecam instead of noclipping but idk
This video features either NeRFs or gaussian splatting. I recommend checking out Two Minute Papers for brief explanations. It's pretty neat stuff! The reason why things get blurry in video footage when there are people is because the people are usually walking around. It's hard to quantify what a moving object should look like when it's in a different position and place from to frame. Current techniques are really only meant for static imagery instead of video footage with people moving around.
Hey everyone! This is my first sponsored vid. It's kinda short but it's what I was working on when I got the email. :P
It's neat to be approached by a sponsor I actually use lol
anyway, here's the link and boilerplate again:
czcams.com/users/premium?cc=gstchannel&
Monthly paid subscription. Price per month varies. First 2 months free. Terms apply. Cancel anytime. If you subscribe through the link in this post or the banner appearing in this video, I may get a commission.
what would happen if you ran this video through the no-clipper??? like especially at 4:13 where it's already unrecognisable from the original image
@@saltedmutton7269 oh god that's a cool idea. i think it'd just dissolve into soup but it'd probably be fun
@@GSTChannelVEVOmaybe with a high-resolution video the first time round it might give some interesting results? almost sounds to me like 4D but i'm not a Physics Man (yet) so i'm not sure... do you have a link to the program that you could put in the description?
@@saltedmutton7269 good idea. I've added a link to the description
I got the popup! Ty
For anyone wondering this technique is called Gaussian Splatting
lol, busted.
i've been infatuated with what you can do with gaussian splatting. and even just COLMAP structure-from-motion
Thanks! I've heard of that but had no idea this is what it was in practice.
What tools do you use to do this?
@@therealquade graphdeco-inria/gaussian-splatting! nothing fancy beyond careful framing.
@@GSTChannelVEVO Hoo I have friends working at INRIA 😲
i have no idea what is happening. this must be what it feels like for old people to open a PDF
lmao
The program he's using, "Gaussian Splatting", allows the user to inspect a single frame of a video file by "rendering" it as if it were a three-dimensional environment. However, it isn't magic. Data not fully visible in the frame being inspected will either be misrepresented, missing, or in the case of larger amounts of invisible areas, blurred out violently. It's why he can look around the corner of the room almost flawlessly, but turning around or moving a lot to look at what isn't in the video anymore results in an abstract painting.
@@arthurbarbosa8204 great explanation, tysm!
This is the opposite of an educational video, where you keep trying to figure out what the fuck the creator means.
I've done so many well-researched and educational videos. I thought it was time for a change. Time to undo all of that. To uneducate the world.
"You can't noclip into videos because it's not possible"
*Repeatedly shows footage of actually doing it*
There may have been some deliberately misleading phrasing there, but the whole thing barely feels like a lie.
A deducational video?
@@GSTChannelVEVOkeeping mystery alive
@@SianaGearz video that makes you forget what you were taught, wow!
bro said "noclipping into MP4 files" and then actually did it
Brand new sentence
This video feels like it's from a parallel universe for 2 seperate reasons.
Which are? I'm curious now.
@@Scoped211. Noclipping into mp4s and not games
2. This video has near no explanation of whats happening, though the creator of the video normally makes educational vids
The irony of people WITH youtube premium sitting through a two minutes Ad about youtube premium hearing you say "you will never see ads"😂
And I never do.
🤔
sponsorblock + ublock origin is the real youtube premium
@@JB52520 wowe u passed out from 2:00 to 3:20
sponsorblock?
yeah that occurred to me, lol
I tried to clearly mark where to skip to, and failing that, sponsorblock works wonders ;)
This explains surprisingly little despite the fact that almost every spoken line seems to be framed as if it were an explanation, kinda impressive.
Basically an algorithm tries to create a 3D scene from the still frames of the video. Like a crude 3D scan. This data is then explorable in a 3D environment.
@@borstenpinsel it's actually a pretty advanced 3D scan, I was reading about it for school last year. if you take your own photos from multiple angles or find a high-quality video to work with, you can get almost perfectly photorealistic renders in real-time from most angles of the subject. it's cool stuff
This video is Palworld and I'm Nintendo standing at the edge of the line with my legal team.
Jk
ruh roh :D
They're always just there a few thousand units away from everything else, waiting to be teleported in when someone hits the Shigeru trigger
“This video is Palworld and I’m Nintendo edging the line with my legal team”
So you are standing at the edge of a *_boundary?_*
@@GSTChannelVEVO spirits?
Gaussian splatting reminds me of those art displays using random trash and detritus to create an image when viewed from the right angle.
a lot of neon feathers and pipe cleaners!
I love the premise and dead pan delivery, this a comedically genius application for the technology lmao
oh man, calling this noclipping and implying that you could find stuff out of bounds was really getting my goat.
seems this is just a gag though.
hehe, yeah. I might have a strange idea about what constitutes a "joke". sorry about your goat. :P
unfortunately theres only shitty unprotected ram out of bounds, so you couldnt get your goat even if you could noclip.
@@generallyunimportant ranching simulator game but the animals are rogue AIs, and if you die in jpeg you die irl swordartonline style
Gaussian Splatting renders are just braindances from Cyberpunk but right now
exactly what i was thinking
Not to mix up with the rapper gaussian that is also a mathematican who does gaussian spitting
I was literally about to make a comment about how this looks a lot like braindances, but it seems like you beat me to it.
Huh, never thought CZcams would sponsor a video.
They seem to be sponsoring a whole bunch of medium sized CZcamsrs all of the sudden.
@@meILM yeah that sounds right. i was given a recommendation to drop this video at noon today (i was late lol) so i suspect some people received a wall of youtube-sponsored videos in their subscription feed today
It's a better approach to shifting people to premium than what they've _been_ doing...
I only saw 2 youtubers ever get sponsored by CZcams: Hunter R. and him.
I got recommended this video instead of sponsored
The math going on to make this work is so far beyond my comprehension it might as well be magic.
The weird thing is that many of us can model these places in our heads, even from an extremely low quality recording. In fact, the quality may not even matter up to a certain point. This means that this concept is actually possible, just not very possible *yet*.
I think our brain is really good at making us feel like it knows the structure, but it doesn't because it's not needed, try rotating a more complex 3d model around, for example of human head, you can't predict the position of features super precisely until you see them (for example draw a dot where it should end up). But it still feels normal and good
But that would mean advancing AI and that could lead to dangerous consequences.
@@madghostek3026Counterpoint: the consistency of shape and perspective in dreams, which is not spoiled by lucid dreaming. Things morph, but you can move around no problem.
@@TheBcoolGuyHow reliable is your source of information? Yeah, not at all.
@@Quitobito we're talking about theoretical things wtf did you expect
would be cool to do this with movies, like that intro city shot in blade runner
it's technically possible, but the results are quite finnicky. at glance, I'm not sure it'd look very good in that particular case.
I'm sorry I was expecting you to go in-depth on like what mp4 codec is and see what the files store inside behind the scenes and visualize it. I was not expecting you to GO IN FIRST FUCKING PERSON and just BEGIN FLYING AROUND. HOLY SHIT LOL
I thought this was gonna be a shitpost at first, but it turned out to be a super cool look into gaussian splatting. S-tier Boundary Break parody.
title: "noclipping into mp4s"
me: oh like, de-compiling mp4s to figure out how they work
CTS: *starts noclipping through mp4s*
heh, welcome back to boundary bre- how in the hell
this was one of my favourite gameplay elements in cyberpunk 2077
Theoretically, pulling data from a low resolution video should be possible because of the motion and extracting the data from variation in the pixel brightness
I've heard of this but I've never actually worked with it 🤔
The sponsor popup looks so alien, I've never seen a CZcams video sponsored by CZcams wild
God its like a glitched out braindance, great stuff
0:54 *Entire world collapses as the still image turns into a video and my tiny babbie brain can't comprehend this magic*
It seems obvious in hindsight, but I had no idea you were a wizard.
absolutely... AWESOME!! i find gaussian splatting and other new technologies awesome, and i really enjoyed how this concept of using it on real videos was executed! props to you, GST. you just earned yourself a sub :D
Its like watching those super long fractle videos that just keep diving deeper into something
CZcams's first industry plant?!
4:04 POV: Posy's close ups
posy fan alert
POSY MENTIONEDDDD 🔥🔥🔥🔥
this genuinely feels like magic wtf
haha for whatever reason i tought you were gonna literally noclip the camera into the video like if it were a 2D plane. Great stuff
This is probably how it would feel like for a 4th dimensional being to visit our 3rd dimension universe
Using Gaussian Splats to explore into videos as a “no clip” is brilliant. 🤯
Now I'm thinking how to noclip a mp3
I'ma be 100% honest I have no clue how I got on this video I set my phone down on Instagram then all of a sudden this was playing but I'm too invested to leave so take my sub
welcome! this is pretty unlike any of my other videos, except in chill vibe. so... beware? :P
Bro noclipped into your phone
@@GSTChannelVEVO I'll be sure to check those other vids out then!
4:04 loooooove how the pixels almost shimmer
This is what I call trickster tech. It was never designed to truly generate interactivity in video clips, it was only designed to emulate it from the outset, literally emphasizing and digitizing the "fake it until you make it" phrase.
A gimmick; nothing more.
What kind of trickery is this
4:08 breakcore album art
Fantastic concept for one of these -most people have no idea this is possible
Cheers ^^
I once had a dream where i was in a park area next to a place i used to work (in real life).
I suddenly fell though the floor, and was sudden carted sideways like i had landed on a fast moving conveyor belt, being able to look up and observe the land i used to occupy.
I woke up suddenly after a couple of moments, as the effect left me feeling like i couldn't breath.
I wish my experience of noclipping was nearly as colourful as this.
really took crawling through the screen literally
it's the first time I've seen somebody actually get sponsored by CZcams.. interesting
This is incredible holy
This is like Cyberpunk all over again! 😭
This reminds me a lot of cyberpunk 2077's braindance editing environment
This is like braindances on Cyberpunk
You are a total artist, you always inspired me to make videos, to upload my music, but in the end I never do more than nothing... Anyways, love your content since Early Sega Genesis Mixes
Reminds me of the "enhance" scene in Bladerunner where Deckard is peering around corners in a photograph.
Great to see people appreciating this. I've been doing this with AGIsoft and Reality Capture for years and LumaAI's Gaussian splatting model does a great job on those cases where the data is too compressed to provide consistent data for photogrammetry.
The other day I found a video I shot with a Nokia 6300 on an old HDD. It's 176 x 144px and 60kbps (yep). We've come a LONG way.
Do you know RAW (DNG) image format? You can do wonders with a phone that supports it (Galaxy S line of phones, for instance). Just load that file in Lightroom or Adobe Camera Raw and you can literally make invisible things visible. Also, it's free of post-processing that butchers regular JPGs.
I stumbled across that format when looking for a way to store images with a more-than-8-bit color depth per channel, but haven't actually used it in a camera. seems magical
@@GSTChannelVEVO It is. You can take a picture of a musician on stage in harsh blue light, remove the blue tint and make his face look like a face again.
You can take a picture of a dark alley at night and make it look almost decent. There's no noise removal or edge contrast enhancement unless you add it yourself. Everything's inherently sharper.
Just make sure that the phone or camera shoots in this format because not all of them do.
This completely messed with my head. It’s like that enhance scene in Blade Runner but in real life. I’m not sure if I should be scared or impressed how soon such a thing has become a reality.
Edit: I should clarify what I mean by it being scary. It’s more so the fact that archived footage has been used to be turned into a 3D space. It gives it this uncanny feeling that I cannot describe. I am well aware this technology is nothing new. In fact, Lidar has been around for a long ass time. But that still doesn’t stop me from being impressed on what it’s capable of.
It doesn't show any data that you don't already have, so it's not truly magic or scary, but it's still really cool imo!
Now I REALLY want some kind of game where you can scroll through and explore someone else's memories in this sort of style
4:06 bro entered a Galaxy
TBH even though I know techniques like gaussian splatting is present, I never imagined that it can technically be used to noclip through videos. Thats pretty impressive. Would be really interested in more videos like these.
Like a Hermetic treatise, this video has much to say in the depths of its poetry which isn't immediately obvious on the surface of its prose.
this is what combing through peoples memories will be like
Gaussian splatting is so cool, I wish there was more stuff that used it
It's actually crazy that we live in a time where noclipping videos is possible soon it will be reality itself
Okay, this is pretty cool use for nerfs
the internet never fails to amaze me
Didn't know what to expect from the title, but I got a beautiful and interesting video.
woah thats absolutely sick!
This is actually mad impressive. Wow.
There's new research coming out like WildGaussians, SpotlessSplats, etc which are more robust to people in the scenes
ough that's cool. i haven't really been keeping up but i love to see it
Gaussian Splatting is so fun to mess with
That one SCP article about the anomalous DVD of "The Sopranos"
open source Gaussian splatting generator? NIIIIIICEEE
VR + this = u are inside of a mp4
we got cyberpunk braindancing before gta 6
can't wait for desinc to copy this
This feels like something out of cyberpunk
it feels like this video isn’t real, as if to understand what is happening you need context that never existed in this world
This video is crazy but even the CZcams sponsor?? What? 😭
I love how this looks, this is such a neat use for gaussean splatting.
gaussian splatting is like the RTX of lidar scanning
Inside a JPEG artefact world someone is taking a photo of someone else “make sure to get my good side”, the good side being the very specific angle they aren’t a disjointed blur spread across a large distance
im not high enough for this
Thw video is cool but I want to point out you said "Sponsors are middlemen" and described how CZcams is the man in the middle of creators and sponsors.
... oh yeah you've got a point there. I'm not sure what the right word would be if you're cutting out the other party and going straight to the "middleman". that's not even in the middle anymore
I think the idea you might have been going for is that advertisers are in a way a middleman between viewers and creators -- viewers pay advertisers with attention, and then the advertisers pay creators in money (via CZcams, who are also a middleman in this chain). Something like that, perhaps?
@@BrooksMoses yeah that's much clearer huh 😅
youtube is still kind of a middleman in that chain, but it's where i withdraw my money, so it feels like a nice "endpoint" to me.
I still think there's an elegance here but I thoroughly fumbled describing it.
good thing that fumble is just between you and me and RafaelScarpa... and 83,000 viewers
The music at 4:02 is so different from what I generally hear, that it almost seems otherworldly, though I dont think thats the right word for it. Reminds me of the Vintage storys OST
oh man such a dope idea
So I might be off with this thought, but is this substituting the idea that a video is images over time and changing it to images over area. Stitching together the frames like how a panoramic shot works. So moving objects/people would cause blurring and other artifacts along with any issues caused by not having a stable frame of reference.
you reminded me of the cool old clip called CHOP CUP with parallax perspective illusions. very cool stuff with mp4!
this video scares me. deeply.
Love how i (think i) know how you did this!! Gives me a feeling of superiority 😁
thats not good
Isn't this black-box stuff???
@@quantumblauthor7300 What do you mean by black-box? The software to do this is freely available
this is amazing
Impressive tech!
Woah, sorcery. Cool.
I learned about paid promotions unexpectedly
this is the first time ive seen a youtube sponsor lol
oh dude i remember seeing this from corridor crew! thank god for the guy in the comments reminding us that it's gaussian splatting
we all know this is all just some nice Gaussian Splatting! but the idea of using this technique to generate a 3d perspective from other peoples videos is just so cool and I think I thought of this idea but never really done it before
also I think it should be called freecam instead of noclipping but idk
How does one get sponsored by CZcams ITSELF
This video features either NeRFs or gaussian splatting.
I recommend checking out Two Minute Papers for brief explanations. It's pretty neat stuff!
The reason why things get blurry in video footage when there are people is because the people are usually walking around. It's hard to quantify what a moving object should look like when it's in a different position and place from to frame. Current techniques are really only meant for static imagery instead of video footage with people moving around.
This is what it's like to be a BD editor, isn't it?
its like a beta version of braindance from cyberpunk
Gaussian splatting!
scrumptious
Did you just pull a "zoom and enhance" on us? Yo this isn't Bladerunner man!