In Theory: Can 4K DLSS Really Work On Next-Gen Switch Pro?
Vložit
- čas přidán 30. 05. 2024
- A next generation Switch is in development and Nvidia DLSS upscaling is widely tipped to become a part of the spec, radically improving visuals for docked play. But the question is this: can mobile silicon handle DLSS? What kind of impact to performance would it have? And can mobile 720p graphics upscaled to 4K actually look decent on a living room display? Alex Battaglia investigates.
Join the DF Patreon for pristine video downloads, behind the scenes content, early access to DF Retro, early access to DF Direct Weekly and much, much more: bit.ly/3jEGjvx
Subscribe for more Digital Foundry: bit.ly/DFSubscribe
Want some DF-branded tee-shirts, mugs, hoodies or pullovers? Check out our store: bit.ly/2BqRTt0 - Hry
This was a really cool thought experiment. I didn't realize how dramatic the image improvement from DLSS could be even from 720p internal.
I think enabling DLSS on PC at 1080p upscales from 720p internally. It looks pretty good and I keep it on for games that support it
@@arthurb5194 on balanced mode I think it's 720p
Performance is probably closer to 540p
@@pyramidschemer4083 Yeah Performance mode tends to look a bit iffy when I tried it in Control and the Back 4 Blood demo, at 1080p. Still, it's an amazing piece of tech and I hope AMD does an AI upscaler in the future too.
Most people don't seem to. When I say it's the future of gaming, the PC cucks always take offense. How dare I doubt native resolution.
@@arthurb5194 performance mode is for 4K, I wouldn’t go lower than quality mode for 1080p if you even neee dlss for 1080p
Videos like these are my favorite on DF! Such a cool experiment. DLSS is such an awesome technology! Really good job on the video and script.
True. I couldn't care less about raytracing, but DLSS is a fantastic technology.
14:26 The DLSS is so effective that I can clearly see the text on the car saying "Аварийная". I don't know how it resolves this from the 720p source. Mind-blowing actually. And instant game changer.
Taking information from other frames basically.
The trick is its actually resolving it from a 1440p source spread out over the past 4 frames. Basically every frame the 720p source is offset by half a pixel which allows it to sample different data even when the camera is really static. By doing this over 4 frames you get 4 unique 720p frames with different data, then with some AI upscaling you get that amazing result. (Note, this is a very simplified explanation of whats going on, but the gist of it is correct)
@@SirDragonClaw hmm, sounds like a checkerboarding.
@@SirDragonClaw Thanks! I was wondering the same, where did it get that extra info! The Doom eternal cutscene example was what triggered my curiosity, you can clearly see stars that basically aren't there in 720p. Again, tbanks for that eli5!
@@maratnugmanov The old checkerboarding doesn't keep as much temporal data. It also goes through a pass of AI inference, but I'm not that convinced that it adds a lot in detail and is more used to get rid of temporal artefacts that they couldn't resolve with a motion vector map.
The comparison of native 720p upscaled vs. 720p DLSS upscaled is absolutely mindblowing. Thanks for showing that so well.
Making games look good on a potato is the future of gaming and helps nature and our future too.
In a sense. ARM is just not very well-equipped for gaming in it's current state, our current optimization on x86 is aggressively optimized for SIMD operations and lookup tables, both of which are ARM's weakest point.
@Russell White Having a good gold efficiency power supply helps a ton too cause it waste far less power while still putting out the amount you need.
@@dial2616 The shift to more aggressive multi-threading in next-gen might help with Intel shifting to big-little architecture, which is something ARM has had for a while. Having that in common will make port optimization just a little bit easier for ARM.
Virtual Reality desperately need it
Beware that this is the reasoning that gave birth to the PS4 and Xbox One, 2 system with a CPU so underpowered that effectively hindered game development (or at least shaped it not in a good direction: flashy graphics but little interaction).
DLSS is so impressive. I can't wait to upgrade from my 1080ti...eventually.
Worth it. When you get the chance go for it.
Also, scary profile pic...
Can't wait to one day upgrade to a 1080ti 🤤
@@brunomiiguel can't wait to one day want to say that I can't wait to upgrade to a 1080ti
Its good but it depends on the game. I feel like problem with PC right now is actual good games.
I’m waiting for RDNA3 and Zen 4
we need an updated video about Switc 2 and Nvidia Tegra T239
btw, great job! I still dream to be with you guys, nerding about tech specs in your studio
I dont need 4k, all i want is games to run at a stable 60fps
Yup. A solid, locked 60fps is my only requirement for gaming.
Yeah even the latest and best Mobile chips struggle to run games at 60fps. Its just not that viable right now. Just accept 30.
@@perfectlyslicedegg3348 Like what exactly?
@@minecraftpvp8040 The Steam Deck.
All I need is 4K at 120 fps
Great video that explains the qualities of DLSS and differences between different modes and how they compare to each other and native res! Before seeing this I thought that they had to target a native 1080p for DLSS to really work properly, but now I would love a 4K 30fps / 1440p 60fps DLSS Ultra Performance Mode Switch 2! If they can target a 720p pixel count and do as much with those pixels as possible it makes more sense than targeting 1080p but sacrificing the rendering, lighting, etc.
4K 30fps? 🤮 ...Each to their own.
@@gogreengameon2146 so like all PS5 and Xbox games in quality mode
@@carlosfer2201 yeah.....🤮
The switch 2 won't have any difficulty getting 4k 60fps games with dlss.
lowest expectation of a next gen switch: Tegra xavier NX
highest expectation: Tegra ampere built on 8nm with DLSS.
Sucks but nintendo is probably gonna destroy even my low expectations
classic Nintendo
Well next generation Switch, that means at least in 2022/2023, using Xavier wouldn't make any sense. Orin will already be a few years old, exactly like how the X1 was 2 years old when the OG Switch released. And they released it in a hurry to get sales to improve. This time they will do it better. Much better ? Who knows. But better.
Man i wish for the latter.
Nintendo will spend as little money on r&d as possible and make something that is just good enough.
@@trixniisama Nintendo always goes with the cheapest solution: GameBoy/GameGear, DS/PSP, 3DS/Vita -> Switch2/Steamdeck.
Really enjoyed this one, if anything it was as useful as a video on the benefits of DLSS as anything else. It's great listening to Alex talk about this and ray tracing
I'd really rather dlss be used to leave 30fps in the past, evening it's not at native 4k, the temporal image you see at a higher frame rate will be much cleaner than having native 4k but a juttery camera
1080p 60fps would be enough for me at that screensize
I find 30 year old 16-bit snes graphics at 60fps more appealing than compromised, upscaled low-framerate modern titles.
@@jannclaudebinoya but some people do play switch in docked mode on a 4k-tv.
for handheld imho 720p is still good enough at that screen size, it's just .. switch player don't actually know what 720p looks like, because almost every 3d game renders at a lower resolution, making the image look blurray and kind a mess (e.g. xenoblade 2).
60fps requires the CPU grunt to be there as well though, which DLSS cannot help out with. Assuming an NVIDIA Tegra SoC is used, the Switch 2/Pro/Super/whatever will be using an Arm processor, which is unlikely to drive more complex game logic at above 30 fps.
@@jannclaudebinoya I think they’re going to stick with 720p in handheld mode, just for power consumption purposes, so high frame rates shouldn’t be difficult. They’ll let it draw more power to reconstruct to higher resolutions in docked mode.
such a great video! I think 1440p DLSS would be a perfect sweet spot
And 60fps
720p internal + handheld resolution; 1440p docked (with DLSS) resolution, all at 60fps, seems most reasonable.
A lot of 3rd party games run at 540p handheld so 720p is still a big upgrade from the better hardware.
even first party games dip under 540p in some situation.
would be nice to see dlss in nintendos hardware. but like always nintendo cooks its own soup. and we will never see dlss -.-
I dont think dlss works that way. The image quality would still be better with 720p to 4k ultraperformance than upscaling it to just 1440p. Havent tested it tho and it wouldnsurely help with frametime.
@@phunkstar7347 The only ones that come to mind are the Xenoblade games and Yoshi's Crafted World. For the most they're usually either native or keep a native res most of the time with small res drops at times.
I was thinking this when Alex talked about not using DLSS in docked. I think it will need to. Even in handheld you really notice it dropping to 540p. Personally I would DLSS up to 720p in handheld. It'll make ports like The Witcher 3 much more compelling on Switch, especially if the upscale in docked is so good that people don't notice the difference with the Xbox Series X version (apart from the framerate, obviously)
I theoretically loved hearing about what the future may hold. Possibly leaving a like.
Really love the comparison of dlss at different framerates. Always wondered how temporal techniques scale with framerate.
This is a brilliant video, solid research and presentation.Great job Alex.
I wish DF would revisit this in light of the Nvidia leak of the T239 to be used in switch 2. Napkin math on that is 1536 cores between 768mhz and 1 Ghz = 2.4 - 3.0 Tflops and 150 tops!!! It also means that his experiment with 110 tops taking 1.9 ms to upscale 1080p to 4k would only take 1.4 ms with 150.
The real question is the power and heat though. T239 is a scaled back version of the T234 @ 45 watts. How many watts would they save by scaling back GPU from 2048 to 1536, clock from 1 Ghz to 768 MHz, CPU cores from 12 to 8, and memory from 32 gb to 16 gb? Does it cut wattage in half? Would that even be enough? And/Or is this T239 the same as the Orin S-1 camera chip with just 36 tops and 15 watts?
Beware of the performance/consumption scaling. Those are far from linear so the predicted TOPS of a 10w solution can be very far from the 20TOPS estimated. It could be as high as 30-40TOPS which would greatly change your cost estimates (if looking at Orin which has a different topology so it makes it a bit hard to do an apples to apples comparison).
DLSS is awesome. It blows my mind a lot of people compare it to FSR and say it looks the same, while in reality they are on a whole different level.
They're still doing that to this day its crazy how oblivious fanboys are.
Interesting stuff.
Do you think Nvidia might develop a custom version of this chip with more tensor cores that will only be activated in docked mode? This could dramatically improve DLSS performance without impacting battery life since these cores would only be used when upscaling to 4K is needed. If this is possible that would open the door to 4K upscaling with 60 fps in docked mode.
I wonder if Nvidia could find a way to make two of them work in tandem, so you would have one in the Switch giving you 720p/60 handheld, and then docked you'd have a second GPU to handle the DLSS and output. It would need some substantial cooling either way
@@coleG112 I guess this is theoretically possible but would be a very costly solution since it would require two chips and a high speed bus to connect the two. And the development cost on top of that.
@@rajackar Not to mention the additional space required in an already fairly slim package. That's going to be a lot more bulky.
@@rajackar for sure. But it also would be an optional thing that all Switch users would benefit from, regardless of model. But I doubt they could pull that off effectively with the current chip. Maybe it’d be something they can plan on for the “Switch 2 Dock Pro” lmao
Nice thought!
Great video! I’m surprised how good 720p looked reconstructed thru dlss! I absolutely love how good this tech is and I hope & pray Nintendo implements this at some level for the next switch, ESPECIALLY with a chip like Orin being used. We would be so lucky…
As the old axiom goes "A burnt child dreads the fire...". Every time we look at the possibilities of what Nintendo can choose we get excited. Nintendo usually goes much more conservative and disappoints us. Then they make a bunch of awesome games and we forgive them again. It's a vicious circle. :-)
Nvidia CEO Jensen Huang is a very ambitious man though. He could pull it off, upselling both his team and Nintendo “to stick it up” to Steam Deck, Series S and ultimately AMD. But can he do it really, though? Maybe someone should send him the link to Alex analysis here ;P
They never do what the fans want and it's annoying af
Exactly. Before people get excited they must remember this is Nintendo we are talking about. They just gave us a freak LAN port ffs... in 2021!!!
I'm sure DLSS is a major priority for them lol
Imagine a new wave racer with ps5 performance behind it :(. A man can dream....
Not really. Before Wii, that wasn't totally true of their consoles, and after Wii, it was more of odd and surprising hardware choices. Hell, I personally didn't peg them to go with an Nvidia solution at all with the Switch and I didn't expect the Switch concept as well, nor was I expecting 3D gimmick of 3DS. It also kinda depends on their 'gimmick' for their next console, since it may not be a straight up 'Switch 2'.
6:15 "assuming a linear scaling factor" This is what I've been curious about. How much of the DLSS time is used motion predicting, and how much is actual inference? Maybe only half, or 1 millisecond not the whole 1.9 is based on inference.
yeah that's a big assumption considering the rest of the analysis is based on it, I would have liked more depth here
It's practically all 1.9ms, what else would that additional time be using besides DLSS?
I don't think breaking down DLSS matters for his point. He was just saying if it takes 1.9ms to do something given 110TOPS (and similar architecture) then how long does it take if you only have 20TOPS? His assumption assumes basically IDENTICAL architecture hence the linear scaling. If you compared a GPU at 100% frequency then compared at 20% frequency you should get 5x difference in TIME to process.
He only did this to estimate how long DLSS would take to do the same task with less processing power to see if 60FPS is even feasible for certain types of games. You don't need to break down what's going on with DLSS any further.
(I'm not sure how easy it would be to break down "motion predicting" vs "inference" as it's all kind of tied together and is going to vary greatly depending on what's going on in the scene at a given time. Which is why, as he said, the best-case for DLSS is a static image. In that case there's NO motion prediction obviously so in a sense the DLSS "time budget" can be spent just making a static image look better without wasting time doing other calculations like getting rid of motion artifacts.)
@@TheGoncas2 The temporal information. Motion vectors that can be done on any GPU.
@@photonboy999 I would think you still need to do motion vectors even if the camera is not moving. You don't know if a vector is 0 unless you calculate it first. You can't just rely on the camera movement and tell it to skip the temporal part if the camera is still, because thousands of other things in the screen could be moving. The still image at 12:28 still has motion. The character breathes, and the background is moving.
In addition to that XeSS works the same was as DLSS. It implements "Jitter" It moves the image on purpose to causing every frame to have motion vectors. It needs motion vectors in order to produce usable results. It hates 0 vectors.
The best speculation in the business.
I would have loved to test the TOPS performance by testing the dlss performance between multiple cards and see how performance scaled rather than assume linearly
Awesome video Alex! Very informative and entertaining. I can still remember how impressed I was with your Control DLSS video, where you used 540p DLSS upscaled to 1080p. Truly next gen tech!
Very cool video. You have a great ability for taking very technical subjects & explaining them so they are very easy to understand.
The tens of millions of Switch2's they'll sell is reason enough to make a custom variant of Orin or its successor with extra tensor cores. If they're only active while the rest of the silicon is dark, the power should be fine.
yes if weve learned anything from the past gen by looking at switch's sales is that the audience is really picky about how they look and perform /s
Or alternatively they could create custom DLSS for Orin instead, which would be significantly cheaper. They can take advantage of the fact that we know screen size for Switch Pro and it will always stay same.
@@vishxification0
Better hardware = More expansive games = More customers
@@vishxification0 Releasing better hardware is not appealing graphics to their consumers, it's about getting 3rd party devs to manufacture for their platform.
@@ZK-ff2ru im not sure thats how it works. at all.
Even temporal reconstruction methods are getting really close, Controls default reconstruction without DLSS gave me good results when running at 1008p on a 1440p screen.
This is another excellent video! I'm loving these videos showing off DLSS and the newer video game rendering techniques
This was a fantastic video! Thank you Alex!
Framerate is most important to me. So yeah, if they'd allow DLSS in performance mode, I'd definitely pick that.
The Switch running games at 720p with locked 30fps would already be a step up.
Tell that the Software Developers.
9:34 I felt that "into", ha. Great breakdown as always of complex scenarios. Interesting to see if this all comes to pass.
This DLSS breakdown at lower resolutions is amazing; love the DF support for Switch :)
I'd like to see Star Fox in 8k lol, since its basically just monocolored wireframes it should be easy enough
It has been done with bsnes HD allready 👍
Frankly speaking, a native 720p upscaled to 1440p with DLSS would already be great
dlss reconstructs the image, it doesn't upscale. Also the switch 2 will run 10th gen games in 1080p easily while dlss will convert it to 4k.
An extremely interesting video, I loved the meticulous approach to approximating the ideas with real-world examples. Great job! 👏🏻👏🏻💪🏻💪🏻
I love you, Digital Foundry. I am always happy when I see your videos in my feed.
It would be interesting to use this approach to get really modern graphics on the 720p small screen from a very low internal resolution. I wonder what's the resolution required to reconstruct a really good 720p image.
Oh wow yeah. I wonder could you double the battery life of a switch in handheld. But I have a feeling the lower the starting resolution the more this technique breaks down as there is so little detail in lower resolutions.
"I turned off motion blur on purpose"
Like a normal, sane, person with good vision would.
I wish we'd push more for more options on consoles. Like NOT having upscaling.
Take Vita in particular, many games run at sub-native resolutions, and many of them can be hacked to run at the native resolution with "over"clocking (compared the standard clockspeed, since it's just pushing Vita to it's rated clockspeed) and the VitaGrafx plugin make them run smoothly. That should have been an option left up to us. Maybe we're fine with sacrificing battery life for higher quality visuals. That especially should have been an option when Vita is plugged in, which would have helped VitaTV more.
The Halo games on 360 looked terrible cause of the upscaling. I would have liked an option to run at the internal resolution with a black frame around it. It would have been smaller, but it wouldn't have been a blurry mess.
I want less upscaling. Less interpolation.
speak for yourself, weirdo.
who tf wants to play on 65+ inch tv while only really getting 38 inch's with the rest being black bars?
@@Hello-ig1px me, if it'd be blurry as hell like Halo 3 was
@@NeoTechni
Uhh well how about you use a smaller screen then?
You will get the same results, go play your games on a 16 inch monitor.
@@Hello-ig1px Getting more options to finetune games is fine by me. In many games I'd rather trade image fidelity for better framerates, or even push the console higher, back to its SoC's rated clocks. The thing about systems like the Switch is that they're actually underclocked in their stock factory configuration, to get the battery to last longer. I would've liked to have been given a beefier battery that allowed me the choice to push it back to its rated clocks and remove the stock underclock in the system, because while the SoC is rated for it and remains stable, they decided to use a battery that isn't rated for the greater power draw of the SoC running at its full strength, and can suffer permanent degradation under sustained use with the stock underclocking disabled. And that really sucks, because it locks people like me who have the know-how to perform this kind of tweaking to only using the system at its fullest when it's docked.
@@Hello-ig1px I shouldn't have to buy new hardware to get things software can do. And I'm not alone in this as there's a plugin for Vita (sharpscale) that does this
Wonderful video, Alex, as usual! Thanks
Fantastic video Alex. Thank you !
I don't need 4k I just need decent 1080p at more than 15fps 😢
What graphics card have you got that the performance is so bad
I'd love to see Nintendo design a dock that significantly increases the cooling performance of the next Nintendo Switch. Something that would allow them to push the SOC to at least 20watts, if not more, would definitely be possible and could provide a pretty big performance increase as well.
At the expense of battery life. There is always a compromise and price to pay. You have to cut corners somewhere to make it affordable for consumers
@@Hybredno. Not really. Having a dock with enhanced cooling that enables a higher power limit when docked would have no impact on the battery life since it would be getting power through the dock. Just make the dock have a USB-C connection to the Switch and 20W Power delivery would be super easy. Battery life is a complete non-factor in this scenario
@@Hybred So nintendo could increase battery. 200$ phones have 5000mah batteries. Most phones much smaller and thinner than the switch have 2 batteries(for fast charging at 50+w) totalling upto at least 4500mah capacity. The switch could at least hold a 6000mah battery. But Nintendo won't do shit.
@@santhoshsridhar5887 I'd rather have more efficiency than a bigger battery. The bigger the battery, the more the device will weigh. The Switch is already borderline too heavy for a handheld device for long play sessions. The Switch 2 should not become heavier.
Real cool and unique video, man. Good stuff
Excellent work, Alex. At first i thought this Video has to be made by rich, but honestly i couldnt think of a way he could have done better than you did. You are such a great addition to DF. You are raising its value. Einfach erstklassig!:-)
Man DLSS is awesome imagine gaming at 12k with only the cost of running 4k. And it just keeps getting better since the tensor cores can be improved and the DLSS process itself.
Are they selling 50-feet screen yet? :P
Yup. Loving this tech
Why would you need to go beyond 8k?
Tech is amazing, but I find it hard to see the uses of gaming at 12k resolution. Only thing that would make sense at that res would be VR... Even then I think 8k should suffice.
@@Neilos-sd6ti I also don't see the point.
I really hope Nintendo takes advantage of DLSS. Imagine Breath of the Wild or Monster Hunter Rise with it.
You'll just have to buy them once again for a new system ofcourse.
You don’t have to imagine. Emulators are scaling the image to 4k already.
@@Sly2Cooper most nintendo consoles are backward compatible by 1 or 2 generations. wii was backward compatible with gamecube. wii u backward compatible with wii. game cube backwards compatible. 3ds as well. it's likely switch 2 will be too.
There's way better looking games not sure why u would choose those 2 as examples lol
@@bern9642 and none of them do not enhance any game from previous gen in BC mode. Because how else will they sell you new version of their past-gen title for $60 once again?
Awesome video! Thanks Alex!
Time to update the analysis for DLSS 3.0
amazing video, I hope this will be true in Switch 2
The good news about the Switch 2 is, the longer they wait to upgrade the hardware, newer architectures become available to them. I want to see a Lovelace switch.
Imagine being Sony or Microsoft if a new portable console with a great library can legitimately run at 4K :P Like suddenly fighting for the same market shares...
Especially since exclusives like Returnal could only run at 1080p anyway...
You can run games at 4K but they'll be basic games with blurry textures and extremely simplistic lighting. It's not the same as true next gen games on real consoles.
Handhelds & home consoles are still 2 different markets. It's not 4K alone that makes that difference.
They wouldn't have pokemon, and assuming nintendo secured exclusivity again, monster hunter. And a dedicated portable system can't really succeed without at least one of those games.
I get they still wouldn't have the gpu/cpu/ram/power to use modern lighting simulation, particules, name it. but still a hell of a shortcut where the other AMD based consoles are a little stuck, arguably wasting ressources on resolution still
Fantastic episode!
DF is that rarity in a CZcams channel. Full of substance with style.
also great video, i love how alex breaks down the logic of technologies and lets you draw your own conclusions, while also providing his own personal thoughts
That was super cool Alex, I didn't realize Nvidia already had a Tegra chip capable of DLSS, but this makes me a lot more excited for a potential Switch 2, if Nintendo is willing to go the extra Mile.
Will Intel's XeSS on the Horizon, I hope AMD also has a temporal solution outside of TSR in the works.
I was so fond of theory crafting the potential performance of switch 2 for so long. But then the years went by. The console passed its 4th year on the market, and I sort of burned out on all the self hyping and imagining the possibilities. This video is the purest form of hype for me. The thing I love imagining. I love this type of content.
Its also stroking my ego a litte, that we are on the same page about sticking to 720p, and working with that image.
As the years went on, I started playing switch less and less in handheld mode, because I had nowhere to leave the house. So that makes me the more excited to see some 1st party titles in extra great quality on my big screen. While sub 1080p is fineeee, I do really really wish games could hit that native resolution goal at 1080p. I'm still dragging my feet on a 4k panel
At 5:00 there is a typo where the text says naïve instead of native. Great video!
DLSS is transformative for the entire industry, Nvidia deserves a prize for this the amount of savings in energy is huge!! I hope the intel tech is good as this.
Alex, if you read this, where'd you get that awesome looking battle scar? Much love,
He once had some bugs during his depth prepass. and since then, it is there.
He once got in a fight with a guy saying RT is just about puddle reflections and nothing more.
He fought the youtube algorithm after his upload notification was not instant
@@dampflokfreund ahahahahaha
Brilliant thought experiment ! Well done and thank you.
What a fantastic video. Explained perfectly and made superbly. Hats off Alex
This is exactly what I want to be in the next Switch. Thanks Alex for spending time tinkering with idea!
2:37 doesn't TOPS mean tera operations per second? 200 operations per second would not be impressive :D
Yes, It is Trillion Operations Per Second (TOPS).
I would imagine the Switch 2's dock would house more tech to boost performance in docked mode.
Fascinating stuff as always!
This video seems oddly relevant now
Is Nintendo more likely to pick a down-clocked Orin (Xavier performance) or the Exynos 2200 (mRDNA)?
They aren't going to ditch Nvidia after having such a successful product. Would make sense for backwards compatibility too. Nvidia wouldn't want AMD to have every console either.
@@_TheElMan True that. I also wonder if another ARM OEM like Qualcomm, Google, or Mediatek would partner with Intel Xe graphics (or Nvidia RTX) once the new Intel and TSMC foundry fabs come online in the US around 2023.
@@handlemonium Intel could have their own SOC. Remember they have their own GPUs out soon
Well done Alex, great stuff as always.
I wholly agree. I think a revamped cooling system in the dock, with a 720p embedded screen with 720-to-4K DLSS in docked mode would be gold.
The Switch could have a hinged grill on the bottom that leads to the fan, and a phone-sized copper vapor chamber mounted on the dock could slot up into it? So it would look almost identical to the current vent setup in handheld mode, except the grill would be able to flip up to allow for a cooling pad to slide into the grill. Idk.
The most interesting thing about DLSS for me, in terms of a switch pro, is that It would most likely be possible to apply it system wide, meaning that the developers wouldn't need to create a patch in order to improve the graphics of their games on the new system.
yeah, the fact that it would hardware integrated and native for the consoles makes a huge difference
This probably isn't possible since dlss needs 16k images of in game content to train dlss for that specific game, but I believe if a switch 2 with dlss were to happen Nintendo and Nvidia would make it easier to do that by then
Not to nitpick, but the next gen console would be the switch 2. The switch pro makes people think of the rumored revision that is very unlikely to exist. But it can't be next gen and the pro.
This is _Nintendo_ we're talking about. Switch 2 is likely the last name they would pick.
@@mjc0961 I agree. But the same goes for the "pro". It's more likely to be the new Nintendo switch as the revision and the switch U for the next gen console. But either way, pro and next gen don't belong together. That's conflating the revision with the successor.
@@mjc0961 after the fiasco of wii u, there is no way they will go with switch pro.
@@shane_MK I agree, if switch call it switch 2, some youtubers will call it switch pro. lol. Nintendo will have to come up with a whole new name.
@@clayjack9969 it won't be called switch 2. lol when has nintendo ever done that? and I really doubt nintendo will use pro when sony and co use it.
Nintendo will go with something very new. they went from famicom to super to 64 to gamecube to wii to wii u (which failed) to switch. the next name be something none of us will be able to predict.
Great work Alex!
That makes total sense!
Switch 2 has a 720p internal screen and so renders internally at 720p at all times. Not having to push for a better native resolution allows it to focus on next-gen graphics compared to the OG Switch.
Then you plug it in its dock and DLSS is enabled to push quality over to 1440p/60 or 2160p/30.
That would be glorious!
Alex makes the best videos. Humble in his approach but having profound depth of knowledge.
Everyone: Expects word on the new PS5 revision
DF: Drops video about DLSS on a hypothetical Switch Pro
Never change 🙂
Loved the video, I can't wait to see XeSS on the Steam Deck, and on APUs/iGPUs in general.
Always cool to have DF swoop in and show us the actual technical and theoretical data of technologies like DLSS, most people would just say "Just add DLSS on the switch and boom its better now right?" Its great that DF can tell exactly how it works and even if it would be worthwhile to use on a device like the Switch
Switch pro is the PC via emulation
Emulates a Unreal 4 game haha no...
Here is an alternative possible solution: Since it looks like DLSS is running on a dedicated hardware while the rest of the GPU is just waiting for the result and doing nothing, it seems plausible to be able to add 11ms-16ms, a frame of latency. While you wait for the DLSS to finish its rendering, you can perhaps be working on the 4K native HUD of the game, and the next frame as well. Less than 16.6ms added latency at 60FPS 4K might seem acceptable in a lot of games, if the alternative is a choppy 30 FPS or 1080p image.
cool analysis. using nsight on DLSS titles can show how DLSS usually has a higher frametime than TAA in most games but it is covered up by the total gain in fps. but the DLSS frametime is usually quite fixed based on the hardware and is less based on the game or engine.
Really interesting video, thanks you.
For Nintendo, it seems more reasonable to target 1440p DLSS with 720p internal resolution.
720p@60fps native for handheld, and 1440p@60fps DLSS for docked, and if 4K TV used, they can use additional upscaler, integrated in dock, with AMD FSR or any other "not deep learning" upscaler.
720p --(DLSS)--> 1440p --(FSR inside dock)--> 4K
Thank you, Alex! It was great and interesting.
Question: Does the 4K DLSS have to run across the whole screen or can it be applied to specific renders in the game in a similar way (i think) that motion blur is applied to specific game assets? That way only using it where they want too
This is quality! Thanks you Alex!
Or or Nvidia could develop DLSS 3.0 with less ms cost and maybe even better quality.
Keep in mind also, DLSS on the Switch would be utilized only in docked mode, so maybe there is something Nvidia can do to draw more power out of the switch when docked, to juice up DLSS better.
Alex, I think you forgot one comparison: adding DLSS vs adding “normal” render hardware.
Get the energy cost of DLSS and use in raster/shading to generate more pixels, then use a simple upscaler.
I think this might be interesting, because DLSS shines when there are enough pixels work on, but when talking about Switch (even a successor), pixel count is usually on the very low segment.
This series is awesome 11/10!
I wonder if Nvidia shouldn't add a level between performance and ultra performance, 900p could enhance the quality a lot.
I think even now it's possible to do that by changing some ini settings or something like that. I remember being able to do that to the DLSS in Control when it was using DLSS 1.0, and setting the input resolution to 1080p (with 1440p display) because even the quality mode was too blurry (ended up not using it in the end).
I have thoroughly enjoyed my switch, but I'm far more interested in the steam deck for portable gaming from here on out.
I play far too few Nintendo exclusives. Mario is about all I care for. Breath of the wild was fun for a bit but I didn't think it was as great as everyone else did.
Only reason anyone has a Switch is for the exclusives. Some have been underwhelming, but overall having a Switch for the exclusives are worth it. Should definitely have something else for third party games.
@@yungmatt009 Yet the Steam Deck will have so many more games that you can't play on Switch than vis a vis. And that's without getting into Switch emulation on the Steam Deck.
@@HeloisGevit Yes, but who cares when all of said games will be available on literally every platform.
Steam deck will eventually be able to emulate the switch. Either this iteration or the next. But it's coming.
Yet, the Switch will still outsell the Steam Deck 10:1 no problem. Ultimately the Steam Deck is just for playing the same games you already play on a tonne of other systems at better quality. While the Switch offers games you get nowhere else. I don’t think the Steam Deck is bad, but let’s not kid ourselves that it is going to be a massive seller outside hardcore gamers.
nice video. would be also nice to see in those comperisons a native 1080p image and the fps to see if the 720p with dlss has better image quality by better fps (or not). and also how it compares to amds fsr (i know it isnt the same) with those "low" reslutions. for the future of steam deck.
Awesome!
I'd love this on a Mario Kart 9 or Breath of the Wild successor.
Wonder if the system will have you specify your TV type in the settings so that what the Switch 2 does is drastically different for a 1080p TV Vs 4K
Drinking game: take a shot every time Alex says "theoretical."
Call it *Super Nintendo Switch*
Or *SNS* for short
Great Vid Alex
Awesome job on this. It gives me hope for the Switch successor.