We're ready for One GPU -- Two OSs. Intel Xe, SR-IOV and thoughts on VMs
Vložit
- čas přidán 1. 12. 2020
- looking-glass.io/
Thanks Patrons & FloatPlane subs for making this stuff possible :)
forum.level1techs.com/t/how-t... -- Video soon (already on Patreon/FloatPlane)
**********************************
Thanks for watching our videos! If you want more, check us out online at the following places:
+ Website: level1techs.com/
+ Forums: forum.level1techs.com/
+ Store: store.level1techs.com/
+ Patreon: / level1
+ L1 Twitter: / level1techs
+ L1 Facebook: / level1techs
+ Wendell Twitter: / tekwendell
+ Ryan Twitter: / pgpryan
+ Krista Twitter: / kreestuh
+ Business Inquiries/Brand Integrations: Queries@level1techs.com
IMPORTANT Any email lacking “level1techs.com” should be ignored and immediately reported to Queries@level1techs.com.
-----------------------------------------------------------------------------------------------------------
Intro and Outro Music By: Kevin MacLeod (incompetech.com)
Licensed under Creative Commons: By Attribution 3.0 License
creativecommons.org/licenses/b... - Věda a technologie
I'm just going to call you G-Man from now on :-D
I can't wait for this to become a reality in the consumer space.
Same. Gaming laptops are trash. I'd be way happier with a VPN home and a SPICE terminal.
@@Whipster-Old right now I’ve got my VM set up with an Nvidia card and use moonlight over VPN to access my personal network. GPU capable workstation and gaming rig (1080p 60fps) using a low end laptop anywhere I have a decent internet connection. This is the future.
@@00Klingon if I could like your comment more than once, I would. Edit: I hope it's wireguard 😂
I've been using something similar Aster v7 with my r7 2700x and rtx 3060ti. I can play doom while my brother plays PUBG. This has been happening for quite some time already
We just had new GPU architectures released this quarter. So chance of SR-IOV happening near zero for the next 2 years until new GPU generation. Or can this be unlocked via driver update?
If intel supported SR-IOV on their Intel Xe cards, I would actually consider picking one up first gen when it comes out.
I'm going to wonder about it's cooling solutions.
Hee hee 💞🤯👍
ditto. Take that first step!
Me too, or maybe i will wait till second gen.
i don't even have the budget, but i'll consider breaking it
Same. AMD CPU and Intel dGPU would do a trick for me on Linux. But I expect Intel dGPU to really work well on Linux. Some parts of Mesa AMD support isn't developed by AMD, i.e. Vulkan driver. While Intel is more involved with Mesa Intel support, including extensive testing of hardware continusely. A high performing dGPU with good SR-IOV and Mesa support, that can be painlessly passthrough to Windows 10, would be amazing.
Wendell, you are definitely responsible for me getting into VFIO and building a machine with it in mind :^)
Same here, I never thought it was a possibility until discovering Wendell's videos!
Cool! Can't wait for DRM and anti-cheat vendors to blacklist virtualized configurations and ruin everything for no good reason!
no need to wait, there are AFAIK already games doing that
They allready do in Rainbow Six, Valorant... And guess what. It got cracked in one week. To a point where running your games in a vm and using host injection became the norm.
Im really pissed about this. Because the ONLY way to play RB6 in a VM is to use a hacked VM. This is insane.
would it be too much to ask to have host anti-cheat.... for wine as well...
@@Mallchad I know enough about battleye anti-cheat that tells me they aren't moving past windows, and it acts wonky on windows still.
I think you’re at least 5 years ahead of time my friend.
possibly :)
Nobody's ever ahead of their time, it's always the others who are behind. It's a very important distinction.
@@jeschinstad a robot 🤖 spot. Lurks outside The level 1 HQ
With proprietary software, we are not the users; we are the used!
Kinda. FOSS developers need to eat too though.
@@alpoole2057 what does money have to do with that? there are several companies based on Open Source...
Open source dev doesn't mean you work for free
No it doesn't but open source companies aren't social enterprises. A lot of passionate FOSS devs burn out at work, due to pressure or lack of meaning. To be free to write free software it generally means not being paid as you work on what you enjoy. However users can be very demanding for features in your own personal time. Most of the time adding worthwhile features is fun but sometimes it is reward less and people can sometimes be unreasonable.
@@alpoole2057 Dude you sound like most of the folk that listens to linux podcasts and has never done a contribution.
It's something you control, you give to it the time that you want, and it's just another task, another mail, another pull request, another documentation paper, just that.
It's quite a high when you do your first contribution, but then it becomes a normal activity, just another proyect (which is better and easier to deal with).
The point is, using propietary software just because many devs go open source as a hobbie is not a valid argument, most open source code nowadays is from companies submitting their work and indie guys scratching their itches. There is absolute no need to go propietary just to "feed developers". Devs arer not weak dependant creatures that need help from everyone, we are just normal people that work and code, and sometimes we publish the code and share it for free.
@@ezequiel5260 Am not sure what argument you are making. Thankfully have been able to contribute for a long time. Not all devs are normal people x
Thank you for all that your doing for the community, and thanks for all the great content.
I cannot say it better, thanks.
He needs a booster, get him some Taiwan Chinese tea's. As those are great 🐱 Perks 💞
Level1 Linux fans engage!
Engaged and enraged. 💞🤯
Let's me get my hands on a thelio , system 76.😜👍😂
Can't wait to try out Looking Glass!!!
This video was a beacon of hope and optimism that I didn't know I needed.
We will have it with WSL2 additions probably end of 2021. Already in developer edition (but of course its not ideal with windows as host os)
Microsoft really does have it backwards, windows should be the subsystem to linux
I believe they are making the transition possible..
Push people use linux side by side.
Blur the line bewteen the OSs.
Then drop legacy tech.
They said Windows 10 would be the last windows, update forever.
i now interpret that as, were making something thats not windows.
And it may be linux.
What will the API be like?
@@kwinzman There's not much API to speak of.
They want Linux/Windows to run in tandem almost transparently, with minimal modification.
@intrlocutr Last I checked microsoft makes minimal money on their software apart from maybe enterprise visual studio and office liscenes.
Which isn't most people.
They make most of their money on Azure services I'm informed.
So why would they hold onto Windows forever if its costing them money to develop and even that has slower to a crawl?
Most of your content goes over my head, this video is no different. But I keep watching because while I don't get all of it, I get more than enough to grasp the topic. That's down to how you present it, thank you.
This idea would be the answer to several use cases I'm currently looking at.
Computer science is a thing, fix up a Linux box. Or grab a pii4.
Thank you! The current state of things where I've opted to dual boot is not optimal and neither is having two graphics cards in one system.
Two graphics cards in a system is quite possible if you are willing to use an IGP for the host OS. Unfortunately that means no GPU-heavy tasks on the host. I wonder if a reboot is required to "free up" the discreet GPU (for compute tasks) when the guest is not running (I guess this is where PCIe reset becomes relevant). I would happily accept that compromise.
@@Quarky_ from my (extremely limited) experience with vfio you can bind/unbind the gpu to/from the OS at any time it's not being used... i should really do that test of running linux headless with windows in a vm with the gpu..
There is another usecase that causes friction as well... Many OSes and software (among them Windows and macOS) can use virtualization features of the host processor to protect parts of themselves. As testing, I tried to enable those features in a Windows KVM machine, but the result either crashed, Windows refused to enable virtualization-based security, or was extremely slow. Intel and AMD should extend their virtualization extensions to allow proper hardware-accelerated nested virtualization (a VM within a VM) instead of forcing it to be emulated in software at the host hypervisor level.
That, and GPU sharing are key hardware improvements to VM acceleration.
@@markkeilysIf an NVIDIA GPU is attempted to be unbound while anything is using it, the attempt will hang and nothing will happen. Getting a zombie bash process stuck on that I/O operation that won't leave the process list until a host reboot is not cool though.
And yes, once you can get the GPU to go completely unused, you can just bind/unbind VFIO to it and it'll work. As long as it's not a buggy AMD card.
I have two xorg.confs and a script to switch between them, to quickly log and relog into an iGPU or NVIDIA for passthrough into Windows or macOS, respectively. When I relog into using one GPU on Linux, I have set the other to go unused due to not being defined in that xorg.conf
@@markkeilys Cool, exciting times :)
Fascinating. This prepares the way for discrete compute inflight services which we implement in our network.
Who would have thought that it would be Intel who would disrupt AMD and Nvidia, enabling us to use VFIO :=D
I've been waiting for this for so long!
Thank you! Wicked video loads of good info!
Wendell, you're honestly one of the coolest dudes I know. Knowledgeable, passionate and working hard to improve your slice of the world. I hope to be more like you one day.
Found you through GN and you have quickly become a favorite channel. You are a good compliment to their primarily desktop gaming and overclocking content, with the more enterprise side of hardware and software tech as well. Loving what you are saying here about not being tied to the cloud. I appreciate the usefulness in certain circumstances but I am always saddened and frustrated to see good software and tools move away from local control to cloud services. I want complete control over what I have and do on my computers. Thanks for the great content.
I'm lost on some points but great vid! Love the enthusiasm!
Awesome video!! Thanks Wendell.
SR-IOV...
That would be a considerably large nudge...
Too large, given the interests of my employers
We can diy it, if we have to....
@@Level1Techs I detect a missed Half-Life Alyx reference here.
"Too large, given the interests of my shareholders" you mean. :D
@@Level1Techs I'm sure people can, I'm mostly meme'ing your G-man reference. Just don't look up videos of that reference unless you want MAJOR half life alyx spoilers
@@Level1Techs youre probably going to need to im guessing., privacy isnt really in the interest of big tech or of governments as things stand currently
Way to go Sir!
Reminds me of my first steps for HWPassthrough on XEN. What a hassle :) But my board was able to completely decouple my single! gfx card and attach it to my vm. Sadly, the other way around didn't work as well.
I've been asking for SR-IOV for forever. This would be a huge boon for containerization too (docker / kube). Who do we complain at to make sure this happens?
Every time i see a title like this i get excited! Then let down that its still not here
Thank you for this video.
Really like the Linux content. Hope you continue to keep up this channel in the future.
Whovever is the first to support vGPU/SR-IOV technology in the consumer space is going to be my next choice for a graphics card. I just wasn't expecting it to possibly be Intel
Amazing that this just popped up...
Looool!! i was JUST planning something similar like this but more however investing in a Dell Precision Workstation, and running HW passthrough coupled with KVM's for multi monitor support.... Will be checking your software out!! - Hope FreeBSD support as both host and client is something in the future!! :)
This sounds perfect for a small hypervisor setup.
many thanks for this, I really wish this to become a reality as I really want to play games in VM from linux with minimal performance hit.
I just became a supporter at patreon
your're strong with the force Wendel :D
fantastic work. I want this, a lot. I'd use my computer completely differently if my 1080 had supported this from the get go
love you Wendell! big Thanks!!! keep drive this evil forces away!
Mutahar is looking different today
Loving the increase of Linux content lately W.
I like this kind of content!
This is awesome , I'm doing this
Oh I've been waiting
this channel is truly unique.
Thanks Wendell!
great vid
Can't wait. We'll look back at this video saying "this is the spark that lit the fire"
Rally the troops! We need this!!!
I wanna say thank you Wendell. You made me discover the world of Vfio passthrough and Linux. Now i run a 780 for my host and a 1080ti for my VMs. I just received my lvl2tech switch, I can't wait to try it,,! My only problem i have is some latency in cpu heavy games, but I'll work through it ;)
Unraid + SR-IOV that supports both dockers and VMs at the same time = Dream come true
awesome info! This is very interesting.
Personally i'd like to run a windows VM on the same GPU as my base distro is, running on secondary display. Need the GPU acceleration for CAD and rare gaming
I hope this kind of tech takes off as well. I use Intel GVT-g tech (thanks ArchLinux wiki) in VMs. Gives me two iGPUs (1024x768) or one (1920x1200) iGPU to pass through to VMs. And thats just the integrated Graphics on the CPU! Amazing stuff!
I'm excited :)
I'm so excited for this. Hopefully unraid is paying attention, and thinking about adding support
SR-IOV very exciting
I want to support you, Im a student finishing computer engineering, as soon as I can I want to be build a system with pass-through virtualization because you opened my eyes. I would love to support you too, just wait a bit I get a job :D
ooo engaging content
The SPICE must flow
Guess where I work and what I work on brother. Good to see this video. You will be happy to see where things have gone in the last 8 months.
thanks Wendell
pls
?
@@hariranormal5584 pls
pls
Hope we will get this 1 day.
I'm calling it wendell creates Sky net trying to realize his dream.
I for one welcome our new AI overlords. Roll on the Quiet War.
Oopsie
@@Whipster-Old ohno Lordy 🙏.
It's the end of times, once it's hacked into NASDAQ,or the DoW.😜👍😂
Subbed, keep fighting the good fight sir. Could wine/proton accomplish the same result some day?
Bro, I really love your vids, and just wanna say thanks for this headsup! I've actually been contemplating dropping ~400 bucks on a S7150x2 from Ebay because of this and have been battling out the SR-IOV vs everything else fight; do I go Proxmox with an older card and ESXi with far newer cards (though with AMD that's limited to the V340, and Nvidia is just too pricey). I'm curious as to how the Xe will perform for workstation loads like CAD in terms of qualification and performance vs the competition though, so let's see how that goes! Otherwise I could just go the safe route with Proxmox and an S7150(x2)
In the past I was "sharing" 1 GPU with multiple users using the virtualgl and the ltsp project. Can't wait for you to succeed.
VirGL works great, but only for OpenGL stuff, not DirectX.
This goes over my head a bit at the technical level, I’m just a lowly Business Analyst... but the theory is super interesting and something I can get behind. This would be huge for general security, it’s an effective way to keep important files segmented and separate and could potentially prevent those less technologically literate individuals from causing data breaches because they want to play games on their work computers. Looking forward to future development of this and all of the cool implementations that it could be useful for!
Updated office tour? Eppic content! W: a leged!
It's a secret 😉 survival Bunker too
@@emazzikanbodo3014 HAHAH!! cribs Level 1 nuclear bunker edition.
@@simoneverett12 where are you at? Staying safes from the invisible enemy? Yet
@@emazzikanbodo3014 uk, our advaice is "stay alert", We've taken this advice to that we all need to train as Ninjas, we also have to sing happy birthday twice when ever washing hands by law.
@@simoneverett12 lols, don't go to demotivation website, memes.
N have u seen those keep calm, n perseverance posters?
Intel architecture engineers: we are doing what we can, we'll do it better next time, hang tight
Intel marketing department: look at how the competition is bad, they are really bad, here a list of things in which the competition is bad, don't buy from the bad competitor
Intel programmers: here sweetheart, here's your drivers, here's your kernel patch. I heard you need this technology, I'll start working on it right now and will make sure it'll be ready for Christmas, this is my gift for you
i hope we get this. it would beat having to deal with duel booting which isn't the best option
per-process GPU scheduling would be wonderful.
Wendell, you are amazing.
I uses Nvidia grid for a VDI solution at work and wanted to use something at home. I went down the passthrough with 2 gpus and vms. Would love to have a single card to split up for this.
My use case is for a spare gaming pcs for when my friends visit.
Wendell sounds truly exited about this. I will keep my eyes peeled.
Brilliant Sir .. I'm not really a gamers but that concept of shared hardware makes complete sense ! must check it out there is so much horse power in modern CPU's / core threads etc and GPU compute its a shame not to let it spread seamlessly in one PC. Hmm the 6900 is our tomorrow ! I wonder if I will get one of those next year + a Ryzen 5950 And run multiple SR-IOV ( or what you suggest ) to get that GPU goodness and AMD Compute doing anything I want.. 2021 is looking to Be GLORIOUS / Thanks Wendell Have a Great Xmas
You are a legend.
what motherboard do you recommend for iommu passthrough using ryzen 5950x?
I've set up an accellerated x streaming session with fb enabled and resource sharing and/or slicing Docker image for just that. I've said goodbye to vms for years now because of the resource and licensing hell and the elegant methods of container systems. People should look at that imho. That has worked for me for years now. Now working on K8s style upgrades.
you give us some hope... I'd love to see sr-iov or mxgpu in newest AMD or NVidia GPUs
Single slot card looked like it had one output port, but behind the PCI bracket??
ignore the hackery, sr-iov cards have no output :D
I spotted that too.
@@Level1Linux you tried to solder an output port on?
@@Level1Linux Thanks Wendell!!! Haha :)
@@alphaLONE I think he *DID* solder an output on
Oh man Wendell is awesome
I'm so ready for this type of tech to become a reality.
I have no use for any of the things Wendell is talking about, but ever since I heard of SR IOV as a way to slice up up GPUs, I have been fully on board.
sounds great, been waiting forever for a APU that could help me setup a VM SR-IOV, maybe won't need to compromise if this comes about. (Ryzen APU's have lower clocks and lower cache sizes, are slower)
Intel iGPUs can do this using GVT-g. Be adviced that consumer CPUs can really only do one host + one guest setups, but Xeons can do more.
Same here, I’ll build a PC as soon as AMD releases a APU without to much compromises. Or if this gets released earlier it might be interesting instead.
We can built it , we have the technology!
WOOO!
I could swear I've read that Big Navi would support SR-IOV. Did that not materialize?
Great video btw, thanks for your continuing efforts. :) This is been a long-standing dream of mine.
I hope we get an update on this topic =)
This is also critical to the small to mid size business server space. A pure open-source VDI stack would be a game changer, and gpu's are needed for anything other than basic office apps.
My new battle station that I'm gathering parts for (no Ryzen CPU stock, and waiting for 5000 BIOS) uses a X470, because of you, Wendell! I'm exactly within the group that you described. Developer on Linux, run Linux and Windows VMs for work and experiments, used to play games... But these days I just get games running for my son. I've been intending to dabble in some ML and have been starting to use some software that is GPU accelerated. I don't have great expectations because I know Nvidia and AMD are failing abysmally in providing basic VFIO functionality. So I'm keeping my old workstation for Windows and whatever Linux GPU shenanigans that I might want to do *in addition* to whatever I end up doing on my new workstation. You're doing the lords work. God help you noble man! *Raises imaginary Earl Grey tea*
the sad part is Pcie lanes on consumer chips is very limited but still love it
0:29 Plays the role of G-man, but sounds like gta5's Lester saying it lol.
While we are at it, please do a Video about Virtio-fs. This seems like the perfect fit in terms of shared storage for SR-IOV.
This is what i'm waiting for to upgrade my existing systems - a high core count / powerful GPU system which can replace my unraid server, gaming rig, parsec stream gaming rig and my HTPC - all in one,
One api could be really awesome
I experimented with Qubes as well as PCI-passthrough with two graphics cards in late 2013 and I did get it working, but the user experience just wasn't quite good enough. With two gfx cards, I had double the cables going to my 4 monitors and it was a bloody nightmare switching them to a different input whenever I wanted to run a VM. I got excited watching a previous video of yours on this topic where this was solved in software instead (where it should be), but unfortunately I'm rather pessimistic in regards to the damn vendors actually turning the feature on for us regular consumers as it may affect their prime cash cow in the server market. Love the effort though.
Do a vm, n launch BeOs 🤯👍
Obviously when looking to purchase a graphics card you have to weigh up a number of factors, but I'd be much more likely to purchase a card that supports SR-IOV even if it is more expensive / not as powerful as its competition that don't support SR-IOV. I really can't be dealing with having to run a separate card for each VM.
Ive gotten as far as having to modify an nvidia gpu Bios to allow for iommu support to "decouple" from the host machine and initialize onto the virtual machine. Support for sr-iov would be amazing
Do want!
Now next job: Get AMD / Intel / Apple to fix their IOMMU, I want my USB host!
I'm excited, despite understanding about half of what you said.
This is the exact frustration that has been bugging me when thinking on upgrades and PCIE/chassis space
literally wishing for a system where I can run Windows(7) in a VM for gaming.
Ive been waiting for SRIOV for some time... WOULD LOVE A SYSTEM JUST FOR GAMES BY ITSELF
sounds great! thats something i want to pay for as a consumer
Wendell is the mysterious G-Man so much makes sense now.