We’re running out of internet - Steam Game Caching Server
Vložit
- čas přidán 19. 06. 2024
- Thanks to Intel for sponsoring this video and a portion of our WHALE LAN Event! Buy an Intel CORE 12700K: geni.us/BoeG
Discuss on the forum: linustechtips.com/topic/14488...
Check out the Supermicro SYS-510P-WTR server: lmg.gg/f052V
Check out Kioxia CM6 Enterprise NVMe SSDs: lmg.gg/tvHfo
Check out Ubiquiti's Enterprise 24 XG Network Switch: lmg.gg/MYwFg
Check out InfiniteCable's ethernet cables: www.infinitecables.com/cat5e-...
Purchases made through some store links may provide some compensation to Linus Media Group.
► GET MERCH: lttstore.com
► SUPPORT US ON FLOATPLANE: www.floatplane.com/ltt
► AFFILIATES, SPONSORS & REFERRALS: lmg.gg/sponsors
► PODCAST GEAR: lmg.gg/podcastgear
FOLLOW US
---------------------------------------------------
Twitter: / linustech
Facebook: / linustech
Instagram: / linustech
TikTok: / linustech
Twitch: / linustech
MUSIC CREDIT
---------------------------------------------------
Intro: Laszlo - Supernova
Video Link: • [Electro] - Laszlo - S...
iTunes Download Link: itunes.apple.com/us/album/sup...
Artist Link: / laszlomusic
Outro: Approaching Nirvana - Sugar High
Video Link: • Sugar High - Approachi...
Listen on Spotify: spoti.fi/UxWkUw
Artist Link: / approachingnirvana
Intro animation by MBarek Abdelwassaa / mbarek_abdel
Monitor And Keyboard by vadimmihalkevich / CC BY 4.0 geni.us/PgGWp
Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0 geni.us/mj6pHk4
Mouse Gamer free Model By Oscar Creativo / CC BY 4.0 geni.us/Ps3XfE
CHAPTERS
---------------------------------------------------
0:00 Intro
1:26 What is caching?
2:59 What’s changed since our last Steam cache?
3:46 The hardware
6:30 We get creative
9:08 One small problem
10:43 Booting it up
12:15 Editing the config
14:33 Our first test
16:00 The boys quarrel
17:05 Take two
19:17 Live test on location at the WHALE LAN and conclusion - Věda a technologie
"That's 1MB/sec" - That is literally my normal internet speed. On a good day.
1 MB /s is 8 Mb / s
Same
Same
I have 5-15 MB/s download speed
Same
This channel has gone
0
DAYS
without Linus dropping something.
lmao
Keep it up, if there is no drop, that is no linus
WE ALL HOPE LINUS IS GONE!!!!!!
Someone hand him a mic!
*0.001 hours
I swear every time Linus and Jake are in a video together it's like two brothers arguing for the entire length of the video and I love it.
I tried setting this up at LAN parties a couple of years ago, definetely more hassle and also DNS would crap out at some point. Glad to see it is now a lot smoother operation.
And as soon as you have two connections, the system breaks more often than it really works. Have seen that happening to often 😂
We had DNS Setup at out local Lan as early as 2005. We announced our MAC of the LAN card on entry which got setup into the system and simply plugged in the cable. Worked without any issue at all!
I wonder what generates more heat in this scenario... the PC's, or the sweaty gamers?
pcs lol
@@MrPruske I bet the PC's will shower more
Pcs
I remember hearing somewhere that humans are like ~250 watts.
"we are sponsored by intel" oh so you admit you are subsidized by the government.
you know, after having gigabit internet, it *is* really hard to go back. it's a lot like having an SSD and going back to a HDD speed-wise
Or going from 60+FPS back down to 30
@@Canady117 got a 3060 gaming laptop about 4 months ago. After experiencing 60fps and above for 4 months, I can't play on my ps4 slim anymore. I now feel dizzy playing on ps4.
@@Canady117 not really the same
@@Canady117 I play at 144hz usually, and I immediately notice when it is below 90-ish
@@MrScorpianwarrior yeah its like still smooth but then your like "this is kind of choppy" even though its at 90 fps lol
I love it when LTT delves into these highly technical projects. Who'd have thought this is how LAN events might be setup.
Who hadn't thought that? When you get 200+ ppl accessing the same resource, it's damn obvious to cache things, no?
@@th0bse_ if you have more knowledge than the average computer user, sure, but most people dont even know what caching does
I always hated requiring internet for local LAN play. I remember the days when we had LAN parties specifically because it was the fastest connection between computers.
That's not the problem here. Local LAN still exists in many games. The problem was the inability for everyone to download the games fast enough, due to a lack of bandwidth (each user would only get ~5-8mbps).
@@tbuk8350 Why not have the games already installed on their own internet connection at home before arriving at the event?
@@corporealcasimir4885 Might not know what games others at the LAN party would want to play. I've had it happen to me before.
@@tbuk8350 - even enabling local LAN play, newer games still require you to be logged in
@@tbuk8350 Thats why we put People into Groups at Lan Partys so they could download it in a normal time, after that the other Group could download the Updates etc.
linus: has an IT problem
also linus: *gets free enterprise grade servers from mega-corporations*
wow thanks everyone who liked and commented on this comment.
yes
seems like intel is always the one saving the day
Sponsored by intel-aka ur salvation
@@turtleguy8914 fr
I mean, yeah; how many people making the purchase decisions for corporate IT projects do you think watch LTT vids? Converting just one of those people can pay for this entire project within a couple years.
Surprising to see this - we did exactly this back in good ol 2001-2009 era. We basically had zipped copies of all installs on a webserver and everyone would get it from there. In the odd case where we needed something new, the admin would simply go out to the internet and provide it on the portal page.
👍
Back when you could actually get an install file
I remember one lan I was the only person who rocked up with the latest updates but the site only had dialup.
Luckily you could just copy steam files to other computers and the dialup was enough to verify
Me and my friends used to rent a cyber cafe for the weekend to play Warcraft 3, DotA 1 and Half-Life, they just put the games on the main computer to deliver the latest versions (Warcraft 3 was still receiving patchs at the time)
Old times are gold today
He did say "Slash Slash"
He says "Slash Flush", but he says it so quickly that you can barely tell. Either way, I'm not blaming Linus for that one.
I literally only get 1 MB/s download . (7-9 mb/s) Scotland.
This kind of experience is only marginally different than the average IT project. Every new piece of software is simple. Every implementation takes 3-4x longer than expected.
And the project manager only allocated so much labor
True story.
@@lordcommander3224 1 story point only 😅
Bugs are basically the mythological Hydra.
If only i had 8mb a second
Love when you guys dive deep into actual IT components rather than just pc builds or talking about new consumer products! Don’t get me wrong I love them too but these types of videos grasp my attention
yeah, i loved to see them using netdata. it's such a great software
I have never heard RAID anything on this channel so it's surely refreshing and a solid video!
@@JohnAdams-bh9zc they made a lot of videos about RAID, NAS and stuff czcams.com/users/LinusTechTipssearch?query=raid
@@davidak_de must have missed it, good to know for future reference 💪
to bad he was calling the sas card u.2 and u.2 card sas
As a networking fan and self-learner, there is something that just gets me so excited seeing networking gear, I absolutely love it
Out of this video I have learned a huge lot of internal storage servers, thank you!
One quick tip, from fellow Lanparty organizer. Configure your router to steal all traffic for dstport 53 and redirect it to this cache! Mikrotik can do that. So many people will leave static configuration of their DNS and that will keep you wondering why the cache do not work... No matter how many times, you tell (even IT) people to configure DNS from DHCP they will not do it, because they are too lazy ;-)
the lan has already happened but this is a great tip
Do you really run into that many gamers who have static DNS setup? I feel like that would be extremely uncommon as most folks just rely on their ISP DNS.
@@msavage960 Using your ISP DNS mean when they crash, you crash. using external DNS prevents crashes and allows you to continue using your service, while the guy down the hall from you yells because his Battlefield game was interrupted.
@@Kitosa_Hinoyosha exactly. Another reason is that ISP dns servers used to be very slow, so most of people (at least in my country) simply uses Google DNS, it is much faster to resolve and practically do not crash. And if you have a lot of people from IT, which is usually type of people on lan, they have it manually changed.
One side note: you cannot redirect traffic on cache directly, because packets would have bad source IP. But on Mikrotik you can enable local DNS server, make it ask your proxy. Then steal all traffic for port 53 (TCP and UDP) and redirect it to local DNS on Mikrotik. Also do not forget to create exception for your proxy server, so it can access port 53 without this, otherwise you will end up with infinite DNS loop 😎 if anybody needs I can send you working configs.
Learning how old Jake is now I am really envious of him to know so much in the server space and having such a cool job
once you get access to a lot of hardware, and being paid to research and implement cutting edge tech we would pick stuff up. But we can all do it on a smaller scale too, my messing around with cheaper hardware and simulating it via open source software.
Ya probably doesn’t even feel like a job to Jake lol
At his age I knew way more, but at the same time wasn't exposed to as much tech as I worked in a poor company in a poor country (Slovakia, eastern EU). I envy him too as he makes way more money in a way nicer job with way more tech and needs to know way less. And all this in a civilized country of Canada.
@@PLANTROON yeap, it is what it is,
It's aight we just do what we can do.
Like, I feel like I also probably know the same stuff, if not more, just cuz I mess with cheaper labs but simulate using software,
It's really how spongy you are at absorbing stuff. For any of us, if we have interest and try, then there won't be a huge difference, its just a matter of not having that hardware on hand.
Also, I live in a country which makes Slovakia 10 times better than mine lol. So yea, circumstances are a big part, but deep down, circumstances won't limit us as much as we think it does.
@@ahmedifhaam7266 what i thought as well. I told myself that I'll be fine here working online, but you still have to deal with local people, service providers, contractors, doctors, and there's just such a divide between the "western" way of doing things and this eastern idiocy, that it catches up to you. Despite working online, despite having money. So with advancing age I realized that any kind of life here is a compromise.
these guys make it feel like a turtorial. I WILL NEVER HAVE ENOUGH MONEY FOR THIS XD
I always love it when you’re telling us about your “slow” internet speeds when they are like 5-10 faster than what I experience
The most impressive part here is probably Linux handeling all the caching and hardware control perfectly out of the box and for free
thats the least impressive part, most impressive part is that windows didnt just fall over when they changed DNS o wait it did, Well this video didnt impress me even a tiny bit
o7🐧
@@bigpod Found the Linux snob.
@@icanmakeeverythingilovedie9861 im not a linux snob but i deal with both on daily basis as i use both on daily basis (linux for work and windows for gaming) and i can say linux is much nicer to do stuff with, and when it comes to networking its specially bad
@@icanmakeeverythingilovedie9861 each operating systems sucks its just that for me linux sucks slightly less but at the end of the day windows is a great kernel saddled with horrible ux linux is good kernel saddled with 1000 uxs some ranging from horrible to usable ish
JAKE'S JOB DESCRIPTION IS JUST PERFECT RIGHT NOW. I love when he just sort of helps Linus and Linus gets miffed.
Also EVERYONE says MW2 lol
@@YakulDeath it's the same number of syllables, but far fewer consonant sounds to slow you down.
Its fewer syllables if you pronounce W as "dub" for shortness as I do
I love this so much , back in the day , literally years ago I would of had no imagination as to what any of this was .
But by being inspired by your videos , studying in uni and working my amazing job , all of this seems so obvious to me and very heard of as I work with the exact equipment every day !
I just wanted to thank you linus for the years of entertainment and educating , you have shaped me into the IT technician I am today !
What kind of university program did you study?
My wifi has 2, 5 Mb/s ;(
Mine too ; (
Yeah life was hard with that speed, I just upgraded to 100mbps
My wifi is only 600mbps 😢
My internet is exactly 100x more
Linus and his tradition to drop things never gets old
The fbi is here and they're very angry at you and if you don't care you'll be brutally executed
Seems scripted at this point haha, seems to be only SSDs.
what's up
@@dmhamw5982 not much lol
Linus: 8mb/s is slow
My internet half the time: "not too bad'
got 10 in germany and that is like standard XD F
i get 3 lol
Tfw 120 a month for maybe 25 down... More realistically 12...
@@ThunderTurkey100 lol. 65 a month and 500/500. fiber baby
speedtest says i get around 48mbitps, but every time i download anything its 8mbitps or lower
LTT videos are always awesome, always feels like I’m watching buddies do a movie skit for high school!
If you use a riverbed steelhead you can also speed up the wan connection, so you have cache ing on lan and wan, but that is nice cacheing server, also if you used a QSFP+ connect it would be 80gig copper and cheaper then the 50 gig combine of the 2 Ethernet cable, QSFP+ work’s nicely. That event looks cool. Thank you so much for all your amazing videos, I enjoy watching them so much.
Formerly at the small ISP I manage we accomplished the same thing using a company called Qwilt. It was a game changer when we only had a small amount of backhaul. Once we upgraded our backhaul to way more that our subscriber base could use we decommissioned the server. It was so nice having about 100TB of cached content. Windows updates, Playstation and Xbox games as well as Netflix and many more video streaming sites. I've never seen PS4 games download that quick on any other network.
same here, now we cache, youtube, netflix, heroku, ms updates, steam, facebook and many more !
I imagine at some point it's the more sustainable solution.
Throwing more compute/bandwidth/money at is a solution in general, but we really need to cut back on consumption.
@@lennihein Consumption in what sense? Also, who is "we"?
"We're running out of Internet"
*I literally tell myself this every day*
If we're running out of anything, it's "intelligent internet".
go egypt they still have download caps on very slow dsl or fiber if u r lucky .
2GB/day vibes.
@@0xDEAD_Inside I have 1.5 lol
I used to be capped at 4 GB a month until 2016, when the local rural cable TV monopoly got tired of clients calling to complain about the face book running out.
I still only get about 5-6 Mb/s, when nobody else is online.
Running this on our LAN party for years now. Very nice piece of software. Together with a traffic shaper and policy based routing it enables us to use ~100 devices on two 50MBit connections. One for the cache, one for the users.
Mega cool stuff! Loved the conclusion in the end, satisfying!
i love it when they explain it to us like we're gonna spend $100k on a LAN party like it's an every day thing
Well to be honest some people are just interested in it, others might need to use something simular for something at work and want to figure out how it works. So its nice that they do it tbh
They could have got away with a lot cheaper hardware, though it'd have taken up a bit more physical space.
It scales. You might have a 6 person LAN party and only a 20Mbit Internet.
That's also what I thought. If it is not aimed at us, then it should be demonstrating the technology used behind big Lan events. Even though it is probably what's being used, Linus should talk a bit about it.
@@grimzkunk This was developed by the people behind the big LAN events of Insomnia and epic.lan.
After the windows 98 video I’m ungodly impressed with Jake’s incredible knowledge of server and network tech especially the really advanced stuff they play with on LTT. I’m a decade older and proud of setting up my wifi.
I think advanced networking stuff is one of those things you either get it really easily or you struggle bad. I dont think theres an in between. some peoples minds are just wired extremely well for troubleshooting.
It's just too bad about his attitude, he'd be a really unpleasant co-worker.
@@Lu-db1uf Why, because he's not licking Linus' boots?
@@Lu-db1uf isn't the attitude just a character on screen?
@@Fanta.... I disagree with this, I mean, I dont know an incredible amount yet, but I think this is true only for the beginning. It doesnt make much sense until some things start clicking and everything falls into place
the subtitles broke
Watching your guys content help me much when i feel down! Great channel!
Jake asking his boss "Are you drunk, buddy?" while Linus struggles to type the correct command is some ballsy shit. lmao
@Trippy SZN I don't think he'd drink right before arranging a 200 people LAN party.. he probably just woke up before shooting that last clip.. also there was a lot of noise in that server room, they probably had to process his voice audio a lot.. I'm a video editor and it's a real nightmare to make audios like that sound somewhat normal. All this combined, you get a perfect drunk weird linus voice.
Canadians are always drunk unless confirmed otherwise.
Timestamp?
@@Yoaru 16:18
The fact that your home has faster internet than your business is a problem I’d dream to have. Does the new house have 10 Gbps internet? I recall you & Jake mentioning that it was possible.
My house already has better internet, but that’s because I work at AutoZone 😂😭 our internet is so slow Speedtest won’t even work, it doesn’t even fail, it simply doesn’t go anywhere at all lol.
Thats a wasteful dream that you wouldn't even notice a difference between 1 Gbps to a 10 Gbps on a daily driver run. Doubt you would download warzone daily.
Shut up or they...
Will brutally torture you and it's gonna be eextremely painful
Bell is now offering multi-gig home internet in my area... 3 gbps up/down.. very tempting!!!
@@UnoZero1 Except for downloading games you probably won't notice much above 100mbps
The off script banter creates the best vids. This was a great piece!
You know you make great videos when I don’t know nothing your talking about but feel like I do as I watch you put all your builds together 😂… I know storage, CPU and GPU but yeah the components and tools etc I’m lost lol
Back in late 90s, we used Squid Cache with a dial up connection as a transparent cache, a bit like Linus is doing here, and it managed to support about 12 gamers without an issue browsing web 1.0 content. Granted, there wasn't CZcams, webpages were pretty simple and the majority of the games were still LAN based, but we got 4.5kb/s of that dial up shared between 12 computers, and it cached all our 'big' patch files and flash animations just fine. We had a 100Mbit hub, not even a switch IIRC for the LAN and honestly the cache was amazing when it worked allowing download speeds we could only dream of at the time. T1 all the way baby! hah... but terrible when it doesn't work. I'm sure cache servers got a lot better since the 90s as well.
yup did the same with squid, and a bunch of solaris servers, and later we added memcache servers as well
:) good old days... my first modem was a supra modem 2400 baud.. after I decommissioned the diy acoustic coupled modem... lol...
That's how I had my share house set up, Linux server running on a bitsa P200 with a Bigfoot HDD, that's the non-MMX Pentium 200!
The house was long and thin though so I had coaxial cable running in a loop past all the spots friends would plug into on the weekends, the network was fine for gaming until someone decided to copy a file in Winblows, then we'd all lag out and yell, "Who's copying what?!"
@@m-j107 I didn't say I was doing it now, I replied to a post which started, "Back in late 90s". Even if you'd missed that didn't the 200Mhz, non-MMX- Pentium CPU give you a hit it was a while ago? "Bigfoot HDD"?
Any large professional lan party has a cache server like this so it's good to see that they're also following suit. The lan party I go to has between 500 and 700 people and absolutely needs one.
Do people not show up with the game they’re gonna ply already installed?
NPF in Denmark there's 5000 atendies with no caching server, they just ask people to download games from home. So yeah, not all Lan's are created equaly (this is the biggest in denmark fyi)
@@mrmotomoto that’s what I keep thinking but I guess it goes broader than that, for instance if the cache server gets to actively and smartly cache everything that goes through it, if it makes sense
@@mrmotomoto if Windows pushes an update or you want too download a new game you didn’t know before. Too keep if off the internet.
@@llamaduden3397 yikes thats some bad IT setup
good thing this video came out, it is just what i was looking for to stream some netflix at my house! why do i keep watching this...
I'm surprised that you only went with a dual 25 GbE NIC instead of either dual 100 GbE or something like that.
The fact that you were able to peg it to 50 GbE pretty quickly and easily suggests that you could've given it even more bandwidth to pull from.
It works, but it can always work better.
just download more internet lol
You clearly don’t understand how internet works 🙄😬 /s
Edit: that was obviously a joke but as I’m watching the video, it seems like that kind of was Linus’s solution
@@quintonconoly it’s a joke 💀
@@quintonconoly whoooooooosh
yeah DUH
lol
Linus, I honestly wish I was able to experience internet speeds like this. My download should be somewhere around 10mbps but I pretty much only get half of that, and my upload speed cap is 1mbps.
It's honestly painful that most Canadian internet service providers don't give any proper attention at all to isolated First Nations reserves. I've got 10/1 speeds in 2022 and I literally cannot keep up with everybody else anymore.
That sucks.
In Turkey a one internet company changed meaning of 1gbps they sold 1000 mbps upload and download with regular internet price and they are giving this service with their own infrastructure
I don't believe that I am using 1000 mbps in turkey its like a dream
15% of Germany has theses speeds aswell don't you worry. Just push the car lobby, who needs Internet even?
is StarLink a viable option for you?
Back in 2016 when I was living in Costa Rica I had to get used to 330kbps download speed 😂 GTA would take 48 hours to download, now I have 35mbps download and even though it isn’t fast by 2022 standards it feels Lightning speed in comparison.
I've been thinking of setting up a cache in my house, excellent video!
What? Why?
Love how the whole purpose of the video is that 8Mb/s per player is not enough, while my home connection doesn't even reach that. Really makes you feel good hearing that
In the early 2000s, right when Steam was born, i attended a LAN party with _thousands_ of people ("Northcon"). Most of them still hauling CRTs to their place (including me). The _whole_ venue had like a 2 mbit/s dsl connection. 2 mbit/s for _everyone_. Downloading your games otf wasn't a thing, we still juggled discs, but this was the first year when people were playing Steam titles who had to be activated online for offline use. This was fun! 😎
I remember a Half Life 2 review that marked away a few points because of forced online activation.
Northcon was a German LAN a friend told me anecdotes about it
I live here with 12Mbps (1.5MB/s), shared with a family of six, 4 of whom actively use it every day. We have to keep negotiating and coordinating our downloads, video watching and online gaming to avoid causing lags for one another. One day fiber will reach us... one day.
get a old PC and grab something like PFsense and setup a Cacheing DNS/Content Cacheing server you can do this Transparently. and no one will even know its there.. you will find even youtube etc/ will be a little smoother.
@@NicolaiWeitkemper is correct, pfsense is more trouble than its worth (can only offer negligible improvements if done right, but will hurt performance compared to consumer routers if done incorrectly), and there is 0 point in building a caching server as virtually everything that can be cached will have already been done so by the browser.
Starlink is an option if you get lucky in terms of waitlist and can spend $100/mo on internet. If you're not in rural america look up the available ISPs in your area, there may be competition or the same ISP may offer faster speeds and have never upgraded you as they have no incentive to do so unless you are a new customer
At the very least in terms of (EDIT: streaming services like netflix and amazon video [two that I know have that option]), couldn't you guys have some stuff downloaded for offline viewing overnight or during downtimes? Another possible thing that could help is making sure they change to 480p or less for youtube vids if the actual picture quality isn't important.
Another thing you ould do if you have a configurable router is to force speed limits on the devices so no single device can choke the others out.
I’m in exactly the same place as you, my solution : Buy a router, stick it to your pc through Ethernet, get your family on the houses wifi. Turn off the wifi at will through the web portal. I also created a hidden ssid guest network for myself.
Nothing some queues couldn't solve. High-resolution videos might still take time to buffer, but services like VoIP and gaming are protected.
Thank you for pointing out the exact same number of syllables in mw2 vs modern warfare 2.
I usually like videos when I see something really funny, interesting, unexpected or something like that. I wanned to like this video 6 times :D
just make a local cache of the whole internet and you'll have infinite download speeds
My friend and I back in gradeschool used to make a similar joke about putting the shortcut for Internet Explorer on a floppy disk
@DONT READ MY PROFILE PICTURE ok i wont
If you lived here you'd be home by now
Basically every web search engine like Google
A small company called cloudflare had the same idea a few years ago ;)
I'd love a video with Valve to learn how Steam handles delivering their downloads. I don't know how they manage it, but (providing I select the right DL server, which isn't the one in my country) Steam downloads are literally the only thing that can actually fully saturate my 300mb/s internet connection. Nothing else can manage that, but Steam somehow sends the data from Sydney to New Zealand at speeds well above what my connection can take - and somehow 5-10x what they can deliver from within the country
For NA, we sometimes have issues when big games release etc where the download servers struggle at launch time. Switching to South Korea and all of a sudden you can saturate your download speed. Its odd.
Germany has five download regions and i used to have problems with all of them constantly. At some point i switched to paris, havent had problems since then.
Out of all sites I've downloaded with, only steam can use my whole download speed.
I’m in New Zealand as well on a 300 mbps Line and I did saturate it lol
They briefly explained some details in a talk called "Denial of Service Mitigation" at 28:00. They have private fiber connections between their servers. Each one of their endpoints has multiple public IP's connected to different ISP's, then the steam client will chose the lowest ping one (or maybe some other metric). Valve could have shit backbones in your area or there might be some ISP shittery going on that valve can somehow avoid with this system.
seeing you guys download 8gigs in like 15 secs made me cry, i usually have to wait like 3-4 hours for that lol
Try 14+ hours for me. It's sad. Faster internet options can't come fast enough!
You guys do it in less than a day?
i love that steam has that feature build in, i have like 2,5 tb games on my pc all on ssd. last week i had a friend over and he was able to download from my pc with like 2,5 gig per sec
The thing that stands out to me is that the dual 25GbE card, which can send data over a network 50 times as fast as my home network, still only needs half of a PCIe slot to handle all that bandwidth. Amazing. (I'm old, and still remember my 300 baud modem....)
PCIe 3.0 can push 1GB/s per lane, PCIe 4 twice that. So yeah, PCIe 3.0 x8 can easily handle a dual 25Gbit card and would only need x4 if it was a PCIe 4.0 card.
PCIe 3.0 x16 can support dual 100Gbit cards!
@@alexatkin I just think a lot of people who don't remember the "bad old days" do not realize just how amazing that technology is.
My main machine has PCIe 4, and really nice Samsung NVMe SSD's. They can hit close to 7GB/s, which is a stunning figure to my mind. Keep in mind, my first computer was a TI99/4a with a CPU running at 1MHz. (Although, it was a 16-bit CPU, unheard of at the time!)
I don’t know which I like more: That Linus went there with the EPIC/Steam joke or that Jake threw objects at Linus for going off script. Best. Intro. EVAR!
settle down nancy.
I was wondering if it might be because of battlenet... Because rip battlenet.
maybe that was also in the script. Big brain thinking.
@@LikeABawzs Can’t say I’m worried if it was actually in the script or not. I just heard, “It’s going to be EPIC!” and had the immediate reaction that “you _can’t_ let that one go!” Linus did not disappoint and it only went downhill from there in the best way possible. 😄
My work place also using the same nginx to cache content served from machine in another continent. We are much smaller in scale though with just only 2 machines serve as cache server. However the benefits is huge and tons of bandwidth save each month for the meager internet service we got.
Regarding the CPU usage (Or lack thereof), nginx tries hard to use sendfile(), which is a Linux API that speeds up sending data by a lot while saving on CPU cycles. Personally I don't have much to do with networking so it's nice to see in action :)
1:07
Linus: It's gonna be freaking EPYC
Intel: ...
I just ordered the backpack I can’t wait for it. keep up the good work.
I saw the video 4 years ago, and OMG time flies
"only gig" (to each station). Gotta love 2022. I remember LAN parties on dual ISDN 64k channels, playing Rainbow Six: Eagle Watch/Rogue Spear/etc, back in 1998ish.
Thank you Linus! I tried this hardware and my downloads went from 1 hour to 60 minutes
that still a hour LOL
@@traytar3193 r/wooosh
Super cool stuff.
Would love to see more of this "practical" self hosting and home server videos
Jake, you really crack me up sometimes.
Great vid
just a random thankyou for doing what you do. Through the good the bad and the ugly your videos cheer me up. the world may be messed up but you are one of the things that keep me going, thankyou and i mean it. things are not good but you and your videos are one of the few lights to my long dark nights. keep on teching, we all got this one way or another. let LTT live on forvever
500watts is probably most common if you have 200 watts of overhead on the server . they dont generally let you O.C. server gear . potentially psu efficiency curve or future cpu thoughts
Also, far less thermal loading and general stress on the silicon of the switching FETs & diodes used in the PSU
“You’re not gonna download Warzone with 1/mbps”
You have underestimated my abilities for the last time, Linus.
I've commented on this video before, but I now have this set up at home (multiple systems, and too many games to keep installed all at once, plus Australia). I'm still downloading stuff to the cache (currently 2TB down, no idea how much to go), but the tests I've done have seen up to 240MB/s (my internet is 100Mb, or 12.5MB/s), and while that's peak and it's usually not THAT high, I'm extremely happy with how it's gone. Great practice for when I build a proper server for it rather than use a miniPC; I deal with this kind of hardware at work, but not the software side of things, so playing with that has been fun and good practice with the miniPC and an 8TB SSD...not sure one of them will be enough; might need another 8TB XD
I been looking at making this kind of cache since I plan on hosting some LANs down the line. It also has a lot of benefits for average use since the local cache can cache a lot of web content that can just be fed back to you on your local net instead of having to constantly redownload a bunch of content all the time.
I think LAN Cache is only setup for actual downloads like particular games servers and Windows Update. It's not a web cache which grabs anything the user looks at. In fact that concept is practically obsolete unfortunately due to https encryption used everywhere. You simply can't switch the source that way on https like you could on http.
In the last decade cache web content has gotten much harder. HTTPS basically requires you to man-in-the-middle every user to inspect whether a request is cachable.
Game downloads work because the whole system is designed to be cachable via CDNs and ISPs. They purposely send the large files over insecure HTTP then verify the files over a seperate secure channel.
@@handspiker1994 thanks for explaining this, I was wondering why they weren't having any certificate issues
Yeah, TIL that apparently a lot of heavy payloads for game services and Windows are sent over http and it is not a big problem. Windows Update, for example, does a special https handshake before the payload is transmitted and this secure channel shares a hash of the payload signed by a Microsoft certificate. On the your end, Windows verifies the payload hash using Microsoft's public certificate. So, in theory, an attacker would have to forge a certificate or compromise https, none of which are feasible. Even though the payload is sent in plain! It's very neat!
I remember going to LANs (my last one was in 2013 though) and they also did this. Actual download speed was garbage, also around 5-8 MBit, but the caching method was amazing.
Neat. I recall using a 2GB drive way back in the day trying to delete pictures to have room to uninstall stuff for Diablo 1 or something.
It's good to know the same "issue" exists with larger drives.
Love it. It's the things I know are possible but I don't have the time or real need to do it. LOL
I bought a Raspberry Pi to make my own DNS cache. Turns out, I never get stuff done because I have 100s of wants on my todo list.
Been about 25 yrs since my first LAN party... Those were the days. Bring back LANs :)
Linus flexing his boss muscle at 9:00
Did you guys have to distribute a certificate to 150 people or does TLS just not exist on that type of content from those providers?
You can tell Jake is one of the real tech guys, he has his machine plugged into the 10GB Core. Also, nice job on breaking DHCP!
As much as I love beautiful stabilised shots of B-roll, the one shot at 4:15 of the back of the server having that little shake to it brings an air of humanity to b-roll in a way I can't describe. Still beautiful
I run a 10-person LAN on 30mbps with this technique plus some aggressive traffic shaping. 👌
Not quite this hardware though...a cobbled together machine full of spare SSDs LVM-striped!
whats aggressive traffic shaping?
@@ahmedifhaam7266 traffic shaping is where you limit certain kinds of network activity. So cutting things like file sharing in favour of online gaming.
I can tell from your sore throat that you filmed your last piece after the event, when everyone had left 😂 no worries, it cool.
Sometimes I wonder how you guys have 14.8m subscribers. Then I watch an intro like this and just nod :)
I would love to see a following up video after the LAN about how good (or bad) it went.
Oh they're definitely doing one (or more), you think LTT would miss such a video(s)? Lmao
It is up on floatplane as BTS (nearly 24 mins)
I am in tears. These two working together is hilarious.
I'm surprised of how little coverage of the LAN event I saw on Twitter
Something to consider, split udp and tcp. While Gaming you only need a really small amount of bandwidth. Reserve about 200 mbit for udp traffic and the rest for all other traffic. Ofc on top of caching :)
I actually followed that same Raid tutorial at the beginning of the year to setup my media drive for my Ubuntu 20.04 server and I also use Netdata on it
As a helpdesk tech, watching Linus bork a DNS flush is funny
I was already chuckling at Linus failing to type the command and Jake's "Are you drunk?" absolutely sent me
me when their "unacceptably slow" speed is my average speed
Always put a dummy compressed file on mission critical server boot files that takes up ~ 10% of the drive when you install it.
Then when things go wrong and the boot drive gets filled, you have a simple way to free space and work out what's going on.
thats a good one ill have to tell the guys about it
linus looks more and more insane every video that passes
I love your videos man they help me so much
Fax v1nce
Watching you guys work on this makes me so glad I spent my career working with real steam. 😵💫 As always, fascinating stuff.
I was confused until I noticed what you mean with real steam xd
You a nuke?
@@tegopro86 No, real Snipe, Boiler Technician
Wouldn't be a Linus Video without from Drops :)
Jake:flush the dns
Linus: slaps keyboard violently
I highkey love this kind of content 🔥🔥 Server type videos > most other content.
Running out of internet? That’s no big deal. We were running out of milk one day, I’ll just ask my dad to run to the store to get some internet for you, he should be back with the milk soon…
What happened to volumes reserving some space exclusively for root use, in case they get written full so that syslogs and root shells will still work? Did you turn that of or has it come out of fashion?
i love the jake/linus banter
Every single day this dude test me on how much he knows.