Part 2: DIY AMD NAS with Unraid & ZFS Software Setup, ft. Level1Techs

Sdílet
Vložit
  • čas přidán 9. 11. 2019
  • This is part 2 of our journey embarking on a custom DIY NAS, this one focusing on software setup for Unraid & ZFS (ft. Level1Techs).
    Sponsor: Get Linode Cloud Computing (geni.us/NehI9e - code GNEXUS20 for $20 credit)
    You can find part 1 (hardware setup) here: • Building the Ultimate ...
    For this video, our NAS box is already built (hardware linked below) and we just need to deploy the software. Wendell walks us through setup for Steamcache, basic file structures, drive groupings as vdevs, and initial configuration for the NAS. We're using ZFS and Unraid together so that we can run VMs with transcoding scripts for old footage, something that Wendell was able to figure out for this video.
    Wendell's tutorial is here: forum.level1techs.com/t/zfs-o...
    Support GN via the GN Store (modmats are now in stock and shipping!): store.gamersnexus.net/
    Wendell & Level1Techs can be found here (they're uploading a video from GN HQ also!): / @level1techs
    In this video, we'll be installing software for our NAS. Find the hardware below:
    ASRock Rack X470D4U2-2T AM4 Motherboard w/ IPMI (Amazon): geni.us/cqFS
    AMD Ryzen R5 3600 (Amazon): geni.us/XMMNrW
    SilverStone CS381 (Amazon): geni.us/1fqCikA
    Cryorig C7 cooler (Amazon): geni.us/Dp35EL
    AMD RX 5700 (Amazon): geni.us/YHAbFc
    Old NetApp disk shelf
    Like our content? Please consider becoming our Patron to support us: / gamersnexus
    ** Please like, comment, and subscribe for more! **
    Follow us in these locations for more gaming and hardware updates:
    t: / gamersnexus
    f: / gamersnexus
    w: www.gamersnexus.net/
    Host: Steve Burke
    Guest: Wendell from Level1Techs
    Video: Andrew Coleman
    Links to Amazon and Newegg are typically monetized on our channel (affiliate links) and may return a commission of sales to us from the retailer. This is unrelated to the product manufacturer. Any advertisements or sponsorships are disclosed within the video ("this video is brought to you by") and above the fold in the description. We do not ever produce paid content or "sponsored content" (meaning that the content is our idea and is not funded externally aside from whatever ad placement is in the beginning) and we do not ever charge manufacturers for coverage.
  • Hry

Komentáře • 521

  • @GamersNexus
    @GamersNexus  Před 4 lety +100

    You can find part 1 (hardware setup) here: czcams.com/video/Hix0l8cFaMw/video.html (hardware is linked in the description)
    Subscribe to Wendell & Level1Techs! czcams.com/channels/4w1YQAJMWOz4qtxinq55LQ.html
    Wendell's tutorial is here: forum.level1techs.com/t/zfs-on-unraid-lets-do-it-bonus-shadowcopy-setup-guide-project/148764

    • @wboyd33
      @wboyd33 Před 4 lety +1

      Off topic but thought you might this intersting...I just looked on Newegg.com and found the Intel i9-9900KS going for 1,199.00. Couldn't that be considered price gouging?

    • @NickF1227
      @NickF1227 Před 4 lety +2

      Where's the cores for sale montage video

    • @Zarcondeegrissom
      @Zarcondeegrissom Před 4 lety +2

      I have to admit, this is the first vid on this NAS stuff that has me thinking I could actually set this up and use it, instead of glamour shot vids that only show a pretty box with blinking lights that "does stuff" and leaving me with no clue how to actually use the box sitting in the corner, lol.
      now for the hassle of getting it to show up in "my computer" on this PC like any other hard drive in this PC, so I don't need to recompile third-party apps I don't have access to the source code for to convince them to work with some obscure network storage thing on the LAN, lol.
      Great vid Wendell, Steve, Andrew, and crew. B)

    • @andrewsmith4429
      @andrewsmith4429 Před 4 lety +1

      I'm trying to figure out Wendell's accent. It's not very strong making it a little difficult to discern. Alabama maybe?

    • @LawrenceTimme
      @LawrenceTimme Před 4 lety +2

      GMT is the only real time zone. All other time zones are fake.

  • @MorkaiAU
    @MorkaiAU Před 4 lety +634

    It's not often that Steve appears out of his depth, but I love the willingness and enthusiasm to learn, and just confirms that he is, in fact, human, as much as we all refer to him as Tech Jesus.

    • @maxmustermann194
      @maxmustermann194 Před 4 lety +44

      Even Tech Jesus is not all-knowing but he is evolving all the time until he reaches his final form!

    • @GamersNexus
      @GamersNexus  Před 4 lety +280

      It's impossible to always be in your depth, if that's a phrase, in this industry. Those who do well are the ones who know when it's time to ask for help. Wendell is a great teacher!

    • @rhoharane
      @rhoharane Před 4 lety +28

      You could say he’s both fully human and fully Tech Jesus at the same time. Some cardinals agreed on this many decades ago.

    • @wax88
      @wax88 Před 4 lety +29

      @Iama Dinosaur so like the holy trinity? Bless your hardware in the name of The Wendell, The Steve and the Holy Buildzoid?

    • @oldtimergaming9514
      @oldtimergaming9514 Před 4 lety +1

      @@wax88 Ha!

  • @nioinsane
    @nioinsane Před 4 lety +349

    Steve is very diligent following good tips. I see that he used the swiss army knife for building the storage server

    • @imagineaworld
      @imagineaworld Před 4 lety +4

      Theres one way...
      Thats it xD

    • @syuaip
      @syuaip Před 3 lety +9

      Which hopefully has a Philips screwdriver on it..

  • @uglyduckling81
    @uglyduckling81 Před 4 lety +103

    What I learnt from this video.
    If you need a proper storage solution you should get an expert like Wendell.

  • @Marc_Wolfe
    @Marc_Wolfe Před 4 lety +83

    I want to see more about the PXE boot setup.

  • @chrispressley4644
    @chrispressley4644 Před 4 lety +33

    I was tired but Wendell and Steve in one video is a must watch for me

  • @ChrisHolzer
    @ChrisHolzer Před 4 lety +16

    24:34
    There is a plugin to Schedule Tasks, there is also a plugin to have a Recyclebin inside the share. :)

  • @questionablecommands9423
    @questionablecommands9423 Před 4 lety +29

    I get why you like that Silverstone case, but I feel like for the features it has, the roadblocks you encountered, and the fact that you've got an external drive array, you would've been better off going with a standard rack-mountable chassis.

    • @PanduPoluan
      @PanduPoluan Před 4 lety +12

      Agree. But this is "kind of" a review of the Silverstone case as well, since Silverstone had kindly sent Steve that case. I do believe Steve will write up a report on how the case should be modified for the next iteration and send a feedback to Silverstone.
      So, I'll be looking forward to a Tech Jesus Edition (i.e., v2) of the case. I think I can see some use cases for that case (forgive me the pun) in my home ;-)

  • @jolness1
    @jolness1 Před 3 lety +17

    Love GN and Level1Techs, haven't seen this before.
    Server hardware is a different ball game, stuff like IPMI seemed stupid to me before I built a server but being able to tuck it away in the closet, have redundant NICs and a remote management interface with a hot spare drive in case I have one die while I am way from home, makes it easy to manage, which is good, I spend enough time at work fixing other people's shit, I want mine to work for my modest needs.

  • @curtisbme
    @curtisbme Před 4 lety +5

    I'd love to see this sort of thing look more the decision making process and enabling that. "why do you do, why do you do it, here's the solution that maps to that and why". These two parts felt like random bits of the process that folks would have a hard time determining if it applies to their (likely lesser) needs/desires.

  • @Kobrar44
    @Kobrar44 Před 4 lety +26

    I was hoping to learn something about building NAS servers but this series didn't really touch on any basics. Could you make a video on NAS servers sometime please?
    What platform should I choose? Do I need ECC memory? How many cores do I need? What budget/advanced options would you recommend? Should I go with existing solution?
    What should I look for when selecting my hard drives?
    Which RAID X should I choose? Should I rely on my motherboard? Should I use software manager? Should I go for some sort of extension card? When?
    Which OS should I go for? Why?
    What if I want to extend my storage capability in the future? Should I just go for more capacity immediately?
    What if one of the drives fails? How do I know? What do I do then?
    Are there any other considerations? Is UPS a good investment?

    • @Jimmy_Jones
      @Jimmy_Jones Před 4 lety +8

      I'm by no means an expert but a UPS is a must. Don't want to corrupt your data mid processing. I run freenas (It's free) with a nextcloud plugin on top.
      I use a PC tower with ECC however from what I read nowadays ECC requirements are a myth. Uses a core i3-6100, 16GB RAM and WD Red drives That cost me about £300 quite a few years back (drives not included)
      I need to update my system (I rarely use it so the configuration is out of date with my needs. I hate using power so rarely have it on. Draws about 60w without HDD'S).
      I now mainly use it as a Windows PC but it's all still there when I need it. I just need VMWare more for my Uni projects (It's my only desktop tower. For some reason I'm not using my Dell blade server (R710. Got that for virtualisation) That draws 180w idle (probably the reason). I need solar panels. Why do I love tech and the environment?

    • @lorcro2000
      @lorcro2000 Před 4 lety +2

      @@Jimmy_Jones ZFS "can't" corrupt data. It can only either write it or not. It's a copy-on-write system. Also, the data is checksummed, which further makes it extremely unlikly to corrupt anything and have it remain corrupted.

    • @Jimmy_Jones
      @Jimmy_Jones Před 4 lety +1

      @@lorcro2000 That explains why having a lot of RAM is important.

    • @PatrickDKing
      @PatrickDKing Před 3 lety +2

      I feel the same way. I've watched all the big tech channels on NAS, this one, Linus tech tips, and so many more and they don't really cover any useful and step by step information. It's all generic or to "impress" us with some crazy big storage system. Add to your question list, should I use software or hardware to run RAID nas.

    • @CptKenny
      @CptKenny Před 3 lety +1

      @@lorcro2000 well, if you have a power cut mid-write or, say, during a rebuild of the array, bad things may happen without a battery backup UPS

  • @jakobfindlay4136
    @jakobfindlay4136 Před 4 lety +125

    Is Wendel saying spinning rust when he refers to the HDD???

    • @odditi8293
      @odditi8293 Před 4 lety +54

      yep

    • @pronstorestiffi
      @pronstorestiffi Před 4 lety +48

      Older mechanical hard drives where coated in iron oxide, essentially rust.

    • @jakobfindlay4136
      @jakobfindlay4136 Před 4 lety +1

      @@pronstorestiffi ahh thought they were always made of of a higher quality metal

    • @johnm2012
      @johnm2012 Před 4 lety +16

      @@jakobfindlay4136 They have used platters coated with a high coercivity alloy for decades but iron oxide is traditionally one of the materials used in magnetic recording media.

    • @ChristopherGoggans
      @ChristopherGoggans Před 4 lety +16

      @@jakobfindlay4136 they are using the best possible material for the task..... I'm sure it's a unbelievably pure iron oxide formed from a specific iron alloy under very specific conditions. It just happens to have an almost identical chemical makeup to generic rust. Hence "Spinning Rust" 😁

  • @JasonOfTGA
    @JasonOfTGA Před 4 lety +36

    Haha, Wendell fried Steve's brain before the shoot started :D EPIC

  • @Sc0rphionx
    @Sc0rphionx Před 4 lety +2

    look i have to pause just to write this, Amazing 11:03. How you akw that you didnt know what LVM is. Im so subscribed to you because of this. To akw something that people should "believe you know" but u clearly dont is a humble amazing thing. kudos man... really kudos

  • @p0xus
    @p0xus Před 4 lety +2

    As an unraid user myself, I love watching Steve learning stuff I already know for a change. Absolutly love the questions and stuff though. Its rare that you can see people actually learn with you.

  • @hypersmartbob
    @hypersmartbob Před 4 lety +17

    Love getting the add for the jellyfish server when trying to watch this video

  • @aaardvaaark
    @aaardvaaark Před 4 lety +3

    This collab stuff is really awesome, Wendell and Steve are a good match for making these in-depth vids.

  • @RealDids
    @RealDids Před 4 lety +68

    Just use the crap out of Unraid plugins, and you can pretty much have all the functionality you want, like job scheduling from the web interface.

  • @videowatcher495
    @videowatcher495 Před 3 lety

    Wendell reminds me of a guy that use to work for my dad. I like see Wendell in this type of mood and environment, creates very sentimental feelings.

  • @XxThePlaylistxX
    @XxThePlaylistxX Před 3 lety +3

    PXE Boot is extremely helpful. We used to image using PXE but since switching to Windows 10, we have been having to use a bootable flash to pull images, or just doing full images off flash drives. I wish we still had PXE boot.

  • @Shadepariah
    @Shadepariah Před 4 lety +73

    ZFS on UnRaid? You created UnUnraid.

    • @Megalomaniakaal
      @Megalomaniakaal Před 4 lety +1

      UnUnRaidRaid

    • @solarstrike33
      @solarstrike33 Před 4 lety +10

      So just RAID again.

    • @garytill
      @garytill Před 4 lety +25

      Unraid is a decent hypervisor and docker host, but for the money i'd've gone with a straight linux install for a ZFS setup like this.
      The value of unraid is the ease of use, and mixed drive compatibility, which they are simply wasting in this setup.

    • @PanduPoluan
      @PanduPoluan Před 4 lety +7

      @@garytill GUI is slick, though.

    • @yucktube
      @yucktube Před 4 lety +2

      I love how all the brown nosing bootlickers commenting on this video don't even realize this most glaring fault of all of its flaws. Thank you for an actual expert comment on a perceived experts show.

  • @sharkwithmanners1734
    @sharkwithmanners1734 Před 4 lety +1

    Hi Steve loved the video, always enjoy videos of collaborations featuring Wendell.

  • @artisan002
    @artisan002 Před 4 lety +1

    There's something very satisfying/comforting about all this.

  • @_0x00
    @_0x00 Před 4 lety +2

    virt-manager as of 2.2.0 has an xml modification switch which has been awesome. good on unraid for adding this.

  • @caseychaos3601
    @caseychaos3601 Před 4 lety +1

    Ah good ol' ghost 32 and ghost 64 definitely good times to be had there! These videos are really making it a challenge to not build a server of my own. Awesome content as always and thumbs up for part 2!

  • @veizour
    @veizour Před 3 lety

    34:09 Thanks for speaking on BTRFS for the snippet.
    Interesting video all around. Thanks!

  • @kaitoharrison872
    @kaitoharrison872 Před 4 lety +286

    Is it fair to call Wendell "Tech Buddha"?

    • @PainterVierax
      @PainterVierax Před 4 lety +37

      It's already Gordon from PCWorld

    • @DrathVader
      @DrathVader Před 4 lety +35

      Wendell was born from human parents, but thanks to his desire to learn and dedication he obtained the ultimate knowledge and ascended to god-level understanding of tech.

    • @teddygoboom1
      @teddygoboom1 Před 4 lety +18

      After seeing him introduced a few days ago I think tech Lucifer might be more fitting

    • @mz-pd5hw
      @mz-pd5hw Před 4 lety +12

      @@teddygoboom1 and master of the dark arts of the penguin and FOSS

    • @solarstrike33
      @solarstrike33 Před 4 lety +16

      Current god list:
      Tech Jesus / Weird Al: Steve
      Tech Dad: Jay
      Tech Satan (plus others): Linus
      Tech Moses: AkBkukU
      Tech Buddha: either Wendell or Gordon
      Any others?

  • @rossogilvy3752
    @rossogilvy3752 Před 4 lety +1

    Wow, this was some serious information. I will need to watch this a few hundred times more, even then my brain will melt..again! Great stuff GN.

  • @shadoh9113
    @shadoh9113 Před 4 lety +2

    Love seeing more enterprise and soho content! Reminds me of work, and some of the stuff level1 mentioned with the details are good to know details. Keep it up!

    • @shadoh9113
      @shadoh9113 Před 4 lety

      Would tdarr meet the scripted transcode needs? Install the docker, point to the library, and setup your plugins for transcoding. It's been working wonders on my media folders.

  • @KRGraphicsCG
    @KRGraphicsCG Před 4 lety

    This was an awesome series... I love learning from people and this is refreshing to see

  • @stuw5376
    @stuw5376 Před 4 lety

    Love the video, this is exactly what I’m looking at the moment, ZFS, NAS etc.

  • @eddsson
    @eddsson Před 4 lety +33

    "And it started deleting 2018." GN, you are f*cking amazing! :D

    • @CptKenny
      @CptKenny Před 3 lety +6

      do you think he could delete 2020?

    • @eddsson
      @eddsson Před 3 lety +3

      @@CptKenny I wouldn't mind if he tried to be honest. :|

  • @BRUXXUS
    @BRUXXUS Před 4 lety +1

    Oh man... I wish I could just download all Wendel's knowledge into my brain. Servers and networking are definitely one of my bigger blindspots.

    • @yucktube
      @yucktube Před 4 lety

      Thank god you can't and thus have still a chance to learn from actual experts.
      FYI: they just un-unraided UnRaid, dumping exactly what the point of UnRaid really is.

  • @bassplaya69er
    @bassplaya69er Před 4 lety +3

    Scheduled tasks in Unraid with GUI can be achieved by installing the Community applications plugin and then the user script plugin. Also worth adding the mover plugin to change when hourly / daily / monthly etc scheduled tasks are run.

    • @Level1Techs
      @Level1Techs Před 4 lety +3

      This is what we did in the tutorial if just seems odd that requires a community plugin ...

    • @nxgentech
      @nxgentech Před 4 lety +1

      @@Level1Techs I agree that the UI can be weird at times (e.g. at some point the checkboxes were actually displayed as radio buttons) and some decisions could be difficult to understand especially for newcomers. Tom is very careful about adding features directly into Unraid. To my knowledge, he and another dev are still the only full time coders on the project so they only work on things that are high priority and delegate the rest to the amazing community. Things like Community Application and UserScripts plugins are well known to any Unraid users and people will find those things easily once they browse the forums. The apps and plugins can be maintained and supported by the app owner and the community, which has worked very well for years now. Also, some people still only want the main feature of Unraid (the Array) and nothing else (no bloat). Tom has said a few times that he always want to focus on that aspect first, because that's the core of the product (which is a bit ironic in the context of this video since most benefits of the array are lost).
      In any case, thank you Wendell for helping the community, I'm sure the GN team will enjoy their new NAS and all the possibilities that it offers !

  • @SyberPrepper
    @SyberPrepper Před 4 lety +1

    Thanks guys for these videos. It's great you can do ZFS on Unraid, FreeNAS and Proxmox. Lot's of options.

  • @GeoffSeeley
    @GeoffSeeley Před 4 lety +12

    You should be using Proxmox if you want ZFS, hardware pass-through, clustering, virtual machines and containers. Oh, and its free.

    • @blackfireburn
      @blackfireburn Před 4 lety +1

      Doesn't support windows VM or pass through last i checked

    • @bourbonwarrior1618
      @bourbonwarrior1618 Před 4 lety +3

      @@blackfireburn Proxmox has supported windows and pass through the whole time Ive been using it. Which has been almost 3 years. You used to have to do pass through on the command line but its in the GUI now

    • @bourbonwarrior1618
      @bourbonwarrior1618 Před 4 lety +4

      I also thought it was weird Wendell chose Unraid. Proxmox seems like a perfect fit. It would be nice to hear his reasoning for it

    • @GeoffSeeley
      @GeoffSeeley Před 4 lety

      @@blackfireburn I setup a Windows 2016 VM with an LSI HBA passthrough on Proxmox yesterday. Works fine.

    • @BGraves
      @BGraves Před 4 lety +1

      @@bourbonwarrior1618 user friendliness for steve

  • @seamydobbsno1
    @seamydobbsno1 Před 2 lety

    My goodness. I really to need to start upping my knowledge, so much of this went straight over my head!

  • @didjeri
    @didjeri Před 4 lety +3

    Finally!!!
    I've been waiting for this video! :D sooooo excited! Liked & Subbed :D

  • @sapphie132
    @sapphie132 Před 4 lety +2

    The cool thing is that they very likely benefited from the web cache when testing RDR2, it's really cool seeing past content that has already paid off

  • @johnnybegood8049
    @johnnybegood8049 Před 4 lety +2

    Wendell, I can’t wait for your next video about comparing Server solutions like Unraid and FreeNAS.

  • @dankswtf
    @dankswtf Před 4 lety +1

    Great stuff, very informative. Always love a good techtuber crossover

  • @pililogan5769
    @pililogan5769 Před 4 lety +1

    Great job once again both of you, Wendell you are the person to go to for nuts and bolts, but darn you can spit it out fast.

  • @cjsfriend2
    @cjsfriend2 Před 4 lety +1

    Great video, gave me some good ideas for when I build my own NAS

  • @leonbrooke5587
    @leonbrooke5587 Před 4 lety +34

    Huge fan of the Star Trek terms. I need to name my things with Star Trek terms

    • @Tallnerdyguy
      @Tallnerdyguy Před 4 lety +3

      Eventually it will lead to those names, figure star trek is a few hundred years into the future

    • @leonbrooke5587
      @leonbrooke5587 Před 4 lety

      @@Tallnerdyguy the Star Trek names for these machines are like transparent aluminium! 😁

    • @docferringer
      @docferringer Před 4 lety

      I was really hoping they named the storage tank "DumpsterFire", but apparently Wendell and Steve are not as original when it comes to naming things. ;)

    • @tyrantworm7392
      @tyrantworm7392 Před 4 lety

      This sort of nomenclature is common in IT. I've seen a large PLMN name all their firewalls from Klingon mythology for example.

    • @bepbep7418
      @bepbep7418 Před 4 lety +1

      Star Trek HAS inspired MUCH of the technology we have today. So it's not really a stretch

  • @grant-is
    @grant-is Před 4 lety +5

    Hi, I think there's a polarisation of responsibilities when it comes to the success of UNRAID. Namely in the more complex core features of unraid vs what can be achieved with the app store/plugins. I've found some very fantastic utilities to enhance the unraid experience. Namely libvert hotplug and auto user scripts. Cheers

  • @Hobbiekip
    @Hobbiekip Před 4 lety +1

    This is just great. The only reason I stuck with FreeNAS was ZFS, unraid here I come.

  • @gotscroogled
    @gotscroogled Před 4 lety +2

    Wendell + Steve = Awesome!

  • @middleclassthrash
    @middleclassthrash Před 3 lety +1

    6:59 earned the thumbs-up

  • @brownishblue
    @brownishblue Před 4 lety

    I love when my favorite tech youtubers mention my other favorite youtubers :D

  • @fandomkiller
    @fandomkiller Před 3 lety

    wendell, the original tech jesuz, long live tech syndicate

  • @WayStedYou
    @WayStedYou Před 4 lety +346

    Windows eating paste confirmed

    • @maxmustermann194
      @maxmustermann194 Před 4 lety +2

      What does he refer to? Some another win10 bug?

    • @KilianGosewisch
      @KilianGosewisch Před 4 lety +28

      @@maxmustermann194 I think it's his version of "the kid eating glue".
      I like it.

    • @or2kr
      @or2kr Před 4 lety +9

      @@maxmustermann194 Windows sometimes does strange things without user input, it corrupted my GRUB for Linux dual boot twice already with just a Windows update

    • @Chriva
      @Chriva Před 4 lety +5

      @@or2kr They have a reason for that. Lots of windows "cracks" (slic, bios hardware spoofers etc) and viruses are installed in the bootsector. Besides.. why bother with dual boot? Just make a virtual machine. Having to restart and select which one to use is just a pain in the rear

    • @or2kr
      @or2kr Před 4 lety +3

      @@Chriva The issue is, I really like playing games on my machine and I need bare metal performance for that. I'm trying to get my GPU to pass through and only my latest attempt today worked due to a newer Bios that I was already on hindering the process. The Laptop with the issue is still not fixed since the last "breakage", but I only really use it for things only a native Windows machine can do + things that aren't really dependant on a good OS, so I sadly have retreated from that front. My gaming rig will always have Linux as the root system though

  • @johngaltline9933
    @johngaltline9933 Před 4 lety +42

    I love Wendell, but when it comes to unraid I think we need to get SpaceInvaderOne in here. Get community applications installed on that unraid box! Plenty of apps for scheduling and such. (also moving the cache to spinning rust scheduling is built in)
    Over all I'm somewhat confused on the point here. I can't find a point in running ZFS on unraid, at least for any practical setup. The only advantage I can come up with is just maybe increased read speeds. For that you give up all the reasons one would choose to use Unraid in the first place. You lose the cost savings of only needing 2 parity drives for up to 28 data drives, now with ZFS you need at least 1 for every what, 4 drives? You lose the ability to add single drives when ever you need more storage. You lose the ability to add drives of different sizes. You lose the fact that in unraid if more than 2 drives fail you only lose the data on those drives and everything on the other drives is still safe.
    Over all you are left paying for an unraid key while neutering all of the reasons to choose it over free options like freenas... or simply running the server as a linux machine and running KVM VMs as needed. It's neat that it can be done, but I'm unsure why it would be done. Am I just missing something here? I suppose, from what I can see it looks like the ZFS pools are set up as unassigned devices, so it might be a 'hack' to get around the 28 drive limit, I suppose, while retaining parity on those additional drives?

    • @KingHalbatorix
      @KingHalbatorix Před 4 lety

      KVM VMs

    • @LA-MJ
      @LA-MJ Před 4 lety +5

      ZFS is supposedly more battle-tested. And you can add drives of different sizes, it's just that the smallest one determines the vdev size. That does not prevent you from having different sized vdevs though.

    • @muf1772
      @muf1772 Před 4 lety +7

      To be honest I find myself more wondering why they're using Unraid if you're using ZFS and all these manual scripts anyway. Having all the storage marked as "unassigned" and then not having an interface for ZFS and Cron is so cringe. Why not just use something like Proxmox that's actually made to work with ZFS.

    • @rationalityfirst
      @rationalityfirst Před 4 lety +11

      @Muf he said, it offers better compatibility with Ryzen CPUs and hardware pass-through.

    • @johngaltline9933
      @johngaltline9933 Před 4 lety +3

      @@LA-MJ I'm of the oppinion that being able to waste drive space unused does not count as being able to use different sized drives. if you have the money to waste on not actually using the full capacity of a drive, then you have the cash to buy 5 or 6 identical drives at once in the first place.
      With unraid running it's native file system, you can mix and match drives of any size while retaining the full storage capacity of every drive. the only limiting factor of this is that the parity drives must be at least equal, or larger than all other drives.
      As far as ZFS beiing more tested, or better in some way, in general it is more robust than unraid in some ways and theoretically has faster data transfer, though using the SSD cache in unraid tends to negate the speed issue in most use cases. As far as redundancy being better or worse, when it comes dow to it if that is your primary concern... making sure you don't lose any data, I still think running unraid native storage makes more sense. First in the event of multi drive failure you only lose the data on the failed drives, where as in ZFS you lose all data across all drives in that array. Secondly, no matter which file system is used, your box is still in the one location. if protecting the data is the goal, then it seems smarter to me to save some cash on drives in the first place and buy more drives to run a mirrored back-up server off site.

  • @TheZelvan
    @TheZelvan Před 4 lety +4

    What a coincidence in the past couple weeks at my work I've created a FOG raspberry PI system that we give to customers to deploy clean images to their computers to manage.

  • @FryGuyNS
    @FryGuyNS Před 4 lety +1

    unRAID out of the box is a bare system with a minimum of features. You need to add the Community Applications then add the System Plugins and Docker Applications you need. This includes the Cronjobs and user scripts plugins. There are a number of things specific to unRAID you need to learn by using it and customizing it to your needs.

  • @danielbernhard1250
    @danielbernhard1250 Před 4 lety

    Nice. Youre the first ohne i mention, Who doesnt go all on the Top Hardware. Instead searched a Konfiguration which maches your needs, with some headroom.

  • @uss_04
    @uss_04 Před 4 lety +2

    Wish I knew Wendell and Steve were so into trek.
    Wendell should have shown up stating
    “Please State The Nature Of The Technical Emergency”

  • @hammerheadcorvette4
    @hammerheadcorvette4 Před 4 lety +1

    Amazing Collaboration !

  • @MustangsbyMatt
    @MustangsbyMatt Před 4 lety +3

    Loving the Swiss Army knife.

  • @futurematt9791
    @futurematt9791 Před 4 lety +8

    Great video, love DIY server stuff! Could you show a little bit about how the disk shelf is connected to the unraid server both from a hardware standpoint and the unraid OS?

    • @johnm2012
      @johnm2012 Před 4 lety +3

      That's the easy bit - via an external SAS connection. More likely two for more bandwidth and redundancy.

  • @saultube44
    @saultube44 Před 4 lety +12

    "just the 14 TB Hard Disks"
    certified r/DataHoarder member

    • @saultube44
      @saultube44 Před 3 lety

      @Marcin Berman Google it next time

  • @Chivaughn13
    @Chivaughn13 Před 4 lety +16

    I was about to sleep but who needs that now I guess. 🤷🏾‍♂️🤷🏾‍♂️🤷🏾‍♂️

    • @danielharvison7510
      @danielharvison7510 Před 4 lety +2

      Sleep? What is this sleep madness you speak of? Here I am at around 2am (aest) watching this stuff. Oh well, time for more coffee!

  • @BorisDessimond
    @BorisDessimond Před 4 lety

    Watched the video when it came out.
    Managed to grab 72TB for 600$. Enough to store my "personnal 4K BR collection", to game on it, and to act as a free server to collect data from LORA sensors.
    Now I'm turning my 1950X based gaming/video editing computer to a server...
    Wanted to get information on LSI cards configuration, came back to watch the video again :p.

  • @CptKenny
    @CptKenny Před 3 lety +1

    7:15, you cant forget the ET routine, Windows phones home so often they've stopped picking up.

  • @SmokinGoodd420
    @SmokinGoodd420 Před 4 lety +99

    Gotta Love How Wendel has that Shit-Eating Grin in the beginning , ahaha Lmao Love You Guys !! Awesome Video!

    • @charlesballiet7074
      @charlesballiet7074 Před 4 lety +8

      2 people nerding it out to 11... why yes I would be smiling too

  • @D3nchanter
    @D3nchanter Před 3 lety

    Thankfully I was able to follow along for much of this, but i'll definitely need to look up the tutorial on his website for the how to. Im not really sure my home network would need anything like this, and if it did, im not sure i'd be able to set this up successfully. Lots going on with that setup.

  • @rompdude
    @rompdude Před 4 lety

    I've used pxe boot from my Synology before. Worked well.

  • @ciaduck
    @ciaduck Před 4 lety +9

    Wait! Did Wendell just recommend Unraid over FreeNAS?

  • @Scorpius165
    @Scorpius165 Před 4 lety +2

    Steve, love your content!
    Do you think you could do a review for gaming monitors sometime (such as the Gigabyte Aorus I guess you're using in this video)?

  • @arthurhaag8946
    @arthurhaag8946 Před 4 lety +6

    there is a plugin for custom scripts.... its called "User Scripts"

  • @jaws9450
    @jaws9450 Před 4 lety +1

    Best video to watch at 5:57 am :D

    • @hammerheadcorvette4
      @hammerheadcorvette4 Před 4 lety

      Good way to start your day

    • @jaws9450
      @jaws9450 Před 4 lety

      @@hammerheadcorvette4 Was actually going to bed ;) Just woke up :P

  • @apefu
    @apefu Před 4 lety

    Love this so much

  • @robertrhoads6248
    @robertrhoads6248 Před 4 lety +4

    This is probably the most interesting video I’ve ever fallen asleep to.

  • @BLKMGK4
    @BLKMGK4 Před 4 lety +1

    unRAID has a pretty robust community, you'll find there's a plug-in for CRON :) Their Container interface is pretty outstanding too - until you want to do things outside of their ecosystem and then it's a little harder but again the community kicks butt building Containers. Also, be careful editing at the XML level, that's under the covers and could get reset when you tweak something in the GUI.

  • @bertnijhof5413
    @bertnijhof5413 Před 4 lety

    I run my daily work on desktop and laptop in VMs. I run the VMs and the desktop Host from a 512GB nvme-SSD. The host is a minimal install of Ubuntu 19.10 with the experimental ZFS booting. I have a recovery install of Ubuntu using an ext4 partition on one of my two HDDs. In September 2019 I did try out this dual boot configuration in Virtualbox.
    I use ZFS to incremental copy my VMs from desktop to laptop, so on the road I have exactly the same distros with the same settings. Desktop and laptop also use the same Virtualbox shared folders (datasets) with all my info using the same mount points.
    My backup server is a 32-bits Pentium 4 HT (3.0 GHz) with 1.2TB in 4 HDDs (2 IDE and 2 SATA-1). It runs on FreeBSD 12.1 and weekly I run my incremental backups to that system out of 2003. Also this combination has been tested first in Virtualbox. The disadvantage is, that the Pentium limits the 1 Gbps link to 200 Mbps due to a 95% CPU load of the network process. I still have 4GB DDR2 and a 3-core Phenom, so I consider to look for a cheap AM2 motherboard to get ~800Mbps.

  • @lunks
    @lunks Před 4 lety +1

    Just a reminder that there is a docker container for handbrake which might make it more efficient, no need to allocate RAM specifically for it.

  • @veretos7
    @veretos7 Před 4 lety

    Wendell is my hero

  • @PupShepardRubberized
    @PupShepardRubberized Před 4 lety

    wags wags yay! im getting a disk shelf for myself too

  • @BrianGarside
    @BrianGarside Před 3 lety

    Love watching these, but I think I will stick with a pre-built NAS from QNAP with ZFS.

  • @borys4206
    @borys4206 Před 4 lety

    Wendell is a cool guy!

  • @hccwarriordan5475
    @hccwarriordan5475 Před 4 lety +4

    I see you have your tech grade Swiss Army knife, Vergil...

  • @mysmtpservices4818
    @mysmtpservices4818 Před 4 lety

    I found this interesting, but for me - there was lot missed out, like the showing us more about the VM's cashing and a clear work through of setting up the ZFS

  • @yaronilan2317
    @yaronilan2317 Před 4 lety +9

    Question: What is your data backup solution for all of this new storage?

  • @lazerusmfh
    @lazerusmfh Před 4 lety +8

    I’ve used unraid for years successfully with multi gpu/device pass through. I tried doing things with freenas... freenas is a huge HUGE pain in the ass. It would break and would require so much time trying to figure out WTF is going on.... unraid had some of that, but the last year or so has been fantastic for me

    • @MyName-tb9oz
      @MyName-tb9oz Před 4 lety +2

      I've never tried UnRAID but I did give FreeNAS a shot. Not only was it a bit of a learning curve but it was also bizarre and unpredictable. When I signed up for the forums to ask about some truly weird behavior that could not possibly have been by design I got a couple of replies that were slightly helpful and then I some .ickhead, silver-back wannabe steps in to tell me how I'm doing everything wrong and how I should just get off the forums if I don't want to do it exactly the way he says.
      Half of the posts on the forums were not much more than Intel worshiping kumquats who thought that it was stupid to want to run FreeNAS under bhyve on FreeBSD. Especially on AMD HW. Yes, of course, who would want to run FreeNAS in a VM? How stupid! Yeah, that was a few years ago but the whole thing left a bad taste for FreeNAS. I doubt I'll ever use it.
      A big part of why I have no plans at all to use FreeNAS is ZFS.
      As someone else mentioned, ZFS looks absolutely awesome. On paper. In reality most of what I saw of ZFS a few years ago on the FreeNAS forums was, "Oh, GOD! HELP ME! All of my data is GONE! It won't recognize my VDEVS any more! How do I get it to recognize the storage again? It just... quit. For no reason!"
      I really don't know how much of that was stupid user tricks and how much was just basic flakiness on the part of ZFS but I sure as hell wouldn't even think about using ZFS without serious enterprise HW. My home server is a dual socket Opteron board with 128GB of ECC RAM from about 7 years ago. It's pretty good HW. I still wouldn't use ZFS. There might not be enough redundancy in my system. Seriously, I wouldn't use ZFS in any situation where you can't run two identical systems with complete duplication of the data. And maybe a third identical system for testing changes. Not a VM. Identical triple-redundant HW. Maybe you want to call me paranoid. That's fine. But I have data that's older than some of the people reading this...

    • @linuxinstalled
      @linuxinstalled Před 3 lety

      Im really happy to hear about your positive experiences with unraid. Ironically, my experience was flipped and I migrated to FreeNAS haha. Different use cases I suppose. Cheers!

    • @lazerusmfh
      @lazerusmfh Před 3 lety

      linuxinstalled yeah funny how that goes huh :) everybody has different needs, though now that freenas is a bit more mature I would probably like it. Though unraid is pretty fantastic. I’m still running my unraid and it’s been flawless the last year or so

  • @aaronargent
    @aaronargent Před 4 lety

    Don't forget to add in recycle bin plugin for a place to store deleted files before cleaning them out

  • @M3PH11
    @M3PH11 Před 4 lety +2

    20:42 Holodeck is the name of the Star Trek Online Live server.
    27:28 WSUS exists

  • @MahdiYusuf
    @MahdiYusuf Před 4 lety

    I asked you delivered. Thanks for part 2.

  • @Shdw-zu9ee
    @Shdw-zu9ee Před 4 lety +1

    What Ram did you use ? Sorry if I missed the part where you mentioned it, but I am planning on building a Proxmox Server with a 3600 on ZFS and I am currently planing on going ECC Ram because I love my data and one VM will be a nextcloudhost.

  • @MazeFrame
    @MazeFrame Před 4 lety

    A friend of mine is running BeeGFS pools, because it is free and it can be made to go fast.

  • @nemesis851_
    @nemesis851_ Před 4 lety

    Happy with my XPENology

  • @brkbtjunkie
    @brkbtjunkie Před 4 lety +1

    Spinning rust. I like that.

  • @peterjansen4826
    @peterjansen4826 Před 4 lety +9

    I finally have discovered a flaw of Wendell, he is one of those people who touches other people their monitors. I always hated it when people do that, I don't want to clean my monitor more often than necessary and I don't want to see grease stains. Also outdoors I can't really clean your monitor, at home I just use some water with a bit of vinegar, that seems to work well.

    • @johnm2012
      @johnm2012 Před 4 lety

      He also touches CPU pins and PCIe card edge contacts, which makes me cringe.

  • @joelsondrew
    @joelsondrew Před 4 lety

    The HBA card you used only had internal connectors, how did you go about routing the external connections from the disk shelf to those connections? Just through an open PCIe slot with no cover?

  • @papageorgi
    @papageorgi Před 4 lety

    I think you guys may want to try freenas since I believe 11.3 (stable af beta at the moment) has updated smb shares and you don't need to setup cron jobs manually

  • @rustynail6363
    @rustynail6363 Před 4 lety

    Way over my head :) but it's like watching two kids in a candy shop :))

  • @thefoxman88
    @thefoxman88 Před 4 lety

    What docker are you using for the cache for Steam/Origin etc game clients?

  • @mz-pd5hw
    @mz-pd5hw Před 4 lety

    Ohh Wendell you magnificent bastard!, those two are too much nerdiness for 1 video. One slip into an in-depth talk about IOMMU, chipset drivers or filesystems performance and this whole channel would colapse and Skynet would awake

  • @JGnLAU8OAWF6
    @JGnLAU8OAWF6 Před 4 lety +19

    RaidZ1 with 14 TB drives? Is that even legal?

    • @yucktube
      @yucktube Před 4 lety +3

      It just shows the difference between an actual expert and a _perceived_ expert ...

    • @guy_autordie
      @guy_autordie Před 4 lety +1

      His ex-google server is the host of his 172Tb.
      czcams.com/video/MyK7ZF-svMk/video.html

    • @JGnLAU8OAWF6
      @JGnLAU8OAWF6 Před 4 lety +1

      @@sbdnsngdsnsns31312 it's not about file system, raw hdd speed isn't high enough.

    • @grey5626
      @grey5626 Před 2 lety

      ​@@guy_autordie Yeah, for reference I was administering TrueNAS systems with more than 300TB circa 2014 at a company with a much lower market valuation than Google/Alphabet, though older. Though, that was a CARP HA setup, so the raw storage was > 600TB.
      Despite what Wendell mentioned in the video, Btrfs is *not* trustworthy and never has been.
      Personally, I wouldn't trust anything less than an OpenZFS RAIDz2 as I was experiencing RAID-DP (NetApp's version of RAID6) with double drive failures way back in 2006. OpenZFS offers RAIDz3, use it.
      A RAIDz1 given the MTBF and BER (Bit Error Rates) on drives in excess of 1TB has been known to be abysmal enough that RAID5 was considered insufficient for anything intended for prod at least as far back as 2005.

  • @thedreadedgman
    @thedreadedgman Před 4 lety

    MOAR!!

  • @r-d6568
    @r-d6568 Před 3 lety

    I am going to pull the trigger and build my Unraid server with this motherboard.

  • @jonathanrodriguez2831
    @jonathanrodriguez2831 Před 4 lety +1

    I see all the youtubers using that monitor. Is it really that good? Should i get that or the PX7 or the LG?
    It would be for gaming and media consumption