What's On My Home Server? Storage, OS, Media, Provisioning, Automation
VloĆŸit
- Äas pĆidĂĄn 16. 05. 2024
- - What applications do I run on my home server?
- What OS am I using?
- How do I automate deploying and provisioning?
- How do I secure my services from unauthorized access?
...and many other questions, answered in this video đ
Links:
My Ansible Playbook: github.com/notthebee/infra
My Ubuntu Autoinstall Role: github.com/notthebee/ansible-...
"Ansible for Devops" by Jeff Geerling: www.ansiblefordevops.com/
"Ansible 101" Series by Jeff Geerling: âą Ansible 101 - Episode ...
Awesome Selfhosted Github: github.com/awesome-selfhosted...
Follow me:
Twitter / notthebeeee
GitHub github.com/notthebee
Twitch twitch.com/notthebeee
Support the channel:
Patreon / wolfgangschannel
PayPal (one time donation) www.paypal.com/donate/?hosted...
Music:
Jalowo - Luminism (ft. Yonderling)
Hale - Moment
Tru Genesis - Burned
King Pong - Game Recognize
Videos are edited with Davinci Resolve Studio. I use Affinity Photo for thumbnails and Ableton Live for audio editing.
Video gear:
Camera geni.us/K8OOyKV (Amazon)
Main lens geni.us/jnnElY4 (Amazon)
Microphone geni.us/tgiSqL (Amazon)
Key light geni.us/Gi1zE2 (Amazon)
Softbox geni.us/F86pM (Amazon)
Secondary light geni.us/aciv (Amazon)
Other stuff that I use:
Monitor geni.us/KUzcmcP (Amazon)
Monitor arm geni.us/5RXu (Amazon)
Laptop stand geni.us/X5vx9Af (Amazon)
Keyboard www.amazon.de/HHKB-PD-KB401W-...
Mouse geni.us/KB7h (Amazon)
Audio interface geni.us/sdhWsC (Amazon)
As an Amazon Associate, I earn from qualifying purchases
Timestamps:
00:00 Intro
00:29 The dashboard and media applications
02:21 Nextcloud
03:20 PhotoPrism
04:15 Bitwarden/Vaultwarden
05:30 System applications
06:35 PiKVM
07:48 PiHole & Unbound
09:07 Home Automation
11:36 Other stuff
12:15 The OS
13:05 Storage and filesystems
14:38 Security
16:57 Dynamic DNS
17:59 Provisioning and deploying
19:09 IaC (Infrastracture as Code)
20:00 Why not just use shell scripts?
22:14 Ansible playbook walkthrough
23:50 Yeeting my bootdrive and reinstalling from scratch
25:48 Thoughts and considerations
26:38 Special thanks and outro - VÄda a technologie
Links in order of appearance:
Homer github.com/bastienwirtz/homer
My custom CSS for Homer github.com/notthebee/infra/blob/ca87f0daf211919ff19ce678523f48f2a6d25ed7/roles/homer/files/custom.css
Nord colors for Homer pastebin.com/AH9NWmSL
Jellyfin github.com/linuxserver/docker-jellyfin
arch-delugevpn github.com/binhex/arch-delugevpn
Radarr hub.docker.com/r/linuxserver/radarr
Sonarr hub.docker.com/r/linuxserver/sonarr
OpenBooks github.com/evan-buss/openbooks
Nextcloud hub.docker.com/_/nextcloud
PhotoPrism hub.docker.com/r/photoprism/photoprism
Vaultwarden github.com/dani-garcia/vaultwarden
UniFi Controller hub.docker.com/r/linuxserver/unifi-controller
Jackett hub.docker.com/r/linuxserver/jackett
PiKVM github.com/pikvm/pikvm
PiHole + Unbound github.com/chriscrowe/docker-pihole-unbound
Deconz github.com/deconz-community/deconz-docker
Home Assistant hub.docker.com/r/linuxserver/homeassistant
Do you maybe have a link for the nextcloud image? Looks damn nice!
@Mrbarb Sure thing i.imgur.com/4Pp7dRg.jpg
Pin this comment !
Great work! Is ansible needed if most of you stuff is in dockers anyway? Should this not make you environments be hw independent already as long those are backed up or in some version control? Also does anyone know if ansibel can be used on a running system, like detecting current config for later deployment?
Hi great video and v similar apps/setup to mine. I've just installed the homer portal and downloaded your custom css file. As this is configured via yaml, please could you tell me where the css file needs to be saved and if it needs to be linked in the config yaml? Thanks
You have so much legally obtained content. You're an example to the community.
đ
DEFINITELY do a Step by Step.
I'm just getting into server stuff and would love to learn from you mate.
totaly agree
@@juliantorres957 I think you can follow the ansible portion and spin up a clone of his setup. I believe. I am new as well lol
juniper certs have topics on certs
Step by step would be really useful!
Each and every time you used the phrase, "...you already know..." I actually hadn't a clue. I too am eager to build my home server as my IoT is getting out of hand.
I just want to let my FBI agent know that I am legally watching this video from my legally purchased device that is connected to a legally purchased network connection that only transmits legal things.
The amount of work put in this video and in the setup itself flies through the roof. I got really inspired to lift up my tiny Raspberry pi server to something much greater!
I love how much information is in this video without over doing it on any one topic. Tips, why you chose it, how you use it, and clear explanation of what it does and itâs application. Definitely saving this video to refer back to. Thank you!
Thanks for making this! I'm making a home server for my family to use for plex and a google drive alternative. Your vids are in-depth yet digestible and you know how to edit so what you're looking at is clean and interesting. Thanks for all that you do
I am planning to set up my home server on an old laptop and it's been weeks of searching and reading through random articles, forums, yt videos etc to create a list of links for reference but when I stumbled on your video I was mindblown by how well made this was. Watched it fully in one go because of how useful it is and packed with so much usable info. From infra to services to security to deplyment to networking, just absolutely insane. Thank you so much for this.
And the ansible playbook service was a really useful cherry on top to anyone who doesn't want to dip their hands in infinitely complicated minor tweaks that takes months to set up successfully!
Never thought that IaC would be brought to this channel, and I'm all for the detailed Ansible guide.
Merry Christmas to you and everyone watching.
I've been debating learning Ansible for a while. Recently got my DCV-VCP 2021 and I kinda of want to learn Ansible + Vagrant to see what all cool stuff can be done. Your playbook is a goal, from zero config to fully functional in one playbook. Very nice.
Iâve watched this video several times since it was uploaded, most times only getting about half way until I had to tap out from confusion. Not your fault, I just didnât have the prerequisite knowledge before diving in. Itâs been over a year since this video was uploaded, and I have finally gotten to the end. I just wanted to share this small achievement of mine, and also commend you: it takes balls to demo an ansible playbook on a production machine with all your data on it. Fair play, and great video.
The amount of useful information in this video is just insane. Thank you SO much and please make more videos like this!!!
The video was packed full of great things. I can hardly wait for more videos, especially HomeAssistant, you bring things across in such a calm and structured way, it's fun to watch the videos.
Thank you so much for this great content!! That must have been a GREAT deal of work, and we, the community, really apreciate it! Hope I can contribute as much as you guys do someday! Anyways, merry xmas and a great new year y'all!
Letâs gooo
Super long video butâŠ
Super packed with info!
Bizarrely I know all the Ansible automation stuff you covered later but really want to deep dive into almost everything you covered earlier.
Great video đ really enjoyed it đ
I'm an SRE and thankful you're out here providing all of this great institutional knowledge for those who wanna get into this this stuff.
Densely packed. Elegant. And immediately practical. Thanks!
Not sure I can pull off a whole ansiblized server configuration, but now Iâll look at it carefully.
Nice video, the IaC part was an unexpected goody. Working as a DevOps engineer I can highly recommend learning this. I even have a playbook to setup my laptop with all the config, software and tools I prefer. Might be a good start for everyone who doesn't have a home server.
Do you have any recommended sources to learn it?
@@maciejrolecki55 check out this playlist: czcams.com/play/PL2_OBreMn7FqZkvMYt6ATmgC0KAGGJNAN.html
@@Doninhas thank you very much, will check it out
This is an incredible video. Very well done. Way beyond my capacity but great to see what can be done!
As someone just starting to learn about self hosting, I think this video is packed with great tips. Thanks for taking the time to explain your setup!
I'd love to see a deep dive into your IaC setup. I've been planning to remake my Home Assistant supervisor plugin-based server into a proper easily reconstructible setup with something like Docker Compose or NixOS, and your Ansible demonstration has blown me away!
This video alone has also been incredibly inspiring. Thank you!
+1
Would also love to see a deep dive. Looking at getting my home server setup with ansible.
+1
Yeah I think I would look to do it with guix :)
I would imagine it to be much more maintainable if done with a tool like guix that can probably do most of the setup by itself from a couple scheme files, and brings easy rollbacks and upgrades, etc. but itâs probably not optimized for the use case yet and lacks packages/services.
I just found this and I want to give it 10.000 thumbs up. Especially the parts about using a Reverse Proxy for your webservices, proxying connections via Cloudflare, Authelia and reinstalling your Linux system because after a while they feel "dirty" were so good!
it's not a long video if the content is super interesting and conveyed in a very accessible, user friendly manner. great work as always!
Thanks for showing so many self hosted alternatives. This video is gold. Great job!!!
Thanks for making this video, this was super helpful!
I was able to fork and run your playbook after some trial and error, using it as a jumping off point for a similar setup, adding things I want to host from repos like docker-selfhosted-apps. Having the setup defined with IaC makes me a lot more willing to spend some time and do it properly instead of hacking together something and having to redo/forget parts later.
Been waiting for this! Thanks.
Interesting to see your server running on 6100. Mine runs on 4570T, I have few of the programs like yourself, however I run emby instead of jellyfin. And instead of pihole, I have OpenWRT running on my router and I block DNS ads on there.
I am always happy to see things like these :)
So much work went into this. Absolutely crazy. Great vid
After watching this I might just end up getting a Synology. I have Home Assistant and other various servers running. I don't know if I have time for another one but I'm very impressed with what you have accomplished. Very nice.
Hey mate, would love to see a video about debloating Windows 11. To everyone watching Merry Christmas and a happy new year.
Afaik Chris Titus already has some videos about that.
@@WolfgangsChannel doing that with Ansible would be fun XD
Maybe run OOShutUp10 first and then those PowerShell scripts :D Both can easily run unattended!
@@WolfgangsChannel Chris Titus also said that Linux is an operating system, so we're taking his word with a grain of salt these days.
@@dial2616 Yeah I don't know why creators are so afraid of covering a topic after someone else has already done it. Usually the first video on a topic is lacking certain tips or other info
@@davisssamuel same spyware, different label
Watching this video alone I learned the basics & nuts n bolts of cloud computing!!!
Thank you very much!
Youâre an OG. So much to learn from you. I am finishing my cs degree and took a networking course and got interested in home setup/networking/ etc and find your videos to be really cool and informative.
Okay, wow. That was a lot of stuff I'm certainly going to slowly chew on over the next months lol. Sadly I can't really reproduce everything because I don't even have a dedicated server or any RPis, but this is right up my alley. Viele danke for the amazing presentation!
One question though, is this approach (mostly Ansible and hosting Docker conts on Linux) feasible with a desktop machine as server, especially without using tons of storage devices?
Thank you!
Ansible can definitely be used to set up a desktop machine. Haven't tried that myself (maybe an idea for a video?) but I don't see why it wouldn't work.
@@WolfgangsChannel Some guys use ansible to setup MacBooks in mass, it's really amazing. Fully development ready machine in 15 minutes, from 0.
Yeah using it for desktops works great as well! If you use Windows then you can install packages with chocolatey, which is such an improvement... Also windows Updates are a breeze! For work I had to create a Window Update Playbook and tried it on a fresh 2012R2 with no Updates and surprisingly it worked great. I almost thought that it stopped at some point, but no it just needed to install a lot of updates... When I had to cancel it, it was at Update 110 XD
There is a video which can be used for inspiration. czcams.com/video/1VhPVu5EK5o/video.html
@@WolfgangsChannel Thanks for the great video. Just a smal question, how can you use homer with local dns on the pi-hole? For example my homer portainer port is 1.1.1.1 , example 192.168.1.200:1111 how can i add a local dns on the pihole dns? As i see you dont use any port and you can direclty access to the homer dashboard.
wow! that was a wealth of knowledge. I wish I had my home server setup like yours. I would love to see a video for a linux newbie setting up a system like yours.
Wow. What a gem of a channel. I honestly feel lucky to have found it
lot of valuable info here, just got my own 42U Server Rack setup and there are some services you listed that I'm absolutely going to look into more, great video man!
Hey Wolfgang, nice to see your home setup! Question: what brand of smart thermostate are you using?
Danfoss Ally
btw for keepass you can sync the kbdx file using syncthing between mobile and laptop/computers. it gets updated everytime you make an entry or an edit on any device. works for me up until now. give it a try maybe.
edit: sucha lovely video! happy holidays!
No Synching on iOS, unfortunately
Herzlichen GlĂŒckwunsch zu den tollen Videos und zum Channel. Deine Videos finde ich richtig gut, ruhig, sachlich, informativ.
I love how excited you appear in your thumbnail. It exudes infectious enthusiasm.
Interesting. Although, the big problem is when you set something for the first time: you often don't know exactly what the right commands are, you have to experiment a bit, test stuff out etc. And with some things, setting them up is such a long and tedious process, that you have no incentive to start doing it all over again. Take for example hosting your own mail server. That takes ages to properly set it up and have it support all the scenarios. By the time you are done, you won't be wanting to do it all over again, and rather resort to patching what you have and keeping it running. Doing things right takes a whole lot of time on top of a whole lot more time for the initial setup and figuring things out.
Ansible
For new homelab builders as option consider proxmox as base system instead of ubuntu server for learning purposes also.
"I use proxmox btw"
Wow! Very impressive Wolfgang. I would love to see a step by step walk-through & deep dive video for your IaaC setup.
There's so much info in this video I love it thank you Wolfgang!
If you want to add more drives into ZFS pool, you'd need to create new vdev and add vdev to pool. And disks in vdev can be replaced with larger disks one by one.
Need to put SSL from Letâs Encrypt now!
You are inspiring me to install Home Assistant instead of Apple Home.
You can also use Home Assistant with Apple HomeKit! đ
I run a HomeKit bridge to be able to use Siri commands with my Zigbee devices.
This is amazing content man. Just found your channel. Keep up the great work!
Many of the software solutions I was looking for my own server, in one video. Vielen dank!
Hey Wolfgang, why are you using XFS instead of Ext4 of Btrsf ? Are there any advantages?
great video. I will definitely use some of these applications.
Since you mention "very legally obtained" movies and software a lot, could you make a video on that topic? All for educational purposes of course
CZcams already removed my video on how to download CZcams videos and gave me a TOS strike, so I wonât risk it
@@WolfgangsChannel too bad. Thanks for the reply anyways, I really appreciate it. :)
Oh hey! Thanks for the video, the home servers are always interesting, hopefully Iâll adapt some of you ideas
This video is exceptional in showing everything you can do... but pretty overwhelming for beginners.
ZFS is not as limiting as you make it out to be. The only RAID solutions that I know requires the same size drives to be used are hardware RAID systems. As of OpenZFS 2.1, you now can add additional drives to RAID vdevs after they are created. You can add nVME drives for Caching and they are handled automatically by ZFS itself, no scripts required. I personally like the fact that everything is checksummed with ZFS, so things bit rot can be avoided, something that ext4 does not do or protect from. ZFS is much more flexible than than you realise.
ZFS is a nightmare
@@adiledemiri7372 How is that?
OpenZFS cannot add any drives to vdevs yet, even in the 2.2.0 ... and it will be a long way to go. Plus caching (L2ARC) requires a LARGE amount of RAM available (1:5 to 1:10 as RAM:NVME ratio!), and this should be ECC. So extremely expensive. Plus ZFS performance degrades when the pool is >50% full. Not a workable idea at all if you don't have a lot of money to support all this.
How do you use Local DNS to access docker containers with something like homer.box, since they share the same IP address but different port?
Reverse Proxy!
Have you figured out how to do it? I've been trying all day to set up a reserve proxy with Apache and/or nginx but it doesn't work.
@@Blitzritze let us know if you figure it out..
@@rpm10k. My next try I'll do it with Nginx Proxy Manager, since swag looked too complicated to me. I am completely new to the whole topic.
@@rpm10k. I think I figured it out, I have to rebuild my entire raspberrypi but then it should work.
You have to run all "programs" in docker and in the same docker network and so you can say via swag or traefik that if a certain docker container is accessed with a certain domain it should be forwarded to the certain ip with port.
This is amazing; it's basically exactly what I'm doing or want to do, plus a few new things I'll try out
That piKVM setup looks really slick, definitely going to set that up in my homelab! I'm tired of lugging out the spare monitor when I need it. Great video!
You better update your unifi controller, as that version is very much affected by log4j, also the issue with that it constantly wants to adopt is most probably that it sets the wrong set-inform url on the AP when setting it up. if you have the controller as a docker container it might have given the internal ip instead of the host ip, this can be set in the controller to specified ip, setting is called "Host for Inform" and will most probably solve that issue between restarts
Thanks for the info!
One thing that's missing and also hard to set up properly is off-site backup.
Iâm always learning a lot of new stuff when watching your videos. Keep it up!
I'm so happy you released this video, what a beautiful Christmas present ! đ I want to redo my NAS that I installed with OpenMediaVault and your first part NAS Video tempted me with the PiKVM and Homer dashboard ! I'd like to see the deep dive and step by step walkhtrough of your Ansible configuration, it looks impressive and would help me so much ! Thank you ! âșïž
Do you self host your e-mail? I assume that if you do, you might be doing it on a VPS.
Also you should consider hosting a tor node.
I don't - in my opinion it's more trouble than it's worth
Hosting email from residential address space gets you autoblacklisted just about anywhere - no amount of spamlist training can fix that. Then there's the problem of incoming spam. So I agree with Wolfgang it's more trouble than it's worth for sure.
Question: I host my email on a VPS, but I was thinking about setting up a second server at home, and pointing my email address DNS at both the VPS and the home server for some redundancy. Assuming this even makes sense (I'm a DNS noob), would that then just get me blacklisted whenever it sends from my home?
Step by step cache drive for mergerfs video please
Been waiting for your vid on this, and was not disappointed!
Still one of the best Tutorials/Showcases I've seen so far!
4:14 *ĐĐĐĐ, ĐŻ Đ ĐĐĐ ĐĐĐĐ* pepega
âBased on Rustâ is a meme now. An irrelevant detail gets promoted like itâs some kind of feature.
Why?
Yeah, All the work Firefox, Google Chrome & Linux Kernel team is doing to rewrite their projects in Rust is a meme right?
@@4n0nmann5 they aren't rewriting anything. They're using it to write select components. In the kernel case, they're allowing some device drivers to be written in it for instance.
Rust fanaticism is ridiculous. It's a cool language but anyone that's actually used it will tell you it's language ecosystem is still immature. People need to chill.
@@seabrookmx I agree. Rust is ok, but itâs not perfect and has its problems. Just like anything else itâs not a fix all. Rust fans are toxic.
@@WolfgangsChannel End users donât really care about programming languages and they usually donât have an effect on usability. Slapping the âbased on Rustâ label on it doesnât make it magically good.
the best part of this video is just all the other resources you posted for the rest of us to follow along a learn our way too, i had been so frustrated on bad query results when looking online, with things that just say "buy this crap of NAS and use the crap software it comes with it" nothing on the side of build it yourself, which is what i was actually looking for, thank you so much for this, i looked up on the whole smart home thing, and is a great rabbit hole to fall into, to know that you can even check energy consumption and stuff like that makes it actually really good
This is such a wealth of info. Bookmarking the links for reference. Thanks a ton!
Thanks a lot. It can be seen here lots of curated work along the years in a 20 min video. Definitely going to take a look to the references you mention.
Looking forward to that deep dive video! Great job!
Would definitely like to see a step by step. Amazing informative video as always!
I discover your channel watching this video and wow so much content. A lot to get excited about how I can upgrade my Homelab. Thanks for sharing !
Really appreciate the callout to all the other contributors. Fantastic stuff
This video is just everything anyone would ask for, thanks for the dedication.
Making my first home server, and the MergerFS and SnapRAID advice is what I was just looking for! You just gained a sub!
THANK YOU ! I was seeking for ideas with my own serv, definitely awesome content
Incredible work, thank you for sharing! đȘ
Great video. I really love videos where people share lots of their fav open source tools around a topic. I wasn't aware of SWAG or DDClient both of them will be very useful to me :-) Been using Ansible for many years (7 maybe?) my fav provisioning tool. I love that it is push based and you can see the progress on multiple servers.
Whow! That's super inspiring!! đ Thanks a lot!!
This is the first time I'm watching you and it's just, WOW!
heavily detailed, and sure once again I'll come back and look at all these when I take my self-hosting journey ~
Love your video style and topics! We need a home automation video :)
Wonderfully informative! Thanks sir! Ill gladly take a video on your IaC etc.
This man is a saint, he rebooted his own home server just to make this video for you.
Welcome back, Wolfgang! Missed you on the youtube feed!
you are the man! I want to do this for a living and as a hobby its just so nice to see the help!
This is good stuff man!, Spread it by explaining step by step
This is great! Almost exactly what I want to do and in almost exactly the way I want to do it (Ansible included)! Thanks
I've always dreamed of having such a set up like this.
Hey! Great vid. I would love to see a video about your macOS setup. Thanks for your time and all the stuff you make!
Liked for Ansible. Subscribed for step by step guide.
My goodness, this video is an invaluable resource!
Wow this was an awesome video. I just randomly came across one of your videos through the CZcams algorithm and Iâm hooked. Canât wait to work on some of this stuff.
It was pretty interesting!
Thanks!
Holy shit! I had so many problems installing my server and I thought it'll be impossible to keep all my services up without loosing my hair but this vid was all I needed. Thanks!
Thanks a lot for this! There are some hidden gems of software that I wasn't aware of! Hopefully once I finish college I'll have the peace (and time) to get going that beast!
Great video! Got some inspiration. Personally I'm just running a pi4 with harddrives attached so it's not as complex but more energy efficient
Love this channel and content thank you
Excellent video, is like a dictionary for devops enthusiast! thanks you very much!
Bro this is exactly what I was looking for thank you so much