Synology Disaster - VMware & iSCSI -- Easy Recovery w/Hot Spare
Vložit
- čas přidán 30. 03. 2021
- + Link to VM Backup Page: sy.to/top7k
+ Link to HA Page: sy.to/6huzl
Wendell talks about how to safely, and easily, backup your data with Synology.
Happy World Backup Day!
Hope you enjoyed!
~ Editor Amber
**********************************
Thanks for watching our videos! If you want more, check us out online at the following places:
+ Website: level1techs.com/
+ Forums: forum.level1techs.com/
+ Store: store.level1techs.com/
+ Patreon: / level1
+ KoFi: ko-fi.com/level1techs
+ L1 Twitter: / level1techs
+ L1 Facebook: / level1techs
+ L1/PGP Streaming: / teampgp
+ Wendell Twitter: / tekwendell
+ Ryan Twitter: / pgpryan
+ Krista Twitter: / kreestuh
+ Business Inquiries/Brand Integrations: Queries@level1techs.com
IMPORTANT Any email lacking “level1techs.com” should be ignored and immediately reported to Queries@level1techs.com.
-------------------------------------------------------------------------------------------------------------
Intro and Outro Music By: Kevin MacLeod (incompetech.com)
Licensed under Creative Commons: By Attribution 3.0 License
creativecommons.org/licenses/b... - Věda a technologie
![[Vowel]물고기는 물에서 살아야 해🐟🤣Fish have to live in the water #funny](http://i.ytimg.com/vi/3G9MH063Cx4/mqdefault.jpg)
I'm getting into container orchestration right now and it's super cool. I can run a GUI in a browser locally or on a server VM and have the exact same experience.
13:08 i just learned that the word "kaputt" is being used in english aswell as in german and i love it
I have a slightly higher end version of this setup using FS3400 units and 40G networking. Another thing you might want to do is setup a snapshot schedule for the iSCSI pool that you can use snapshot replication to backup to a 3rd Synology, and you can also use the active backup for business application to backup the individual VMs to that 3rd Synology.
"Giganstore", he named it...
Gigantor theme is now stuck in my head. Thanks for that. 🙃
I just bought one of those 8 bay Synology units with 8x8TB IronWolf drives on Sunday, as well as a 32 GB RAM upgrade kit. Hopefully I'll get everything in by Friday and be able to test it out. I was planning on doing a RAID 6 array.
I love the videos of this guy. Each time I see him, I feel happy. I don’t know why 😃
Awesome vid. What’s the link to the VMWARE NUC you mentioned or the dual NIC one?
I'm actually thinking about two synology-units for two of my locations, but since the whole "you will only be able to use synology drives" thing, I've started to hesitate.
I do have an 1812+ running nonstop for close to a decade @ home, but that one won't be locked to specific drive manufacturers.
Exactly the content I'm looking for! Now if you could just keep making micro homelab videos until the sun burns out!
I can't wait to have a real back up
this comes a long way since my last time playing with Lefthand/StoreVirtual (HPE)....synology made it simpler!
The phone migration issues spoken about is a Android problem, Samsung used to make an attempt at backup and restoring your phone but it is not great. Apple backup fully restores your phone as long as you have encryption on.
Thanks for spreading the good word on world backup day!
I got a synology that has been running nonstop for the last 9 years and it never went down, I just do a maintenance every 6 months to dust it off from the inside. This is what I use for my homelab with VSAN and sometimes I also run my lab in a nested environment with VMware workstation, depends on what needs to be done. ESXI 7.0 works fine with Synology if you got the right NICs but you can also run it from the vmnic inside vmware workstation for example.
Now only if I could afford all those toys. in the future. gr8 video always learning
I bought an 1821+ with 6 of those 14tb exos drives last month. I'm certainly a newbie with this type of hardware, so I'm still learning about all the cool things I can do with it. Good stuff!
sweet baby jesus.. if that is for your homelab, i hate you lol
My Asustor NAS is beginning to show its age. I'll be going to Synology in the future.
I'm happy that we actually live in the future. There's so much cool stuff all over the place.
Is Synology HA a good choice for lets say storage class for kubernetes? I'm worried that it might not be a good idea to run lets say postgres, won't it go crazy with the fact that the storage is shared between two devices and its not atomic? once you write a file and it ends up on one synology, will those changes become available after it gets propagated to 2nd one or does it depend on load balancing algorythm?
Worth mentioning that you can get a (limited) VMware licence for free? Perfect for a home lab (limitations of course).
I'm curious about the apps that will be running in the VM Cluster. Basic office automation stuff or beefy power user software?
So would you be able to remote into one of the Synology's and update the FW, reboot it, then once you have made sure its up and running and syncing update the firmware on the second Synology?
I did some quick math and had a question about the DS1821+. If you add NVMe SSD to it you can theoretically saturate even a dual 10Gb port on it?
If you have 2 synologys in HA config. What is your opinion on running each synology with a Raid 0 array instead of a resillent array (raid 1, 5,6, 10)? Also, can the HA be configured though a VPN tunnel so you can have them on separate locations?
10:47, what do you mean VMware not going to notice? If something was fsynced just before the failover, it wont be seen on a standby nas -> data corruption. Also if your heartbeat connection is cut, doesn't it bounce virtual IP back and forth , because of split brain as there is no 3 arbiter?
I know it's not running on vmware but I will love to see an unRaid alternative. Especially on a price point of view. We don't all have deep pocket for our home lab.
The more Synology videos I watch, the more I want one. Though I want to research Qnap and other competitors first. A DS1621+ with a 2-interface 10G addin card sounds like how I’m going to go. Currently I’m running an ancient Drobo 5N. It... works, but I want to locally manage security camera footage.
The synology nvr series are more affordable and come with more licenses.
@@QuickQuips 3 months later… I went QNAP (and on the day it was delivered, the Qlocker ransomware hit, ugh). Decided not to do the surveillance for now, and if I do it’ll only be a couple of cameras so licensing isn’t much of an issue.
I felt both brands are decent in spite of QNAP’s… questionable… security practices. I chose QNAP due to the hardware being more powerful, comes with ZFS, and I could SnapSync backups to a remote NAS.
Both brands have pros and cons.
Backups are important I detected it twice this year, while the last 10 years I had no issues! Note that all my systems run ZFS and I also have in general 5 weekly snapshots for each dataset (Size Limitations). Since Jun 2019 I have three backups and backup once/week. It takes ~ 1 hour and it is a typical poor man's solution. Those backups use:
- A 2003 Pentium 4 HT (3.0 GHz) with 2 x 2 leftover HDDs in total 1.21 TB (3.5" IDE 250 & 320 GB and 2.5" SATA-1 2x320GB). It runs FreeBSD 13.0-RC4.
- A Dec 2011 Intel i5-2520M with a 1TB SSHD. It did run Ubuntu Mate 20.04 LTS.
- A 2014 Samsung Galaxy S4 with a 64GB micro-SD card. It has all my private stuff (photos, videos, wma copies of my LP/CD, etc). I consider it my off-line backup.
I run ZFS, because it has a far superior protection against all kinds of problems. Note that the old Pentium is only powered on for ~1 hour/week or say 1 week/year. It ages more slowly than I :)
- The snapshots did protect me after I had been hacked, and received a request for money. I simply rolled back to the snapshot of one month before the threatening Email and changed all my passwords and started using the Firefox master password.
- Last week after updating my laptop's Ubuntu 20.04 LTS, my system did not boot anymore. After a while and after using GSmartControl, I detected that the SSHD started developing say ~70 more bad sectors during each test run. The SSHD is clearly dead, she only does not know it yet herself.
The SSHD did say "recertified" on the side, so probably I bought a scam. I used it for ~4 years, but it only collected a few power-on months.
The 160GB HDD, I reuse is a very special HDD for me. I will use it, till the replacement for the SSHD is ordered and arrives. That HDD runs at ~35MB/s read and ~40MB/s write speeds, strangely read speeds are lower. It came with my new 2008 laptop running Windows Vista. That combination (crap HDD and immature OS) has been the main reason, I switched to Ubuntu 8.04 LTS :) Sadly 160GB is the biggest leftover disk I have, so I installed Ubuntu 21.04 Beta and backup my private stuff (~70GB) to it. It boots Ubuntu 21.04 on ZFS (lz4 compressed by default) in an almost acceptable minute. Afterwards it runs quite nicely from the L1ARC memory cache maxed at 2 GB of the 8 GB (lz4 compressed by default too).
Note that my backup speed is now limited by the HDD (40 MB/s) not by the 1 Gbps (~100 MB/s) Ethernet link :(
From your description it doesn't seem you're running enterprise drives that have "Time Limited Error Recovery".
I'm a complete newbie who is concerned about protecting my data.
In your opinion, could I just use regular consumer drives like WD Blue or Seagate Barracuda and just scrub the drives every week or so?
@@corvoattano9303 It all depends how you use those drives. As home users we don't use those drives 24/7 at high loads.
Look at my desktop. I use my SSD for most of the work, my HDDs are used for say max 2 hours/day and if not used they are switched off automatically after 5 minutes through their settings. Because I use those drives infrequently, I use a refurbished WD Black and a Seagate Barracuda with 8 and 7 power-on years. I don't worry too much, because those drives need 12 years to add another power-on year and because normally I have 2 backups.
The HDDs in my backup server are older, but have less power-on years. I only power-on the system for the back-up and that takes max 1 hour/week. That system ages with 1 week each year. I'm 75 so that Pentium system will probably outlive me, since the drives need 52 years to collect another power-on year.
@@bertnijhof5413 I don't know the specifics of how power on years are measured but based on your experience, it seems likely that I don't have much to worry about.
@@bertnijhof5413 Also. Thank you for responding. I saw your comment on one of tech deals' videos but I forgot to ask.
Love Synology
Same
Only until your Synology NAS crashs and you find out it's 100% proprietary unrepairable shit.
@@llothar68 that's the only reason why I'd still recommend anyone to build their own unit if they can
@@llothar68 Exactly. I've been using Synology for 10 years. The main issues have been hardware failures (CPU & Power Supplies.) Obtaining replacements parts/units was ALWAYS time consuming and costly. My next NAS boxes will run TrueNAS and use off the shelf hardware (e.g. Supermicro.)
I am not a Synology Fan, but having the option for HA on only two devices is really nice if you cannot afford enough servers for something like Ceph :)
Does the Synology NAS have a way of knowing when its running on battery only from the APC UPS? so it could shut down safely before battery runs out.
Yes some ups are on the hcl and connect via usb.
Ironically, the latest DSM update 6.2.4-25556 from Synology has the potential to break iSCSI connections. Recreating a target and mapping it to a LUN ultimately fails. The issue is the LUN cannot load due to some type of failure. I confirmed it with their support department today. They say it is a known issue and they can implement a fix.
Is VMWare the primary Hypervisor Level1Tech use?
5:15 -- Synology's E10M20-T1 is a classic Level1 "cheat code."
With dual m.2 cache plus 10Gb/s RJ-45 😎
5:58 -- "Only one machine can use an [iSCSI target storage] at a time," is truth.
Kindest regards, neighbours and friends.
Been a linux admin since 1995 and setting up my own stuff doesn't scare me at all. Also rarely trust anything I didn't set up.
Bought a Synology after seeing the work one handle hundreds of users flawlessly for years.
OMG world backup day again already!?! Its cool though I'm doin like a 5-3-1 type thing over here. Should have me covered, except for stuff like that one time I rebuilt my freenas system with new drives and restored everything from tape, somehow my documents didn't make it back on and I didn't notice and went on vacation for like a month. Had to restore from a portable HDD I plug in every once in a while that time LOL. Never hurts to go a bit overboard when it comes to backups!
As RAID is not backup, do 2 identical RAID boxes in HA actually count as a backup? Can't user error/ransomware nuke both boxes simultaneously?
3-2-1 rule. You can use snapshots here but still have some edge cases for 3-2-1 rule
@@Level1Techs Thanks for replying - and doing the video ofcourse! Is there any way to get the data off the discs by putting them into some other hardware if the Synology box dies (I've had one go to sleeep and never wake up again) or is that too when you reach for your 3rd-copy backup?
@@DigitsUK I know that if the box dies, you can literally take the drives out of the old box, and throw them in a new Synology unit. It will recognize that there is already an array there and ask if you want to import it. This works between models too. I've gone from a DS411 to a DS1515 and from a DS1515 to a DS1813 without any problems.
@@jwalden91lx Thanks - I was hoping that there might be a 'just throw them all into a Linux box and run...' kind of answer, rather than my data being vendor locked...
I don't buy equipment with Realtek NICs. Too often they have driver or compatibility issues, and it's just not worth the headache to save a few bucks on something like a motherboard.
Would you be able to do this with truenas installs
synology is Love!!
i can`t find the video with the vsan witness appliance on synology, can someone help ?
@level1Tech. need a good over the air networking 6month only storage system for DVR. Nvme I was thinking. Atsc3.0 nas solid state about 2Tb. without breaking into a Bank.
I should set up a cluster, i picked up a few of lenovo's Tiny desktops with 4750GE for only $500 each, though i had to buy additional RAM and add NVMe drives because i wasnt going to put up with 500GB 5400RPM glacier speed
I'd wonder of Optane M.2 drives would work with that synology, i've tested it to work in some OSes as a cache drive on a 4000 series AMD system, it just does not work with windows. Though i wouldnt use this for production, as Intel might have designed some sort of code poison that will lead to an early death if it detects the lack of supported intel processors
Solutions remind me an old blade center made by one of the big tech players
Man what a messy office, looks just like mine :)
With Proxmox would ceph be similar to vSAN?
It should be yes
Some things are wrong in the video. vSAN is not new and the ESXi would even still run if you would pull both Synology's.
Sooo.. For us whom are never gonna be available to shell out quarter of the finances needed for a setup of this spirit. What can we do with an Odroid HC4 and backblaze?
Ebay, my man. Start with a smaller unit and a few drives. Upgrade drive sizes/quantiy and NAS units as funds permit. You can even take the drives out of a smaller unit and put them in a larger unit (2-to-5, 5-to-8, etc) without having to copy everything over. Synology will let you import an existing array once it recognizes it. Then you can expand the array and continue to add drives.
Speaking of backups, why not backup your entire CZcams library to other platforms?
NAS envy. I have a small 2 bay Synology. lol
Disaster recovery and backup recovery have two different goals hence the time taken to recover.
LOL I read the title and thought there was an issue with Synology
Boiler snake merch!
I want this very same Synology model. It's awesome but it's almost 1000 € without storage :/ Edit: For HA you pay double for storage with the Synology. Not worth imo, it's not like a smart SAN solution to use HA pairs on compute unit only and have each node connect and use both storage shelves in case of failure. That way you don't have to half your usable storage.
I wonder how this handles split brain
Didn't you have a vid entitled "RAID is dead"????
My tears are my backups
Great video. Just ordered the Synology DS1821+. Could you post a link to the step-by-step guide that is on the level one tech forms?
Searched the forums and only found the video. No step by step with screenshots: forum.level1techs.com/t/synology-ds1821-review-virtualization-backup-security/168361
I know I know I NEED good backup. But my wallet says it can it a bit longer 😂
Its the poor people who have to play musical hard drives.
Luckily Proxmox has no problem with Realtek
Proxmox doesn't, but any BSD based guests will.
"Why build one... when you can build two for twice the cost!?" xD Didn't synology have it's named dragged through the mud in recent memory? Gamer's Nexus made videos about their NAS dying, getting RMA'd, and dying again, and then in the comments some other tech tubers mentioned theirs dying as well.
Edit: Maybe it was only GN, never mind. Sample size of one probably isn't necessarily representative.
Motto: when you already have to google keywords in the title....
Synology is awfully slow with iSCSI (even with optimizations and increased MTU and ...) and ESXi server. for sure not suitable to run VMs even for home network. Synology also have very bad support even when the box still has warranty (at least in my case. support was super lazy and they technically didnt do anything). i hope others had a better experience.
I normally love Wendells stuff but this is a little insane for a home lab
2 DS1821+ 950 each so $1900 ( not including disks )
16 x 8TB WED RED 200 Each $3200
2x fancy intel dual 10gig nicx 230 each $460
2x asrock deskmini approx 500 a piece as speced $1000
1 Xeon Nuc average price $1500
I am not even going to deal with the upgrades he did to the synology units
VMUG 200 dollars but well worth it
Approx total in this video $8060 That is some home lab. I know it was a sponsored video but it was so far out of line with what most non youtube influencers are going to have in their home lab out side of maybe the desk mini or other small formfactor machine due to serve the home. A synology 1821 with drives is more realistic ... i expect insanity builds out of linus or Jay. But you invoke the name of the Home lab people and part of home lab is not shiny new equipment. I dont know how to feel the first time Wendel has ever let me down.
Low cost and Synology don't belong in the same sentence, they're literally the Apple of NAS.
AMBER, HOW ARE YOU DOING?
GOOD THANK YOU ~ Editor Amber
Using synology is super expensive.
Humm.. any advice on convincing the wife to spend a few K for a stack of new hardware?
i'm more interested in hyper-v than vmware.... call me crazy
Is there a reason for Hyper-V, there are other options, Xen, Proxmox, etc.
well, as a regular user, who casually watches youtube videos, does not have a youtube channel, or i.t. business, and only has 1 "decently moderate" PC (with an i9)
i found myself in need of virtualizing a system for specific work-vpn-related issues,
and found that hyper-v works perfectly.
It is built into windows already, and is 100% free of charge.
So the answer to your question would be, " why NOT?" :D
No thanks. I will keep using Proxmox with CEPH. It's so much better it's not even in the same league.
RAID IS NOT A BACKUP!!!
“I’ve got eight 8TB WD Red Pro drives in here…” - the perks of being a CZcams influencer. Am I jealous? Abso-bloody-lutely. I can only budget for 4TB drive & they’re bought once a month for four months - two months still to go, for my Raid 5 NAS build. 🥺🥺🥺✌🏼
actually I bought those used from allyn but okay
Kaputt 🤣
Do you learn german Wendel?
*WOW* that title is horrible.
how about: Disaster Recovery with Synology ...
or: Synology - Recovery from Disaster
About the most confused IT video ever. Like a salesman trying to sell something he doesn't understand that's the wrong product to the wrong audience. Basically SME's who do serious HA and DR don't buy Synology. If you're a home user or super small business you just need a decent cloud or offsite backup. Everything in this video is confused and wrong and no professional IT would present such nonsense.
Why are corporations stealing money from poor people
Not everyone lives in a kibbutz, like yourself. Most people need to make money.