Backup & Recovery Made Easy: TrueNAS ZFS Replication Tutorial
Vložit
- čas přidán 27. 05. 2024
- lawrence.video/truenas
ZFS 101: Leveraging Datasets and Zvols for Better Data Management
• ZFS 101: Leveraging Da...
Connecting With Us
---------------------------------------------------
+ Hire Us For A Project: lawrencesystems.com/hire-us/
+ Tom Twitter 🐦 / tomlawrencetech
+ Our Web Site www.lawrencesystems.com/
+ Our Forums forums.lawrencesystems.com/
+ Instagram / lawrencesystems
+ Facebook / lawrencesystems
+ GitHub github.com/lawrencesystems/
+ Discord / discord
Lawrence Systems Shirts and Swag
---------------------------------------------------
►👕 lawrence.video/swag/
AFFILIATES & REFERRAL LINKS
---------------------------------------------------
Amazon Affiliate Store
🛒 www.amazon.com/shop/lawrences...
UniFi Affiliate Link
🛒 store.ui.com?a_aid=LTS
All Of Our Affiliates that help us out and can get you discounts!
🛒 lawrencesystems.com/partners-...
Gear we use on Kit
🛒 kit.co/lawrencesystems
Use OfferCode LTSERVICES to get 10% off your order at
🛒 www.techsupplydirect.com?aff=2
Digital Ocean Offer Code
🛒 m.do.co/c/85de8d181725
HostiFi UniFi Cloud Hosting Service
🛒 hostifi.net/?via=lawrencesystems
Protect you privacy with a VPN from Private Internet Access
🛒 www.privateinternetaccess.com...
Patreon
💰 / lawrencesystems
Chapters
00:00 TrueNAS ZFS Replication
01:36 What is ZFS Replication
05:44 How to Create a TrueNAS ZFS Replication Task
07:50 Editing Backup Credentials
09:17 Editing Snapshot Tasks and Retention
11:50 Sedning Encrypted Datasets
14:04 Restoring To Source With ZFS Replication
15:07 Dataset Encryption Keys
17:05 Advanced Custom Replication Tasks
18:53 TrueNAS Wizzard Certificate Error
20:00 ZFS Replication Between Different Versions of TrueNAS - Věda a technologie
Having the two different TrueNAS systems use a different color theme makes a huge difference, thanks!
That's basically how I have my 2 truenas boxes setup. Been running them for years now. It works perfectly 😊 That said I still use core. I'll go to scale when core goes EOL
Loving these TrueNAS Scale videos! Thanks Tom. Great job.
This was what I had planned for next week. Perfect timing. Thanks... :)
Just a note, I use Tailscale in subnet router mode on each side. I had to select Netcat Active Site as REMOTE for the replication task to commence.
For encryption, the fact you must type a directory name to make a new directory instead of making a dataset and choosing it, is extremely confusing and impossible without this video. Thank you so much.
for more info, no matter the property you set for the designation it will not work, unless you double encrypt (encrypted designation inherited folder, and re-encrypt the snapshots sent to put in there).
doing pulls of data from a production TrueNAS to a backup one is a pretty awesome way to create hidden backups.
Thank you for this great and detailed explanations.
Very useful video, THX.
so niceeee. Just what I needed now as I bumbed into problems. Got a secondhand HP DL380 Gen9 to get rid of my very loud and very old IBM 360. Hope I can manage the replication with this tutorial. also boot disk is failing on the old system and dont know if I can replace that so I move to the new system.
Great video!
Perfect, just what I need!
So, the replication task always does a RAW send (zfs send -w), so that encrypted datasets are always sent encrypted on the wire by default? And the SSH encryption (if turned on) would basically send doubly encrypted data? What does the other "Encryption" checkbox on the right side (under the destination) do? From the video it looks like the destination dataset automatically was set as encrypted because the source was, even though, this "Encryption" checkbox was not checked in the setup of the replication. Is this checkbox only needed to turn unencrypted source datasets into encrypted ones on the target?
One technical question: Does the encrypted dataset need to be locked in the moment when "zfs send -w" (or the replication task) is run in order to be sent encrypted or will it be sent encrypted even when the dataset on the source is currently unlocked (like in the example here)?
The locked / unlocked status of a volume, indeed even if it's mounted or not, has no impact on the ability to send. Keep in mind, you're sending a snapshot anyway, not the truly live data. In fact the destination server doesn't even need the encryption key for this to work, it's not important that the destination server be able to actually decrypt the volume it's receiving. ZFS send operates at the volume level, not the file level.
@@entelin oh yeah right, the replication sends the snapshot! Then it makes perfect sense that it would always be sent encrypted
How can you us the Zpool iostat and other commands in Truenas Scale?
brilliant, thank you for this well timed video. i don't suppose you have a "cloud sync" tutorial in the works?
I have some older videos on CloudBackup I might do some newer ones but the cloud backups are easier than TrueNAS Replication ones.
Thanks for the video. Replication from scratch is still a bit unclear to me. Let's say the backup server has replication data from multiple TrueNAS servers. Will Replication from scratch delete all snapshots regardless of destination paths, or just the snapshots for a set destination path?
From scratch is just for that dataset path on the destination
Would this be a good idea for say something like a active failover if your running your own hardware? Then on XCPNG just manual flip the connection?
There is not a simple process for that, so not really.
That is what I thought, I'm trying to use 2 of the same hardware I have for an Failover just incase trying to be like a normal SAN without like XOSAN or vSAN@@LAWRENCESYSTEMS
I've seen a lot of videos like this in setting up replication, but I haven't found anything on restoring TrueNAS from a replication after a complete failure. If system A replicates to system B, how do I restore system A from B after system A fails?
You simply reverse the process
@@LAWRENCESYSTEMSawesome. Thanks for the reply.
You do a one time, non scheduled, replication from the backup server to the main server and proceed as normal.
If you manually snapshot the source and the destination, can it determine differences and copy just those or will the destination allways be wiped out? this was not clear.
You can have it send over all snapshots from source both manual and automatic, but don't make changes on the destination because they will either be over written or cause the process to fail.
Does this still work well if you use the truenas box for esxi datastores
Yes
Is Raidz necessary with a setup like this if availability is not important but data integrity is?
You need at least 2 drives to validate & fix data integrity issues.
Is replication an extension provided by Truenas, or a built in feature of zfs? In other words, can one replicate zfs snapshots between systems that aren’t Truenas?
This is a function of ZFS but for simplicity of this video I kept it just to showing how to use it in TrueNAS.
Thanks for the reply.
Did I miss it but did you ever state that that netdata is now the built-in system reporting app?
You can load Netdata as an app
sir explain from other system to nas..........in local network file sync............
Why is ZFS replication on target system read only by default?
So you don't mess with the backup data because if you do it will need to resend the snapshots again from the source
@@LAWRENCESYSTEMSaha thats what I am doing wrong. I really cannot touch anything in the replica? I was thinking they could both be doing snapshots and sync...
@@HermieDaddy That is why in the beginning of the video I explained the concepts of how it works and that it IS NOT a syncing system.
👍🏻👍🏻👍🏻👍🏻👍🏻
Encrypt everything... the actual cost of time/bandwidth is not that significant anymore IMHO
first