Migrating My Proxmox Containers to My New Proxmox Cluster (LVM to ZFS)
Vložit
- čas přidán 14. 11. 2022
- This video was sponsored by Rize
Use my code "DBTECH" or link rize.io/u/dbtech to be the first 1,000 people to get a 25% discount off your first three months with Rize.
/=========================================/
In this video I'll show the process I used to migrate my single node Proxmox setup with LVM storage to a 3 node high availability Proxmox setup with ZFS storage.
/=========================================/
Get early, ad-free access to new content by becoming a channel member, a Patron or signing up for the members' only website!
✅ / dbtech
✅ dbtech.fans/
✅ / @dbtechyt
/=========================================/
The hardware in my recording studio is:
✔ Custom PC w/ Ryzen 2600, 32GB RAM, RTX 2070, Assorted Storage
✔ Panasonic LUMIX G7 4K Digital Camera: amzn.to/3IGEOcb
✔ SAMSUNG 34-Inch SJ55W Ultrawide Monitor: amzn.to/395g9BZ
✔ LG 27UK650-W 27” UHD IPS Display with HDR 10: amzn.to/398pg4S
✔ WALI Premium Dual Monitor Stand: amzn.to/398AiqM
✔ Neewer Lights: amzn.to/3nZcoSX
✔ Light Power Supply:amzn.to/3Konpqf
✔ 55" Gaming Desk: amzn.to/3AkgHgw
✔ Sabrent USB-C Hub: amzn.to/3qFcwbV
✔ Das Keyboard 4 Professional: amzn.to/3G9rPxM
✔ Fuqido Big and Tall Gaming Chair: amzn.to/3IGegrq
/=========================================/
The hardware in my current home servers:
✔ Synology DS1621xs+ (provided by Synology): amzn.to/2ZwTMgl
✔ 6x8TB Seagate Exos Enterprise HDDs (provided by Synology): amzn.to/3auLdcb
✔ 16GB DDR4 ECC RAM (provided by Synology): amzn.to/3do7avd
✔ 2TB NVMe Caching Drive (provided by Sabrent): amzn.to/3dwPCxj
✔ TerraMaster F5-221 (provided by TerraMaster): amzn.to/3IfH2QD
✔ 5x6TB WD Red Plus NAS: amzn.to/3LnbPvC
✔ 8GB DDR3: amzn.to/3kfLTX3
✔ TerraMaster F4-423 (provided by TerraMaster): amzn.to/3kjUms5
✔ 2x8TB Seagate Barracuda Compute: amzn.to/3xBAO95
✔ 16GB TEAMGROUP Elite DDR4: amzn.to/3MzzFV9
✔ 512GB Silicon Power NVMe Caching Drive: amzn.to/3MzkBae
All amzn.to links are affiliate links.
/=========================================/
✨Find all my social accounts here:
✅ dbte.ch/
✨Ways to support DB Tech:
✅ / dbtech
✅ www.paypal.me/DBTechReviews
✅ ko-fi.com/dbtech
✅ Cashapp: cash.app/$dbtechyt
✅ Venmo: venmo.com/dbtechyt
✨Come chat in Discord:
✅ dbte.ch/discord
✨Join this channel to get access to perks:
✅ / @dbtechyt
✨Hardware (Affiliate Links):
✅ TinyPilot KVM: dbte.ch/tpkvm
✅ LattePanda Delta 432: dbte.ch/dfrobot
✅ Lotmaxx SC-10 Shark: dbte.ch/sc10shark
✅ EchoGear 10U Rack: dbte.ch/echogear10u - Věda a technologie
Use my code "DBTECH" or link rize.io/u/dbtech to be the first 1,000 people to get a 25% discount off your first three months with Rize.
Ok, I've edited my initial reply and the second reply a few times to try and get all the info in so you can understand them, I hope. Read them both again..
I rsync my docker directories every hour to my NAS as a backup process. It's then a simple matter off pulling any directory to a new server. Cloudflare tunnels combined with docker makes it so easy to implement.
Except that LVM and ZFS aren't as compatible as we might like. Some systems that run on LVM just won't run on well/easily on ZFS. MySQL is something I had issues with
@@DBTechYT Using rsync should make the underlying filesystem format irrelevant. I move the data between the the two systems via the NAS rather than via tar/scp. The end results are the same moving between ext4 filesystems out on Oracle VPS and my internal proxmox zfs.
Thanks for producing your great videos! I am always learning things from them and find them very enjoyable!
Thanks for your comment. The nice thing about self hosting is that there's no one right way to do things. I found a way that worked for me and, luckily, I should only have to do this one time :)
Same process I used to move my containers from OMV to a VM on Proxmox. Thanks!
Thanks for watching!! :)
Great video David, this will help me to transfer my RPI4 containers to proxmox!
Glad it was helpful!
Love the lighting DB.
How are you running adguard in an lxc container without having a port 53 problem? Could you do a quick video on that please?
Greetings DB, been running your tutorials for as long as I can recall. Is there any way we can persuade you into doing a new series of videos, deploying the several software’s but on a Proxmox environment, instead of OMV? Thanks in advance
you had me at "ran into snags moving from LVM to ZFS"
Cant you just backup to a share, mount the share on the new cluster and restore? I believe you get to choose the storage...
I think you can run pct enter 999 (container ID) from the nodes console.
Awesome! Good to know. I'm toying with moving my webserver from a VM on my unRAID server to a container on my new (to me - old machine) proxmox server. Was thinking of using Rsync to transfer all the files over. Part of the problem is this VM is just a webserver so I didn't set anything up with docker. Means I have to send data across from multiple directories. But you've given me some ideas so thanks!
Have fun!
Dd the lvm to a file then move to Zfs. If I remember you can convert the raw file to Qemu image file. qemu-img convert -p -n -t writeback -f raw -O raw
Hi, just for your info
If you have lxc containers running docker inside in lvm (using overlay2), and you want to use replication, it wont work.
You must change change lxc to ZFS volume and docker it wont work with overlay2. You must change to vfs which I don't recommend (huge disk space usage) or, instead, fuse_overlayfs much better.
I did a few days ago. (Dunno if there are some better option, but my research toke me to fuse_overlayfs)
I'll have to look into fuse_overlays. Thanks for the tip!
I am too encounter same problem. Lxc container on zfs use vfs(it take so much space only for couple containers and images). Right now i think i just use turnkey_core.iso for ordinary vm (i try it and doker inside use overlay2). How it is fuse_overlay for you, is it good?
Thank you for sharing. Out of curiously, in your container template, you have Portainer. This would appear in each clone you make. To manage all docker files do you use a "master" Portainer instance or just each individual ones?
At the moment I use individual dashboards but I should install portainer agents and do it from a single dashboard
@@DBTechYT Not sure if you can manage stacks created on other Portainer instances. I'm using the Edge Agent and I cannot.
With all of your containers running Portainer, are you able to bring them all under one Portainer interface or do you just login to each one individually?
I could use a Portainer agent to manage them from one location, but there isn't much management to do on a regular basis, so I just log into each one
Please make a one-video series on a TrueNAS scale. Thanks for the very informative tutorial.
A "a one-video series on a TrueNAS scale"? About what, specifically?
Been there done that 😂. I didn’t RTFM on clusters before setting them up. I don’t run as root but as a admin user for extra protection.
I only allow root on local access via Proxmox and have 2FA enabled on my nodes. And, yeah, I didn't RTFM either. Obviously lol
The proxmox containers are able to be backed up to an NFS share right?
That's how I have it set up
@@DBTechYT Sweet, I built a Docker swarm with a few computers I managed to get for free but thinking that Proxmox HA is a better option.
I believe the easiest way to migrate would be to mount a clonezilla image to the VM and do a backup, restore the backup on the cluster and you're good to go.
I'm moved from a single system with LVM to 3 node cluster with ZFS. Different file systems. Some systems that run on LVM just won't run on well/easily on ZFS. MySQL is something I had issues with
I was going to recommend the sane thing as I used cloanzilla to migrate from esxi to proxmox.
2 ‘to my’ in your video title. Sorry to point it out, but thought you’d like to correct!
Thanks! It's weird what our brains can overlook/correct without us even realizing it
Q1: you're moving VM from one proxmox server to another proxmox server?
1. Proxmox Backup Server
2. External Storage (NFS, iSCSI)
3. Backup & Restore boot-CD
4. Manually Copy VM
I'm moved from a single system with LVM to 3 node cluster with ZFS. Different file systems
I don't think the storage type really matters in that case. You could also probably create an NFS storage in common between the single and the cluster, move the container, disown it, and re-adopt it on the cluster. Or add the single node to the cluster (before making any VMs), move the VMs, then just remove it from the cluster.