How to Properly Use Cloud Storage | Rsync Encrypt Tutorial
Vložit
- čas přidán 7. 08. 2024
- This video shows you how to properly use cloud storage with Rsync and encryption. This is vital to have a basic understanding of and I show you how to backup and restore encrypted files via any cloud service.
SkySilk VPS: bit.ly/2VPG5pY
Synology Backup Service: sy.to/ir5g8
Support My Work
-----------------------------------------------------------------------------------
►► Get Updates, Launch Announcements and More ➜ www.cttstore.com/newsletter
►► Chris Titus Tech Digital Downloads ➜ www.cttstore.com/downloads
►► CTT Store Membership w/ All Digital Downloads ➜ www.cttstore.com/members
►► CZcams Membership w/ Discord Channel ➜ www.youtube.com/@ChrisTitusTe...
►► Twitch Membership w/ Discord Channel ➜ / christitustech
Other Places to Find Me
-----------------------------------------------------------------------------------
►► Titus Tech Talk ➜ / titustechtalk
►► Titus Tech Gaming ➜ / titustechgaming
►► Twitch ➜ / christitustech
►► Twitter ➜ / christitustech
DISCLAIMER: This video and description contain affiliate links, which means that if you click on one of the product links, I’ll receive a small commission. This helps supports the channel and allows us to continue to make videos like this. Thank you for your support! .
►► Digital Downloads ➜ www.cttstore.com
►► Reddit ➜ / christitustech
►► Titus Tech Talk ➜ / titustechtalk
►► Twitch ➜ / christitustech - Věda a technologie
On your cron example at 20:00, you should include a value for minutes or the cron will run that crontab job once a minute from 3am to 3:59am.
Great point! Thanks for catching this Bill
Also the guide that was shown said allowed values for hours are 0-23 making 3 4am not 3am.
@@strandloper - No, not quite.... Zero hour, midnight or 2400 hours is the beginning of the day. Each hour indicated after that is the number of whole hours since midnight. So, 3 AM means that there have been three whole hours since the zero hour. 4 AM would indicate that there had been four whole hours since the zero hour.
@@HamBands Ah right. Makes sense. I haven't used crontab since before 2005 so my memory is a little foggy.
I LOVE YOU MAN! I JUST LOVE YOU! I'VE BEEN WORKING WITH MANUAL BACKUP TO CLOUD FOR A MONTH WHILE TRYING TO FIGURE OUT WHAT'S THE BEST WAY TO ENCRYPT AND AUTOMATE IT. YOU SOLVED IT IN A 20 MINS VIDEO DAMN!
Hi Chris, this tutorial is AWESOME! Just installed rclone on my machine an played a little with sync, copy and move and encryption / decryption to a personal OneDrive account. This works like a charm. Kudos!
Hi Chris, I just wanted to say that was one awesome video thank you so much. I really enjoy how you put it into simple basics so its very easy to understand.
Excellent, useful video, Chris. Thank you so much.
Love this. Don't forget to use the -P flag to watch progress.
Thank you Chris, great video. Saludos from the Netherlands.
Thank you, Chris. I had never used rclone so I'll look into it.
Such a good lecture on rclone! Thanks Chirs!
Thank you Chris
Exactly what I needed! Post this on Reddit!!
Thanks! I had been using rclone for regular drive use, but now it's encrypted =)
Exactly what I was looking for!
Always learn something new in your videos! At some point, I hope you do a video on Ansible. I'm wanting to use it to backup laptop configs to deploy to different ones...
Nice video and very well done. I would like to add that it is a good idea to use the full path to rclone (/usr/bin/rclone) in crontab. In my opinion it isn't a good idea to depend on what the default path is set to. I once found out the hard way that what cron was actually running wasn't what I expected. This applies to scripts too.
Agreed, thanks for the comment.
didn't know about rclone, thanks!
Rclone_vfs mount your gdrive for unlimited Plex storage.
Rclone is awesome. I've got symlinks on my desktop to my Rclone mounts for Google Drive, OneDrive and Dropbox, and I can simply drag and drop stuff between services or from my machine. Super transparent.
I wonder what your thoughts on Duplicati are
Great vid! Very good content and well informative.
love advanced user friday!
Any tips if you have a bunch of stuff ALREADY on Dropbox to encrypt it? Great video. Will be implementing ASAP.
really nice video
Excellent video (like usual), but my advice is not using "rclone sync", instead use: "rclone copy". If (by mistake) you will delete a source file it will be deleted in the remote backup. It is not secure way of doing backups...
Will you be doing the updated version of arch installation?
Either I fell asleep or the Rsync part is missing ((((
Thanks Chris for the video and especially the section on encryption.
rclone has a nice feature that allows you to mount the cloud-service as a directory on your local system
rclone mount dropbox: /mount/point
I find this easiest as I can then use cp to transfer files back and forth without making any allowance for the fact that I am communicating with the cloud. I'd be interested to know if this works with encryption.
One problem I did have was that after a failed upload I lost the sharing information for the files (which I could only change using the browser anyway), but perhaps that's to be expected.
This would be very interesting!
"I'd be interested to know if this works with encryption." Did you test it?
Chris, VEE-EYE ... jus' sayin' :) thanks for the vid. rclone is great!
Would you reccomend to use rclone sync for a large data. Let's say 10TB of oracle data?
A backup not tested is just a wish :P
Stealing this phrase!
Thank you so much, someone has a cloud attached to my Google account that I did not download, and I tried to connect to the host when I downloaded the cloud console and it came up an unauthorized host called devshell
Hi Chris,
are you aware of any native ZFS cloud backup solutions?
I use cryptomator on ios and win, it has an user interface. Works even with cyber duck
Is this a good way to do an S3 migration? I need to move some data from a netapp storage grid to a Dell ECS.
Oh! BTW, you know you "can" use rclone inside Windows as well. It does all the same stuff there, though its mount option needs some user space file system driver as a dependency.
Just thought I'd mention it for those who want to stick with windows for some reason. You're not totally left in the dark.
I did not know this, thanks for the comment!
That's good, I'm looking to move to Linux at home but will still be Windows at work.
@@strandloper In the exact same boat. Work only "provides" Windows and some programs needed for work only run on Windows anyway. This allows me to make use of "cloud" storage to transfer files and backups between both work and home - not needing an external to be carried about. Though mostly used so I can get to them no matter where I am, even if travelling abroad. I've been steadily moving towards Linux for the past 2 decades now, thus far the only Windows left at home is one VM on a desktop and a dual boot on my laptop. All the rest is some form of Debian or another (Mint, Kubuntu, Pop_OS, straight Debian as server, and OMV as NAS).
For my "real" file transfers, the absolute simplest way I use is Syncthing instead. Effectively a peer-to-peer cloud without intermediate servers - directly transferring the files from one machine to any I choose and keeping all synchronized with one another.
I used to use Fedora for everything, but around 10 years ago I ran into an issue with a program I needed for work (BricsCAD) at the time the program was only available as 32bit, but my machine was further ahead than a 32bit OS would allow. Fedora's 32bit on a 64bit OS didn't play well with that program. Yet I found Ubuntu worked perfectly without a hitch. Since then I've gone with some form of Debian or other, usually an Ubuntu derivative - just because they tend to need the least amount of effort to get setup. This is most probably no longer an issue, especially as that program is now available as 64bit as well. But I'm more "familiar" with Debian these days, not really any reason to change anymore.
For gaming, Pop is my goto - since again I don't like to faf about too much. The simpler, easier, most expedient is my first choice. Only if I have some specific reason would I opt for some other idea like Arch. Thus far Pop does fine for my gaming needs. The only games I have which aren't exactly "awesome" are Bethesda stuff - most "run" in Proton / through Lutris. But things like F4SE and SKSE means mods don't work well or at all under Linux - similar issue to those anti-cheat stuff. Unfortunately Bethesda games tend to require mods to fix the bugs, crashes and bad design in their games, thus why I still have one dual boot for Windows.
@@benriful I'll take a look at Syncthing though I do like using cloud storage because it provides backup and some rollback for the occasional DOH! moment along with syncing. BTW are you also South African? I've never heard the phrase "don't like to faf about" used by non-Saffers.
@@strandloper Yep, SA since I was born.
Note, Syncthing does have a setting to keep several versions of a file. You can state how many of them, per shared folder, per machine sharing it. Various options on how the versioning occurs, e.g. just placing it in a "trash can" (similar to how recycle bin works), simple versioning (moving the files at delete or overwrite to a date stamped folder, or staggered as a hybrid between date stamps and age, or using an external program for versioning. I think "default" is the date stamp folder with 5 versions per file.
And since each computer you set to the shared folder will have a copy of everything in that folder, it means even if a complete computer dies on you, you still have it on another (or even more than one).
Hello Chris can you please explain ZFS option on new Ubuntu 19.10 and does it increase performance compared to ext4 or does it have potential to increase performance for daily average consumer
Performance is worse than EXT4 from my understanding, but I love ZFS for it's backups and reliability.
@@ChrisTitusTech thank you for your response. I read that apple is using a new file system optimized for SSDs what do you know about ext4 is it already well optimzed for SSDs or can we expect ext5 or something like that. (I thought ZFS could be that new ssd file system but its for another purpose altogether)
Could you do some videos on how to get Windows 10 working on VirtualBox as if it's running on native hardware?
Can you do a video on how to video yourself doing an install for example. This way you've got a trail to go back and see how you screwed things up. For example you could retrieve your passwords later by watching the install video.
can you access the encrypted files from a windows machine and if so how?
Good tutorial Chris. But imagine you have to reinstall your os ( ubuntu ).. from scrach due to total harddrive failure. You buy new harddrive. You do new ubuntu install. You have your passwords stored at a safe place and your encrypted rclone files stored at Dropbox, fine. But how would we resync it back again to our fresh ubuntu install on new harddrive/os.
Watching Chris not being on DWM is weird x'D
And yeah I know it's an older video ^^
How do you use rclone mount 1fichier I want to explain mount rclone to cloud 1fichier
If I understand correctly, you work on unencrypted files locally and periodically sync those into the cloud storage folder with encryption so they can sync to the cloud. I currently use (on Windows) the legacy Boxcryptor Classic that gives me a virtual unencrypted drive mapping on the fly to an encrypted subfolder of my Dropbox folder. I want to maintain this ability when I move to Linux; so what options are there to do that? I need the same on personal Linux desktop and laptop, as well as work Windows desktop. Cryptomator seems to fit the bill but what other options might there be?
Cryptomator was the only free solution I found, primarily as a linux user but wanting cross-platform compatibility with Win,Mac,iOS and android. The mobile apps are buggy but the desktop apps are solid.
Thanks for the tutorial. Everything worked until i rclone sync and downloaded the encrypted test file. For some reason, it's not decrypting the file. Any idea why?
Hi I have a question. Lets say we have three folders 1, 2, 3 which are uploaded to some cloud storage using rsync. Later, if I merge folder 1 with 2, will it be reflected on my cloud server? or will there be still, 3 folders? Ideally, after the merge, I would want there to be 2 folders. Can rsync do this? Thanks for answering.
Aparently RSYNC may not be able to keep in memory if a folder is deleted. So its difficult to make it a Dropbox replacement. Can we perhaps use github.com/deajan/osync Osync?
Just wanna know if there any way to protect our data from the future threats?
Such as quantum machines that can decrypt the copy of our data which is and will be stored secretly by any company...
Maybe a company like our internet service provider.
Is there a VERY light option of encryption algorythm I can use?
I don't need to be as secure as I need it to be fast.
I'm talking about stuff as simple as n shift-left operations of the bytearray. Secure enought that so you can't open it unless you know some basic stuff about computers and fast enough a potato computer can do it in an instant.
Why?
Because most of the stuff I have in my computer (main drive) is not that sensitive, and I want to offload the task to a raspberry pi.
...Why?
Because it is faster to use sshfs and change de computer that is mounted instead of setting all this up again in case I want to (a) change drive, (b) move the folder or (c), do it in another computer.
Is slow, yes, but more convinient for *me*
When I upload some files from my laptop to GoogleDrive or Dropbox, rclone deletes all my previous files in there. How come?
I type this: rclone sync ~/Documenti/ GoogleDrive:
Any help will be appreciated. Thanks
And why exactly was "rsync" needed? Is it dependancy of rclone that needs to be installed manually?
Can you please make a video on QUBES OS ? Also can you please guide me on how to remove windows 10 from my laptop and install QUBES OS on it please ?
Certainly QUBES is an great way to compartmentalize things and be very secure.
A person who doesn't know how to remove windows 10 is trying to install/use Qubes OS? Qubes is not for beginners. You might have a difficult time using it
Now, You said to encrypt my data before it gets to the cloud. What if I did not do this or learn how to do it before watching your video, and I have a lot of data sitting in a cloud drive like google drive. How do I go about encrypting it? Do I download it all, encrypt, and reupload? Is there another way? Will it even make a difference if they already have it?
Could you make one video tutorial with wasabi? & please confirm that does their pricing is really true? Cause I find out it's way cheaper than any cloud provider even cheaper than Backblaze B2 cloud!
i use pcloud. however the purpose of pcloud is to share files, not backup storage. pcloud offers a audio player along with being able to download the files. files and bandwidth are tracked so you know how many downloads or how much bandwidth is used (useful for my purposes, as in not needing to link back to my home computer to share said files)
i use a 24TB NAS for my backups, as i do not trust cloud providers with my personal data, encrypted or not.
I use pcloud for backup. I guess you can use storage for whatever you like.
How can I read my encrypted files on mobile iOS?
I thought this was an `rsync` tute, but it seems to all be `rclone`. Is there a timestamp for the `rsync` bit? I just want to know the right options.
Sync.com has you covered. The crypto is almost perfect.
Hi Good morning . Ummm I need some help with my laptop . I just no longer want to use Ubuntu . And I can't remove it from laptop . I can't find aaaanyvideo or some information to get back into the Windows . Please help me Thank you
Just shoot your ssd/hdd on a cloudy day in the sky! Maybe a cloud stores it.
But what about retrieval? Maybe attach a really long string? :)
@@ChrisTitusTech Exactly c:
2:33 - Why can you read my mind? no words can better describe my feelings about cloud storage xD
why is it so important to encrypt your filenames? like I get if it was something at all sensitive, but if it were just something like an essay or something, is it still important?
We need an app like tutanota but for storage
Me like: Oh I got some tape laying down here.Let's use them with my HP LTO 6 Tape Drive recorder.
OneDrive just uploaded a ton of my personal data without my permission and I don't know how to get rid of it and get my files back without loosing the data on my computer. I had previously turned off this feature... but today "suddenly" all my files have a little cloud picture next to them.
BTW, if you get the 404 package install, you can just run Pacman/yay -Sy
nano, vim... What about emacs?
@@epsi I use Dvorak...
Is just about learning and training your muscular memory.
@@epsi Maybe a boneless pinky?
Dont you think ''they'' could decrypt anything you could encrypt regardless? im no expert but if its a publicly offered encrypter whatever, i would think they could break it anyway.
@@arrdubu interesting, and thanks for the info :)
@Arr DubU said it best, it is far more common for the access point to be at the user level than breaking into encrypted storage. A good case of this is when a terrorist in the US encrypted his iPhone. A 3rd party finally cracked it using an exploit in the Apple iPhone software, but something like this, there is 0 access or exploits unless you have direct access to BOTH keys. Short of having a quantum computer, there is NO way for them to get access.
@@ChrisTitusTech Nice, cheers Chris :)
Sync.com is interesting.
3:42 Chris Murloc Tech
dropbox asks for your computer username and password. someone would have to be insane to give them this info
Speaking of storage, I think it is time to talk about LVM. It can be deployed as a hybrid storage solution using both NAS and local SSD cache using dm_cache. LVM is very flexible, support encryption on the fly and RAID configurations. Oh, and check out Yakuake, much more easier to access the console that way with your own preferred global shortcut.
IT is built on a web of trust. Or mistrust. But it will either become trust or it will become nothing.
Rclone encryption does not take much processing power. Its the remote/api thing that makes everything go slow. that shit is limited af
Also, it's pronounced "vee-eye". Just pronounced each letter of "vi" and you're good. :)
Back to the good ole USB, really too complicated.
RIP trying to use this with proton drive. So slow 😭
I understood that my data needs to be encrypted the first time you said it now at 9:20 it’s starting all over, how many times did you repeat it? I don’t know how much longer I can be told that over and over. And be told it doesn’t matter what cloud storage service I use, I got that too. I’d love to see this video, now that I had a break and cooled down I’ll try again. What did you say about advanced Friday? This video is for advanced users? You explain to them simple concepts over and over as if they don’t listen or understand? What do you teach beginners like?
Don't use Google, you know why. JK, you can use whatever you want.
An why would I trust the encryption software?
I could be just tagging my important files and they end up taking a longer route before reaching my cloud 🤷
Cloud storage is the toilet paper of the internet :) .... pay attention to the instructions . :) roflmao
Don't trust any company!, LOL
Please do not follow this guide, It's old and very outdated.
Preaching about security and your system is not up to date? Not consistent.