6 AWESOME Command Line Tools For MAC And LINUX
VloĆŸit
- Äas pĆidĂĄn 31. 07. 2024
- In this video, I present six awesome command line tools that are a critical part of my CZcams
workflow.
Check out the accompanying guide on my website: techcraft.co/videos/2022/4/6-...
đ Check out my Homebrew guide here: âą The 1st thing to insta...
CHAPTERS
==========
00:00 - Start
00:20 - rmlint
02:05 - rsync
03:51 - rclone
04:58 - ncdu
06:02 - btop
07:06 - ntfy
TOOLS
======
* rmlint - rmlint.readthedocs.io/en/latest/
* rsync - linux.die.net/man/1/rsync
* rclone - rclone.org/
* ncdu - dev.yorhel.nl/ncdu
* btop - github.com/aristocratos/btop
* ntfy - ntfy.readthedocs.io/en/v2.0.1/
LINKS
=====
* Pushbullet - www.pushbullet.com/
* Backblaze B2 - www.backblaze.com/b2/cloud-st...
GEAR
=====
* iPad Pro 11" - geni.us/H0qJ
* Apple Magic Keyboard - geni.us/8uBg
* Anker Thunderbolt 3 Cable - geni.us/BTOsQ
* Aluminium Armour Case - geni.us/M5ph
* Synology DS920+ NAS - geni.us/2yKgZp
SUPPORT THE CHANNEL
=====================
* Buy me a coffee - www.buymeacoffee.com/techcrafted
AFFILIATE LINKS
==============
Tech Craft is a participant in the Amazon EU Associates Programme, an affiliate advertising programme designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.co.uk - Kråtké a kreslené filmy
This is probably the first video on terminal tips where all (except rsync) were new to me. Thanks for a great video of really helpful tools I didn't know about before.
Totally make this into a similar series and explore CLI tools vs only the ones you use. Canât wait to get to my machine to try them all. Awesome work!
Very useful, thanks. Nicely presented. Told me exactly what I need to know without waffle or unnecessary musical accompaniment.
Really useful bunch of tips. There are a couple here, rclone and ntfy that will be extremely useful to me. First time I've seen this channel pop up in my feed, and already subscribed on the strength of this video.
thanks for these awesome recommendations , especially for btop and ncdu
Wow - superb video and some top tips there! Love your use case for ntfy! Subscribed đđ
Thanks a lot for hinting rclone. Thatâs what I was missing for long time
Love this video! Straight to the point!
thanks for the videos! I really enjoy watching this channel
a great selection! Certainly I will try ntfy -- getting notifications on a smartphone sounds cool (a modern replacement for sending notification emails from cli)
Excellent - subscribed on the spot - well done!
Oh my god, spot on, what a great video without any BS. You are awesome đ
Thanks for the kind words. I'm trying to make 'without any BS' my brand and it's heartening to hear that it resonates with people.
Love the videos (and all others lately)
Implementing ipad + Pi as we speak
Thank you for this info!
btop look really useful! gonna give it a try.
Excellent video again. Very useful tips and great I can use these on my Mac as well as on my many Pis.
After a while I was hearing another word instead of rsync. I'm often accused of rsync around with my computer. đ
đ top class that one!
btop - great stuff! thanks for the suggestion. adding it to all my current and future servers!
You should definately install rsync from brew, the default MacOS installed rsync was last updated in 2006. With the brewed version you'll get a version that supports alternative (faster) checksum generation and compression algorithms (if rsyncing to another machine this is assuming the other machine has an up-to-date rsync as well, if not it will automatically fall back to the older protocol and inefficient algorithms).
I hadnât even thought to check that. Thanks for the heads up!
Great tip. On my new MacBook Pro M1 Max the rsync version was 2.6.9. After running brew install rsync the version is now 3.2.4.
"faster hashes" ? What could top rsync which already uses the best one ?
@@rautamiekka I meant checksum generation, and I would hardly call md5/md4, as used in the macOS rsync, "the best one" and xxh is better (subjective) and faster (objective).
Does the brew version include APFS extended attributes? (I have vague recollections of some Apple versions of standard tools being tweaked for resource forksâŠ)
Great content, thanks!
Like the approach, thanks for these simple tools - I have way too many double files hahaha
Wow!! Those are all great đ
Okay. That was awesome! Thank you!
Great video. Thanks
This is an _extremely_ useful series on how to use Mac as an actual computer - the best way to get *ix experience on reliable hardware.
You got yourself a subscriber.
Great stuff!!
super useful - thanks!
Great video. Regards from Colombia.
Amazing video! Subbed!
Well done. Thx
this was very cool. thanks to your video, I've installed ncdu (Ubuntu terminal equivalent to windirstat I reckon), the exquisite/hack scene style btop and, especially, ntfy. Really useful tips. Thank you.
It is not often that I subscribe to a channel after watching only one of its videos, but this video is significant! The content is clearly and well presented, to the point, and timely! I have subscribed. Thank you for this information. I will use these tools frequently. If I may, I'd like to ask a neurodiverse question. The advantages of using the terminal and command line's capabilities are clear. I have wanted to use the command line more often than I do. I am not fearful of using its application Terminal because I always read up on unknowns before implementing anything. I have a lot to learn. Luckily, I am technically minded and confident. So, fear of using Terminal is not a barrier for me, which is more common for others avoiding it. My reason for the slow adoption of the command line is a little different. I tend to remember and recall information visually. Whilst using Terminal, I make sure that I fully understand what I am doing. However, when I try to recall what I did at a later date, I struggle to remember it.
So, my question is, do you know of software with a GUI that can record actions like changes, installations, deletions and other significant changes made in Terminal?
I know asking for a GUI is somewhat contradictory when the command line and Terminal are concerned, but I see this as a way of ditching the majority of GUIs for just one. One visual app to see what I am doing would allow me to better learn and use the command line by remembering tasks by visualizing them in a timeline. Moreover, such a feature would allow me to undo or fix any mistakes when the repair is possible. Thank you for this information. I will be installing these immediately because they will save me both time and money. Cheers! âđ§âđ
Thanks for your kind words.
I'm not aware of anything that can visualise command history as a GUI.
Depending on the OS of your machine, you'll have some kind of command history file, for me it's `.zsh_history` in my home directory. You can configure this history to have timestamps so you could, in theory, power some kind of timeline.
I can trawl the history to see what commands I execute, searching for things like `apt install` or `brew install` to see what software I've added and removed.
It's an interesting idea to create some visualisation from that but sadly nothing seems to exist at the moment.
@@tech_craft Hey dude, sorry for my later reply to yours, and thanks for taking the time. A visualisation would work best, an example would be a graphical list with three elements, including; date and time, action (install, uninstall, other changes), and a representative icon. However, I didn't know of the history file you mentioned. I use Mac's, so I will check it out, thanks. Cheers mate. Rich.
As well as shell history, thereâs âscriptâ and âasciinemaâ which is closer to screen recording for a terminal. Not really what youâre looking for but it does capture output in addition to input.
Instant subscribed great video bro
Dude I can watch a gazillion more commands please make more of this
So, great content once again!! I just wanted to ask, I've been crazy looking for a tool to create a sync for files and working offline in my iPad (in order to use Obsidian, but I guess for emacs would happen the same). I wouldn't like to carry with me a Raspberry Pi every time I know that I'll be working offline, and I find Working Copy useless, except whenever I start hosting a gitea repository at home (the goal is to handle me my files while using end-to-end encryption and avoiding hosting my files in the cloud)
This is a tough point at the moment. I want the answer to be Syncthing which everywhere but iOS is incredible. Sadly, there's no native iOS support. There is an app for iOS called MobiusSync, but it's pretty lacking in features and hasn't been updated in a while.
I've been playing with hosting NextCloud at home and using that to expose files to my iPad. To connect back home I'm currently running Tailscale and Remote.it - testing both to see which is best.
This is actually an area I've been working on a lot and I have a series of videos coming up soon showing how I'm replacing iCloud/Dropbox etc. with open source, self-hosted software.
This video is really helpful, the terminal UI is really good too, will you make a tutorial on how to make our terminal UI like yours?
Thanks! I have a video that covers some of the setup here: czcams.com/video/8LcTA5m6_ts/video.html
This covers everything apart from the configuration of the Kitty terminal editor on the Mac. Mostly, I've just used the Dracula colour theme for Kitty so it's not too hard to reproduce.
I will be doing a full video on this topic though.
very interesting!!!
It's common to use A && B to run B when A is true, and A || C to run C when A is false.
However, combining them into A && B || C is not the same as if A then B else C.
In this case, if A is true but B is false, C will run.
Good video.
Thanks!
Thanks for the support Ron - very much appreciated.
nice video
Great video I was searching for a tool like rmlint. I also really like your terminal theme and was wondering if you would share it?
Sure. I'm using Dracula Theme pretty much everywhere: draculatheme.com/
Btop is amazing !
NTFY is super cool, thank you
Glad you like it - it's such a great tool I'm happy to share it with more people.
HammerSpoon is good for notifications too. I hadnât heard of Pushbullet. I use AppleScript and Messages app for remote notifications on MacOS but havenât sorted out other systems yet.
Glad to be the 1,000th like!
Adding to my list of useful: btop, ncdu, rmlint
Another useful? is neofetch; great way to get an eye-view of current machine capabilities.
Iâll give that one a go. Thanks for the heads up!
@@tech_craft I can not imagine a computer without neofetch/screenfetch/pfetch
Unison is an rsync-like tool useful for bidirectional syncing. A bit fussy about version skew between hosts but useful in some cases.
Thatâs a blast from the past. I used to use unison all the time before I started using Dropbox and then switched of Dropbox to Syncthing.
For me, rclone and ntfy look to be great additions for cloud tooling. I'm now sad to think that I'm coding for cloud uploads and task notifications on a task workflow management system which is the airflow on my pi cluster. And man this video is 2 years old. I'm kinda ashamed. I need some catch up to do. Subbed, sir.
wish I'd known about rmlint ages ago -- much more reliable than fdupes! đ
Very interesting and usefull, but one question:
I would like to ask what font you are using in your terminal?
It's JetBrains Mono: www.jetbrains.com/lp/mono/
@@tech_craft Thanks for very fast response.
Do you know of any utility to find near duplicate images? (Eg original vs compressed version of the same image) cheers!
I've not seen a general purpose utility for that. There's quite a few AI/ML systems for near duplicate matching but nothing wrapped up in a utility yet that I can see.
Thank you. Very clear and well structured.
(I am new to your channel)
This video is in your CZcams playlist. How do get command line on an iPad? Do you have a video with instructions?
I am keen to buy and set up an iPad for software development.
(I have not watched any of your Pi videos)
Thanks for the kind words!
The Pi videos are the best place to start, probably this one as the best intro: czcams.com/video/A3qn1nqw-Gw/video.html.
I haven't done a video yet on what the command line looks like on the iPad _without_ the Pi. In essence the best two choices are A-Shell and iSH. I have a video about them on my content backlog.
@@tech_craft thanks for the detailed reply. I'm looking forward to all your videos
ZSH allows you to use special mapping of environment variables. You can simply do:
# append
path+=('/home/geowar/extra/bin')
# or prepend
path=('/home/geowar/extra/bin' $path)
And skip the conditional lines.
The purpose of the conditional is to check that python3 is available. How does using `path` avoid that? From my testing it will still complain if `python3` isn't installed? Maybe I'm missing something obvious!
@@tech_craft My bad: My brain auto-translated that to the usual pre-check to see if the new path was already in the list of paths. FAIL!
No worries! Thanks for taking the time to comment - I really do appreciate it!
Weird, it was always said that chaining the §&&§ and §||§ like that ain't an if-else statement but rather a "show the 3rd one only if the 1st command succeed but the 2nd failed", yet it also worked for me with Bash (I can't be arsed to make Zsh work right on my Ubuntu, it's way too much work even for me) with §rm -v foo§ O.o
do you happen to know how rmlint verifies that files are duplicates? what if there are similar files with the same filename and file size? i am thinking a checksum of large files would take too long. i didnât immediately see this explained in their manual but i also havenât had the time to delve into it either.
It does run a hash to figure out if files are the same. You control the type of hash using the paranoia setting đ rmlint.readthedocs.io/en/latest/tutorial.html#paranoia-mode
I didn't know rlint, but rdfind works for me. I had a ton of duplicated data and chose to keep them in both places, just with rdfind -makehardlinks true. Keep in mind that this requires support for hardlinks on the filesystem (meaning most stuff except FAT, NTFS and exFAT) and that it won't work across filesystems.
Nice one. That's been added to tool list!
@@tech_craft btw, IIRC NTFS also supports hardlinks, but I'm not sure if Linux' drivers can handle that
đđ
Is there any cli app out there who will able to manage all installed cli apps? It might be headache to remember all of its names.
That's good question, and it's a rich area of choices. If you're using Homebrew on the Mac then you can run `brew dump` to get a bundle file that lists all your installed software.
That same file can be replayed using `brew bundle` to install all the software on a new machine or when reinstalling.
For something more sophisticated you have tools like Ansible or Nix. Both are comprehensive solutions but have a pretty steep learning curve!
Not sure if you already have, but would be nice to do a tmux video
Just noticed that you have and it is an awesome video! tmux is king
Hello đđż
Awesome video. Iâve been creative with rmlint and deleted som duplicates from very important files. Does rmlint have a recovery mode on deleted files?
Sadly not! Which platform are you running on?
@@tech_craft Iâm on a MacBook Pro M1 đ»
You could give Disk Drill a go and see if it can recover the files.
Since pushbullet isn't available for iOS anymore, what would you suggest?
I said Pushbullet but meant Pushover đ€Šđ»ââïž Iâve been using pushover for a while now and itâs been working well.
This is a feature of htop but btop must have it: By selecting a process and pressing 'e', you can view the process's environment (if your user has the permissions for it, usually it has to be one of your processes).
I'd been using htop for years and I never thought to look for how to do it because it never even occurred to me that it was something htop would do. So if no one had told me you could do it I would never have known.
How do you get that fancy `cat` printout at 8:32? :)
That's `bat`. I showed that one off in this video: czcams.com/video/2OHrTQVlRMg/video.html
@@tech_craft love it. Thanks!
Do you have an iPhone pushback app on European App Stores? In the US app store it is not available right now.
I misspoke in the video - I have Pushover not Pushback on iOS.
Thanks a million!
NTFY is now in Homebrew...
The best cli tool is 'fuck'. If you misspelled a command you just type fuck and it autocorrects the bad command.
How do you use pushbullet on your iphone, I thought only android devices are supported since a few years?
I realise I said pushbullet but I meant pushover. I was reading the ntfy docs and had the name stuck in my head!
@@tech_craft Oh yes, it's a shame Pushbullet was a really good tool. It think my next phone will be an Android because I miss this app
Have you tried Pushover? I'm not sure how they compare, but Pushover is pretty nice for my use cases.
@@tech_craft Yes, pushover is nice for notifications but pushbullet can do other useful things (on android, at least): read and write SMS in your browser (a real keyboard is great to send sms), share a clipboard between your computer and your phone,... I completly dropped pushbullet since I have an iphone
How do dupe files happen like that? I wouldnât ever expect to have duplicate files because I maintain all my files.
The only reason i love mac more than windows is that it has bash instead of powershell and cmd
Is pushbullet available on iOS?
I misspoke. Iâm actually using Pushover on iOS.
8:39 - Pushbullet on iOS?
I misspoke. Itâs Pushover
@@tech_craft Oh interesting, I will give it a try, thanks!
ntfy = notify-send on linux
shouldnât btop be bpytop?
btop is the latest revision of bpytop, this time written in C++
BashTOP became BPyTOP when it was ported from Bash to Python. Then BPyTOP was ported to C++ and became BTOP.
@@RedBearAK good to know, thx
Path modifications should be done in the .zshenv file; not .zshrc.
That isn't necessary for most people nowadays. If your default shell is zsh, you will almost always have encountered at least one "interactive" shell before you run any scripts. And the interactive shell will have sourced zshrc, which will have fixed your path. I'm guessing 99% of normal zsh users could just toss everything into zshrc and be perfectly happy. đ
I tend to put PATH changes for interactive commands into .zshrc to reduce the scope of that change. YMMV.
@@traal Dear StackOverFlow: Why won't my .zshrc path modifications work for my non-interactive scripts? [\satire]
*ncdu = ncurses-based du viewer
IMD should be in here
That's a new one to me. Do you have a link, I'd love to try it out.
@@tech_craft Here's the github link github.com/Noah-Arcouette/imd
Windows users watching this
I think all of these will work in WSL2 but I haven't had a chance to try.
For notifications I actually use this BASH function using osascript (you can only do this for macOS):
function alert() {
osascript -e 'display notification "'$3'" with title "'$1'" subtitle "'$2'"'
}
I add it to my .zshrc file and just type `alert "Title" "Subtitle" "Description"`