Building My ULTIMATE 10 Gigabit Video Editing Storage Network! (Part 2)
Vložit
- čas přidán 29. 06. 2024
- Part 2 covers the configuration of this equipment, including the first setup of the NAS and switch, connecting to Final Cut Pro X, and a few tips and tweaks along the way. I've highlighted the different sections in this video with timestamps below.
Chapters
0:00 - Intro
1:02 - 10G adapters
2:03 - Powering up
4:53 - Checking the network connection
6:18 - Qfinder Pro application
7:00 - QNAP NAS Smart Installation (first time setup)
14:32 - Creating a storage pool
24:58 - Configuring SSD cache acceleration
30:33 - Creating a shared folder
35:18 - Accessing the share from a Mac
36:16 - Transferring a file
38:15 - Managing the switch
45:07 - SMB & AFP
48:02 - Creating a user
49:49 - User permissions & hiding default shares
51:31 - Setting up Final Cut Pro X for network editing
59:59 - SFP+ questions answered
01:01:49 - Connecting to a network share on startup (Mac)
01:05:49 - Final thoughts
Check out Part 1 of this series here: • Building My ULTIMATE 1...
or
watch the complete series here: • Building My ULTIMATE 1...
I'd like to say a huge thanks to everyone at QNAP for the support. QNAP generously provided this equipment to the IMNC channel free of charge for review, however all opinions remain completely my own.
QNAP TS-h973AX-8G NAS:
UK - amzn.to/3r1hihC
US - amzn.to/3aXvxhI
QNAP QSW-M804-4C Switch:
UK - amzn.to/3kxmrvw
US - amzn.to/3uLEBOT
WD Red Pro 10 TB 3.5 Inch NAS Internal Hard Drive:
UK - amzn.to/3q6Ri3e
US - amzn.to/37Vy3TX
WD Red 500 GB NAS SSD:
UK - amzn.to/3sACV90
US - amzn.to/3kG3V4d
FULL PRODUCT INFORMATION AND SPECIFICATION (UK site)
QNAP TS-h973AX NAS (8G/32G)
www.qnap.com/en-uk/product/ts...
QNAP QSW-M804-4C Switch
www.qnap.com/en-uk/product/qs...
Browse the full range of QNAP switches to find the ideal switching solution for your setup: www.qnap.com/en-uk/product/co...
To connect to a 10Gbps, 5Gbps or 2.5Gbps network, purchase of an adapter or expansion card will be required, unless your computer is already equipped for speeds greater than 1Gbps over ethernet. QNAP have a range of adapters and expansion cards available that can be found here: www.qnap.com/en-uk/product/se...
To see all of my gear, visit my new Amazon Storefront:
www.amazon.co.uk/shop/itsmyna...
I'll be expanding my storefront so feel free to keep checking back!
______
📷I have a VLOG channel, check it out📷
/ imncvlogs
______
🌍IMNC SOCIAL🌍
Twitter: / tom_j_smith
Facebook: / itsmynaturalcolour
Instagram: / tomjosephsmith
______
You can support IMNC by using my Amazon links - it doesn't cost you a thing 🤓
🇬🇧UK: amzn.to/2VENCZr
🇺🇸USA: amzn.to/3quIbKQ
Thanks for the support!
______
🖥🧼CleanMyMac X - The ultimate cleaner for your Mac! 🧼🖥
CleanMyMac X scans every inch of your system and removes gigabytes of junk, large hidden files, old archives, unused apps, and malware. Get yourself a powerful Mac cleaner and see how a clean Mac feels here:-
macpaw.audw.net/c/2589867/638...
Check out the other awesome MacPaw apps here:-
macpaw.audw.net/c/2589867/248...
These are affliate links. IMNC earns a commission from all sales via these links.
______
I sometimes part with my old nerdy possessions to fund future projects on the channel. These can be found for sale here:
IMNC Facebook shop: ItsMyNatural...
IMNC eBay: www.ebay.co.uk/usr/mynaturalco...
_______
🎞My videos are filmed with the Sony ZV-1. Use these links to purchase this awesome camera🎞
UK - amzn.to/2L7ZBwN
US - amzn.to/3quxKa3
_______
All Amazon links within this video description are affiliate links. IMNC earns a small commission on each sale. The price you pay does not alter. - Věda a technologie
Thanks Tom. I was just about to go to bed and your video popped up. Now I’m over an hour late. Love your videos.
you should have setup the SSD's first as a system storage pool. that would thne make the system/qpkgs etc faster. but you created slow disks pool first which assigned the system to that pool!
At 32:33, in the create shared folder wizard. The setting "Performance Profile (block size)" if you are working with large video files, you might want to increase it. Make it higher than 128Kb. a much larger block size will increase the overall storage performance for large files
Would love a network and setup update when you get a chance!
This along with part 1 and 3 make the most fantastic overview of setting up a relatively complex bit of kit, thanks so much! Love your enthusiasm, and what seem like great results for video editing. I've been looking to get this NAS for a while now so this is super helpful.
I don't know how to thank you honestly. I have this EXACT setup, and was having a very frustrating time. Not done yet, but this has already made it significantly less stressful, and I've gotten further than I think I would have otherwise already. Thank you!
I have a suggestion with the switch + sftp issue:
If you connect the QNAP SFP+ to the 10gb port on your UDM Pro, then use 1 (or more) ethernet connections from the UDM Pro to the Ubiquiti Switch, you should be able to have multiple devices on the udm pro switch being able to use their full 1 gigabit to connect to the new nas. If you have the ports free, you could use multiple ethernet cables between the UDM and the ubiquiti switch and set it up in link-aggregration, this should also allow multi-gigabit connection from your other devices.
This channel just gets better and better. Great subject and great video editing as well. Thanks and looking forward to part 3 👍
Thanks so much!
Awesome video as ever Tom. Very excited to see this in my sub box this fine Friday evening. I’ve got to say I never knew you could add network drives to your login items that is going to change the way I use my Mac when I restart it. Thank you so much for that tip. May sound stupid but it’s gonna make a huge difference to my day to day working and saving time when I want to jump straight into the edit. Again great video and loving this new series. Have a great weekend!
James, really glad you found that useful. Thanks very much for the kinds words, glad you enjoyed!
Really did enjoy the last two parts! Can’t wait for part 3 and more :D
great vid, looking forward to the next one, fascinating how much effort you make on these videos, performance/etc. Totally agree "fit for me" vs "fit for you" and people do need to understand the difference - tbh im much too lazy, i'd be very "its good enough for me and my standards, feels right is good enough", but really appreciate you making the effort to move that measure to be more objective
Thank you for showing the whole process to us. This helped me a lot, since I got the almost same setup so I could follow your steps. Thanks a lot!
Great video Tom. You have convinced me to get the same system. Getting ready to shoot a documentary running at least 3 cameras in 4K and I can only imagine how many terabytes of storage I will need and when it’s time to edit I will need a fast solution. Can’t wait for part 3
Fantastic to hear, David!
I'll be including some 4K testing in Part 3 for sure, as well as other handy tests.
Really glad you found this useful.
Great video series!! I had to setup nfs. With my synology to get final cut pro working with the Libraries. Also, i've been using the users and group tip and trick for a few years now which is a huge time saver great tip you shared. I'll share another great tip. I also right click the desktop on osx. Open view options and enable show item info. It will then show the free spaced on all the hd's and volumes connected to the mac. love servers Keep up the great content!!
To top off a perfect Friday, a new IMNC Video 😍
Love the series! I finally made the decision after extensive research to go for the QNAP!
Finally part 2 I have been waiting for this video lol lol
Same
Excellent video and really well explained. Pleased Ive discovered your channel... all because I was looking up Betamax last night!
Tom you always have such an exciting and interesting presentations!!!! Another Saturday treat for me. (i am a day late tuning in - been working on the road) I may never get to the point of installing a NAS but if i do then i will know how!!! Thank you Tom and blessings to you and your wonderful family from across the pond.
Thanks so much, Larry! Hope all is going well with you my friend. Thanks for tuning in once again and really glad you enjoyed.
Amazing stuff ! :)
just a suggestion put your unifi switch on a normal RJ45 and run the Dac cable to the DMP SPF+. Thats what I would do
love how you go through the setup process, great vids a fan of DR Who is a bonus too :)
if you need to get the sfp connection working to your main network you could try connecting direct to the dream machine as that has sfp+ ports
I concur. Not doing so would lead to the whole daisy-chaining switches thing, which I'm sure Tom knows is bad (I think I've heard him mention he knows it's bad).
Leave your big Unifi switch as your main 'access' switch, make your UDM Pro a kind of 'core' switch, branching off with the SFP+ ports into the new QNAP which will be a secondary 'access' switch, and of course the other Unifi 'access' switch. This would be far more ideal than daisy-chaining them!
Great video as always Tom, Shocked at how easy that was to set up. I just set up a Synology RS816 and you set that Qnap up allot quicker and easier than I managed with mine and I only have 2 4TB drives. I am impressed.
Thank you! It probably seemed a lot more slick than it was, video editing magic at it's finest while I sat there pondering what to do next haha!
In all seriousness though, I find both Synology and QNAP excellent in terms of setup wizards, onscreen help / info / guides etc. I like that these systems with such great capabilities are fairly accessible now.
Completely agree with you. My biggest issue was I was trying to use the photo station app app, ate up all the CPU horse power, was only after 24 hours I found out what was eating the CPU up lol
Just a couple of suggestions:
- lz4 compression will help improve the performance of your transfer speeds and help save drive space. I'd turn that on.
- if you can install the OS on the pair of ssd drives and create that pool first, then add the hdd pool, you may also benefit from a performance boost.
Looking forward to the next video with some numbers!
Edit:
Would you also be able to include drive temps and sound level in your follow up? Would really appreciate those data points.
the SFP port on your standard switch may share an i/o with a RJ45 port. You may have to unplug and possibly disable that port for the SPF port to work.
It doesn’t.
regarding overprovisioning, a NAS, even a consumer one, has more and sometimes much more disk usage than a desktop hard drive. This is due to regular array maintenance alone not counting NAS usage itself. Thats why the over provision can be beneficial. However if you are using enterprise grade hard drives, even used ones, or really only have not intensive use, you can minimize the overprovisioning
That is great info to know. Thanks for letting me know.
Good job buddy
Welcome to the Fast Side. You are so used to your firewire 800. 😂
(9:52) I agree, since a lot of apps would ask users to input the IP address, or allow users to bookmark sessions/presets that expect a static IP address since that's easier to code for.
Hey Tom, rewatching this video as planning my own QNAP NAS purchase soon - still love the content. Just wondering now why you didn't choose to connect the QNAP switch to the UDM-Pro using 10GbE SFP+/DAC cable? Then connect USW either to that switch, or directly to the UDM using a different port? The SFP+ port on the UDM-Pro is 10GbE, just like the QNAP switch, but your USW isn't... Cheers!
Nice this video
Great video Tom! I'd suggest maxing out the RAM on the NAS to unlock the full power of ZFS! Also you could think about running some virtualisation on the NAS so that you can use VM's for testing etc. You might even want to run link aggregation to your desktop to see if you can boost the already phenomenal performance still further. Might be worth sticking another two SSD's in the unpopulated drive bays so that you can add more shares to the faster storage. That way you could run some kind of caching server for DNS or web content / software updates which would take some of the strain off your internet connection? You might as well use the full power of the beast!!! Is it possible to farm the final rendering / upload of your videos out to the NAS? If so you might be able to make use of the NAS here too?
Fantastic comment with loads of great ideas. Stay tuned for future stuff! This is hopefully just the beginning.
To solve your SFP issue without buying other hardware, you can link up the Dream Machine Pro to the QNAP using your DAC cable, since they both have SFP+ ports. Then use a gigabit ethernet cable between the QNAP and the non-pro switch, or between the non-pro switch and the UDM-Pro. It won't really matter though, everything will run at the same real-use speeds :) If you're running out of ports on the USW, you can get a Ubiquity 1GB SFP copper module for one additional port, but at that point you can just use the QNAP ports directly.
Awesome.
Great video Tom. I need to hook up 4 computers to this system. Do I need a switch or can I use the 10gb, 2x 2.5gb, and 1 of the USB ports on the back each to different computers?
that was fast, the first file drop, 2gb 2secs? nice!
A couple of inexpensive 1GbE SFP to RJ45 transceiver should sort that minor issue with the switch.
So glad you're back! but what are you doing for #MARCHintosh?
Haha I know the answer to this...🤫
Don’t think Tom would want me to reveal his new toy yet🤣
Hi Tom, just a thought about getting SFP+ 10G between the UDM and QNAP switch. The UDM has a 10G SFP+ port which your currently using to connect to the USW-16-GEN2 though limited to 1G. Connecting the UDM and USW with an ethernet cable instead would free up the SFP+ port for you and then should be able to use this to connect directly to the QNAP Switch. Would still be 1G between the two devices as it is now but would enable the 10G link.
If mounting a network volume/share at login isn't something someone wants to do, they could of course just put an alias of the volume on their desktop and open it before launching FC. One could also create a small script, again aliased on the desktop that first mounts the volume and then calls FC.
These solutions would enable someone if they choose, to eject the volume when not using FC and then easily/quickly mount it again before launching into FC.
Hey Tom, any plans to continue your Folding@home efforts again? The team has been doing great!
The UDM-Pro has 10GB SFP+. Also you don't want to use the switch on the UDM-Pro since all 8 ports only have a 1GB backplane to share. On Unifi for some reason you need to log into the device and manually set the speed on the SFP/ SFP+ ports.
Regarding compression, the CPU in that NAS is plenty fast to handle compression/decompression duties. Enabling compression could give you faster transfer rates, since more data gets crammed into the pool's write speed and pulled out of the pool's read speed. E.g. if the data is 4:1 compressible, the transfer rate could be up to 4x faster, though likely less than that in reality, and probably running into the limits of 10Gbe for sequential data. However if your data is incompressible like video, then yes it does not make sense to make the NAS try to compress it.
I saw on another video where someone installs the system on 2 NVMe SSD and not on the HDD.
Would be interesting to know if it gives faster readspeeds and if it's possible to do that afterwords, without loosing settings or whatever else..
I'd go UDM-Pro sfp+ port to your Qnap switch then connect to Qnap switch to your Unifi switch.
Hey. I just built a similar setup to yours, the difference is that I created the first pool on NMVE SSDs, and I also bought a thunderbolt 3 to 10GbE adapter but I'm not even close to editing any video with this system. I'm using a new, fully maxed-out MacBook pro max and I can't play back an HD video on an HD timeline. Do you have any idea what I'm doing wrong?
Cool
Do you know if you can connect to one of the storage pools via the usb-c (from a mac) similar to a DAS?
The UDM-Pro 8 switch ports share the 1gb. Are you able to use a port on the Unifi 24 port switch for better performance?
Great video do you get the full 10g network on the Mac is is it limited like what I have read in place
I haven't noticed any obscurities while testing. Everything reports 10GbE just fine and speeds seem completely on point so far.
04:53 is it just me or does his desktop with that picture and orange sides look like it could be the cover of a national geographic magazine?
Personally I would have gone with the UniFi Switch Aggregation
rather than the QSW-M804-4C. its half the price and Unifi!
Hey, Tom, there’s a TV show from 2003 called “Boohbah.” I used to saw that.
Did you check for firmware updates on the switch
I knew I should have gotten the 10 GB NAS for future-proofing, but I worried that it would be too much too soon until 10 GB becomes standard.
It seems that 10GbE is getting much more affordable and a lot easier to deploy. This was all plug and play, and with these 10GbE capable RJ45 ports, it all just slots right in with no hassle. Great stuff.
You should set your lowest Samba version to Samba 2. Nothing uses Samba 1 anymore and it's more of a security risk than anything else.
Thanks for the tip, Mike!
@@ItsMyNaturalColour In Windows its almost impossible to use SMB1 it's been so thoroughly deprecated. My Seagate NAS is old enough that this became an issue.
@@PWingert1966 actually you can, even in the lastest windows 10. just go to add/remove programs->add windows features, select SMB 1.0/cifs, reboot and you are good to go. but, it is a security risk...
What do you use for backup, especially for offsite backup?
The NAS looks good Tom, but I think I’ll be sticking to UniFi switches.
The NAS is a complete beast. The Switch is also very nice, but if you're a UniFi guy, it makes sense to stick to it.
Great video, but am left wondering why are you jumping ship from Synology to QNAP, it just doesn't seem to fit with your setup ?
The new rackstation synologys only supporting their own drives might be a factor?
Hi if you didn't fix the issue with the dac cable check if the autonegosiation on your UniFi switch in on if yes set it to 10gbps
Sorry I haven't spoken in a while Tom, hope everything been fine, I am still watching your videos, take care and all the best to you buddy :)
Hey Joe! Awesome buddy, all is well thanks, hope thing's are good for you too!
Glad you're enjoying the videos.
@@ItsMyNaturalColour Yes, I am fine, all good thanks Tom, you're videos are amazing, loved your content since before i joined CZcams. from the times when you had your iMac G3s Lol :) glad to see you still posting after all these years
I have a QNAP switch op order, 6 x 2.5 GHz, and 4 x 10GbE/SFP+ combo ports
Slightly OT but worth noting. I ran into an interesting issue with one of my NAS units. My Laptop that I made the initial connection with is a Dell G5. Dell in their infinite wisdom has worked a deal with Microsoft to add bit locker functionality to all their machines regardless of whether they are running WIN 10 Pro or Home. On My NAS which I connected to from this G5 with the Bitlocker encryption enabled I setup an iSCSI drive using one of the available hard drives. This resulted in the iSCSI drive being BitLocker encrypted using the key for the G5! Now iSCSI is not a terribly stable connection and drops quite often. Easy enough fix by removing the connection in the iSCSI manager and reconnecting. Here is the fun part. every time I reconnected; I need to manually (because I am not using Win 10 Pro I can't save or read the key from a USB stick thanks Dell) re-enter the 40-bit encryption key from the G5. The best part is that any other machine I am accessing this drive from I must also use the G5 key. So, I usually leave it disconnected until I need to use the Backup facility for the documents drive from windows which can only use a mounted lettered drive!
Dell and Microsoft - says it all.
that's weird, i haven't seen any dell or other brand of computer that had factory encrypted disk with bitlocker. unless there is some weird option in the tpm section of the dell bios, bitlocker can usually be removed by decrypting/disk wipe/tpm disable etc. iscsi being a block protocol doesn't care about what data goes in or out, the prompt for the key is coming from windows as it detects bitlocked data. but again bitlocker has to be explicitly enabled for each additional drive by the user, so it's super weird that the iscsi disk was also encrypted in the first place, without you doing it.
oh well, i guess dell has a new surprise for everyone...
@@giornikitop5373 I discovered it when I had to upgrade the SSD and the tech said it was BitLocker encrypted and asked if I had the key? I had to go to my Microsoft account and gen a backup key for the computer. I called Del and they confirmed that most of their consumer-grade machines running windows hoe come with encryption via BitLocker enabled since 2016. Normally it runs in the background and no one notices but in certain situations it needs to be undone for things like upgrade replacements and backups. It can be turned off but then you must decrypt the drive to transfer the information and then re-encrypt it. Upgrading windows to Pro can be an issue too I was told. The problem is that since my machine does not have Windows Pro version I can't save or read the key from a USB drive and must type it in every time.
Hi the sfp port on the end of unifi Dream Machine can only use port 7&8 or top sfp is up link and bottom sfp is down link you can not have anything in all 4 ports it’s goes 7&8 or sfp up and sfp down also nice video just wish I had to money at the moment to buy a nas for security purposes and for connecting when at work
So you will have to get a SFP+ switch to get access to the extra speed, it might be possible to create a password by creating an anagram of something obscure about you that only you know.
Ask LTT ;D
You didn't adjust the MTU size to 9000. Can you run iPerf on your setup to measure your network speed?
I was going to mention - you created your username on the NAS as 'Tom Smith', where your username on the Mac is 'tom'. Surely if you created the user on the NAS as just 'tom' as well with the same password as your Macs, you'd have a bit more of a seamless experience?
Just a thought.
Have a look at 01:03:54 - my Mac account username is Tom Smith. You may be spotting my home folder name as tom?
Noice
possibly everyone does as they see fit
At least I chose to opt for the motherboard with two intel xeon processors and as storage I use ssd from samsung of 2tb and 4tb
Being also the most reliable resistant in any condition of use as storage
On the operating system version I opted for a 1tb ssston from kingston and as an operating system I opted for a windows 8.1 pro all have up-to-date updates including drivers and paid antivirus with license
And in total ssd I put around 60 ssd all connected by pci sata board with 8 ports
Why not leave the DHCP active and just set your switch to serve the same IP address to its MAC address.
Nothing wrong with that at all, Kris. Thanks for the comment!
Shouldn't you be using a crossover cable between two like-devices? Maybe that is why you aren't getting the switches to communicate, also, you would need to set the switchport mode for the port to be a trunc port for them to pass on your VLAN information
Autosensing ports on the devices should mean crossover cables aren't needed? The devices will be able to negotiate to get the best speed?
@@NMY556L Yes, you are right... Auto-MDIX ports will automatically adjust depending on which type of connection it detects... Whether he has that feature on the switch or not, I'm not sure.
If possible can you make as more easier to make watch "Building My ULTIMATE 10 Gigabit Video Editing Storage Network!" process on playlist?
I don't think I would have set it up that way for your situation. If everything is backed up and you have shared video editing 2TB M.2 SSDs in RAID 1 with storage in RAID 10.
BTW .. if all I were using (that NAS) for is video editing, what you're describing is a scratch drive, then 100% SSDs with sufficient space for your work project.
insannneeee,,,,
you can buy unifi AGG switch 300$
Qfinder Pro is a but buggy. Menu selection and cursor connectivity are a bit flaky!
Prova a creare una TL ricca di contenuti e lunga almeno 2 ore, 120min.......e osserva se FCX collassa..... 😳....questo perchè qualsiasi software di editing rallenta molto quando le TL si arricchiscono.....
Since you don't like Windows, what is your attitude towards Windows users?
Ooo
No new uploads in a year :(
£186 for the qnap usb4 adapter, no thanks...
To be fair the video was sponsored hence the hardware choices
@@NMY556L Yep I agree.. I have synologoy nas and that was a bad move... Should have kept the netgear...
I love the part where on your browser you have the BPH folder or better known as the "best pornhub" favorites folder ......homie pornhub has a favorites system you dont have to bookmark them rofl