10TB for $70! How to format 520b sector SAS drives to 512b - EMC, Netapp, HP, Dell, etc.
Vložit
- čas přidán 7. 08. 2018
- ►sudo apt-get update
►sudo apt-get upgrade
►sudo apt-get install software-properties-common
►sudo apt-get install sg3-utils
►sudo sg_format -format -size=512 -fmtpinfo=0 /dev/sda
(you may need to use the --six flag depending on your drives)
►Patreon: / jdm_waaat
►Try Twitch Prime for free: amzn.to/2vFyf6I
►Discord: / discord
►Reddit: / jdm_waaat
►Twitter: / jdm_waaat
►Massdrop invite: www.massdrop.com/r/QL4TTY
►Coinbase - get $10 free: www.coinbase.com/join/51d245c...
As an Amazon Associate, ebay, and DROP Partner I earn from qualifying purchases. - Věda a technologie
This helped A TON! I was trying to create a raid array on a dell perc h700 raid controller with some new (to me) drives from a netapp. It kept saying the drives were defective. This worked! thanks!
Lots of great info in this video beyond the original scope. Thanks for sharing!
it work like a charm, 9 HDD in my office that we where thinking are bad, now they are fully operational....
Great info man! I have a system setup as a "conversion machine" with all types of devices and interfaces on it, from MFM to SCSI1/2/3 to SAS1/2/3 with tape drives, floppy drives, zip and Jaz drives, cdrom/dvdrom/etc. I'll just put this on it and since I externally pull out the cabling I can use it to run those long formats on many drives. I found keeping one "old" system setup like this saves a ton of time with these "new" projects. Thanks again!
What brand of drives were these?--Seagate, Hitachi?
Thank you for sharing the trick. Formatting 30 drives in two enclosures (KTN-STL3) with Dell H200e HBA. Process is slow but working.
Just the video i was looking for!, and was in my suggestion.
thanks alot, this helped me out. I bought two SAS drives HGST and was having the issue finding them on the system. Format is on the way so lets see.
Works perfect, same drives (2TB), used Ubuntu 18.04.3; had to add "--six" (did not work without --six); but video really perfect, clear and no nonsens !
how did you get the raid controller to not just block the drive. When i scan i dont see the drives because the controller faulted them. The do show up in the controller so i know they are present.
@@awidesigns I didn't have to do anything special (as far as i remember); are you sure drive(s) are OK ? I have LSI SAS3801E L3-01123-04E Dual Port SAS Controller with Seagate's ST33000651SS (3TB)
Same issue I had and I was banging my head for hours trying to figure this out. I actually found the same solution but it was posted vaguely somewhere on a forum post. In my case I got 12TB SAS or 4x3TB Seagate Costelation SAS (I think they came out of a net app) for $105 or so. $27 each. Two things you should be aware, it will take no less than 4-5 hours to format them and also all of mine came sealed but had about 16000 hours which I'd assume to be 2 years running 24/7.
I'd recommend everyone copy and paste the final command.
I had to do this to 40 drives!!!!! I have 3 15 bay EMC shelves and all but 5 of the drives are EMC parts numbers so
Very good explanation. Thanks
Some RAID Controllers don't talk to your computer's or server's bus which means they don't appear in BIOS. So they will likely not appear in sg3_utils. Only your RAID Controller will. If you can put your drives in a Non-RAID array or on a HBA Controller/Card, this should work for you. Another thing, You cannot connect SAS drives to SATA back planes/connectors. SATA, however, is supported by SAS.
Along with formatting the drives how have you incorporated them into your build? Is it a SAS motherboard and if not, are you using a SAS controller card? What is the purpose of formatting the drive is it just for SAS or SATA motherboards or do both need it?
Excellent ... many thanks
very helpful - thanks
Would there be any performance / space advantage if they were fomatted to 4K instead. And, would the process be more or less the same. Thanks for sharing. Much appreciated.
It is also possible with an adaptec 5405 - You just have to make some entries direct into the adapter-bios-configuration (boot etc. all enable)
doesent work for me....
Can you tell me what RAID or SAS controller you are using? Many won't recognize the 520 byte drives to reformat them.
Great video as always, wondering where you found such a deal on drives?
In europe best we get is 3 drives for 150 euros...
ebay.de
I bricked 11 DELL SAS drive's with this 2 days ago... make sure you don't interrupt the process.
How dp you brick it? Is it totally not reading it via sg_scan -i and sg_readcap /dev/sdX
Very good content! Do you know what should i do with 4TB HGST EMC drives that are recognized as 3TB? Any idea how to update frimware from HGST? (because EMC limited drives as 3TB with their custom firmware). Thank you!
What server did you use for that ? HBA mode o Smart Array ?
Thanks for your video! Would you have any estimation how long would it take to format a 600 GB Netapp drive from 520 to 512?
I saw that sometimes it takes up to three hours
Thread master if your still active what does --six does on the drive I think, we have the same drive i got es.3 seagate 4tb 3 sas drive I have is successful but one drive keep finishing with medium hardware failure is that physical issue now?
I got my hands on some EMC SAS SSDs, but they do not show up in the os in sg_scan on a Dell R430 with a H330 HBA. Any idea what else could i try?
Find out how to do the Samsung Sata SSD's that NetApp / EMC / IBM use. I have one that is stuck in 520 byte mode and I have yet to figure it out.
Do you have the opposite process, how to get a non emc Drive to work with EMC hardware?
Thanks for the guide, btw, two questions might also be asked by many people, 1) what does the fmtpinfo=0 parameter do here in the sg_format command, 2) is there anyway to read the SMART info such as drive power on hours out from these SAS drives? Thanks!
The fmtpinfo=0 should change the "end to end protection" to 0 (off), it's unclear weather it really does or not though. In Linux smartctl -a will show SMART info for a drive.
Hi this happen in SATA HDD version of these disk?, in only achievable on linux not windows?
Mine didn't work straight off the bat, had to reformat to 520 then reformat to 512. possible issue from who ever decommissioned the shelf. very long process for 24 drives.
just had a quick look on ebay australia, damn they want a fortune for them here, 300gb models are $80 each 2nd hand
Just seagate or Hitachi can be converted to?
Does Ubuntu recognizes the drives even if they are not initialized? On a Dell Server the drives failed to initialized, I want to unlock them.
I'm a bit confused. Aren't sectors physical structures on the platter? Because if they are physical, you're not supposed to be able to change their size... ?
Micron SSD 410m from EMC will not format using sg_format under windows 10, HGST works great.
Many thanks for this tutorial. I did it on a "Savvio® 10K.4 SAS" i.e. "ST9600204SS" in Ubuntu with a P420 controller on a PC (not a server) in HBA mode and I could finish the format procedure with and without --six flag. I created a disk Volume in Ubuntu afterward and I could copy small files into the disk without a problem but big files could not be copied. Also in Ubunto, the file system check shows me an error. Now I want to use the same disk and the same controller in HBA mode on an HP Proliant DL380 G7 Server on which a windows 10 Pro is running. I can see the disk in windows but it is not usable at all. I even tried it with the Raid mode of the controller. In Raid mode, I get an error that says there is a problem with this disk. In this case, the disk is not visible in windows at all. I would appreciate it if you share your ideas about my case.
You likely already realized this but HP's controllers are a real prick, even in HBA mode. Things should likely be done with a dedicated HBA and then if you wish to use them with your P series raid card that should work.
Excellent vid mate tyvm
Using this with Dell Perc H310 flashed to IT mode
Would it work with 4TB seagate? I got Dell Perc h700 but it can not be flashed to IT mode.
@@Thrakus definitely try SeaTools for Windows - advanced options saved my life with a couple of disks of which i was convinced were not savable. (It detects the disks with any card i throw at it, in any mode lol) i wasted so much time in linux.
Can you do this with HPE 3PAR drives???
Great video by the way!
I'm also curious to know this)
I bought a hgst netapp drive it's a sas type but when i tried it, minitool partition wizards detecting it as bad disk is that unfixable?
This tutorial works from hgst bad disk using sas raid controller on it mode now become unallocated logical disk. It works on truenas kudos to ypu brother.
Hi.
I found some drives on ebay like yours. Is not so cheap but in Europe are more expensive. But is good deal. I have one HP Dl 160 g6 server with p410 raid controler. Can I reformat the drives using live ubuntu on server with the drives connected to sas on that server?
I dont think so, I have the same server and the "smart" raid controller made me look like an idiot when I tried.
What did you use as a connector? You did not show.
Hmm , had some drives with format failed it starts then just stops , some worked some not
What version of Ubuntu Are you using ? is this installed or live from USB ?
It was a live distro from USB
Anyone know how to revert the disk from 512 to 520 ? I got some disks that need to be reformatted to 520bytes - but sg3 utils command fails for "--size=520"
Great video! Not too long! Only the essential! But I still have a doubt!
I have a Dell R610 server with a PERC6/I Controller and it shows the NETAPP drives in there but as Failed drives (they are brand new drives) when I use the sg_util or lsscsi command they don't show de drives , only shows a PERC6/I device as sda.
How to fix it to linux shows the drives directly pure in the OS ??
Which controller did you used??
TKS in advance to anyone
Did you ever figure this out? I have a few netapp drives in a MD1200 connected to an R520. PERC H800 also shows them as failed.
Did you find it out? Keen to know too!
@@greasyfingerss9811 Just replying to everyone here, so you know in the future or for others. You can't do this through a raid controller you'll have to get a breakout cable or have a HBA card so the drives are directly connected.
I am a newby where it comes to SAS drives. I have 4 2TB Constellation ES.3 drives and have been for hours trying to find the easiest way to connect these drives to my PC. It seems that I must spend a whole lot of $$$ just to connect them. I purchased them not realizing they were SAS drives. Any help would be appreciated... Thanks... One other thing, must they be used in a raid configuration (something else I am not familiar with) or can I use them as individual storage drives?
what is your motherboard? the simplest way is to buy a PCIe HBA raid card with passthrough rom., then connect the harddrive to the card with sas-to-sata cable. Or, if your MB has sas port (scu), you can choose disk mode as raid or non-raid in BIOS. and, check that sector size is already 512 to use in windows
hi
i got this msh in same drives
Format unit command: Data protect, type: sense key; write protected media?
FORMAT UNIT failed
I have some drives that wont take 10 or even --six for mode sense. :( What else could one do? Btw we are trying this in windows, cent os crashes on boot so im running out of idea's here.
I'm gonna try that format protection command next
I've just gotten some X3550 M2s IBM and had one drive working enough to port ProxMox then I got stuck with all the other 500gb drives, duh. This seems to be the answer and I'll try it I even took the drives out and tried to use a PC with a SAS to SATA connector into a normal SATA chan, but of curse (sic) it saw the drive in admin crap and it's outputting "drive not ready" so cannot partition or format (drives didnt spin up too so dont assume your drive is dead its just SATA not telling the drive something) and on the server RAID (LSI) "wrg type" so bearing in mind ALL my drives are EXACTLY the same IBM 2.5 500 GB 7200s then Im going to try this, ON the RAID controller - in the X3660 chassis, so it talks properly to the drives (it already sees them in LSI diag - but even that hates them) ...(....which is why the PC didnt work) I wish you'd outlined the physical machine just for info but I guess it doesnt matter. I hope these commands translate to the version of Linux the latest PrxMox installed - million thanks from Thailand, the home of the server junk yards (and a lot else besides!!)
I tried it IT WORKS great thanks!
I can't help but flinch every time you touched the PCB... I killed a 2TB drive back when they were several hundred dollars by touching the bare PCB like that >.
Touching the PCB will not kill hardware.
@@JDMWAAAT O.o I just of just had really crappy luck with ESD then.
format unit: Fixed format, current; Sense key: Data Protect
Great info and it might be a nice deal for someone that wants 2TB drives but who wants 2TB drives any more. I have 4TB drives that I am looking at replacing because they are too small.
The process is still the same.
any chance we can format a sun oracle sas 2 - 6gb 10k rpm drive?
You can reformat any drive that connects
Other forum said it wasnt possible to use EMC disks elsewhere because of Firmware, not format. hmm..
Will KtN-STL3 work with brand new sata 7.2k hard drives?
Yes, so long as your sas hba supports it
I have HGST HUC109060CSS600 MODEL HDD I have done all actions through sg3-utils and even showing now 512 bytes but when i am trying to initializing hdd showing FATAL error also not able to make array of drives
@Antibiotik Hi! I have 8 disks of HUC101860CSS200 and all of them can easily be changfed to 512 bytes of sector size. But the information "format unit has started" is followed (after 30 seconds) by this message: "test unit ready: transport: Host_status=0x01 [did no connect]"
Do you have any idea?
This is all great and stuff, but sg3 utils dont even see my sas hard disk drives.
I think it requires a HBA or pass-tru, a feature none of my 6 or 7 controllers that I have available supports I guess.
Any controller (two Adaptec, 4 LSI controllers, 1 Intel controller, all SAS capable, tested with different backplanes dont fucking support my ST4000NM0023 with MS0F firmware)
maybe theyre cheap and yes theyre enterprise grade but they probably have a shit ton of hours on them, either way cool idea
I want to see how you get the drives connected to your system and how your card sees the drive.
Probably with something like this: www.newegg.com/Product/Product.aspx?Item=12-117-664
I received those today. Not picked up by the bios though. The drives are spinning, but the computer isn't seeing them.
I second this ; cant understand how an aftermarket Raid Card ( LSI or similar ) can present the Drives to an OS in the first place
@@technomad900 you have to use for example an LSI megaraid card flashed with IT mode. you have got a lot of tutorial about it. Basically IT mode shows you the directed attached drives by deactivating raid capabilities on your card.
i did it but in same driver didnt work i got msg protection disk
I have 6x 2TB 7200rpm SAS drives from an old EMC VNXe storage system. Would this format process allow for these drives to be used on an IBM x3650 M1 server?
Yes
So I was able to format my Seagate 2TB 7300rpm SAS drives to 512b without any issue but the ServerRaid controller that came with the x3650 M1 will still won't detect the drives. I even tried an LSI M5015 RAID controller from an M3 server and it too will not detect the drives. I'm stuck :-(
@@troyhector Do you need to 3.3v mod?
@@JDMWAAAT I'm not sure by what you mean?
For me when I run the sudo sg_scan -I. It only shows my dvd-rom an my dell perc h700
I cannot see my drives either at this point, just shows my other USB drive and DVD-Rom
3:43 sas connector? may be sas-to-fc adapter rather?..
I was given a Dell 4TB 7200RPM Nearline SAS 3.5inch Hard Drive, all my drives in unraid works, but this one doesn't show in unassigned devices. is this the steps I need to do, to get this drive working?
Randy Kennedy possibly. However it is more likely that it has 3.3v standby. Google 3.3v easystore mod
@@JDMWAAAT I've done that with my easy store shuck drives. This can happen on a sas drive to?
Hello, what controller are you using on that server? what is the server? thanks for your contribution, greetings
forums.serverbuilds.net/t/official-recommended-sas2-hba-internal-external/4581
They are a pain to deal with. Formatting takes forever!
This method didn't work with SSD formatted in 520bps.
I guess im confused, how is everyone getting around the raid controller just blocking the drives so when you scan nothing appears. My dell perc controller puts a blocked annotation on the drive and when i get into ubuntu i see no drives.
Don't use a dell perc controller.
forums.serverbuilds.net/t/official-recommended-sas2-hba-internal-external/4581
I just purchase some 15k 450gb sas drive for my hba and one of them is stuck at .99% when reformatting to 512 bytes. I’m using sg utils on windows and running the command sg_format -format -size=512 pd(drive number)
I’m new to this whole process so if anyone knows a solution let me know!
Don't use SG Utils on windows. Use it on Linux.
What is the advantage of reformatting a disk from 520 to 512 sectors?
512K sectors are the normal sandard. a regular computer does not know how to address a drive with 520k sectors
When disks are fomatted with 520 sectors, Windows shows a CRC disk error and will not allow you to format the disk from windows disk management tool, Mine are HGST SAS Disks using LSI SAS Card in IT Mode.
HI friend , I have a Netapp hard disk 450 GB SAS 3.5 15 k . This disk is dose not work in all Dell and Hp server . You have any idea how can i solved this problem ? Disk Part no 0b24501
How can i Format Netapp disk .
The trick first getting the system to see the drives. If you have the ability to flash the OEM RAID controller to its actual manufacturer, like in this article: techmattr.wordpress.com/2016/04/11/updated-sas-hba-crossflashing-or-flashing-to-it-mode-dell-perc-h200-and-h310/, I highly recommend it. Check Reddit for ways to do it too. I scored with mine. 6 600GB 10k SAS drives for $10 each. Once your system can see them, use linux to format them to the 512byte sectors.
hd com sed, voce atualiza um firmware
I am running Windows 10, how do I format and install a SAS drive in Windows-10
you dont -
I got 72Tb for 610€. ._. 6x12Tb. Now searching how to use those Lenovo drives 😂
@@custombikedesigns343 Amazon canceled, got 4*8tb barracuda instead :p I went for an unraid system.
I dont know why but the "format" part go realy fast ... and now the drive and unreconized by my controller ... did it ever happen to anyone else?
Never do this without a HBA card ... :) After ward I was able to see them and format them again and now there are working.
could i sotre games on the drive after doing this?
Yes, but you would still need a sas controller.
Dear how can I connect EMC Harddrive to PC ???
You need a SAS HBA.
forums.serverbuilds.net/t/official-recommended-sas2-hba-internal-external/4581
its possible with a 10tb sas hdd?
Where did you find a 520b 10TB?
donde?
How do you get the firmware off.... I keep getting Illegal request errors on my Seagate Constellation drives...
have you tried to add the --six flag? Had the same issue until I did..
How did you get the system to see the drives to begin with? I received these today: www.newegg.com/Product/Product.aspx?Item=12-117-664
No luck in a PC though.
@@haywire97470 you need to have a sas controller. Either a sas raid or HBA card. Sata drives are backwards compatible on a sas controller but sas drives are not compatible over sata. Makes sense?
@@-MOS- yes and no. Lol I didnt realize that. I got my Rraid controller flashed and I'm able to work with the drives. Had to put it into my PC for flashing. (A PERC H200i)
@@-MOS- I have a PowerEdge R610. with an H200i RAID controller that I have flashed and now have full use of my 6 600GB 10k SAS drives I got for $10 each. Found out the trick was flashing the card in my PC's PCI Express slot, not doing it while in the server. I highly recommend this process for anyone with this card. You almost can't brick it. I messed up numerous times because of the server and it's still working great.
Where you bought it bro
Said in the video.
Hello, I heard that if I format EMC Hard Drive from 520b to 512, the drives would be defect in few months, true / false ? Many thanks.
Where I can buy 10TB SAS drives for 70 bucks? :-)
eBay, look for job lot auctions, I got 20 600gb drives for £90 and 10 900gb drives for £72, not as good as a deal shown here but still good
So wait... you connect the SAS drives into a PC to the normal SATA port?
Got a couple of these on the way from Newegg for $3.92 a piece thanks to a 50% off code that's being offered: www.newegg.com/Product/Product.aspx?Item=12-117-664 So, yeah, totally doable..... in theory lol
EDIT: Well, I have received my cables and hooked two drives to a PC. Not sensed at all. They're spinning, and clearly on, just not able to be seen. Care to share how you got this to work? Sure would be awesome if the creators of these videos didn't just create them and abandon them for the rest of us to just wonder.
@Mr. Rich B.O.B yeah, I discovered that. But it wasn't a total waste. I was able to use one of thos to hook an ssd to my server's SATA port. I have an extra power supply set up to provide it with power and it is a data store for esxi lmao. Works until I figure this SAS situation out. Trying to get the damned H200i Raid controller flashed so the server will use it and the drives.
Sudo sg_scsn - I. Is not working.
Also when I do sudo apt-get upgrade it works for a while then the screen goes black. I turned off hypernate and screen timer.... Uggg thanks in advance
Space is the premium vale and 2tb is a waste of a slot. This is why they are dirt and cheat.
yeah, but I got mine free with a 30 USD complete X3550 M2 server /3 X 500 gb / 2 cpu/ 32GB ram etc! so its worth a try to get the feel of getting various VE systems working etc before shelling out on new hardware drives and uprating to a better platform
Clean desk compared to mine. I just got 24 4tb drives for 700$
I’m sure you can do this much easier under Windows.
Prove it
@@JDMWAAAT That Sir is a Great answer. If you were nearby I'd buy you a beer :)
what is "windows"??? Is it an air vent or something lolz
first
Hi
Work for one IBm 10tb, not work for 12tb , have this messages Unexpected extra argument: -size=512
Unexpected extra argument: -fmtpinfo=0
Unexpected extra argument: /dev/sg0.