GStwin.com GS500 Message Forum

Main Area => Odds n Ends => Topic started by: slipperymongoose on June 02, 2013, 04:49:26 AM

Title: Relability question SSD or HDD?
Post by: slipperymongoose on June 02, 2013, 04:49:26 AM
Hey all Im looking for a new hard drive to save all my music and precious photos etc plus a file dump for my vlogs and movie projects etc. I wanna know what kind of drive is more realiable HDD or SSD? I already know about the speed and data transfer rates etc etc and I know that SSD whips HDD butt in terms of that but I'm hearing a lot of conflicting info so wondering if anyone here knows. Cheers.
Title: Re: Relability question SSD or HDD?
Post by: Malfruen on June 02, 2013, 07:27:55 AM
I have an SSD and about...6? Yep, 6... normal HDD's in my rig. SSD is WAY better for speed, as you pointed out, and it's better for video editing as well. The flip side is that they are quite expensive compared to normal drives, and they DO have a limited lifespan. That lifespan, however, is some ridiculous number of read/write cycles that you will probably never see.

I'd say, from my experience, get 2 normal drives, one internal, one external, and put a copy of whats important on BOTH. Then if one drive dies (It can happen. I had a 750GB drive die on me after having it for 2 years. I had a 3TB drive die after 2 weeks. I have yet to see an SSD die personally, but I know it happens), you have a complete backup of what you had before. It's more expensive, but if what you have is REALLY important, you can't really be too careful. Not to mention it's cheaper than the alternatives. A platter swap for a HDD to recover data can run you upwards of $1000, while a 2TB EXT-HDD is about $100. Some external drives will come with free backup software, so you can set that to backup once a week or once every couple of days.

All electronics technologies are probably as bad or good reliability wise as the other. You just have to be smart about how you prepare for the worst possible outcome.
Title: Re: Relability question SSD or HDD?
Post by: adidasguy on June 02, 2013, 10:08:24 AM
Whichever you use, you want 2 backups for important stuff.
Any backup can fail.
One might be get a terabyte HD for $100 or so as a primary backup.
Then buy a box of 32 or 64 gig memory sticks. Use them as a secondary backup.
Spreading data across many devices insures that if a device fails, you won't lose everything.
Don't forget about the CD or DVD for another copy of important data.


Title: Re: Relability question SSD or HDD?
Post by: Kijona on June 02, 2013, 11:42:38 AM
SSDs have a limited number of write cycles. They're expensive per MB versus the old-tech platter type. With that being said, they're less prone to failure and have a higher MTBF (mean time between failure). They're also more resistant to shock and damage from being banged around. However, they're also more sensitive to things like voltage surges, static, and moisture.

For pure backup purposes I'd suggest you buy two 500GB or 1TB drives and put everything you need on both of them - redundant copies. Then simply remove them from the computer and store them in the anti-static bag they came with and a bit of the anti-moisture stuff. Since HDD's are hermetically sealed, it could literally sit for YEARS and YEARS providing it doesn't get submersed in water. Even still, providing the platters aren't damaged, all of the data can be recovered quite easily.

For real-time backup you could just switch between the drives, that way if you lose one, you still have the other.

Title: Re: Relability question SSD or HDD?
Post by: Kijona on June 02, 2013, 11:46:19 AM
I think something like this would be quite useful to you: http://www.newegg.com/Product/Product.aspx?Item=N82E16812119152

Just a thing to note...you shouldn't let HDDs run without any cooling for any extended length of time. Plug it in, save it, and then unplug it.

For new drives you may or may not have to format/partition them from the computer in order to use them as USB.
Title: Re: Relability question SSD or HDD?
Post by: slipperymongoose on June 02, 2013, 03:21:50 PM
But if a hard disc drive sits for too long without use don't the bearings go bad and the drive shits itself. I'm leaning toward an external plus DVDs
Title: Re: Relability question SSD or HDD?
Post by: Kiwingenuity on June 02, 2013, 03:48:01 PM
Quote from: Kijona on June 02, 2013, 11:42:38 AM
SSDs have a limited number of write cycles. They're expensive per MB versus the old-tech platter type. With that being said, they're less prone to failure and have a higher MTBF (mean time between failure). They're also more resistant to shock and damage from being banged around. However, they're also more sensitive to things like voltage surges, static, and moisture.

+1 to Kijona
SSDs do fail (especially if you get a surprise firmware update) - and so do memory sticks (known to fail after 3 years if not used) and written media such as DVDs (fungus eats them).  My brother works for a large data provider and they have numerous instances where this has been found to be the case. 

I run a pair of matched 500Gb SATA drives in Raid 1 (mirrored) using a generic RAID controller, and it would be a simple operation to rebuild if a drive pegs it.  You just have to make a good habit of carrying data forward onto new interfaces for the hard drives, although they don't change often.

If you have a quality PSU in your system, or even just unplugging and storing the drives in a nice cool place you should have no issues with a mechanical HDD.  I have some MFM drives here which are over 25 years old and they still spin up fine, every issue I have encountered with mechanical drives has been poor power supply or heat related. 

The ultimate backup option of course is tape - I have some LTO 1 tapes here which are ancient but still work, but you have to be wary that the drives only have 2 or 3 generation backward compatibility. They also are far more expensive than a HDD, and have the same storage requirements.
Title: Re: Relability question SSD or HDD?
Post by: adidasguy on June 02, 2013, 04:08:41 PM
I had 2 RAIDs go out. Both lost their boot tracks making the whole idea of RAID worthless. RAID works if a track goes out on one of the drives, but when the boot goes out the drives are junk.

I just keep multiple copies of everything. Portable drives. Home computer. Office computer. If one location gets hit with a meteor, data is in the other location (or a portable in my backpack).

Tape is now very ancient. I don't know if you can still get much tape. Anyway, when I did have dome cart. drives, they never did work well and took forever to use. Never was able to get any data back off of them.

CD's and DVD's are pretty reloable. When I make one, I make 3 copies in case would should get damaged. I have some early CD's that are 25 years old and still work.

As for mechanical drives, they can last a long time. Some are 30 years old. Still work. Early USB interface. Right about the only thing that goes bad is the power supply. Their cheap external switching supplies have limited life spam. Capacitors dry out and they die.

The best back up of critical data is multiple formats and stored in multiple locations. Heck, buy yourself a case of 64 gig thumb drives and scatter them all over your world. Those are super cheap.



Title: Re: Relability question SSD or HDD?
Post by: slipperymongoose on June 02, 2013, 04:14:41 PM
I'm trying to sign up for Dropbox, ill dump it there plus a small external plus DVD and that should give me a nice spread
Title: Re: Relability question SSD or HDD?
Post by: weedahoe on June 02, 2013, 07:41:46 PM
I built a new machine  a few months back and bought two 3Tb drives and set in raid. I do have a SSD 160gb in the machine that is in my truck because I needed faster boot up times
Title: Re: Relability question SSD or HDD?
Post by: john on June 02, 2013, 07:53:39 PM
I built 50 machines about 5 months ago.  Of them 6 had standard HDD's and the others I installed SSD's.  Already one machine with a regular HDD failed.  None of the SDD machines have failed.
Title: Re: Relability question SSD or HDD?
Post by: Kijona on June 02, 2013, 08:03:25 PM
Quote from: john on June 02, 2013, 07:53:39 PM
I built 50 machines about 5 months ago.  Of them 6 had standard HDD's and the others I installed SSD's.  Already one machine with a regular HDD failed.  None of the SDD machines have failed.

Such is the nature of mechanical hardware.
Title: Re: Relability question SSD or HDD?
Post by: Kijona on June 02, 2013, 08:42:39 PM
Quote from: slipperymongoose on June 02, 2013, 03:21:50 PM
But if a hard disc drive sits for too long without use don't the bearings go bad and the drive shits itself. I'm leaning toward an external plus DVDs

News to me. I've never taken a HDD bearing apart but I would assume it's a sealed bearing. What makes it any different from the bearings in anything else mechanical? Old motorcycle wheel bearings don't fuse as far as I know, and they're packed not sealed.
Title: Re: Relability question SSD or HDD?
Post by: slipperymongoose on June 02, 2013, 09:06:31 PM
Leave any bearings sit long enough and they will have some sign of failure, just depends of weather they are high or low speed bearings as to what you do about replacing them.
Title: Re: Relability question SSD or HDD?
Post by: Kijona on June 02, 2013, 09:16:56 PM
Quote from: slipperymongoose on June 02, 2013, 09:06:31 PM
Leave any bearings sit long enough and they will have some sign of failure, just depends of weather they are high or low speed bearings as to what you do about replacing them.

I don't know man. I've got an HDD from 1995 that's been sitting all this time and I just plugged it in to see if it still works. No problem.
Title: Re: Relability question SSD or HDD?
Post by: Malfruen on June 04, 2013, 11:28:47 PM
Quote from: Kijona on June 02, 2013, 09:16:56 PM
Quote from: slipperymongoose on June 02, 2013, 09:06:31 PM
Leave any bearings sit long enough and they will have some sign of failure, just depends of weather they are high or low speed bearings as to what you do about replacing them.

I don't know man. I've got an HDD from 1995 that's been sitting all this time and I just plugged it in to see if it still works. No problem.

I've got an old Maxtor 128MB drive, manufactured on the 22nd January 1991, still spins up and goes like a beast. Still has DOS 5.0 on it for all my old games and shaZam!.

Backup everything is all I can say, no method of backup is going to be foolproof, or failsafe, or anything like that. I've had a platter disc shaZam! the bed, and it was a nightmare to get everything back off it. It's not even so much the drive dying, which is a problem in itself, it's when a perfectly good drive decides to wipe it's boot sectors or MFT.
Title: Re: Relability question SSD or HDD?
Post by: yamahonkawazuki on June 05, 2013, 12:29:52 AM
Quote from: adidasguy on June 02, 2013, 10:08:24 AM
Whichever you use, you want 2 backups for important stuff.
Any backup can fail.
One might be get a terabyte HD for $100 or so as a primary backup.
Then buy a box of 32 or 64 gig memory sticks. Use them as a secondary backup.
Spreading data across many devices insures that if a device fails, you won't lose everything.
Don't forget about the CD or DVD for another copy of important data.
as a common game says ^^^^BINGO ^^^^^
Title: Re: Relability question SSD or HDD?
Post by: john on June 05, 2013, 07:49:21 AM
Any backup is better than no backup.  I have a 2GB external drive that I push a backup every day to. 
Title: Re: Relability question SSD or HDD?
Post by: bettingpython on June 05, 2013, 08:07:34 AM
SSD versus Platters depends on usage. SSD's are great for random read write access but believe it or not for sequential reads the performance is not that great. Until price comes down and reliability increases in the consumer SSD's they are good for your OS and as a swap space but for data storage and archival storage they are unreliable. I had an OCZ take a dump on me 6 months after I built the rig, replaced under warranty. Enterprise class SSD's are astronomical in price and used in fault tolerant storage arrays where the loss of a couple of drives at a time is not a threat to data. (think 4k to 6k per drive with 16 drives in the array)

Write cycles are a reliability myth for SSD's though, yes there is a limit. If you do the calculations on write cycles per cell and disk utilization and how the controller distributes cell utilization across the matrix especially drives in the last 12 months you get roughly 8 years before you have an average of 10% burnt out address blocks. Unless you are doing multiple daily DOD multi pass wipes do not let the write cycle "limitation" of  SSD's influence your decision to use one as your OS... not for storage though. Ideally your OS on pair of SSD's in Raid 1 would be optimal.

Traditional disks, we'll address they go bad if they don't get used first. At one point in time I had an old AS400 at the mortgage company I worked for and it was very scary the one time we powered it completely down. Powering a drive completely down "parks" the disk arms with the read write heads, now it is done automatically but at one time you had to manually park your drives, in some very old IBM drives their were issues with drives that had not been park cycled locking into the parked position and never moving again even though the platters would spin up. Long term inactivity on a modern drive is not a problem if you use it as removable storage. Protect it from static, emf, and physical impact and it's good to go as long as you have a machine capable of reading it. What I mean by that is my gaming rig has no IDE header on the mobo I have SATA cable headers and SAS cable headers but no capability to plug in an older IDE drive, those are going the way of the dinosaur. For online storage a raid 1 array with 2 of the largest drives you can go with is ideal in the consumer market. Personally I use a pair of Terrabyte WD caviar blacks SATA III 3 Gb/s for performance in my storage on my rig. I fail the array remove one of the drives and rebuild onto the spare to archive. For sequential read write operations it's just as fast as my SSD. I also use a 3TB  RAID 1 NAS box for media server media(itunes library and media files used by XBMC) and bare metal backups. Applications install on a 500gb SATA III 6 Gb/s drive.

Drive life expectancy in the consumer market is 5 years. And even at the enterprise level we calculate 5 years as our life expectancy and begin upgrading hardware at that point even though the MTBF rating for enterprise class drives in an array is higher than the individual life expectancy of a consumer drive.

Pretty much the definitive study of hard drive failure prediction rates.
http://static.googleusercontent.com/external_content/untrusted_dlcp/research.google.com/en/us/archive/disk_failures.pdf
Title: Re: Relability question SSD or HDD?
Post by: yamahonkawazuki on June 05, 2013, 10:30:45 AM
got to get another 1tb drive for my comp along with a card ( gpu) which ive got a lead on. even tho its a btx i can make it work. later on planning on making a 4 or 6 core rig for gaming and media and setting the current rig as a network storage and backup deviice
Title: Re: Relability question SSD or HDD?
Post by: pliskin on June 05, 2013, 10:31:25 AM
Hers a storage solution with will blow your mind.
I built (with some vendor help) a storage/backup solutions that is as close to 100% redundant as you can get without mirroring the entire data center.

We have a 6tb EMC VNX disk array with dual power supplies and dual UPS backup power. No way it will ever go down due to no power....unless powers goes out and the 300gal diesel generator runs dry along with both  UPS's and both internal shut-down batteries all give up the ghost at the same time. Everything is hot swappable and redundant.

We back up 4 Raid5 configured servers to the EMC disks. Real time snapshot backups, nightly incremental, and weekly full backups. After the weekly full backup finishes the entire backup is cloned to DAT5 tape on another raid5 server which also backs itself up. On top of this each server also also has a DAT5 tape that we can spin data to whenever.

That being said in the past 10 years we've had about 5 or 6 out of about 30 hard disks fail in servers/storage. And they are running 24/7x365.

The whole damn thing is so complicated I don't even know if I could fix it anymore so it better never die. In fact as I'm typing this the backups are failing because we ran out of space and I have not figured out how to extend the back pool. All this hardware and it's failing because the software sucks and is not working like it should.

I've found drives, power supplies, monitors, etc tend to all go bad at about the same time (+ or - a few months).
When we install a batch of new PC's a few years later parts will start to fail in clusters. This tells me they are engineered  to fail. I mean, what are the odds every power supply dies in the same make/model/batch of machine with in months of each other?
Title: Re: Relability question SSD or HDD?
Post by: yamahonkawazuki on June 05, 2013, 10:40:25 AM
thats the damned truth Eh?, my psu in main rig idk maybe 4yo, my spare is 3yo, had a drive work for 5 years plus when i sold quadzilla. still running along with 1tb drive in cali.
Title: Re: Relability question SSD or HDD?
Post by: Kiwingenuity on June 05, 2013, 12:15:35 PM
Quote from: john on June 05, 2013, 07:49:21 AM
Any backup is better than no backup.  I have a 2GB external drive that I push a backup every day to.

Oh yes - you have my vote sir.  The number of people that come whining to me to fix their troubled laptop drive that they have stored absolutely everything on for the last three years.. even with a MBR failure you can still typically recover something.  Laptop drives seem to cook and the controller fails, then you are stuffed.. 
Title: Re: Relability question SSD or HDD?
Post by: Kiwingenuity on June 05, 2013, 01:04:20 PM
Quote from: pliskin on June 05, 2013, 10:31:25 AM
I mean, what are the odds every power supply dies in the same make/model/batch of machine with in months of each other?

The odds are very good if you particuarly get a bad run of regulator capacitors especially.  All the components bought have a nominal MTBF - and due to the way they manufacture of components, you will get pretty much failure on the dot everytime. You buy MIL spec or aviation grade components, you don't get this problem - but you pay accordingly. Compare a voltage regulator for a bike made in China versus the Japanese equivalent - the Japanese one is twice the size, costs nearly twice as much, but lasts a lot longer.

You can usually spot the difference if you pick up a cheap "600W" PSU and pick up a high end 500W supply - the weight difference is obvious, the high end PSU will have better heatsinks, better capacitors and higher spec components.

PC power supplies (Buck converters) are very hard on the output stage capacitors in terms of noise - if there is inadequate high frequency filtering (or the filter caps fail due to heat), you will eventually cook the main regulator capacitors with harmonics from the switching.  You can buy more time before failure by getting a higher quality PSU, but PSU failure is not the issue to drives.

Mechanical drives suffer when the PSU cannot maintain the voltages levels required - effectively running the drive in a brown out state of power (draws more current and power dissipated goes up = cook the drive).

I guess I am used to seeing this in industrial applications everyday too - quality DC power is everything when you have devices that are operating to very close margins.  Some of the gear we work on is between 30 and 50 years old.  I will grant you that they are hideously expensive power supplies feeding this gear, but the payoff is very low downstream equipment failures = uptime.

BTW Pliskin - probably an overkill solution, but hey, awesome to get that much gear into a pile and working  :thumb:
Title: Re: Relability question SSD or HDD?
Post by: slipperymongoose on June 05, 2013, 03:36:39 PM
Holy crap what have I started my eyes have glazed haha. Goes to show how getting out of the game in 2003 has rendered me nearly illiterate today haha
Title: Re: Relability question SSD or HDD?
Post by: pliskin on June 05, 2013, 06:50:57 PM
Quote from: Kiwingenuity on June 05, 2013, 01:04:20 PM
Quote from: pliskin on June 05, 2013, 10:31:25 AM
I mean, what are the odds every power supply dies in the same make/model/batch of machine with in months of each other?
BTW Pliskin - probably an overkill solution, but hey, awesome to get that much gear into a pile and working  :thumb:
I know, it is overkill. But I've been through a couple complete system crashes under unbelievable worst case scenarios where important data got lost. I do sleep a little better at night knowing if this one crashes I'll have good data....somewhere in there.

About 20 years ago, before this level of protection was available, I worked with a guy who did SQL database work. With a stroke of a key he wiped out over a million dollars worth of orders. Who's fault was that? His, or the hardware quys? Nobody knew. I don't want to be "that guy".
Title: Re: Relability question SSD or HDD?
Post by: yamahonkawazuki on June 05, 2013, 10:14:12 PM
betcha that guy blamed hte hardware ppl. and hardware ppl blamed that guy. thats always fun to figure out and a great use for this particular smilie  :technical:
Title: Re: Relability question SSD or HDD?
Post by: Kiwingenuity on June 05, 2013, 11:23:30 PM
That would be a difficult call with a transactional database using SQL - so easy to drop a table in SQL if the commands were left available..

Thankfully we deal just with plain old data - LTO6 tape backups (incremental) with a full backup every week. stored offsite - This paid off when we lost our Christchurch office during the big quake.

Always good to be prepared  :cool:
Title: Re: Relability question SSD or HDD?
Post by: yamahonkawazuki on June 05, 2013, 11:46:20 PM
Indeed sir. down the road as funds permit will be building quadzillas big brother using 2 1tb drives in a raid array
Title: Re: Relability question SSD or HDD?
Post by: Kijona on June 06, 2013, 08:38:02 AM
I think the biggest thing to consider in HDD versus SSD is this:

If a power surge cooks an HDD, 99% of the time it'll be just the onboard controller that's damaged. That means that the data can still be recovered by a professional. Essentially, as I talked about earlier, the data will remain on the platters indefinitely, even if the drive is badly damaged. Providing the platters themselves aren't damaged, you're golden.

The same thing, however, cannot be said for an SSD. A power surge would most likely destroy all of the data on the drive.
Title: Re: Relability question SSD or HDD?
Post by: john on June 06, 2013, 09:18:40 AM
This is our backup scheme...

Readynas with redundant array at a datacenter as our primary fileserver.  A backup NAS, that pulls backups from the primary NAS.  A third external USB drive at the datacenter as a final emergency backup.

Servers in 2 locations help guarantee we can recover our data.
Title: Re: Relability question SSD or HDD?
Post by: yamahonkawazuki on June 06, 2013, 05:50:04 PM
Quote from: Kijona on June 06, 2013, 08:38:02 AM
I think the biggest thing to consider in HDD versus SSD is this:

If a power surge cooks an HDD, 99% of the time it'll be just the onboard controller that's damaged. That means that the data can still be recovered by a professional. Essentially, as I talked about earlier, the data will remain on the platters indefinitely, even if the drive is badly damaged. Providing the platters themselves aren't damaged, you're golden.

The same thing, however, cannot be said for an SSD. A power surge would most likely destroy all of the data on the drive.
this is true. also figure lack of power over an extended time used to render SSD's empty or would chance it.
Title: Re: Relability question SSD or HDD?
Post by: Kiwingenuity on June 06, 2013, 05:55:21 PM
Quote from: yamahonkawazuki on June 06, 2013, 05:50:04 PM
this is true. also figure lack of power over an extended time used to render SSD's empty or would chance it.

Lack of power does - have seen a USB stick used for a product key fail after sitting three years in a safe.  SSDs use the same memory cells, so you run the risk of the same loss of memory happening.  Only have to plug it in to let it refresh though.

Have had to recover from platter once - that gets pretty expensive... at the time there was only a single provider and it cost several grand..
Title: Re: Relability question SSD or HDD?
Post by: yamahonkawazuki on June 06, 2013, 05:57:57 PM
Quote from: Kiwingenuity on June 06, 2013, 05:55:21 PM
Quote from: yamahonkawazuki on June 06, 2013, 05:50:04 PM
this is true. also figure lack of power over an extended time used to render SSD's empty or would chance it.

Lack of power does - have seen a USB stick used for a product key fail after sitting three years in a safe.  SSDs use the same memory cells, so you run the risk of the same loss of memory happening.  Only have to plug it in to let it refresh though.

Have had to recover from platter once - that gets pretty expensive... at the time there was only a single provider and it cost several grand..
weve got many lappeis with ssd's ( mistly minis)  anyhoo in a pawn shop stuff is there for months usually. so every so often, ( once every 2 weeks)  ill plug them in for an hour or two.
Title: Re: Relability question SSD or HDD?
Post by: slipperymongoose on June 20, 2013, 05:14:07 PM
Well in the end I now have a 2TB seagate external drive serving as my backup drive/youtube movie dump/ whatever else i feel like dumping drive with a 250gb WD drive as a backup backup for the seagate that's holding my precious family photos. Now I need a program that will when I want it to ghost a copy of my computer HDD onto the big seagate so I can get some sort of a backup regime going any suggestions?
Title: Re: Relability question SSD or HDD?
Post by: ohgood on June 21, 2013, 05:32:54 AM
crap 1tb main drive (size for speed)
crap 500gb externals (x2)
crap 160gb external with complete, full updated system and userspace clones
crap 40gb external with complete, full, updated system, no userspace clones
crap 16gb keychains with userspace prefs and passwords (encrypted)
siiiiiigh

all my photos and videos backup (ha!) automagically to mega, dropbox, picasa, and google drive

all my personal stuff get tard, gzipd, encrypted then backups (ha!) to mega, dropbox, and google drive.

occasionally ill look at the dvd burner and laugh. what a uselessly slow and complicated,  delicate pos. dvds might last 2 years, and have tiny capacity = worthless. that is, provided they don't get a gnats sack hair on them. or someone sneezes. or the manufacturer took a dump on it.

rsync, tar, gzip are my friends. I haven't lost data since the last oopsie with "rm -rf".

having a complete system clone, rsyncd weekly, with userspace stuff is priceless. 20 minutes of dumping one image back to the main box, and its like gnu again.


but I won't use anything but mac os and hackintoshes anymore. my understanding (past results) the next version (after 8)of windows might not suck, but we'll see.