Why Windows Home Server Does Not Use RAID

Qblogger over at the Windows Home Server Team Blog recently wrote an article discussing the use of, or non-use of, RAID technology in WHS.  Can you use RAID in WHS?  Sure you can.  Is it more secure, or faster?  Perhaps.  But do you need to?  No, according to Microsoft.  From the article, here is why:

Windows Home Server storage system design requirements

  • Must be extremely simple to use. Must not add any new concepts or terminology average consumers would not understand. Simple operations should be simple and there should not be any complex operations.
  • Must be infinitely & transparently extendible. Users should be able to just plug in more hard drives and the amount of storage available should just grow accordingly. There should be no arbitrary limits to the kinds of hard drives used. Users should be able to plug in any number of drives.  Different brands, sizes, and technologies should be able to be mixed without the user having to worry about details.
  • All storage must be accessible using a single namespace. In other words, no drive letters.  Drive letters are a 1970′s anachronism and must be squashed out of existence!
  • The storage namespace must be prescriptive. In other words, our research told us that consumers want guidance on where to store stuff. Our storage system needs to be able to tell users where photos go. Where music goes. Etc…
  • Must be redundant & reliable. There are two components in every modern computer that are guaranteed to fail: fans and hard drives. Because they have moving parts,  Windows Home Server must be resilient to the failure of one or more hard drives.
  • Must be compatible. Compatible with existing software, devices, disk drives, etc…
  • Must have great performance.
  • Must be secure.
  • Must enable future innovation. Both the amount of storage consumers are using, and capacity/$ are growing at Moore’s Law like rates (while nothing else really is). This creates a discontinuity in the industry and an opportunity for innovation. The storage system must operate at a higher level of abstraction to enable rich software innovation (file level vs. block level).

There have been many discussions in the forums regarding the use of RAID for a WHS computer.  The one concern that I seen over and over again in these posts is backup for the WHS.  Before I can discuss backup for the backup server, we must discuss what the purpose of a WHS is.  When WHS was first released, Microsoft advertised it as a backup solution for client computers.  If a computer hard drive dies, one simply pops in a new drive, loads the restore disk and restores that computer to the last saved backup.  WHS also created a a folder called “shares”.  In this folder, the WHS user could copy files to this folder, which all machines in the WHS network could access.  I can’t say definitively, but I do not believe Microsoft expected the end user to simply copy files over and delete the originals.  I do not believe that WHS’s original purpose was to act as a file server, without the benefit of that data being backed up elsewhere.  Anyone who “moved” data in this manner was asking for trouble.  And quite often they got it.

Microsoft’s original answer to this was the “folder duplication” option.  This option would create 2 copies of any shared folder that had this option enabled.  If a hard drive failed, other than the system drive, simply remove it and replace.  Although I have never seen any discussion regarding how this is done, WHS somehow recreates this duplication information on the new drive.  This is Microsoft’s alternate redundancy solution to a RAID 1 array for the shared folder data.  If the WHS user is cognizant enough to turn it on.

The “real” backup solution for the “shares” folder was introduced in Power Pack 1 which allows the user to create a data backup drive.  From the PP1 release documentation:

  • You can can now back up and restore your home server shared folders to an external hard drive.
  • When you add a hard drive to your home server, you are given an option to use the hard drive to back up your home server shared folders. When you select this option, your home server appears in the Computers & Backup tab. You can then use Backup Now to back up your shared folders to the hard drive.
  • You can view and restore your home server shared folder backups on the Computers & Backup tab.

What this allows the WHS user to do is create a shared folder backup and take it offsite.  The ultimate and only backup strategy in the case of a total disaster, such as a home being destroyed in a fire.

Many users were upset with the release of PP1 in that there was no option to backup the client backups or the System drive.  Along came the WHS BDBB add-in that allowed the WHS user to backup the client backup database.  As for the System drive, the only way to backup this drive up, to my knowledge, is with an imaging software such as Acronis True Image or Norton Ghost.

So, to recap the above, these are the backup/redundancy strategies that are available to a WHS user:

  • Folder duplication (redundancy).  Does the same thing as a RAID 1 array, and takes up the same amount of space as a RAID 1 array.  The disadvantage is that this is only for folders beneath the “shares” folder that are turned on the create this duplication.  Neither solution, however, is a true backup.
  • WHS’s external backup of the “shares” folder.  The only true backup solution for data on a WHS machine.  This would be available to a JBOD or RAID solution, as this is copied to a drive external to the data array.
  • Client backup database.  The ability to create this backup is through the use of an add-in solution called WHS BDBB.  This is a true backup.
  • System Drive backup.  The only option I am aware of to backup the System drive is through a 3rd party program such as Acronis True Image or Norton Ghost.  There are many potential disadvantages here.  How well do they work with a WHS OS?  How well do they restore the System drive in the event of a failure?  How easy is it to reintegrate the client backups and shares folder?  I do not know the answers to these questions.

All of this seems like a rather piece-meal solution.  Much of the above discussion leads one to suggest that a RAID array would be a better solution.  Perhaps for total system redundancy, but only for redundancy.

If we look once again at the three software sections of a WHS machine, what is the importance that can attached to having a backup to each section?  To me:

  • “Shares” folder backup.  This is a no brainer.  Backup of this section of a WHS machine is of the highest importance.  If a user were to “move” over an entire family photo collection, and then lose it, that is a catastrophe.  Which is why WHS allows a duplication option for these folders.
  • Client backups.  By definition, this is a backup.  The data contained here is an image of the client machine.  You can restore a complete machine or portions of it.  Do you need a 3rd copy?  Perhaps, perhaps not.  Losing a WHS machine and a client machine at the same time would be an unusual occurrence.  Not unheard of, but unusual.  At least one has the option to do so with WHS BDBB.
  • System backup.  I do believe that this has a high priority.  That is what system restores are for.

In the above discussion, I have tossed around 2 key terms.  Redundancy and Backup.  Whether it is Microsoft’s folder duplication option, or a RAID solution, neither is a backup solution.  Both are redundancy solutions to protect the user against the loss of a single hard drive.  Lose the system disk in a Microsoft solution, and you may end up losing some of that data.  Lose a RAID array, you’ve lost everything.  The only true backup solution is to physically create a copy of your “shares” folder data on a separate drive that can then be removed from the machine, which just so happens to be the option that Microsoft created in PP1.  If needed, you can also create a copy of the client backups.

Just remember, redundancy is not a backup.

So, in the end, the major advantage of a RAID solution over the Microsoft JBOD duplication solution is that is it provides redundancy for the entire OS and the data on that computer.  The major advantage of Microsoft’s JBOD duplication option is the ease of adding additional space to the data drive.  Both have redundancy of a partial (native WHS) or complete system (RAID).  Just do not expect either to be a backup solution.


Enjoyed this post? Share it.

If you enjoyed reading this post, then why not share it with your friends and followers?

About Jim Clark

Hello. I’m from the heartland of the U.S. Lots of corn and beans, although Iowa is a lot more than just farmland. It also has a few computer enthusiasts (no, not me!). I’ve been around PCs since I got my 1st PC XT aloooong time ago. WGS is one of the first sites I found centered around WHS. And the best. Every once in awhile, I do get away from the KB and enjoy time with and my wife and our 4 kids. And I do have a day job.

Sign Up for WGS Daily News

If you don't want to miss out on the latest news from We Got Served, why not subscribe to our daily digest? You'll get the day's headlines and a short summary of each news item delivered straight to your inbox each morning.

, , , , , , , , , , , , , , , , , , , , , , , , ,

  • http://blog.szuta.com Boggy

    Jim,
    I must disagree in at least one of your conclusions, specifically about the need (lack of) for backup/recovery of client database on WHS. The reason that everybody creates multiple historical version of client backups is to be able go back and recover from these old backups (individual files for example). Concluding, that a current image of a client is acceptable way to recover from WHS hardware failure (resulting in client backup database loss) is just … a big misunderstanding. If this was something that one can accept your third point (need for system backup) makes no sense (one can recover/”re-image” WHS operating system from a provided DVD).
    I agree with you in one point, MS did not have a very clear vision on how much could be done with WHS, and became a victim of its own success (yea, I love WHS despite all of these problems). Now, after considerable time has passed, Microsoft needs to finesse the product, and make it complete (as much as I like Acronis, Ghost imaging products I’d rather not have to use them).
    Anyway, thanks for the article.

  • Jim Clark

    You may be correct. This article was one of the most difficult ones I have written. Completely rewritten at least 5 times. As you have observed, MS’s “unclear” vision somewhat clouded my “unclear” vision. :)

    Perhaps if you simply ignore my conclusions, and look only at the redundancy vs. backup, it makes (hopefully) the most sense. RAID or folder duplication is not a backup solution. Once one acknowledges that, the reasons to have a RAID setup IMO mostly goes away.

    In my case, I don’t use my client backups as repositories for old versions of files. You consider that important, I do not. Which is OK. :) Everyone has different needs in that regard.

    Finally, some users feel the most comfortable with a RAID setup. I “simply” prefer the simplicity of JBOD. Need more space? Just add another drive of any size, any make, any time.

  • http://geocline.net/ smadge1

    Well, if I had time to plan my WHS all over again, maybe one day I will. I would create a RAID1 set for the first drive, to increase the redundancy of system drive failure, something that’s not addressed by Microsoft at all.

  • http://www.northlander.org Dan Bowling

    I use WHS primarily for file shares. I don’t want to be locked into a single type of hard drive with a RAID setup, but the one thing that I’ve never been sure of is fault tolerance with WHS’s drive extender. If a drive is failing, and that data begins to corrupt, then what is preventing WHS from duplicating that bad data? How does it’s JBOD + Duplication create fault tolerance at all? Is there ever a checksum being made with the original tombstone file?

  • Peter

    I am a professional Network Administrator and so my view of “storage” is very much the classical centralised storage which is run on hardware with multiple redundant systems (Power supplies, RAID, etc) then backed-up daily or to a bitwise real-time system.

    I think that a probable solution for the home-user will be to use something like LIVE Mesh to do a bitwise real-time file-backup of your edata to WHS then onto an Internet file-store. This means that your valuable data is safely offsite for major emergencies (house fires, server melt-down, etc) , but locally available for minor ones (disk crashes etc).

  • Stenton23

    This is the sort of information I was looking for (repeat, sort of…). I purchased an internal 500 GB SATA drive on Sunday with the intent of adding it to my HP MediaSmart Server so that I could back up my first 500 GB drive. Instead, I wasn’t given the option to create a backup drive, but rather had to add the drive to the pool.

    It’s swell to have one TB of storage space, but that’s not what I was interested in.

    If anyone can give me a clue on how or whether I can still accomplish my original goal, I’d appreciate it. :-)

    BTW: I love this site, and I still love WHS.

  • Jim Clark

    @Dan Bowling – I am not sure, but a drive failing in a file redundancy system (whether WHS or RAID) leads to the same question you have. How does either system maintain file integrity of a failing HD?

  • Jim Clark

    @Peter – One of my versions that I dropped made several comparisons to a business solution. It just did not seem to fit into the “short” article I wrote, so I rewrote it all again. :)

    If I had left it in there, the main point that I would have made is that priorities/needs for a business differ greatly from that of a home user. Where I work, if the network dies for 15 minutes, the company has lost X dollars in lost wages during that time.

  • Jim Clark

    @Stenton23 – You need PP1 installed. When you go to add a drive to the pool, the window that comes up gives you the option to simply add to the pool or make it a backup drive.

  • Stenton23

    Thanks, Jim. I do have PP1, but when I had that option, I was only allowed to add it to the pool. Creating a backup drive caused an error message, similar to “the drive is not properly formatted” (sorry, I can’t recall the message verbatim).

    I’ll keep looking for the answer — or save to purchase an external.

  • CWH

    Stenton23,
    You with now need to remove this new drive through the Console and then re-add it. If you have PP1 installed, you will be given the option to select what you want to use the disk for, -after- you have initially been asked if you want to add this disk. It’s the second question.

    In general using Acronis etc to clone the system partition is OK IF you are going to just do a disk exchange. However, the first time WHS does anything – balancing – backup – etc., you clone will be out of date and will generate errors, or not be able to see some of the stored data.

    Also, since the early days of WHS, there have been add-ins allowing for off-site storage of shared folders. I think Jungle Disk was one of the very first ones produced.

    CWH

  • Stenton23

    Thanks, CHW! I’ll give it a try.

  • Stenton23

    Sorry — I meant CWH…

  • Theo van Elsberg

    Great article Jim! And I mostly agree with what you are writing. As a side note I must say that I like to see Windows home Server from a different angle. Windows Home Server:

    1. Is a SERVER (for Home usage)
    2. Gives you an automated client backup system with the main purpose of restoring failing client PC’s
    3. Enable remote access for both data and network clients.

    A Server centralizes data storage and maintenance. Also a Server should be (a) Reliable 24×7 available and (b) Extendable. For a professional administrator a server installation with RAID configuration may meet these requirements. But RAID configurations do not meet the design requirements for WHS. The WHS alternative (duplication) does. It gives both the reliability and extendibility for a “Home Server” in a configuration that it is easy to maintain. Failing drive? Additional storage? Add-in? With WHS “Mom or Dad” can handle this.

    That all said: *ANY* SERVER should come with a good (data) backup that is stored off-site. I do not think I need to elaborate on this?

  • Serpentbane

    Hi. I do see the benefits of Microsoft’s JBOD for many users, and the ability to scale the system over time as easy as possible. However, for me as a more experienced user this is not a preferable solution. At the moment you throw in several terabytes of data the mirror solution just is not effective enough as everything has to be duplicated.

    In this scenario RAID5 (hardware) would and have to be the way to do this, either through a large array or several arrays on the same computer, depending on your wallet. A 4P RAID5 controller will just hold you back from a night on the pub, a 16P controller would not settle with that, unless you really drink everyone under the table.

    With a RAID5 solution you only loose one disk per array. Having one four 500GB disk array gives you 1500GB total, while a mirrored solution with the same disks gives you 1000GB total. Using eight of these disks with RAID5 would leave you with 3500GB, while the mirrored solution gives you only 2000GB. And so on.

    I myself have about 5 terabyte of data, not counting backups and system disks. Mirrors are just not affordable.
    I also suggest using a hot swap solution as this opens for easy replacement of disks while the server is powered on. There are many cheap and great hot swap solutions for the average consumers out there.

  • zam442

    @Serpentbane – Actually I would disagree with the RAID5 option especially with fact that rebuilding data stresses drives to the point of failure. I have personally seen enterprise quality SAS and SCSI drives in RAID5 arrays fail completely while rebuilding a replacement drive from a previous failure. RAID5 can only tolerate one drive failure at a time, lose more than one drive and you lose everything. One has to expect that if one drive is failing in a system where all drives were purchased/mfg at the same time, that the rest are not far behind, at least in the OEM/consumer space. If you don’t believe it, read just a few lines of feedback on NewEgg of any of the large capacity drives from any vendor. When the best feature of a drive manufacture is the “excellent RMA process” it makes one nervous. RAID6 with double parity is the only real way to go but this can a tad expense and complicated for the average user.

    Now Windows Home server may be adept at backing up personal systems of your family members with the mundane such as documents, picture and assorted MP3 collections but it is still very far from being an ideal solution for a real home media server while still providing peace of mind that your data and extensive home movie collection will not be lost to a defective spindle, random disk error or power outage.

    Picture this, one hour of Hi-Definition video recording can be as high as 25gigs of disk space, picture that across every holiday and birthday party and vacation and the limitations of the Windows Home Server solution becomes painfully obvious in a short space of time and backing your data up to store somewhere else when the data set is larger than present drive capacities quickly becomes a conundrum. Tape excels at this but it is expensive, slow and beyond the casual user but is far more reliable than disk. The “cloud”, Live Mesh, whatever you want to call it, calls several things into question including capacity and performance and not the least of which is privacy and security. Several online backup/mesh solutions exist and everyone of them is stricken with capacity, speed or cost limitations or any combination thereof. The backup issue is not solved cheaply or easily and it can become a difficult to solve problem very quickly for movie and music aficionados, digital media hobbyists and professional alike.

    My two cents

  • Pingback: The Home Server Show 39 - OS System Drive Failure Options

  • Pingback: Windows Home Server

  • Da1ek

    I guess when it comes right down to it, this is a entire converstation and debate falls into the beginner , advanced and expert camps and is at the end of the day a dicussion about volumes.

    Its a debate the belongs in the pub , DE vs RAID 5/6 .

    What is clear tho is that MS has introduced a defacto limit to the size limit within the
    home server system in that it locks the user into a 2TB volume via MBR. Ok Ok there
    are hacks , but most of these got a lot less safe after PP2.

    Homeserver is marketed as a consumer product pitched at the beginner camp and here
    DE scores and wins hands down for simplicy. Whats more than annoying is that the
    instance on MBR versus GPT stops anyone who wants to introduce a larger than 2TB
    volume.

    I know this is an old and beaten to death topic, but i can find no where that GPT is a
    problem child for home server , so really come on MS give us the option to use it
    without dangerous hacks..

  • dball

    Smage is right. To resolve all of these issues, just mirror the C: drive where WHS is installed using your motherboards built-in raid support and then use WHS as intended. WHS will continue to mirror the rest of its stored data for you.

  • http://www.google.com/maps/place?cid=5399740412979153119&q=locksmith+in+hoboken+nj&f Kennith Strop
  • Pingback: Storage expansion on home server - HEXUS Community Discussion Forums