It’s the perfect time to think about it.  With disaster on everybody’s mind, and this being the season of resolutions, it’s time to think about your disaster recovery strategy.

Recently, a major department right here at FSU suffered catastrophic loss to their servers, with scant means of quick recovery.  Their site was down literally for weeks as staff from all over the University scrambled to assist them in recreating the critical pieces.  They lost of a lot of time and money.

I’m absolutely sure they’ll be super-prepared next time, but you don’t have to wait until something tragic happens to be prepared!

Disaster Recovery Enterprise Planning = Big Words (Scary!)

When I was an IT Manager n00b, I thought that planning for disasters was intimidating and complicated.  I thought it took a team of folks working around the clock, military-style, to prepare for incidents.  I was encouraged to believe this by colleagues constantly talking in business-speak, conference sessions talking about things like “DR evaluation metrics”, and by big ugly books that take days to even read through.

In the meantime, while I was being intimidated by all this “enterprise” stuff, we went without reliable backups.  We would have been Scre-ewed if something happened.

1. Embracing Common Sense

Okay, just ignore all that business-speak.  Let’s start with the basics:  If you’re not backing up your data, put down the big ugly DR books right now and go setup a backup.

No, seriously, do it right now.

This does not have to be complicated.  Go find an external hard drive, then find out where your data is on your computers or servers.  Plug the hard-drive into the back of the computers and copy the folders with your data.  Do this every day, and you have a basic disaster recovery strategy!

Pro Tip: If you’re using Windows, I’m a big fan of using Teracopy when I have to copy lots of data at a time.

You get bonus if you copy the data to two hard-drives and take one off-site every day.  Now your data is in two geographic locations on three devices.

See? Easy.  Now that you’re off and running, you can make your life even easier by automating your backups.  If you’re not excited about doing a bunch of geeky tech stuff to get your automated backups working, go convince your boss to spend a few bucks a month on cheap, easy-to-setup online backup services.  If he doesn’t want to spend the money, you can scare him with many horrifying stories of data loss on the Internet.

2. Being Prepared

Next Step: Just sit down in a quiet place for a few minutes and think about the things that could go wrong:

• “My server could suffer a catastrophic hardware failure”
• “My backup data could be corrupt”
• “The building could burn down”
• “We could get robbed”
• “An employee could go apeshit and format the C: drive of the server”
• etc..

Now consider which three or four of those scenarios are most likely to happen in your department. You’ve just considered your risks.  Now, for each one of those scenarios, think about (a) what you can easily do to guard against them and (b) what you would have to do to recover from them:

• Buy a second, backup server (or set an old computer aside to act as server temporarily in case of disaster).
• Keep two backup copies instead of one and periodically test opening files on the backup.
• Take backups offsite so that the data doesn’t burn down with the rest of the building.
• Lock the servers in a room without windows.
• Keep backups (already done), and make sure employees don’t have too much access to the server.
• etc..

If you write all of this stuff down somewhere and tell your boss about it, you have a basic DR plan!  Go have a beer.

3. Building Your Kit

Now that you are creating backups and thinking about our risks/responses, it’s time to build your Disaster Recovery Kit! Put this kit somewhere out of harm’s way, and have it handy in case you need it.  Here’s mine:

1. A camcorder bag — I like this, because it’s easy to carry and has a lot of compartments for all the stuff below:
2. Operating System Boot discs – In my case, Ubuntu Server 8.04
3. GParted Boot disc — For formatting and partitioning systems on-the-fly.
4. Cables – Standard power cable and USB cable.
5. Backup hard drives — Two.  They are my offsite copies of all our data.  I rotate them and keep them encrypted.
6. Flash light – Small and compact, for poking around inside computers or navigating server rooms in the dark
7. Thumb drive — Includes a backup of my server setup procedures/changelogs, systems passwords (in KeePass), and a bunch of portable apps.  Updated weekly.
8. Printed copy of contact information for key stakeholders — My IT colleagues, clients, and my boss, so I can keep them updated.
9. Geek tool kit –  Something like this.  Includes screwdrivers, etc.
10. External SATA Hard Disk Reader – Something small and compact.  In case I need to rip a hard drive from a computer and get the data off quickly.
11. A big sheet of paper that says “Don’t Panic“
12. Music CD with high-energy power music on it.
13. Energy supplement — Or a flask of whiskey, depending on how you roll.
14. “Getting started” guide – A piece of paper, right on top, that explains briefly how to use the kit.
15. Checklist — With all of these items on it, and with weekly DR Kit maintenance procedures.

There, now I can sleep at night much better.  What’s in your DR Toolkit?