Dedicated to my late brave, beautiful and silly mummy, Debra Ross. I love you mumster.

Skip navigation

Drive catastrophe, good thing I have solid backups

Rest in peace
Rest in peace.

This afternoon my sister accidently knocked one of my 1TB external hard drives onto the hard concrete floor of our temporary house here in Adelaide (the drive I talked about in a post back in August). The drive is making some very scary noises and none of the indicator lights are working. I’m ready to call this a write off. Absolute catastrophic disaster.

I have backups of all the data except for some raw audio files for some of the latest Rubenerd Shows, which means I can’t go back and recompress them at higher bitrates at a later date. For what it’s worth, if she had knocked any of my drives onto the floor, I am somewhat relieved that it was this one.

One of my concerns is how I’m going to afford to urgently buy a new one so I can have backups of my other drives again. Say if Murphy’s Law was to take effect and one of my other drives were to fail between now and when I get a replacement for this drive, I would lose months and months of work and study material. It would be catastrophic.

The other concern is that I do have backups of all this stuff, but the backups are in ultra compressed Rzip format to save space. The problem is, I don’t have enough drive space amongst my other external hard drives or internally in this laptop to decompress them, at least I don’t think I do. I have a long night ahead of me frantically rearranging files and deleting things in the hopes I can scrape up enough space to decompress these files.

I’m giving some serious consideration to buying a Blu Ray burner to backup static data, then using hard drives as regular backups. Blu Ray discs are far too clumsy and slow to use for day-to-day operations, but they might be invaluable for archival of material such as old Rubenerd Shows or camcorder videos. Having this data backed up on hard drives is a bit silly if I’m not changing them.

I’ll also be rearranging my stuff on this table and stringing the cables off hooks underneath so that this kind of accident can’t happen again.

So much for my really good mood I had less than a few hours ago. :’-(

Western Digital Scorpio Black 298GiB goodness

My new Western Digital Scorpio Black 298GiB (320GB) notebook drive
My new Western Digital Scorpio Black 298GiB (320GB) notebook drive

I seem to be starting an alarming number of my posts with the exact same four words: "In a previous post…". I was able to buck this alarming trend in this post however by presenting this largely superfluous paragraph instead.

As I’ve mentioned on a previous post (My kingdom for a bigger notebook hard drive), despite having numerous gigabit ethernet and FireWire external hard drives with space to spare, I still have lots of trouble with maintaing a decent amount of free space on the internal drive on this MacBook Pro. No matter how much I try to utilise external drives, their bandwidth and transfer rates simply don’t cut it when it comes to encoding huge swaths of video or compiling source code on gargantuan study projects, or for ports such as KDE. I find external drives to be invaluable for backup and archival purposes, but they’re just not practical for heavy on-the-fly usage; perhaps if I bought a eSATA or FireWire 800 ExpressCard and bought new cases for my existing drives it may improve the situation, but I suspect they’d still be handicapped. And it’d cost a bundle!

So far I’ve had two internal hard drive changes in this MacBook Pro since I bought it back in 2006. It’s become almost a yearly tradition!

  1. The original drive was the optional 91.13GiB (100GB) unit Apple shipped with my then-new new MBP which was smaller than the stock 111.76GiB (120GB) but it was 7200RPM not 5400RPM. More on that below.

  2. The second drive was a Western Digital 149.01GiB (160GB) 7200RPM unit (WD1600BEVS) which was bought in Imbi Plaza in Kuala Lumpur during my family’s one year stint in Malaysia in 2007; this is the drive I’ve had the longest.

  3. My fabulous father bought my latest drive during his latest East Asian business trip to Korea and Japan. The drive is a gloriously roomy Western Digital Scorpio Black 298.02GiB (320GB) 7200RPM unit (WD3200BJKT) with 16MiB of onboard cache, a free fall sensor and is advertised as being ultra quiet in operation, as energy efficient as a 5400RPM drive and supports a 3Gb/s transfer rate; the latter three I’ll be checking out myself in due course.

I’ve had people tell me in as many words I’m stupid for buying 7200RPM notebook drives because they drastically increase heat and reduce battery life, but having used them successfully in iBooks, Armadas, ThinkPads and MacBook Pros for over four years now, I officially call BS. The difference in battery power is negligible to nil; the brightness you set your screen and whether or not you’re using WiFi would have a far greater impact. As for heat, also negligible difference. In fact I can confirm with a laser heat thermometer I borrowed from my Father’s lab at one point that a new 7200RPM drive in my old iBook actually ran cooler than the 5400RPM drive it replaced.

7200RPM drives are definitely worth it, the transfer rates and general responsiveness with applications is noticeably better, and if you’re serious about using your laptop as a production machine for compiling code or video rendering/encoding it’s an absolute must. If you have an older laptop the difference in performance is even greater, my beautiful iBook G3 from 2002 felt noticeably quicker after a 7200RPM drive upgrade, similar story with my retro svelte Armada M300.

I wonder what the capacity of the drive I buy in 2009 will be? Will they have 30TB drives by then you reckon?

My kingdom for a bigger notebook hard drive

An ominous sign of things to come?
An ominous sign of things to come?

It’s crunch time: alas after months of neglect and with so many assignments and projects active and being worked on at any one time, my internal 149 gibibyte (aka 160 gigabyte) hard drive has finally been maxed out. Bummer!

Having used Windows, Linux, FreeBSD, NetBSD and Mac OS X on computers with drives that are nearing breaking point, I do appreciate how incredibly stable the BSDs and Mac are under capacity stress. By comparison the general wisdom with Windows (at least when I still exclusively used it before 2003) was that you must reserve at least 10% of your drive at all time to maintain stability, NTFS included. By comparison, this MacBook Pro has been close full for a while now and still only EyeTV and the slow as molasses Microsoft Office 2008 for Mac applications are capable of crashing it.

As I’ve discovered the hard way though, notebook computers present their own set of storage challenges! For most of my life I’ve been a desktop computer user; it was only in 2006 when I made the decision as a computer science student studying overseas that a souped up notebook computer would make more sense for taking around to different houses and around campus than a new desktop.

Of course the problem with said notebook computers is that you can’t just easily slide in an extra hard drive when your existing one starts to fill up! Sure you can buy external drives, but they still won’t match the performance of the internal drive. What happens then is I tend to backup material to the external drives, but projects I’m compiling, editing video for or otherwise working on end up staying on the internal drive.

VMware Fusion 2.0 beta 2 New Virtual Machine Assistant
What can I say, I love toying around and exploring operating systems!

This is also a problem for virtual machines which I spend lots of time using and writing about. To satisfy my own addiction and fanaticism for studying operating systems, as well as for my work which involves compiling and testing applications, I have multiple VMs on this internal drive. Running these virtual machines on an external drive is completely out of the question given the performance would really, really suffer. Having 12 virtual machines which combined take up 72GiB on a 149GiB notebook drive though is also completely out of the question!

With my desktops in the past I tended to dedicate a smaller drive with the fastest RPM for the operating system and two larger, equally sized drives mirroring each other (later using RAID instead of software) for the data. On my current desktop back in Singapore which I SSH and SFTP into from here in Adelaide I have FreeBSD 7.0 AMD64 on its own dedicated, 10,000RPM SATAII drive with 32MiB of cache shared with binaries, and two 7,200 RPM drives for the home directories, port collections, documentation and served data. Ideally I’d love to have another super fast drive just for /swap too!

On this laptop I’ve got everything under the sun on one drive. Perhaps partitioning the drive and assigning the /Users directory to a secondary partition might help to compartmentalise the information and improve performance. On BSD and Linux it’s trivial to assign the /home directory to a separate volume, on Mac OS X I’m not so sure. Seems like I have some homework ahead of me!

This much taken up, on a 149GiB internal notebook drive. Bummer!
This much taken up… on a 149GiB internal notebook drive.

Of course it probably wouldn’t hurt cleaning this drive out either. I have a few Ruby scripts which I run each afternoon which cleans up my desktop and puts files in the appropriate places, but it can’t determine what is safe to delete and what isn’t. I need an electronic secretary I think. Make someone sign a NDA, then go through my drive and get rid of things. No, wait… perhaps that isn’t such a good idea.

As my fabulous father always says after ringing me from his office in Singapore which has more paper, books, phone receivers, emails and blood pressure tablets than Parliament House: "All I need is a time machine Ruben… then I’d work just fine"

Data capacity then and now, pretty amazing!

For a high school assignment back in 2003 I had to demonstrate competency in a spreadsheet application by entering data and creating several charts, or to use the exact language from the assignment sheet: “You must demonstrate competency in a spreadsheet application by entering data and creating several charts”. I used the amount of rewritable computer data capacity I had on hand as my data.

ASIDE: Before I started using Macs as my primary machines I used Office 97 on my Windows machines. Even in 2003, I saw no compelling reason to use anything newer than Excel 97!

Well here we are in 2008 and by chance while I was pouring through my backups trying to find an old text file, I found that old Excel spreadsheet file and was absolutely flabbergasted (is that a word?) by the hard disk sizes! So to put things into perspective I decided to quickly open the file in Gnumeric and add data from my recent drives, and just for fun the data from some of our older machines (I didn’t bother with my dad’s AT or anything older!).

File sizes are shown in the hard disk manufacturer’s advertised sizes which assume 1 kilobyte = 1000 bytes

Year Total Capacity Drives
1994 0.1GB internal
We gave up on MS-DOS DoubleSpace compression!
1997 5GB 4GB internal
100MB Zip disks x10
2003 190GB 80GB x2 in Windows desktop
30GB in iBook
15GB iPod 3G
2008 4195GB 60GB in MacBook Pro
750GB in DIY FreeBSD desktop
80GB in iBook
160GB in Armada M300
15GB iPod 3G
60GB iPod 5G
160GB USB 2.0 Iomega
320GB USB 2.0 WD
400GB FireWire 400 Seagate
500GB FireWire 400 Maxtor
750GB Gigabit NAS WD
1TB Gigabit NAS WD

And what would these four capacities look like in comparison to each other if they were put into a fun but fairly useless graph?