Gridsouth Blowz? ... What can I say?

Update... 1617 09/25/09
Talked to a Gridsouth rep on the phone today. This is the source of the mysterious AppRiver phone calls I've been getting. I guess Gridsouth moved in with AppRiver. Anyway, he asked me when I was going to pay my overdue bill. I parried by commenting that I figured that since they had turned off the server and I hadn't complained that they might figure I was not going to renew. I threw in a "by the way, what ever happened to the drive recovery effort?". He promised to have some one from tech support call me back today...~Steve>

Yeah right.  >_<

I'm waiting...


Update... 0036 09/01/09
It's been over a year since Gridsouth lost my accumulated work's life on the internet. They finally turned off the server, it seems to be dead in the water. I sit here thinking about the fact that they never gave me a straight answer concerning data recovery on the server image they lost and so I have reconciled myself to the idea that I will never get back the contents of my server. Of course, they had a brand spanking new CentOS image up and running for me, after I requested it. After all, I had paid for a year in advance and had only used up about 3 months of the contract by that time.

Some background

This all started in February of last year. By that time, JHS had been hosting several physical boxes with CreativeDataConcepts in Pensacola for a while. I had known Jim from my time at IWDC. We were one of CDC's first customers. While I was still working for IWDC, a buddy of mine was looking for a place to host some boxes for a company he worked for, The company, ASTI, was out of Wash DC and provided EDI based services to a government market. I knew several of their local employees and had done some consulting for them, So, I steered them to CDC. I had known Jim a while by then, and he welcomed the business. Time passed and I moved on to found my own company, JHS, coincidentally, with a former ASTI employee. We actually took over the contract for ASTI and managed the hosting site for them. Over the years, ASTI's continued to pay the hosting bill and JHS managed the Pensacola facility for them. JHS paid for upgrades to the equipment and also hosted some customers at this location.

Factor into this Hurricane Ivan. Damage from the hurricane caused the hosting center to be without connectivity and power for the better part of over two weeks. JHS paid for (out of pocket) setting up and moving our hosting customers so that they were able to continue business. As a result, some of our customers decided not to stick with us (the lack of emergency power came as a surprise to us, too). We lost 95% of our hosting business in the aftermath of the storm. After that point we continued to host and maintain the facility for just ASTI, JHS and my personal sites there. Things languished for a couple of years and then last year (2008) ASTI decided not to pay the hosting bill anymore. Faced with paying the entire bill myself (JHS was essentially kaput by this time as well), Jim basically forced me to make a decision on staying and paying out of pocket or shutting down completely. However, Jim offered a lower cost alternative, virtual hosting with Gridsouth, and I decided to try it.

I will say that Jim went to bat for me originally and got me a good solution for a reasonable price. This was in February of 2008. Once the virtual server had been up and running for a while we retired the old server hardware and pulled the drives for backup. From that point on we relied on the native backup system provided by Gridsouth (the infamous 72 TB SAN). Fast forward to August of last year. Around the 15th, (See blogs below) Gridsouth suffered some kind of catastrophic hardware failure on the SAN that destroyed my virtual server image, and, oddly enough, all of the backups. DRT as the EMS guys say. At first it was "we'll be back online soon". Pretty soon however, it was obvious that they had lost everything on that RAID array. Lots of promises were made about how they were going to send the drives out to a recovery specialist, yada yada. I kept in touch with Gridsouth tech support (by this time, Jim wouldn't return my calls) on the status of the recovery effort. Pretty soon, it went from any time now, to "we'll let ya know". Eventually, Gridsouth quit responding to my queries for status on the recovery. I got the message, I tell you.

Oh, I was back online after awhile with a new, fresh, EMPTY, CentOS image. The tech sounded kinda surprised that I wanted it. I guess he expected I would have bolted since they lost all my SH*T. Indeed, I only ever enabled a couple of email and web server features for the jhsgroup.com domain. I pretty much forwarded all my other domains to yahoo email and used directnic's free hosting. Hadn't used the machine much since then.

So here it is, just a little over a year later, and to date, no data has ever been recovered, as far as I know. No apologies, no answers. I understand that they were embarassed that they lost my SH*T, but come one, one "sorry dude" or a "my bad" couldn't have hurt. Years of work, gone in an instant! If there was a bright spot, it was that everything was pretty much just my stuff and not a customer's....~Steve>


Update... 1758 08/15/08
I've been talking to the sales director at Gridsouth. First, it looks like it might be 4 or 5 days before I know what they will be able to recover from the hardware. The drives have been shipped and are in the hands of the recovery specialist. It remains to be seen what can be recovered. So, they are looking into perhaps setting up a new clean CentOS server to get me back online. I would have to recover my configs from the old hard drive I decommissioned several months ago when we retired the old JHS servers. I am waiting to see what they offer....~Steve>


Posted... 1500 08/15/08
Well, my sites hosted at Gridsouth have been down for approaching 5 days now. Evidently, some drives on the 72 TB SAN device ate themselves. This happened somewhere after 6PM on Tuesday. All my email, webs database and list servers are off line. I've been on the phone with Tech Support at Gridsouth and it's been variations on "we had a hardware failure, and expect to be back up after a while". Alternately, my requests for MTTR have been met with either, "I don't know" or "any minute now". Finally, last night, the tech I spoke with said that they were going to "send out some drives for recovery". Since my site hasn't reappeared, I suppose that means I need to prepare myself for the eventuality that all my work, literally years of development, is gone for good. Yes I have some backups, but they are fairly old, dating from when I switched to the Virtual Machine hosting service. The hosting service's "magical" grid computing architecture was supposed to make backing up obsolete. Can you say "single point of failure". Well, anyway I've called the owner several times to get the straight skinny, but so far he hasn't returned my calls. EPIC FAIL....As the old knight in that Indiana Jones flick once said, "he choose poorly". I guess that about sums it up.
BTW, I'm hosting this from my free account with my domain registrar, but my email is generally down. You can get me at my work email, if you know that, or you can try my kb4oid address, I have that forwarded to my yahoo account temporarily,
...~Steve> .

read more
   
  Copyright 2008, The JHS Group, Inc.. All rights reserved.
Privacy Police | User DisAgreement | Terms of AbUse | Copyright DisInformation