Sunday, 20 November 2011

Fasthosts VPS downtime 2011

We were big fans of Fasthosts.co.uk, first joining them in 2004 as a customer. Over then years I have bought numerous hosting accounts as well as 4 dedicated servers. The service has always been very good with competitive prices.

As valued customers of Fasthosts their team would often contact me with new deals, in July 2011 one of there sales guys called me to tell me all about there new VPS systems. He explained they have a system in place that is very unique in that there is no downtime!
He went on to explain how this system worked, saying that there is always a full backup of your entire account on another cluster, meaning if any hardware goes down we wouldn't even know anything about it as it would automatically be switched to another cluster seamlessly.
On top of that the system was scalable, I could add more ram and hard drive space as and when and better still the spec I required worked out cheaper than my dedicated servers.
It all sounded great, I bought a VPS, set it up and went live. At the start everything seemed great. The VPS cpu showed less load than the dedicated server and overall it worked brilliantly.

31/10/2011 07.57 AM - I sent a ticket to Fasthosts saying my VPS had gone offline, 6 hours later 31/10/2011 01.57 PM their support team got back to me saying 'I can confirm that your VPS is now back up and running.' However, it took more than 30 hours downtime before our server came back online. It wasn't fixed Fasthosts had simply found a workaround to get it back online!

Since 31/10/2011the server has been sluggish hitting massive cpu spikes and crashing regularly, on a daily basis bringing the vps down. It then takes up to 4 hours to get the server restarted from Fasthosts.
No one takes any notice of the ticketing system, you have to call and speak to someone before they agree to even look at the problem. The guys on the phone support have very little knowledge so must just endure abuse on a daily basis.
They pass your information through to a second line of support who have console access to the servers. These guys eventually get the server(s) restarted.
You normally get a ticket back telling you there is nothing wrong at Fasthosts end and the problem is your end!
The trouble is at the same time our VPS is down, Twitter tells us hundreds of others are down too! So we know its nothing our end, rather their problem.

On 20/11/2011 03.59 AM - I was the first person to alert Fasthosts to the fact their VPS system had had another major crash and was experiencing a big problem. Again Fasthosts tried feeding me lies saying it was just me, no one else and must be something on my system.
They took 16 hours to recognise the problem before releasing a System Issue that read: 


  • We have identified and are investigating an issue affecting some of our VPS customers. A small number of our VPS customers will be experiencing intermittent issues connecting their servers.

I had already been searching Twitter in the daytime and found hundreds of others all complaining by this point with similar issues.

Its now 28 hours after me reporting the second major outage at Fasthosts data centre within two weeks, its still down, there are hundreds of people now tweeting bad press about Fasthosts.
Today I will close all my accounts with them, if they try stop me breaking the contract I will enforce legal action against them.

We use a company called http://basicstate.com/ to monitor our servers and know minute by minute when something is up or down. If the server or vps is down I get a sms personally sent to my iphone within 3 mintes of the server falling over. I have all of these sms saved as backups for evidence against Fasthosts. We also have all of the Fasthsts T&C saved and backed up.

10 comments:

  1. I just won a new client , as his previous hosting company where not good ..2 days after taking over his site ,he now has no site ! down due to fasthost.....

    ReplyDelete
  2. COPY OF RECENT TWEETS

    mediaeasier media easier
    @
    @iAppTec @Fasthosts restoring accounts on new VPS at HeartInternet, will take some time to propagate but making progress unlike #fasthosts
    3 minutes ago

    Vinopic Vinopic Wines
    Apologies our website keeps on crashing over the weekend and again today. Our server company @Fasthosts can't seem to do their job right.
    6 minutes ago

    DelcomSystems 2 Way Radio & CCTV
    Sincerest apologies to our customers, yet again our hosts @Fasthosts have let us down. Please call 01722 418000 while our sites are restored
    9 minutes ago

    DelcomSystems 2 Way Radio & CCTV
    @Fasthosts VPS is still down - 15hrs and no response to our ticket. What's going on?
    10 minutes ago

    iAppTec Matthew
    @
    @mediaeasier So have you managed to move off @Fasthosts yet , cant wait to have my sites back ! :)
    13 minutes ago

    LindaJRossiter Linda Rossiter
    @Fasthosts Any update on the VPS service? Your status page is 9 hours old. Will we be up again this morning?
    13 minutes ago

    graphicevidence Graphic Evidence
    @FH_Dave could you please publish your service level agreement on here for people to see @Fasthosts
    27 minutes ago

    NeilGeorges Neil Georges
    @
    @lemoneye @fasthosts this seems to be an on going problem. Can't run a business with no email or website. Not happy....
    30 minutes ago

    graphicevidence Graphic Evidence
    @FH_Dave @fasthosts Your servers are down yet again, this is just astonishingly bad!!
    34 minutes ago

    mattflash123 Matt Adams
    @fasthosts VPS is down again. Please update
    49 minutes ago

    mediaeasier media easier
    Interestingly @Fasthosts say only a few clients are effected, so how comes it takes hours and hours to do a restart for them then??
    1 hour ago

    robh Rob Heaton
    @
    @Fasthosts Opps, wrong ticket, can you look at 111120-000128 please!
    1 hour ago

    lemoneye Lemoneye
    Update: Our Windows services are running normally, but we still have no Linux server and currently no ETA from @Fasthosts for a fix.
    1 hour ago

    Curious_Works Steve Bailey
    @Fasthosts Looks like another 24hr period of no service. Very dissapointing. How can I secure a move to the 'new' stable service?
    1 hour ago

    robh Rob Heaton
    @
    @Fasthosts Can you take another look at ticket 111120-000358 please!
    2 hours ago

    joelafferty Joe Lafferty
    @
    @Fasthosts thanks for fixing, still not happy tho. Is it fixed fixed? @rickcurran
    2 hours ago

    joelafferty Joe Lafferty
    RT @mattflash123 are you on CentOs on your VPS, @fasthosts told me that it was only Centos that stay down-dunno @rickcurran ?
    2 hours ago

    mediaeasier media easier
    Post more info against @Fasthosts #Fasthosts VPS outages here tinyurl.com/7o48ku3
    2 hours ago

    mediaeasier media easier
    @Fasthosts VPS' have been down 26 hours this week, they telling people to look at status page but the post dont say anything. Total shambles
    4 hours ago

    lemoneye Lemoneye
    News: Our suppliers @fasthosts have ongoing issues with our servers which they're working on overnight. We apologise for the inconvenience.
    7 hours ago

    yummymumto2 Kate P
    @
    @humanb3an Think I'll take that advice.... hopefully someone will sort it out tomorrow. Have tweeted @fasthosts and @nominet - have all the
    9 hours ago

    abimpson Alex Bimpson
    Seriously, is every hosting company as shit as @Fasthosts are?
    9 hours ago

    cloud10beauty cloud10beauty
    @
    @fit4beautyqueen so sorry, our site has been down all day due to problems with our server hosting company @Fasthosts
    10 hours ago

    TeamTomTom Tom
    Epic fail on the part of @Fasthosts to keep VPS customers updated & connected. Will start the process to move providers in the morning.
    10 hours ago

    yummymumto2 Kate P
    PLEASE PLEASE @fasthosts transfer my domain - have owned it since 2001 and NEED it back... i am sooooo stressed about it all now :o(
    10 hours ago

    ClickHereGroup Click Here Digital
    @Fasthosts down again. Sincere apologies to our customers, we'll be arranging

    ReplyDelete
  3. a new provider in the morning.
    10 hours ago

    webfactoreuk WebFactore
    We are very sorry for the current issues due to a failure of our hosts @fasthosts. We are working on a solution and will update soon
    10 hours ago

    Curious_Works Steve Bailey
    @Fasthosts anyone going to answer the 24hr hotline tonight?
    10 hours ago

    Curious_Works Steve Bailey
    @Fasthosts Is this trouble you are having with the/MY VPS service going to continue like this week in week out? It is TERRIBLE.
    10 hours ago

    search_first Search First Ltd
    @Fasthosts Can you disclose more info on which VPS OSs are affected? Are you working with Microsoft,CentOS etc to stabilise Hyper V for all?
    10 hours ago

    search_first Search First Ltd
    @Fasthosts What's going on? Are you working on a permanent fix to this downtime? Our VPS has had regular issues like this since Feb 2011
    10 hours ago

    cloud10beauty cloud10beauty
    @
    @joelafferty @Fasthosts as is mine and has been down all day!
    10 hours ago

    mattflash123 Matt Adams
    @joelafferty are you on CentOs on your VPS, @fasthosts told me that it was only Centos that stay down
    11 hours ago

    joelafferty Joe Lafferty
    @
    @Fasthosts not happy status page static service not intermittent but complete #fail
    11 hours ago

    joelafferty Joe Lafferty
    @
    @Fasthosts @cloud10beauty status page is pretty static & mentions 'intermittent' access problems at 19:54!! - my sites are completely down!!
    11 hours ago

    cloud10beauty cloud10beauty
    @
    @Fasthosts when will the servers be fixed? This is terrible service!!
    11 hours ago

    mediaeasier media easier
    @fasthosts VPS's down since 4am 20thNov. 18hrs downtime. Luckily we have transfered our main VPS to heartinternet we'll be online 2moro AM
    11 hours ago

    PaulGreenHiFi Paul Green Hi-Fi
    Apologies to anyone trying to get on the main site. We have had lots of server problems with terrible service from @fasthosts
    11 hours ago

    Dalek6388 Jon & Gav
    Apologies to anyone trying to get on the main site. We have had lots of server problems with terrible service from @fasthosts
    11 hours ago

    travellingSouk The Travelling Souk
    @
    @Fasthosts no updates on your system since 19.54 -cannot believe this is happening to us again
    12 hours ago

    mediaeasier media easier
    @
    @mattflash123 @Fasthosts VPS's running incompatible hardware, meaning they wont restart without running a file check + they are overloaded
    12 hours ago

    joelafferty Joe Lafferty
    @
    @ZarbiWebDesign cheers for mention - here's hoping we see some action from @fasthosts #fail
    12 hours ago

    joelafferty Joe Lafferty
    apologies to all @fasthosts #fail means my blog and lifetree website down. will tweet when back up... I'm not happy! @fh_dave

    ReplyDelete
  4. 12 hours ago

    ZarbiWebDesign Zarbi Ltd
    @
    @joelafferty @fasthosts @fh_dave Our server 1 has been down for almost all of the last 20 hours. Now our server 2 has gone down.
    12 hours ago

    joelafferty Joe Lafferty
    @rickcurran sent a few IRATE tweets re @fasthosts #fail
    12 hours ago

    joelafferty Joe Lafferty
    how can @fasthosts say 'intermittent issues' connecting? when my clients get a big 'database error' when trying to connect?? #fail @fh_dave
    12 hours ago

    joelafferty Joe Lafferty
    Spent 2 days working on crucial article only to have @fasthosts unscheduled outage on website!! URGENT to fix #fail @fh_dave
    13 hours ago

    mediaeasier media easier
    We will fight @Fasthosts all the way to court if they try to stop us breaking our contract
    13 hours ago

    mediaeasier media easier
    Any exsiting @Fasthosts VPS customers, I recommend doing what I did today, go with bit.ly/vM0OtJ much better access and live console
    13 hours ago

    r3trosteve Steve Schofield
    @
    @ZarbiWebDesign @fasthosts @fh_dave shockingly bad. I've been patient until now, but this is just ridiculous. Clearly not fit for purpose.
    13 hours ago

    ericmoose ericmoose
    If @fasthosts were football referees, the crowd would be singing "you don't know what you're doing!" Disgraceful VPS service today, again.
    13 hours ago

    ZarbiWebDesign Zarbi Ltd
    @
    @r3trosteve @fasthosts @fh_dave We've had approximately 3 hours of uptime in the last 15 hours.
    13 hours ago

    lemoneye Lemoneye
    To our loyal, patient customers, our sincere apologies for the interruptions to service caused by @Fasthosts today. We will update you ASAP.
    13 hours ago

    ZarbiWebDesign Zarbi Ltd
    @
    @r3trosteve @fasthosts @fh_dave It happened on Tuesday, Saturday & this is 3rd time today.
    13 hours ago

    angelstarsummer Angel Summer
    @Fasthosts if I switch to a linux server can I write a .htaccess file to redirect or block page requests from one or more ip addresses?
    13 hours ago

    mediaeasier media easier
    @ZarbiWebDesign @Fasthosts @FH_Dave the problem started at 03:29 this morning, fasthost overloading hardware on non qualified VPS platforms!
    14 hours ago

    mattflash123 Matt Adams
    @Fasthosts VPS in read only mode again. Maybe better to spend the time fixing the issue than rebooting for the 10mins it stays up when u do
    14 hours ago

    r3trosteve Steve Schofield
    @
    @ZarbiWebDesign @Fasthosts @FH_Dave How many times has this happened to you over the past few weeks? I'm losing count!
    14 hours ago

    r3trosteve Steve Schofield
    FFS @fasthosts My VPS is down AGAIN. These issues are so frequent over the past few weeks, I'd be better running sites off my local drive!
    14 hours ago

    ReplyDelete
  5. NorwegianSkier Olav Skretteberg
    @Fasthosts I suggest you change you slogan to "Industry leading downtime hosting" You have failed misrably again, need a better host, help??
    14 hours ago

    ZarbiWebDesign Zarbi Ltd
    @
    @Fasthosts Server has gone down again. Please reboot it right now. @FH_Dave
    14 hours ago

    TeamTomTom Tom
    @fasthosts I am seriously concerned that your infrastructure is again failing. what a complete and utter joke! More SLA claims here we come.
    14 hours ago

    lemoneye Lemoneye
    @
    @Fasthosts A small number of VPS customers with intermittent connections? Try no connection all day, no updates or info. Awful service guys!
    15 hours ago

    dale_bulbrook Dale Bulbrook
    @Fasthosts Hi, need urgent response to ticket 111119-000385 please.
    15 hours ago

    travellingSouk The Travelling Souk
    @
    @Fasthosts pleaaasee give us an update on what's happening today. This is dreadful 20/11/11
    15 hours ago

    cloud10beauty cloud10beauty
    Unfortunately our website is temporarily unavailable. Our server provider @Fasthosts is experiencing problems which has affected our site
    15 hours ago

    cloud10beauty cloud10beauty
    @
    @NeilGeorges @lemoneye @Fasthosts totally agree. It is disgraceful
    15 hours ago

    cloud10beauty cloud10beauty
    @
    @WhatLarryLoves yes unfortunately our server provider @Fasthosts is experiencing problems which has brought our site down
    15 hours ago

    webguynick Nick Coates
    Oh noes! Looks like @fasthosts exchange server's haven't got exchange connector enabled :( guess it's IMAP to configure on #evolution
    16 hours ago

    robh Rob Heaton
    @Fasthosts Can you please have a look into ticket - 111120-000128. Cheers!
    16 hours ago

    Curious_Works Steve Bailey
    @
    @Fasthosts Yes, things are 'working' now. I look forward to this follow up email that will hopefully provide some information and answers.
    17 hours ago

    mattflash123 Matt Adams
    @Fasthosts Our VPS is down please resolve.
    17 hours ago

    StylePiques Style Piques
    @Fasthosts YOU GUYS ARE USELESS! Please get our site back up and running!
    17 hours ago

    Curious_Works Steve Bailey
    @
    @Curious_Works @Fasthosts Guess its not worth Fasthosts answering.
    18 hours ago

    mediaeasier media easier
    if I worked @fasthosts Id start looking for another job, its obvious they are about to go under!
    18 hours ago

    lemoneye Lemoneye
    I see we're not alone with problematic VPS's @Fasthosts. Given the impact these problems are causing, the lack of info is incomprehensible.
    18 hours ago

    mediaeasier media easier
    @Fasthosts we too are leaving Fasthosts this week after 7 years with them. We are movig to heartinternet.co.uk VPS
    18 hours ago

    craig_bass Craig Bass

    @Fasthosts my vps has gone readonly AGAIN following yesterdays incident.
    18 hours ago

    ZarbiWebDesign Zarbi Ltd
    We are waiting for @Fasthosts to reboot our server. We can advise our clients we are changing our hosting this week...
    18 hours ago

    ZarbiWebDesign Zarbi Ltd
    @
    @Fasthosts I am DMing you now. Please reboot URGENTLY.
    19 hours ago

    ReplyDelete
  6. Curious_Works Steve Bailey
    @Fasthosts Like everyone else my VPS is down AGAIN.Ticket 111120-000147. WHY is this happening so often? Do you think this is good enough?
    19 hours ago

    pr_dept5 Paul Regan
    @
    @Fasthosts yeah its all sorted now , thanks
    19 hours ago

    neil_yeomans Neil Yeomans
    @
    @DarrenJWare @search_magician @Fasthosts zen.co.uk/business/hosti…
    20 hours ago

    DarrenJWare Darren Ware
    @Fasthosts our virtual server is down again!! This is getting ridiculous and we are losing money!!!!!
    20 hours ago

    mattflash123 Matt Adams
    @Fasthosts our VPS is down again, two days in a row and forth time in the last month!
    21 hours ago

    ZarbiWebDesign Zarbi Ltd
    Nearly three hours since I phoned @Fasthosts to get my server back up. Eight hours of down-time today. Time to take legal action.
    21 hours ago

    ZarbiWebDesign Zarbi Ltd
    We had been promised by @Fasthosts the server would be back up by 10am. This is a total absolute disgrace. @FH_Dave Why is this so poor?
    22 hours ago

    norwichtech Klik + Co
    Our @fasthosts VPS has died AGAIN. Reluctantly, I think we're going to have to migrate our main web-application to Rackspace :(
    22 hours ago

    pr_dept5 Paul Regan
    @Fasthosts still waiting for a reply to my support ticket - is there anyone there over the w/e??? 111119-000356
    23 hours ago

    ZarbiWebDesign Zarbi Ltd
    I don't believe this. Our @Fasthosts server is down again and I can't log in to reboot myself. This is shocking even by their standards.
    20 Nov

    FrontierTown Richard Downer
    Are @Fasthosts having virtual server trouble again? I've just discovered mine has disk I/O errors since yesterday 11am. ticket 111120-000030
    20 Nov

    mediaeasier media easier
    @Fasthosts sent support ticket 4 hours ago and called numerous times yet no response from #fasthosts at all!!!
    20 Nov

    mediaeasier media easier
    @Fasthosts please don't tweet back being kind saying please DM us, I have multiple times but get no response! And yes I am following you
    20 Nov

    mediaeasier media easier
    @Fasthosts this has been going on for 3 weeks SORT IT OUT you are getting a really bad name online
    20 Nov

    mediaeasier media easier
    @Fasthosts yet again our VPS is down !! Your management team called me to say you have hardware problems and vps are stuck in read only mode
    20 Nov

    craig_bass Craig Bass
    @Fasthosts VPS still down.
    19 Nov

    HollingsworthFH Keith Hollingsworth
    @
    @Fasthosts thanks, will do
    19 Nov

    ScienceLogic ScienceLogic
    "@IngramMicroInc partners with our customer @Fasthosts to provide Ingram resellers w/ cloud solutions: ow.ly/7z4gt @theWHIR #cloud
    19 Nov

    carolmillerwed Carol Miller Designs
    @Fasthosts Can you tell me why I have been waiting for you to fix an issue for over 5 weeks now?
    19 Nov

    HollingsworthFH Keith Hollingsworth
    @Fasthosts I recently bought hollingsworthfamilyhistory.co.uk from you, what do you think of my site?
    19 Nov

    ZarbiWebDesign Zarbi Ltd
    @
    @Fasthosts @FH_Dave Now approaching 50 minutes with the reboot not even done yet. Absolutely disgusting.
    19 Nov

    craig_bass Craig Bass
    @fasthosts @FH_Dave VPS is has a read-only filesystem again. Could you please reboot asap. Support ticket # has been DM'ed to @fasthosts
    19 Nov

    ZarbiWebDesign Zarbi Ltd
    Sincere apologies to clients on server 1 - @Fasthosts have let us down once again. Only 4 days since the last crash. We will be terminating.
    19 Nov

    ReplyDelete
  7. yummymumto2 Kate P
    @Fasthosts ... and hence it is causing me problems. It has been going on since Tuesday!
    19 Nov

    yummymumto2 Kate P
    @Fasthosts Can you please advise me how long this is going to take as I am without my e-mail whilst this is being sorted...
    19 Nov

    yummymumto2 Kate P
    @Fasthosts Hubby has now done the domain release form, which you asked him to do at 9.50pm last night, but nothing else happened.
    19 Nov

    ZarbiWebDesign Zarbi Ltd
    @Fasthosts server 1 is down. Please reboot immediately
    19 Nov

    LindaJRossiter Linda Rossiter
    @Fasthosts Do you still have livechat? I'm reporting an problem - is your form the best method? Thanks
    19 Nov

    iAppTec Matthew
    @fasthosts , its back working ... shall i risk upgrading :)
    19 Nov

    iAppTec Matthew
    @
    @Fasthosts well i am not sure whats wrong, hopefully @mediaeasier will contact you ....as i got no clue .. just halfway through upgrade...
    19 Nov

    mattflash123 Matt Adams
    @fasthosts our VPS is still not working. Appears to be the same storage read only issue as last time
    19 Nov

    izb Ian Beveridge
    @
    . @iAppTec Yes. Our @fasthosts hosted site has been intermittently going down for weeks now. Stays down for minutes at a time.
    19 Nov

    iAppTec Matthew
    @
    @Fasthosts i have contacted @mediaeasier first , as they are my first port of call.
    19 Nov

    Co2accountable Gary Carty
    @siyeoman @fasthosts How can I engage with you to discuss poor customer service. Feeling that other peoples grumblings are correct
    19 Nov

    iAppTec Matthew
    @
    @mattflash123 @fasthosts think we are on VPS , its @mediaeasier who i go via , they own a server
    19 Nov

    mattflash123 Matt Adams
    @
    @iAppTec @fasthosts we are having issues too are you on VPS or?
    19 Nov

    iAppTec Matthew
    anyone else having problems with accessing sites hosted by @fasthosts ? or is it just me ? right in the middle of an upgrade ...wham !
    19 Nov

    Co2accountable Gary Carty
    @fasthostsShit A friend has experience of @fasthosts threatening for money while not providing a service
    19 Nov

    Co2accountable Gary Carty
    @fasthosts don't seem to want to help a customer at all. They want her money. I'm glad I'm not a customer of theirs
    19 Nov

    Co2accountable Gary Carty
    @fasthosts: Deal with bad service. Trying to force a friend to pay for service that she hasn't had for 2 months is extortion.
    19 Nov

    ReplyDelete
  8. http://www.theregister.co.uk/2011/11/21/fasthosts_outage/
    Virtual server farm goes titsup TWICE in a month

    Punters blast Fasthosts
    By Brid-Aine Parnell • Get more from this author

    Posted in Small Biz, 21st November 2011 13:43 GMT
    Get more customers. Get Pocket Landline on Orange
    UK hosting firm Fasthosts has suffered its second outage in a couple of weeks as its virtual private servers went down on Sunday afternoon.

    According to Reg readers, the VPS service had already gone offline on October 31 for around 30 hours and has now been down since yesterday afternoon.

    Fasthosts system issues page on their website said on Sunday at 1711 GMT:

    We have identified and are investigating an issue affecting some of our VPS customers. A small number of our VPS customers will be experiencing intermittent issues connecting their servers.

    Another two updates overnight said Fasthosts engineers were working in the problems with both software and hardware providers to solve the issues for good. The firm also said it was still investigating the root cause of the outage.

    This morning at 0958 GMT, Fasthosts said:

    We have stabilised the VPS platform, with no new instances of this issue occurring since 04:00. Some Linux servers may be in Read Only mode and require a manual File System Check. Work to conduct this process on all affected servers is ongoing. A root cause analysis is being conducted in conjunction with our vendors.

    However, the hosting still appears to be having issues at the time of publication, with customers tweeting @fasthosts to get solutions to their downed servers.

    @webfactoreuk told its own customers this morning that:

    We still experiencing server issues. The servers were restored around 4am however seem to be having issues again now.

    While @edwardjanes said:

    Nearly 3 days downtime on my virtual server in last month, will take over 50 years of service to hit your 99.99% uptime GUARANTEE.

    Fasthosts had not returned a request for comment at the time of publication. ®

    ReplyDelete
  9. Fasthosts VPS down today for 6 hours, not the first time, probably wont be the last but it will for us as we've had enough and are moving away from them to something dependable.

    ReplyDelete
  10. We went with Heart internet, 2 years later its still great. Highly recommend them, have none of the problems we had with fasthost.
    MediaEasier

    ReplyDelete