webhost status

And the final 2 file servers for this week are going to get upgraded tonight:

janice
gonzo

We’ll be starting with janice in about an hour, and proceeding with gonzo after janice is completed.

As always, we will post updates here as things progress!

Tomorrow we will be upgrading ns2.dreamhost.com to apply some security patches. The actual downtime should not last longer then 5 minutes but during this period you may notice site slowness due to dns lookups failing at ns2.dreamhost.com. The upgrade is planned to start at 10:00PM PDT and should be finished around 11:00PM PDT.

Tonight’s round of upgrades include the following servers:

boppity
scooter

We will be starting with boppity tonight in about 20 minutes. We will post updates as things progress!

As mentioned last week, we will be performing upgrades to some of our file servers over the next few weeks. Tonight’s file server is animal (and hopefully gonzo afterward)

We will be starting the upgrade shortly. We will post updates as things progress!

One of our central database servers has kernel panic’d and is currently being rebooted. For the mean time, most central services are offline (web panel)

We have our mysql gurus working on it and we expect to have things back up and running shortly.

The winds of change are blowing! Starting next week, we will begin to phase out telnet and Frontpage, as well as upgrade apache services to Apache2.2 (from Apache 1 and Apache 2).

If you are still using telnet to connect to a shell, you should immediately switch to SSH. For information on SSH and how to use it with DreamHost, see this wiki article.

As we posted back in June, Microsoft has discontinued Frontpage, which means we have no way to support its extensions in Apache 2.2.

- Whatever extensions you have will stop working.
- You will no longer be able to upload your site within Frontpage using Frontpage Extensions. You will need to use an FTP client instead. You can find information on FTP clients here. Note that Frontpage does have a built-in FTP client that you can use as well. Instructions on using Frontpage as a FTP client can be found here.

If you have any questions or concerns, please contact support.

On Thursday, August 14, 2008 at 10pm Pacific time we are going to retry turning up our remaining links with Global Crossing. They assure us the previous bugs have been fixed, and we shall try again. If all goes well, you shouldn’t notice any downtime. The window for this is 1 hour, though we should be finished in well under 30 minutes as the configuration work is completed.

http://www.dreamhoststatus.com/2008/07/30/network-maintenance-tonight-0730/

We will be continuing our file server upgrades to address a long standing SATA driver bug in Solaris 10. These will occur over the next three weeks, starting Monday, August 18, 2008 at 10pm Pacific time. We will be doing one to two per night, depending on any hitches which may present themselves along the way. Estimated downtime per file server is no longer than 4 hours.

These upgrades will affect your websites, email, ssh, and ftp access to your files if you are on one of these file servers. No email or data should be lost during this process. MySQL will not be affected.

Week of 8/18/2008
animal
gonzo
scooter
boppity
janice

Week of 8/25/2008
rizzo
bambi
sweetums
waldorf
zoot

Week of 9/1/2008
bumper
fozzie
thog
gladys
kermit

The webserver pegasus is having some trouble, so I’m moving it to new hardware. This process should take about thirty minutes.

Due to a database error, any users trying to get at their Junk Mail settings right now will run into some problems.  Our admins are currently restoring the tables for all Junk Mail users and the system should be back up just as soon as that restore completes.  It might take a couple hours to run thru, but we’ll be sure to update this status blog post as the restore rolls along.

We are fully aware of the authentication issues that you are experiencing when accessing your Mailbox via WebMail. There appears to be an issues with one of our central databases. I have an admin looking into the issue at the moment. We hope to have this issue resolved shortly. Sorry for any inconvenience this has caused. Please check back here for further updates.

The web server dalitz crashed a little bit ago, and has been checking its filesystem since. It should be back up inside of an hour. We apologize for this inconvenience, these filesystems take about that long to check.

We are currently having issues with our ns2.dreamhost.com server. It is not responding to queries and it may cause issues if you’re trying to point a new domain to our nameservers. After a quick check, we believe this may be due to a bad drive in the server. Our admin team is currently working on this situation and hope to have it resolved as soon as possible. We will update this post when we have more information or the issue is resolved. We’re sorry for any inconvenience this causes you.

This will explain any problems that you’re encountering when attempting to access your website, ftp server, etc. I have notified an admin and they are currently looking into this matter. We truly apologize for any inconvenience this has caused. Please check back here for future updates.

Tonight, around 10pm, we’ll be plugging in 5 new network links to expand our bandwidth by 50%. We don’t expect any downtime to be incurred but we’ll have our Cisco consultant on-site in case anything happens.

If you have Dreamhost Junkmail enabled for your domain, the process of checking your junkmail quarantine has changed. Now instead of using webmail for accessing the quarantine you will now have to login to http://mailboxes.dreamhost.com with your email address and password. After this you will see a link to access the new Junkmail Quarantine. If you have any questions / problems using the new interface please feel free to contact support.

The old Junkmail interface is disabled as of now so we can sync the new system with the old. This will cause your to be unable to access junkmail for a short period of time. We expect to have the new quarantine system live by 1:00PM PDT and will resolve this post when it is complete.

We experienced an outage on the central database the handles WebMail. Downtime lasted 30 - 40 minutes. Our Admins have restarted the database server. This appears to have resolved the problem. We’ll continue to actively monitor the stability. Sorry for any inconvenience this may have caused. If you continue to encounter problems with Webmail access, please submit a support request.

We are currently noticing some downtime with MySQL servers. Our administration team is looking at the issue right now. We are experiencing heavy packet loss on one of our MySQL racks in the data center. We will update this post with more information as soon as we can.

Update 7:24pm - We have fixed the issue. It appears that some network monitoring software we were using got a bit out of control and clogged the network. We have disabled it for now and service has returned. Sorry about that.

One of the filers for the Spacey cluster has suffered a hardware failure. Technicians have been dispatched to this site. Estimated downtime is one hour for affected customers. This includes all websites and email hosted on this filer, but not MySQL.

Edit: 10:26am Pacific It looks like a hard drive failed and was causing errors on the filer which prevented it from properly functioning. Remote hands have removed the faulty disk and the filer appears to be running normally. Our technicians are still en route with spare parts just in case! We are rebooting the affected servers now, and systems should be nominal in about 15 minutes.

It looks like passat’s not coming back after a reboot. It should be back on new hardware in about 1 hour!

Update 3:32: Sorry for the long delay, that was no fun! Should be back up now, though.