We’ve received reports from some of our customers about errors or delays sending mail to or from Gmail on September 23, 2013.
This was caused by a general problem at Gmail that they’ve since resolved, and wasn’t related to our servers.
At 7:59 AM Pacific time on September 13, we tweeted this:
7:59 AM Pacific time: We're investigating a possible network outage affecting some customers. http://t.co/TySP4KGNY1
— Tiger Technologies (@Tigertech) September 13, 2013
However, this was a false alarm. The problem was in our independent external monitoring system, not a real problem with any of our servers or network.
At approximately 11:00 PM Saturday August 23, 2013, the “web06” server will be restarted. This will cause a short interruption of service for Web sites that server lasting about 8 minutes.
Other servers will not be affected. Mail for customers on this server will be queued and delivered after a short delay.
There’s been a lot of discussion recently about a critical Joomla security bug that allows “hackers” to upload malicious PHP script files to Joomla sites, then run them. This would allow hackers to use your site to send spam, or to replace any file on your Web site.
Although our customers running Joomla should always upgrade to the latest versions when available, we’ve also put rules in place to protect against this vulnerability.
Between 7:41 PM and 8:04 PM Pacific time August 4, 2013, one of our network providers experienced high packet loss, causing intermittently slow or unavailable connections for some customers.
All services are now running normally, and we’re working with that network provider to determine the root cause and prevent a recurrence. We apologize for the inconvenience this caused customers who were affected.
Update at 9:33 PM Pacific time: Our provider reports that their network in San Jose, California was overwhelmed by a large denial of service attack directed at another one of their customers (unrelated to our company). They believe they have resolved the problem.
Between 9:50 AM and 9:59 AM Pacific time August 1, 2013, the “web08” server experienced a distributed denial of service (DDoS) attack, causing Web pages to load slowly or not at all.
The attacks are continuing, but we are blocking the IP addresses involved and all services are operating normally. We’re monitoring things closely to avoid problems, and we apologize for the inconvenience this caused customers.
Between 7:55 PM and 8:06 PM Pacific time July 25, 2013, one of our upstream providers experienced high packet loss that caused an interruption in service for some customers.
The problem was resolved at 8:06 PM and all services are now operating normally. We apologize for the inconvenience this caused.
Between 11:00 PM and 11:59 PM Pacific time Saturday June 22, 2013, the “web07” and “web12” servers will be restarted. This will cause a five minute interruption of service on each of these two servers at some point during this hour.
Other servers will not be affected. Mail for customers on these servers will be queued and delivered after a short delay.
Between 10:00 PM Pacific time on Saturday, June 8 and 5:00 AM on June 9, each of our hosting servers will be restarted. This will cause a brief interruption of service (less than 10 minutes) for each site at some point during this 7 hour period.
Beginning at 10:38 AM, the “web12” server experienced high load that made sites on that server slow (or intermittently return “503 errors”) for several minutes. The cause of this problem (a user running a process that caused extremely high disk usage) has been identified and resolved.
We sincerely apologize for the inconvenience this problem caused.
