Brief performance problem on web12 server March 4, 2013 (resolved)

There was a brief but severe performance problem on the web12 server today between 9:59 and 10:07 AM Pacific time. During this time, many Web server requests were very slow to load or even “timed out” completely. All services are now operating normally again. Other servers were not affected.

This problem was caused by high database load due to a customer making “runaway” database queries on that server. We are investigating the details to avoid future problems, and we apologize to affected customers.