Mom server temporarily unavailable (resolved)

Posted November 24th, 2008 in System Status. Tags: .

The “mom” server experienced high load starting at around 10:45 AM (Pacific time) this morning. We restarted it just before 11:00, and it’s now working normally.

The high load was occurring because the Linux kernel was limiting what it cached from the file system. The server had close to 2 GB of free RAM that is normally used for file caching, but the kernel was caching only a few hundred MB. This caused heavy load on the disk system, making the server sluggish and pushing the “load” far higher than we consider acceptable.

We are investigating the root cause of the caching problem to ensure that it doesn’t happen again. We don’t consider this acceptable, and we sincerely apologize for the inconvenience this caused customers on that server (other servers were not affected).

Update: Our investigation has revealed the probable cause of this, and it is not a problem that will recur.

  1. Recent Posts

    1. PHP versions 8.1.30, 8.2.24, and 8.3.12
    2. MariaDB (MySQL) database server update from 10.5 to 10.11 (completed)
    3. Labor Day 2024 holiday hours
    4. PHP versions 8.2.22 and 8.3.10
    5. WordPress 6.6
    6. PHP versions 8.1.29, 8.2.21, and 8.3.9
    7. 4th of July 2024 holiday hours
    8. Memorial Day 2024 holiday hours
    9. PHP versions 8.2.19 and 8.3.7
    10. PHP versions 8.1.28, 8.2.18, and 8.3.6

  2. Categories

  3. Tags

    all servers email holiday hours linux mailman maintenance mod_security mysql network php phpmyadmin security server updates spam ssl status updates webmail wordpress zapp

  4. Feeds