Node dfw3 (Dallas, TX) outage
-
Saturday, 11th January, 2025
-
14:05pm
Dear all,
Node dfw3 (Dallas, TX) is offline. The node became unresponsive, and reboot signals did not work. We’re waiting for a response from the datacenter. Sorry for any inconveniences caused.
Updates:
2025-11-01 5:33 AM PST - Node dfw3 (Dallas, TX) is down.
2025-11-01 9:00 AM PST - System appears to be going into a kernel panic immediately after booting. It complains about there being errors in /dev/md0 and then goes into kernel panic. Attempting recovery mode yields similar results.
I booted into recovery mode on the oldest kernel and it appears to be running the fsck... seems to be taking longer than I'd imagine but I'll leave it running just in case. Those are large drives so maybe it takes a while.
2025-11-01 9:48 AM PST - This has been resolved. All drives are healthy.