June 12, 2007
Situation: We lost the main "read slave." No data was lost. (We have five copies at all times.) But we are missing a critical machine, and have to rebuild it.
The blog still works. Abby has proposed a "down" bookpile contest...
5:11 Eastern US. Downtime happens, but not updating this message was inexcusable. We will keep this message up to date from now on. (Tim)
5:11 Eastern US. John is working to rebuild the machine. I suspect it will not be up tonight. (Tim)
5:46 Eastern US. No new news.
9:13 Eastern US. John's still working hard. I promised to bake him a cake as a reward. (Abby)
10:16 Eastern US. Give us another hour or so, we're hoping to get the site back up tonight! (Abby)
10:48pm Eastern US. Mere moments, folks. (Abby)
9:51am EST: I thought we'd scotched them, but our DB issues seem to have come back. I'm looking into them right now, will update as info comes available (John)
10:59am EST: John's still figuring out what the problem is, and it's looking like it'll be a while. (That means you have more time to enter the bookpile contest - Abby)
12:45pm EST: Transfering some data around, which will take another 2-3 hours. We'll see what the deal is then. (Abby)
3:33pm EST: It's looking like we won't be up for the rest of the day, at least. I'd recommend pulling out a good book to pass the time. (Abby)
