Downtime explanation 11 Sep 2011

Alexander Turcic · 09-11-2011, 08:33 AM

Hello guys,

My sincere apologies for the unexpected downtime you've experienced today. We were offline from 11:28 to 13:23 GMT due to a small (alas, fatal) typo in one of our server settings. Normally we don't mess with these settings, and it only happened as we're preparing for our next infrastructure upgrade (bigger and faster hardware). Again, my apologies, and thank you to everyone who contacted me directly!

Now I wish you all a very pleasant Sunday!

Alex

kennyc · 09-11-2011, 08:34 AM

Thanks for all you do Alex.

beachwanderer · 09-11-2011, 08:40 AM

No problem. Only people who don't do anything don't make mistakes / have no mishaps at work.

for your work and a nice sunday (afternoon) to you too.

Alexander Turcic · 09-11-2011, 11:08 AM

Quote:

Originally Posted by beachwanderer

Only people who don't do anything don't make mistakes / have no mishaps at work.

I'll have to remember that one.

pdurrant · 09-11-2011, 11:50 AM

Quote:

Originally Posted by Alexander Turcic

My sincere apologies for the unexpected downtime you've experienced today. We were offline from 11:28 to 13:23 GMT

Cough... 11:28 to 13:23 BST, I think. It was certainly working at 11:20 BST and not working at 11:30 BST.

Thanks for getting it back up so quickly!

PeterT · 09-11-2011, 02:22 PM

I still recall with embarrassment some of the mistakes in parameters I made back in my mainframe System Programming days. Nothing like a mistake causing you to have to restore a standalone system to allow you to edit the live system to bring it up

beachwanderer · 09-11-2011, 04:00 PM

Quote:

Originally Posted by Alexander Turcic

I'll have to remember that one.

Ah. You don't know the whole story, then?

Well, it's: The people who don't make any mistakes get the advancement. See?

jocampo · 09-11-2011, 05:00 PM

Quote:

Originally Posted by Alexander Turcic

Hello guys,

My sincere apologies for the unexpected downtime you've experienced today. We were offline from 11:28 to 13:23 GMT due to a small (alas, fatal) typo in one of our server settings. Normally we don't mess with these settings, and it only happened as we're preparing for our next infrastructure upgrade (bigger and faster hardware). Again, my apologies, and thank you to everyone who contacted me directly!

Now I wish you all a very pleasant Sunday!

Alex

A MySQL version upgrade maybe?

Alexander Turcic · 09-11-2011, 05:20 PM

Quote:

Originally Posted by beachwanderer

The people who don't make any mistakes get the advancement. See?

Ha! Advancement? Where? Why didn't anybody tell me????

Quote:

Originally Posted by jocampo

A MySQL version upgrade maybe?

Far more trivial. We were cleaning up a few settings to prepare for upcoming hardware upgrades, and we missed to comment out one reference to a now non-existing entry. During log rotation the web server service followed that reference and subsequently complained about not finding the entry. All attempts of our fail-over system to restart the service, well, failed.

jocampo · 09-11-2011, 09:06 PM

Quote:

Originally Posted by Alexander Turcic

Far more trivial. We were cleaning up a few settings to prepare for upcoming hardware upgrades, and we missed to comment out one reference to a now non-existing entry. During log rotation the web server service followed that reference and subsequently complained about not finding the entry. All attempts of our fail-over system to restart the service, well, failed.

Interesting!

Thanks for sharing ...

GeoffC · 09-12-2011, 03:15 AM

And there was me thinking you no longer wanted me .....

09-11-2011, 08:33 AM	#1
Alexander Turcic Fully Converged Posts: 18,175 Karma: 14021202 Join Date: Oct 2002 Location: Switzerland Device: Too many to count here.	Downtime explanation 11 Sep 2011 Hello guys, My sincere apologies for the unexpected downtime you've experienced today. We were offline from 11:28 to 13:23 GMT due to a small (alas, fatal) typo in one of our server settings. Normally we don't mess with these settings, and it only happened as we're preparing for our next infrastructure upgrade (bigger and faster hardware). Again, my apologies, and thank you to everyone who contacted me directly! Now I wish you all a very pleasant Sunday! Alex

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Other Non-Fiction Stapleton, John H.: Explanation of Catholic Morals, V1. 22-Jul-2011	weatherwax	ePub Books	0	07-22-2011 02:48 PM
Short downtime	Alexander Turcic	Announcements	41	06-15-2009 01:49 PM
Reminder: Short downtime today 12:00pm EST	Alexander Turcic	Announcements	15	01-26-2009 02:43 PM
Recent Downtime	Alexander Turcic	Announcements	0	12-25-2004 06:37 PM
SERVER CHANGE - FORUM DOWNTIME	Alexander Turcic	Announcements	1	12-10-2002 02:14 PM

09-11-2011, 08:34 AM	#2
kennyc The Dank Side of the Moon Posts: 35,930 Karma: 119747553 Join Date: Sep 2009 Location: Denver, CO Device: Kindle2 & PW, Onyx Boox Go6	Thanks for all you do Alex.

09-11-2011, 08:40 AM	#3
beachwanderer - Posts: 2,602 Karma: 16748808 Join Date: Nov 2007 Location: At the Baltic Sea Device: Some	No problem. Only people who don't do anything don't make mistakes / have no mishaps at work. for your work and a nice sunday (afternoon) to you too.

09-11-2011, 02:22 PM	#6
PeterT Grand Sorcerer Posts: 13,693 Karma: 79983758 Join Date: Nov 2007 Location: Toronto Device: Libra H2O, Libra Colour	I still recall with embarrassment some of the mistakes in parameters I made back in my mainframe System Programming days. Nothing like a mistake causing you to have to restore a standalone system to allow you to edit the live system to bring it up

09-12-2011, 03:15 AM	#11
GeoffC Chocolate Grasshopper ... Posts: 27,599 Karma: 20821184 Join Date: Mar 2008 Location: Scotland Device: Muse HD , Cybook Gen3 , Pocketbook 302 (Black) , Nexus 10: wife has PW	And there was me thinking you no longer wanted me .....