- Messages
- 34,551
- Reaction score
- 204
- Points
- 63
We have figured out the cause of the issues on the web servers. What was supposed to be a seamless upgrade to new & faster hardware ended up turning into quite the nightmare due to some unforeseen and undocumented incompatibilities with some newer kernels, hyper threading, and i7 hardware.
We are currently on our 3rd hardware swap which should be completed shortly. Once done we have some minor setup to do. Once complete the web servers will be moved over and everything should be working normal again, if anything faster than before.
I apologize for the inconvenience this caused, due to our unique distributed free hosting setup it is not easy to get support when we run into issues like this. We had the COO and DC manager where our servers are located working with us all last night along with calling in favors from every sysadmin we know. What it came down to was changing one setting at a time and testing on multiple different hardware setups to locate the cause of this issue. Unfortunately all this testing caused a 'yoyo' affect for the web servers going up and down, mostly due to the fact we could not properly test each change without putting it live.
Right now we have all web traffic going to an under powered system while the new servers are setup so things still may remain slow, however should be online. I will make any further updates directly in this first post instead of replying at the end of the thread so it is easier to find information.
UPDATE
The web servers should now be back online as usual. If you are receiving the default cgi-sys page error please clear your cache, temp files, and possibly restart your browser. That file gets cached in the browser and is hard to get rid of sometimes. Please do not request support in this thread for anything other than what would be related to your website loading.
We are currently on our 3rd hardware swap which should be completed shortly. Once done we have some minor setup to do. Once complete the web servers will be moved over and everything should be working normal again, if anything faster than before.
I apologize for the inconvenience this caused, due to our unique distributed free hosting setup it is not easy to get support when we run into issues like this. We had the COO and DC manager where our servers are located working with us all last night along with calling in favors from every sysadmin we know. What it came down to was changing one setting at a time and testing on multiple different hardware setups to locate the cause of this issue. Unfortunately all this testing caused a 'yoyo' affect for the web servers going up and down, mostly due to the fact we could not properly test each change without putting it live.
Right now we have all web traffic going to an under powered system while the new servers are setup so things still may remain slow, however should be online. I will make any further updates directly in this first post instead of replying at the end of the thread so it is easier to find information.
UPDATE
The web servers should now be back online as usual. If you are receiving the default cgi-sys page error please clear your cache, temp files, and possibly restart your browser. That file gets cached in the browser and is hard to get rid of sometimes. Please do not request support in this thread for anything other than what would be related to your website loading.
Last edited: