Performance does thou sucketh this a.m.

[gkainz]

Monday, 1/14 08:20 MST

Clicked on New Posts. Took about 25-30 seconds to complete the response, but query results said 3.86 seconds to complete.

Click on any thread, new post symbol takes about 6-10 seconds to respond and draw the new page.

Posting this took over a minute

 

[bstratt]

Agreed. It took 1 min 15 seconds to open your post after clicking on it!

 

[Keith Lane]

Yea, Verily. It doeth sucketh big time......

 

[gkainz]

"I canna hold 'er together much longer, Cap'n! She's breakin' up!"

 

[Teller1900]

Same here. I even got this:

Database error The database has encountered a problem. Please try the following:

• Load the page again by clicking the Refresh button in your web browser.
• Open the www.pilotsofamerica.com home page, then try to open another page.
• Click the Back button to try another link.

The www.pilotsofamerica.com forum technical staff have been notified of the error, though you may contact them if the problem persists.
We apologise for any inconvenience.
After waiting about a minute to get new posts.

 

[Greebo]

Time permitting I'll check into this today.

However, I don't have time right now, and depending on my emails, I won't have time to seriously check this out for a few days.

 

[jesse]

My monitoring log:

Mon Jan 14 07:09:05 CST 2008 - POA DOWN
Mon Jan 14 07:09:08 CST 2008 - POA DOWN
Mon Jan 14 09:32:48 CST 2008 - POA DOWN
Mon Jan 14 09:33:47 CST 2008 - POA DOWN
Mon Jan 14 09:34:31 CST 2008 - POA DOWN
Mon Jan 14 09:34:47 CST 2008 - POA DOWN
Mon Jan 14 09:35:07 CST 2008 - POA DOWN
Mon Jan 14 09:37:47 CST 2008 - POA DOWN
Mon Jan 14 09:39:48 CST 2008 - POA DOWN
Mon Jan 14 09:40:04 CST 2008 - POA DOWN
Mon Jan 14 09:41:48 CST 2008 - POA DOWN
Mon Jan 14 09:43:48 CST 2008 - POA DOWN
Mon Jan 14 09:44:48 CST 2008 - POA DOWN
Mon Jan 14 09:45:26 CST 2008 - POA DOWN
Mon Jan 14 09:46:48 CST 2008 - POA DOWN
Mon Jan 14 09:47:48 CST 2008 - POA DOWN
Mon Jan 14 09:48:47 CST 2008 - POA DOWN
Mon Jan 14 09:49:48 CST 2008 - POA DOWN
Mon Jan 14 09:50:45 CST 2008 - POA DOWN
Mon Jan 14 09:50:45 CST 2008 - POA DOWN
Mon Jan 14 09:51:48 CST 2008 - POA DOWN
Mon Jan 14 09:53:47 CST 2008 - POA DOWN
Mon Jan 14 09:54:24 CST 2008 - POA DOWN
Mon Jan 14 09:54:26 CST 2008 - POA DOWN
Mon Jan 14 09:54:27 CST 2008 - POA DOWN
Mon Jan 14 09:58:47 CST 2008 - POA DOWN
Mon Jan 14 09:59:01 CST 2008 - POA DOWN
Mon Jan 14 09:59:08 CST 2008 - POA DOWN
Mon Jan 14 10:18:52 CST 2008 - POA DOWN
Mon Jan 14 10:18:59 CST 2008 - POA DOWN
Mon Jan 14 10:19:00 CST 2008 - POA DOWN
Mon Jan 14 10:19:02 CST 2008 - POA DOWN
Mon Jan 14 10:24:07 CST 2008 - POA DOWN

 

[JohnR]

It's been several days like this, off and on. Someone spill molasses in the server?

"As slow a POA in January."

 

[gprellwitz]

I've been seeing some long response times intermittently for the past couple of days. Today has been especially bad, though.

 

[Greebo]

I'm trying to determine if this is the db or the web host, first. Right now I think its more likely the web, as the db side seems pretty sprightly when I run manual queries. However, I'm running an optimize just to be certain.

 

[gprellwitz]

And I just got a 500 level error at about 12:51 CST.
URL was: http://www.pilotsofamerica.com/forum/forumdisplay.php?f=2

 

[KennyFlys]

I was having an extremely slow return even at 4AM this Monday morning. That's normal?

Just now when I brought up the first thread to look at, I was going to another tab and opening my mail directly from the Charter server in a very small fraction of the time it took for the PoA server.

 

[skyflyer8]

Hey, I'm looking on the bright side. I have nothing to do today and waiting for POA to work is helping me pass the time.

 

[Greebo]

Putting a call into the host now.

 

[Everskyward]

It's better now than it was a half-hour ago...

Hmmm, guess I spoke (wrote) too soon.

 

[mikea]

Ees feex now.

Good job, Chuck.

Gawd that was scary. I almost hadda do real work.

 

[Let'sgoflying!]

Thank you.

 

[Greebo]

Don't thank me.

Nothing I tried did a dang thing.

And I had to hang up before I got tech support.

 

[mikea]

Don't thank me.

Nothing I tried did a dang thing.

And I had to hang up before I got tech support.

It's still hanging now and then.

Chuck, did you see that message about Media Temple disabling 'allow_url_fopen' in PHP for security against SQL injection? I figured if you talked to them they would know if that had any effect. You can override it with a directive.

 

[Let'sgoflying!]

Its still nice to have someone working the buttons for us.

 

[KennyFlys]

There's something terribly wrong when a professional hosting service is less efficient than AOL.

 

[Greebo]

It's still hanging now and then.

Chuck, did you see that message about Media Temple disabling 'allow_url_fopen' in PHP for security against SQL injection? I figured if you talked to them they would know if that had any effect. You can override it with a directive.

I did, but it hasn't taken effect yet. The change is important, but should not affect performance.

On that note, I've got security updates I need to make here as well soon - if I can find the *@#($ time...

 

[gkainz]

whatever gremlin that was visiting us appears to have moved on for the time being. I hate those transient, unexplained gotchas ... they always come back to bite at the worst possible time ...

 

[jesse]

Rough day yesterday. I don't think the grid is all they crack it up to be:

Mon Jan 14 07:09:05 CST 2008 - POA DOWN
Mon Jan 14 07:09:08 CST 2008 - POA DOWN
Mon Jan 14 09:32:48 CST 2008 - POA DOWN
Mon Jan 14 09:33:47 CST 2008 - POA DOWN
Mon Jan 14 09:34:31 CST 2008 - POA DOWN
Mon Jan 14 09:34:47 CST 2008 - POA DOWN
Mon Jan 14 09:35:07 CST 2008 - POA DOWN
Mon Jan 14 09:37:47 CST 2008 - POA DOWN
Mon Jan 14 09:39:48 CST 2008 - POA DOWN
Mon Jan 14 09:40:04 CST 2008 - POA DOWN
Mon Jan 14 09:41:48 CST 2008 - POA DOWN
Mon Jan 14 09:43:48 CST 2008 - POA DOWN
Mon Jan 14 09:44:48 CST 2008 - POA DOWN
Mon Jan 14 09:45:26 CST 2008 - POA DOWN
Mon Jan 14 09:46:48 CST 2008 - POA DOWN
Mon Jan 14 09:47:48 CST 2008 - POA DOWN
Mon Jan 14 09:48:47 CST 2008 - POA DOWN
Mon Jan 14 09:49:48 CST 2008 - POA DOWN
Mon Jan 14 09:50:45 CST 2008 - POA DOWN
Mon Jan 14 09:50:45 CST 2008 - POA DOWN
Mon Jan 14 09:51:48 CST 2008 - POA DOWN
Mon Jan 14 09:53:47 CST 2008 - POA DOWN
Mon Jan 14 09:54:24 CST 2008 - POA DOWN
Mon Jan 14 09:54:26 CST 2008 - POA DOWN
Mon Jan 14 09:54:27 CST 2008 - POA DOWN
Mon Jan 14 09:58:47 CST 2008 - POA DOWN
Mon Jan 14 09:59:01 CST 2008 - POA DOWN
Mon Jan 14 09:59:08 CST 2008 - POA DOWN
Mon Jan 14 10:18:52 CST 2008 - POA DOWN
Mon Jan 14 10:18:59 CST 2008 - POA DOWN
Mon Jan 14 10:19:00 CST 2008 - POA DOWN
Mon Jan 14 10:19:02 CST 2008 - POA DOWN
Mon Jan 14 10:24:07 CST 2008 - POA DOWN
Mon Jan 14 10:47:16 CST 2008 - POA DOWN
Mon Jan 14 10:48:24 CST 2008 - POA DOWN
Mon Jan 14 10:56:48 CST 2008 - POA DOWN
Mon Jan 14 10:57:47 CST 2008 - POA DOWN
Mon Jan 14 10:58:48 CST 2008 - POA DOWN
Mon Jan 14 10:59:06 CST 2008 - POA DOWN
Mon Jan 14 11:34:30 CST 2008 - POA DOWN
Mon Jan 14 11:43:04 CST 2008 - POA DOWN
Mon Jan 14 11:49:13 CST 2008 - POA DOWN
Mon Jan 14 11:53:02 CST 2008 - POA DOWN
Mon Jan 14 12:00:11 CST 2008 - POA DOWN
Mon Jan 14 12:18:47 CST 2008 - POA DOWN
Mon Jan 14 12:19:42 CST 2008 - POA DOWN
Mon Jan 14 12:19:43 CST 2008 - POA DOWN
Mon Jan 14 12:19:43 CST 2008 - POA DOWN
Mon Jan 14 12:36:03 CST 2008 - POA DOWN
Mon Jan 14 12:45:48 CST 2008 - POA DOWN
Mon Jan 14 12:46:48 CST 2008 - POA DOWN
Mon Jan 14 12:47:47 CST 2008 - POA DOWN
Mon Jan 14 12:48:47 CST 2008 - POA DOWN
Mon Jan 14 12:49:58 CST 2008 - POA DOWN
Mon Jan 14 12:51:01 CST 2008 - POA DOWN
Mon Jan 14 12:52:17 CST 2008 - POA DOWN
Mon Jan 14 12:52:57 CST 2008 - POA DOWN
Mon Jan 14 12:54:35 CST 2008 - POA DOWN
Mon Jan 14 12:54:52 CST 2008 - POA DOWN
Mon Jan 14 12:55:22 CST 2008 - POA DOWN
Mon Jan 14 12:56:51 CST 2008 - POA DOWN
Mon Jan 14 12:57:44 CST 2008 - POA DOWN
Mon Jan 14 12:58:54 CST 2008 - POA DOWN
Mon Jan 14 12:58:57 CST 2008 - POA DOWN
Mon Jan 14 12:59:07 CST 2008 - POA DOWN
Mon Jan 14 12:59:40 CST 2008 - POA DOWN
Mon Jan 14 12:59:42 CST 2008 - POA DOWN
Mon Jan 14 13:00:11 CST 2008 - POA DOWN
Mon Jan 14 13:00:12 CST 2008 - POA DOWN
Mon Jan 14 13:00:22 CST 2008 - POA DOWN
Mon Jan 14 13:03:49 CST 2008 - POA DOWN
Mon Jan 14 13:03:51 CST 2008 - POA DOWN
Mon Jan 14 13:03:52 CST 2008 - POA DOWN
Mon Jan 14 13:13:01 CST 2008 - POA DOWN
Mon Jan 14 14:13:47 CST 2008 - POA DOWN
Mon Jan 14 14:15:33 CST 2008 - POA DOWN
Mon Jan 14 14:16:07 CST 2008 - POA DOWN
Mon Jan 14 14:26:32 CST 2008 - POA DOWN
Mon Jan 14 14:33:30 CST 2008 - POA DOWN
Mon Jan 14 14:33:30 CST 2008 - POA DOWN
Mon Jan 14 14:33:42 CST 2008 - POA DOWN
Mon Jan 14 14:34:05 CST 2008 - POA DOWN
Mon Jan 14 14:35:07 CST 2008 - POA DOWN
Mon Jan 14 14:36:04 CST 2008 - POA DOWN
Mon Jan 14 14:37:06 CST 2008 - POA DOWN
Mon Jan 14 14:38:08 CST 2008 - POA DOWN
Mon Jan 14 14:39:04 CST 2008 - POA DOWN
Mon Jan 14 14:42:08 CST 2008 - POA DOWN
Mon Jan 14 14:42:09 CST 2008 - POA DOWN
Mon Jan 14 14:42:14 CST 2008 - POA DOWN
Mon Jan 14 14:43:04 CST 2008 - POA DOWN
Mon Jan 14 14:44:06 CST 2008 - POA DOWN
Mon Jan 14 14:45:04 CST 2008 - POA DOWN
Mon Jan 14 15:15:48 CST 2008 - POA DOWN
Mon Jan 14 15:16:47 CST 2008 - POA DOWN
Mon Jan 14 15:17:48 CST 2008 - POA DOWN
Mon Jan 14 15:18:47 CST 2008 - POA DOWN
Mon Jan 14 15:19:48 CST 2008 - POA DOWN
Mon Jan 14 15:20:48 CST 2008 - POA DOWN
Mon Jan 14 15:21:48 CST 2008 - POA DOWN
Mon Jan 14 15:22:48 CST 2008 - POA DOWN
Mon Jan 14 15:23:47 CST 2008 - POA DOWN
Mon Jan 14 15:24:48 CST 2008 - POA DOWN
Mon Jan 14 15:25:48 CST 2008 - POA DOWN
Mon Jan 14 15:26:47 CST 2008 - POA DOWN
Mon Jan 14 15:27:27 CST 2008 - POA DOWN
Mon Jan 14 15:27:33 CST 2008 - POA DOWN
Mon Jan 14 15:28:47 CST 2008 - POA DOWN
Mon Jan 14 15:29:48 CST 2008 - POA DOWN
Mon Jan 14 15:30:47 CST 2008 - POA DOWN
Mon Jan 14 15:32:48 CST 2008 - POA DOWN
Mon Jan 14 15:33:47 CST 2008 - POA DOWN
Mon Jan 14 15:34:48 CST 2008 - POA DOWN
Mon Jan 14 15:35:48 CST 2008 - POA DOWN
Mon Jan 14 15:36:48 CST 2008 - POA DOWN
Mon Jan 14 15:37:48 CST 2008 - POA DOWN
Mon Jan 14 15:38:47 CST 2008 - POA DOWN
Mon Jan 14 15:39:48 CST 2008 - POA DOWN
Mon Jan 14 15:40:47 CST 2008 - POA DOWN
Mon Jan 14 15:41:48 CST 2008 - POA DOWN
Mon Jan 14 15:42:48 CST 2008 - POA DOWN
Mon Jan 14 15:43:48 CST 2008 - POA DOWN
Mon Jan 14 15:44:48 CST 2008 - POA DOWN
Mon Jan 14 15:45:48 CST 2008 - POA DOWN
Mon Jan 14 15:46:48 CST 2008 - POA DOWN
Mon Jan 14 15:47:47 CST 2008 - POA DOWN
Mon Jan 14 15:48:47 CST 2008 - POA DOWN
Mon Jan 14 15:49:48 CST 2008 - POA DOWN
Mon Jan 14 15:50:48 CST 2008 - POA DOWN
Mon Jan 14 15:51:48 CST 2008 - POA DOWN
Mon Jan 14 15:52:47 CST 2008 - POA DOWN
Mon Jan 14 15:53:48 CST 2008 - POA DOWN
Mon Jan 14 15:54:48 CST 2008 - POA DOWN
Mon Jan 14 15:55:47 CST 2008 - POA DOWN
Mon Jan 14 15:56:47 CST 2008 - POA DOWN
Mon Jan 14 15:56:48 CST 2008 - POA DOWN
Mon Jan 14 16:02:46 CST 2008 - POA DOWN
Mon Jan 14 16:04:24 CST 2008 - POA DOWN
Mon Jan 14 16:04:24 CST 2008 - POA DOWN
Mon Jan 14 16:04:24 CST 2008 - POA DOWN
Mon Jan 14 16:04:25 CST 2008 - POA DOWN
Mon Jan 14 16:25:48 CST 2008 - POA DOWN
Mon Jan 14 16:26:48 CST 2008 - POA DOWN
Mon Jan 14 16:27:47 CST 2008 - POA DOWN
Mon Jan 14 16:28:48 CST 2008 - POA DOWN
Mon Jan 14 16:29:48 CST 2008 - POA DOWN
Mon Jan 14 16:30:47 CST 2008 - POA DOWN
Mon Jan 14 16:31:48 CST 2008 - POA DOWN
Mon Jan 14 16:32:47 CST 2008 - POA DOWN
Mon Jan 14 16:33:51 CST 2008 - POA DOWN
Mon Jan 14 16:34:48 CST 2008 - POA DOWN
Mon Jan 14 16:35:47 CST 2008 - POA DOWN
Mon Jan 14 16:36:48 CST 2008 - POA DOWN
Mon Jan 14 16:37:47 CST 2008 - POA DOWN
Mon Jan 14 16:38:51 CST 2008 - POA DOWN
Mon Jan 14 16:39:48 CST 2008 - POA DOWN
Mon Jan 14 16:47:01 CST 2008 - POA DOWN
Mon Jan 14 16:53:04 CST 2008 - POA DOWN
Mon Jan 14 17:02:16 CST 2008 - POA DOWN
Mon Jan 14 17:04:27 CST 2008 - POA DOWN
Mon Jan 14 17:04:49 CST 2008 - POA DOWN
Mon Jan 14 17:05:15 CST 2008 - POA DOWN
Mon Jan 14 17:12:08 CST 2008 - POA DOWN
Mon Jan 14 18:42:49 CST 2008 - POA DOWN
Mon Jan 14 21:34:47 CST 2008 - POA DOWN
Mon Jan 14 22:22:01 CST 2008 - POA DOWN
Mon Jan 14 22:23:01 CST 2008 - POA DOWN
Mon Jan 14 22:24:02 CST 2008 - POA DOWN
Mon Jan 14 22:25:01 CST 2008 - POA DOWN
Mon Jan 14 22:26:02 CST 2008 - POA DOWN
Mon Jan 14 22:27:02 CST 2008 - POA DOWN
Mon Jan 14 22:28:01 CST 2008 - POA DOWN
Mon Jan 14 22:29:01 CST 2008 - POA DOWN
Mon Jan 14 22:30:02 CST 2008 - POA DOWN
Mon Jan 14 22:31:02 CST 2008 - POA DOWN
Mon Jan 14 22:32:01 CST 2008 - POA DOWN
Mon Jan 14 22:33:01 CST 2008 - POA DOWN

 

[Greebo]

They have their occasional hiccups, to be certain.

 

[gprellwitz]

Actually, I think the slowdown is due to Jesse's monitoring program!

 

[jesse]

Actually, I think the slowdown is due to Jesse's monitoring program!

I agree--a simple page load per minute probably overloads their entire grid. Even Spike's web provider performs better on a day to day basis.

 

[Greebo]

I agree--a simple page load per minute probably overloads their entire grid.

Well, that tears it. Sorry jesse, you're banned!

 

[mikea]

I agree--a simple page load per minute probably overloads their entire grid.

Could be some miscreant really DOSing somebody else who's on the grid.

 

[cherokeeflyboy]

doing it again.really s l o w this pm

 

[mikea]

doing it again.really s l o w this pm

It's the Arctic blast coming down the center of the country. Performance should improve once the engine heaters kick in.

 

[KennyFlys]

My instructor called earlier. He thought I was screaming at him. Of course, I had several POA pages still loading while I accessed our scheduling, set up a few flights this week and weekend then logged out. The POA pages were still loading... about five minutes later.

 

[mikea]

My instructor called earlier. He thought I was screaming at him. Of course, I had several POA pages still loading while I accessed our scheduling, set up a few flights this week and weekend then logged out. The POA pages were still loading... about five minutes later.

Not that this ever helps but it's working only moderately slower for me.

 

[kevin47881]

The current speed is deplorable at best.

 

[Maverick]

Site performance is unbelievably bad today.

I saw this first when checking in from home early this morning and it's been really bad all day. I have a Comcast connection at home and an AT&T dedicated T1 at the office. Response from the web site has been extremely slow all day.

 

[mikea]

The current speed is deplorable at best.

Hmmmm. Must be a backbone link/NAP broken between youse guys and MT. It really is OK for me.

 

[jesse]

Doubtful Mike. The problem is always 'waiting for reply' and responsive up to that point. ICMP is always very responsive. It really just depends where the load balancers send you and your server side SQL queries. Sometimes if you click refresh a few times it'll start working.

 

[Dave Krall CFII]

Re: Site performance is unbelievably bad today.

It's slowed from the normal, nearly instantaneous speed, to about 3-5 seconds per command for me.

 

[bstratt]

Re: Site performance is unbelievably bad today.

Another interesting twist - when I logged in this morning after not having been on for about a day, the "home" page told me there were 13 new posts. I thought that was a small number given the time frame in question. Once I selected "New Posts", I got over 100 new posts but all but 13 were indicated as not read from an earlier search. Weird!

 

[gprellwitz]

I've not had any problems this evening.