Comments on: mk-query-digest now understands HTTP

By: Xaprb

Xaprb — Mon, 14 Mar 2011 14:52:04 +0000

Looks like a bug. Please discuss on the Maatkit mailing list.

By: rsmac

rsmac — Mon, 14 Mar 2011 14:20:07 +0000

I was trying to parse an http log. Used the same options to generate the tcpdump file as if in Mysql:

tcpdump -s 65535 -x -nn -q -tttt -i eth0 -c 1000 port 8890

And I got this error:

./mk-query-digest –type http http.log
Pipeline process 3 (HTTPProtocolParser) caused an error: Use of uninitialized value in string eq at ./mk-query-digest line 9854

Is there any specific options in tcpdump to format the output file?

By: zerodeux

zerodeux — Tue, 01 Feb 2011 19:41:19 +0000

In between Pinba and basic HTTP log analysis, you could use http://forge.bearstech.com/trac/wiki/PhpTop for a poorman’s profiler (plug: I’m its author).

I’m wondering : at some point, “realtime” sampling, collecting and displaying interesting stat data for adminsys could be implemented by many different and interoperable tools ? For instance asql already samples and collects many type of events but has no display/analysis facility, etc.

By: Xaprb

Xaprb — Sun, 15 Nov 2009 19:07:14 +0000

It is extremely useful for *finding* slow requests. What you are really saying is, it’s not useful for understanding why the request is slow.

By: Nickolay Ihalainen

Nickolay Ihalainen — Sun, 15 Nov 2009 17:10:49 +0000

How about pinba for php load reporting? I think a simple web server log/tcpdump is not usefull for finding slow http queries.
Generaly we need info about parsing, calculating, io/wait, network wait (mysql,memcached,web services), network response time (from web server to client)