Comments on: Maatkit learns how to map-reduce http://www.xaprb.com/blog/2010/05/06/maatkit-learns-how-to-map-reduce/ Stay curious! Mon, 13 May 2013 05:55:40 +0000 hourly 1 http://wordpress.org/?v=3.5.1 By: Xaprb http://www.xaprb.com/blog/2010/05/06/maatkit-learns-how-to-map-reduce/#comment-18264 Xaprb Fri, 07 May 2010 18:44:13 +0000 http://www.xaprb.com/blog/?p=1812#comment-18264 Here is a straight answer: no, this doesn’t reduce memory consumption. I didn’t mean to avoid the question. My reply was off-topic because I wanted to praise Daniel for his good work on figuring out what uses memory.

]]> By: Sheeri Cabral http://www.xaprb.com/blog/2010/05/06/maatkit-learns-how-to-map-reduce/#comment-18263 Sheeri Cabral Fri, 07 May 2010 18:07:01 +0000 http://www.xaprb.com/blog/?p=1812#comment-18263 Bryan – I wasn’t complaining about the memory usage, I have a workaround and am using it happily.

All I was doing was asking if this particular “divide and conquer” strategy addresses the memory usage issue.

My complaint was that I didn’t get a straight answer. I use mk-query-digest and in fact have asked (and my company paid for) features in this.

In fact, I completely understand about the memory usage because there’s a lot of aggregation and comparison, so I understand the need to use that much memory.

]]> By: Daniel Nichter http://www.xaprb.com/blog/2010/05/06/maatkit-learns-how-to-map-reduce/#comment-18262 Daniel Nichter Fri, 07 May 2010 14:07:23 +0000 http://www.xaprb.com/blog/?p=1812#comment-18262 Thanks. :-)

]]> By: Mark Callaghan http://www.xaprb.com/blog/2010/05/06/maatkit-learns-how-to-map-reduce/#comment-18261 Mark Callaghan Fri, 07 May 2010 13:22:00 +0000 http://www.xaprb.com/blog/?p=1812#comment-18261 Daniel — we <3 Maatkit

]]> By: Xaprb http://www.xaprb.com/blog/2010/05/06/maatkit-learns-how-to-map-reduce/#comment-18260 Xaprb Fri, 07 May 2010 12:00:56 +0000 http://www.xaprb.com/blog/?p=1812#comment-18260 Bryan Ryan, I’ll pass your compliment along to Daniel.

]]>