Grokbase Groups Hive user April 2011
FAQ
Can you try using using streaming from Hive?

http://wiki.apache.org/hadoop/Hive/LanguageManual/Transform

Cheers,
~Avram


On Apr 7, 2011, at 10:28 AM, Henry Liu wrote:


I'd like to report some counters in my customized map and reduce ruby scripts for hive, just like hadoop streaming does by writing to stderr.

Such as.



#increment hadoop counters
$stderr.puts("reporter:counter:Impression,Total,1")
if first_click == 0 && click_details.empty?
$stderr.puts("reporter:counter:Impression,NoClick,1")
end

$stderr.puts ("reporter:status: status rid #{rid}")
$stderr.puts ("test debug message: rid #{rid}")


These are all logged as regular messages, no counters/status recognized at all.

Anyone has any ideas?

Thanks.

Search Discussions

Discussion Posts

Previous

Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 5 of 6 | next ›
Discussion Overview
groupuser @
categorieshive, hadoop
postedApr 7, '11 at 12:39p
activeApr 7, '11 at 6:35p
posts6
users5
websitehive.apache.org

People

Translate

site design / logo © 2021 Grokbase