Grokbase Groups Hive user July 2009
FAQ
Hey all, in this case I am using a hive deployment from an old trunk
(sorry). I am having an error with 'ADD FILE' and 'using'. Can I work
around it or is the only method to move to release? Or am i doing
something wrong?


[ecapriolo@hadoopdata10 ~]$ cat /tmp/return5.sh
#!/bin/sh
echo 5
exit 0

hive> list files;
/tmp/return5.sh
hive> from clientip a MAP 1 USING 'bash return5.sh' as nn limit 1;
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_200905271425_0257, Tracking URL =
http://nyhadoopname2.ops.edwardcapriolo.com:50030/jobdetails.jsp?jobid=job_200905271425_0257
Kill Command = /usr/bin/hadoop job
-Dmapred.job.tracker=nyhadoopname2.ops.edwardcapriolo.com:8021 -kill
job_200905271425_0257
map = 0%, reduce =0%
map = 100%, reduce =100%
Ended Job = job_200905271425_0257 with errors
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.ExecDriver
Time taken: 92.171 seconds
hive> from clientip a MAP 1 USING 'bash return5.sh' as nn limit 1;


hive_trunk-2009-03-23.T

2009-07-02 15:35:51,408 INFO
org.apache.hadoop.hive.ql.exec.FileSinkOperator: Initializing Self
2009-07-02 15:35:51,410 INFO
org.apache.hadoop.hive.ql.exec.FileSinkOperator: Writing to temp file:
/tmp/hive-ecapriolo/_tmp.17643771.10001.insclause-0/_tmp.attempt_200905271425_0257_m_000000_0
2009-07-02 15:35:51,452 INFO
org.apache.hadoop.hive.ql.exec.LimitOperator: Initialization Done
2009-07-02 15:35:51,452 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: Initialization Done
2009-07-02 15:35:51,453 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: Executing [/bin/bash,
return5.sh]
2009-07-02 15:35:51,453 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: tablename=clientip
2009-07-02 15:35:51,453 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator:
partname={log_day=2009-03-22}
2009-07-02 15:35:51,453 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: alias=a
2009-07-02 15:35:51,470 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: StreamThread
OutputProcessor done
2009-07-02 15:35:51,470 INFO
org.apache.hadoop.hive.ql.exec.SelectOperator: Initialization Done
2009-07-02 15:35:51,472 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: StreamThread
ErrorProcessor done
2009-07-02 15:35:51,474 INFO
org.apache.hadoop.hive.ql.exec.SelectOperator: Initialization Done
2009-07-02 15:35:51,474 INFO
org.apache.hadoop.hive.ql.exec.TableScanOperator: Initialization Done
2009-07-02 15:35:51,497 INFO
org.apache.hadoop.hive.ql.exec.MapOperator: DESERIALIZE_ERRORS:0
2009-07-02 15:35:51,497 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: DESERIALIZE_ERRORS:0
2009-07-02 15:35:51,497 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: SERIALIZE_ERRORS:0
2009-07-02 15:35:51,583 ERROR ExecMapper: Hit error while closing
operators - failing tree
2009-07-02 15:35:51,630 WARN org.apache.hadoop.mapred.TaskTracker:
Error running child
java.lang.RuntimeException: Error while closing operators
at org.apache.hadoop.hive.ql.exec.ExecMapper.close(ExecMapper.java:104)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2198)

Search Discussions

  • Edward Capriolo at Jul 3, 2009 at 12:30 am
    FYI the broken pipe was caused because the external script was bad. I
    failed to take into account that

    #!/usr/bin/perl
    use strict;

    print 7;
    exit 0

    Is not good. It need to be a program that keeps reading from the input stream.

    #!/usr/bin/perl
    use strict;

    while (<STDIN>){
    print 7;
    }

    Brain Fart today

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categorieshive, hadoop
postedJul 2, '09 at 7:52p
activeJul 3, '09 at 12:30a
posts2
users1
websitehive.apache.org

1 user in discussion

Edward Capriolo: 2 posts

People

Translate

site design / logo © 2021 Grokbase