Hadoop
Hive Error
gilnet
2011. 12. 26. 15:38
2011-05-06 18:39:14,533 Stage-1 map = 100%, reduce = 100% Ended Job = job_201104081532_0509 with errors java.lang.RuntimeException: Error while reading from task log url at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130) at org.apache.hadoop.hive.ql.exec.ExecDriver.showJobFailDebugInfo(ExecDriver.java:889) at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:680) at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:123) .....[snip]..... at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:186) Caused by: java.io.IOException: Server returned HTTP response code: 400 for URL: http://hadooptest3:50060/tasklog?taskid=attempt_201104081532_0509_m_000002_2&all=true at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1436) at java.net.URL.openStream(URL.java:1010) at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120) ... 16 more Ended Job = job_201104081532_0509 with exception 'java.lang.RuntimeException(Error while reading from task log url)' FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
Hive 에서 쿼리를 실행했을때 발생하는 에러
이경우
Hadoop 의 mapred-site.xml 설정중에서mapred.child.java.opts=XmxNNNM
값의 설정치를 높여 준다.
참조 : http://www.mail-archive.com/user@hive.apache.org/msg01373.html