long rowidScanStart = getTimeMilSec("2009111912", dateFormat);
long rowidScanLast = getTimeMilSec( "2011110112", dateFormat);

HTable hTable = new HTable("LogTraffic");

//데이터를 읽어올 범위를 지정
Scan scan = new Scan(Bytes.toBytes(rowidScanStart), Bytes.toBytes(rowidScanLast));
ResultScanner scanner = hTable.getScanner(scan); 
for (Result result : scanner) {

//삭제할 RowKey값을 가져온다
byte [] row = result.getRow();
deleteRow(row) ;


scanner.close();
hTable.close(); 

//데이터를 삭제하는 Method
deleteRow(byte[]  row){

            HTable hTable = new HTable("LogTraffic");
            Delete del = new Delete(row);
            hTable.delete(del);
            hTable.close();

}

'Hadoop' 카테고리의 다른 글

Zookeeper Warning 메세지  (0) 2012.10.11
Hive Error  (0) 2011.12.26
Hadoop 인스톨 ②  (0) 2011.07.20
Hadoop 인스톨 ①  (0) 2011.07.19
Apache Hadoop이란?  (0) 2011.07.18

2011-05-06 18:39:14,533 Stage-1 map = 100%,  reduce = 100%
Ended Job = job_201104081532_0509 with errors
java.lang.RuntimeException: Error while reading from task log url
    at
org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130)
    at
org.apache.hadoop.hive.ql.exec.ExecDriver.showJobFailDebugInfo(ExecDriver.java:889)
    at
org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:680)
    at
org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:123)
.....[snip].....
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
Caused by: java.io.IOException: Server returned HTTP response code: 400 for
URL:
http://hadooptest3:50060/tasklog?taskid=attempt_201104081532_0509_m_000002_2&all=true
    at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1436)
    at java.net.URL.openStream(URL.java:1010)
    at
org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120)
    ... 16 more
Ended Job = job_201104081532_0509 with exception
'java.lang.RuntimeException(Error while reading from task log url)'
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.MapRedTask

Hive 에서 쿼리를 실행했을때 발생하는 에러
이경우

Hadoop 의 mapred-site.xml 설정중에서
mapred.child.java.opts=XmxNNNM
값의 설정치를 높여 준다.

참조 : http://www.mail-archive.com/user@hive.apache.org/msg01373.html 

'Hadoop' 카테고리의 다른 글

Zookeeper Warning 메세지  (0) 2012.10.11
HBase 데이터 Scan 및 Delete  (0) 2011.12.30
Hadoop 인스톨 ②  (0) 2011.07.20
Hadoop 인스톨 ①  (0) 2011.07.19
Apache Hadoop이란?  (0) 2011.07.18

Help -> Install New SoftWare -> 
 http://download.eclipse.org/releases/indigo 를 입력
-> 
Collaboration  ->  Subversive SVN Team Provider (Incubation) 선택한후 
next -> next-> 설치  

재시작 

Open Perspective ->  Svn -> SVN Kit 1.3.5 -> Next -> 설치 완료 

'Eclipse' 카테고리의 다른 글

리눅스 Eclipse Svn 계정 변경  (0) 2014.05.07
웹 화면 설계용 툴  (0) 2013.11.08
이클립스 메모리 관리  (0) 2011.07.12
eclipse 3.6 HeliosにVisualEditor을 인스톨  (0) 2011.02.11
Eclipse + Tomcat6.0 + postgres8.3  (0) 2010.08.06

+ Recent posts