`
923723914
  • 浏览: 640060 次
文章分类
社区版块
存档分类
最新评论

java.io.IOException: java.lang.reflect.InvocationTargetException 问题的解决

 
阅读更多

执行

select * from tb where createtime >= '2014-02-13' and createtime < '2014-02-14' limit 10;

报下列错误:

Error during job, obtaining debugging information...
Job Tracking URL: http://192-168-102-155:50030/jobdetails.jsp?jobid=job_201309041025_117599
Examining task ID: task_201309041025_117599_m_000005 (and more) from job job_201309041025_117599
Examining task ID: task_201309041025_117599_m_000000 (and more) from job job_201309041025_117599

Task with the most failures(4):
-----
Task ID:
task_201309041025_117599_m_000001

URL:
http://192-168-102-155:50030/taskdetails.jsp?jobid=job_201309041025_117599&tipid=task_201309041025_117599_m_000001
-----
Diagnostic Messages for this Task:
java.io.IOException: java.lang.reflect.InvocationTargetException
at org.apache.hadoop.hive.io.HiveIOExceptionHandlerChain.handleRecordReaderCreationException(HiveIOExceptionHandlerChain.java:97)
at org.apache.hadoop.hive.io.HiveIOExceptionHandlerUtil.handleRecordReaderCreationException(HiveIOExceptionHandlerUtil.java:57)
at org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.initNextRecordReader(HadoopShimsSecure.java:341)
at org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.<init>(HadoopShimsSecure.java:288)
at org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileInputFormatShim.getRecordReader(HadoopShimsSecure.java:402)
at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:544)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:370)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:324)
at org.apache.hadoop.mapred.Child$4.run(Child.java:266)
at java.security.AccessController.doPrivileged(Native

FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask

执行

select * from tb limit 10;

报错信息:

Failed with exception java.io.IOException:java.io.IOException: Malformed ORC file hdfs://192-168-102-154:9000/user/hive/warehouse/******/2014-02-11.txt. Invalid postscript.

表的文件格式为orc 但是同事从其它系统导数据的时候 放了几个文件夹的txt 文件。

用orc文件格式的表去读取text格式的文件 显然会报错。

因而上述的问题也得到很好解释。

解决办法 将orc表下面的text所有文件夹的数据mv到其它的目录下面。

分享到:
评论

相关推荐

Global site tag (gtag.js) - Google Analytics