Hive Out of memory due to thread exceptions

Asked Feb 18 '21 at 08:56

Active Feb 18 '21 at 09:07

Viewed 42 times

Currently, we are hive version 2.3.7 in google cloud. And my jobs are failing intermittently once in a week with above error, As a workaround, we are restarting the hive megastore , curious as to know why this issue occurs in this version and how to fix the issue permanently.

Error log :-

java.sql.SQLException: org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. unable to create new native thread

Caused by: java.lang.OutOfMemoryError: unable to create new native thread

Any suggestions would be appreciated.

edited Feb 18 '21 at 09:07

Rajan Kali

11,436
3
24
35

asked Feb 18 '21 at 08:56

Never_Give_Up

Hive's JVM is running out of free process descriptors – rkosegi Feb 18 '21 at 08:58
@rkosegi, yes may I know what could be the issue and resolution specific to hive.. – Never_Give_Up Feb 18 '21 at 11:59
I am.goung through your shared link – Never_Give_Up Feb 18 '21 at 12:00
I am not sure if that helps but i am trying to find a lead using your link.. The issue I am facing is specific to the hive – Never_Give_Up Feb 20 '21 at 14:22

Hive Out of memory due to thread exceptions

0 Answers0