How can I read from different Hive Metastore using Apache Spark

Asked Mar 28 '18 at 10:11

Active Mar 28 '18 at 14:49

Viewed 53 times

val spark=
SparkSession.builder.master("local[*]").config("hive.metastore.uris", "thrift://10.30.61.13:9083")
        .appName("Spark Hive Example")
        .enableHiveSupport()
        .getOrCreate()
    val df=spark.table("xtable")
    df.show()

Through this I need to set this in hive-sit-xml . So when I want to connect to another hive then again I need to change the hive-site.xml.So how can I generalise it

edited Mar 28 '18 at 10:13

OneCricketeer

151,199
17
111
216

asked Mar 28 '18 at 10:11

AkhilaV

Why do you need to change hive site? https://stackoverflow.com/questions/31980584/how-to-connect-to-a-hive-metastore-programmatically-in-sparksql – OneCricketeer Mar 28 '18 at 10:14
that means no need to change hive site right ? – AkhilaV Mar 28 '18 at 11:26
I've used that code successfully. – OneCricketeer Mar 28 '18 at 12:41

How can I read from different Hive Metastore using Apache Spark

0 Answers0