Exiting Spark-shell from the scala script

Question

I am using this command to run scala scripts.

spark-shell -i test.scala

At the end of the execution of the script I still see spark-shell running.

I have used ":q/:quit" in the test.scala script to try and exit but it's not working.

score 7 · Answer 1 · answered May 07 '20 at 00:17

7

In version 2.4.3 System.exit(0) is working.

answered May 07 '20 at 00:17

abhijitcaps

score 6 · Accepted Answer · edited Jan 24 '22 at 03:04

6

You need to add exit() at the end of your script to avoid stepping into scala REPL.

Helloworld.scala

print("Hello World");
print("Second Line");
print("Bye now");
System.exit(0)

Run above

spark-shell -i helloworld.scala

edited Jan 24 '22 at 03:04

Wonko the Sane

answered Mar 17 '16 at 08:06

charles gomes

26

You may need to use `System.exit(0)`. `exit()` did not work for me. – dkoes Sep 25 '16 at 01:11
@dkoes Thank you for System.exit(0). exit() did not work for Spark v2.1.1 – PanwarS87 Jun 28 '17 at 20:10
1

In scala you can use sys.exit(0) instead of System.exit(0) – Jelmer Jul 09 '19 at 09:28
@Jelmer i use 2.11.8 and your answer was the only one working, cheers! – JBoy Jan 13 '20 at 16:00

score 5 · Answer 3 · answered Feb 12 '20 at 00:56

5

I also like the echo :quit | spark-shell ... answer that was offered on another question.

answered Feb 12 '20 at 00:56

Leif Wickland

3 Answers3