I wrote my python code local,it is about spark streaming pulling data from kafka and do some rdd operation,I would like to test if my rdd operation satisfied my expection,but I have not set up kafka and spark,how to test my job?
Asked
Active
Viewed 59 times
0
-
maybe something like unit test?anybody knows? – Frank Apr 11 '18 at 10:59
-
possible duplicate of https://stackoverflow.com/questions/43507988/how-to-test-spark-rdd – Panos Apr 11 '18 at 12:22