0

I am learning PySpark and come across UDFs. I am not able to understand the diff between Python Functions and UDF in PySpark?

What is the need to use UDF instead of using Functions?

AngiSen
  • 863
  • 3
  • 14
  • 36
  • 1
    There are some operations that may not be easily possible using only the Spark API Functions. – pault Sep 19 '18 at 13:51
  • Related: [Spark functions vs UDF performance?](https://stackoverflow.com/a/38297050/5858851) – pault Sep 19 '18 at 13:51

0 Answers0