0

There is 15 billion row data. 80 different column grouping and addition operations are performing.

But gets stuck at 199+1.

why does this happen? what can i do to solve?

enter image description here

enter image description here

blackbishop
  • 26,760
  • 8
  • 50
  • 69
  • Does this answer your question? [Handling Skew data in apache spark production scenario](https://stackoverflow.com/questions/51017314/handling-skew-data-in-apache-spark-production-scenario) – Vincent Doba Jan 07 '22 at 09:14

0 Answers0