0

How can I achieve keys of a grouped spark-dataframe?

And another question:

What does a pyspark.sql.group.GroupedData object include?

Vahid
  • 2,763
  • 1
  • 31
  • 38

1 Answers1

0

How can I achieve keys of a grouped spark-dataframe?

Without aggregating data and collecting the result it is not possible. It would be easier to just:

df.select(grouping_columns).distinct()

What does a pyspark.sql.group.GroupedData object include?

Just the execution plan:

Alper t. Turker
  • 32,514
  • 8
  • 78
  • 112