RDD of List String convert to Row

Question

I'm trying to convert an RDD that has a fixed size lists of strings (a result of parsing CSV file) into and RDD of Rows. This is so I can turn it into a dataframe, because I need it into a dataframe to write to parquet. Anyway the only part I need help with is the converting of Rdd from list of strings to Row.

The RDD variable name is RDD

Ok I converted to Row I used val RowRDD = RDD.map(r => Row.fromSeq(r)) — uh_big_mike_boi, Feb 16 '16 at 19:37

uh_big_mike_boi · Accepted Answer · 2016-02-16T23:26:17.447

3

I used:

import org.apache.spark.sql._
val RowRDD = RDD.map(r => Row.fromSeq(r))

edited Feb 16 '16 at 23:26

answered Feb 16 '16 at 19:37

uh_big_mike_boi

3,252
3
29
59

RDD of List String convert to Row

1 Answers1

Linked