Flatten nested pandas dataframe

Question

I'm wondering how to flatten the nested pandas dataframe as demonstrated in the picture attached.

The nested attribute is given by 'data' field. In short: I have a list of participants (denoted by 'participant_id') and they submitted responses ('data') at different times. I need to create the wide dataframe, where for each participant at each time stamp there is a row of records of their data ('q1', 'q2',...,'summary')

Many thanks in advance!

Please dont use png for data or table. – Merlin Jul 25 '16 at 19:08 — Merlin, Jul 25 '16 at 19:08
@Merlin, thanks, I didn't know that. – Arnold Klein Jul 26 '16 at 08:35 — Arnold Klein, Jul 26 '16 at 08:35

score 7 · Accepted Answer · answered Jul 25 '16 at 18:10

7

Try this:

pd.concat([df.data.apply(pd.Series), df.drop('data', axis=1)], axis=1)

answered Jul 25 '16 at 18:10

piRSquared

265,629
48
427
571

2

But the columns names are 0 ,1 and etc. and 0 wil have {"q1": "me"}, Instead can we get column name as "q1" and that value as "me" ? @piRSquared – 7H3 IN5ID3R Aug 16 '17 at 11:49

Flatten nested pandas dataframe

1 Answers1

Linked