Skip columns while copying data into redshift from S3 using copy command

Question

I have a CSV table in S3 with 100's of attributes/features, I don't want to create table in RedShift with all these attributes before importing data. Is there anyway to select only the columns I need while copying data from S3 into Redshift?

Possible duplicate of [in redshift postgresql can I skip columns with the copy function](http://stackoverflow.com/questions/17055708/in-redshift-postgresql-can-i-skip-columns-with-the-copy-function) — Bruno Reis, Jun 08 '16 at 20:19

score 0 · Answer 1 · edited May 23 '17 at 11:52

0

You cannot achieve the above using just a copy command it is doable using a python script. Please go through this

Read specific columns from a csv file with csv module?

edited May 23 '17 at 11:52

Community

1
1

answered Jun 08 '16 at 20:20

error2007s

12,666
5
31
47

score 0 · Answer 2 · answered Jun 08 '16 at 21:16

0

There are couple of options listed in aws forum for this problem, take a look at https://forums.aws.amazon.com/message.jspa?messageID=432590 if they may work for you.

answered Jun 08 '16 at 21:16

Sailendra Pinupolu

950
1
9
8

Skip columns while copying data into redshift from S3 using copy command

2 Answers2

Linked