awk - how to delete first column with field separator

Question

I have a csv file with data presented as follows

87540221|1356438283301|1356438284971|1356438292151697
87540258|1356438283301|1356438284971|1356438292151697
87549647|1356438283301|1356438284971|1356438292151697

I'm trying to save the first column to a new file (without field separator , and then delete the first column from the main csv file along with the first field separator.

Any ideas?

This is what I have tried so far

awk 'BEGIN{FS=OFS="|"}{$1="";sub("|,"")}1'

but it doesn't work

What about cut? `cut -d '|' -f 2-` – squiguy May 08 '13 at 18:58 — squiguy, May 08 '13 at 18:58

score 17 · Answer 1 · answered May 08 '13 at 19:00

This is simple with cut:

$ cut -d'|' -f1 infile
87540221
87540258
87549647

$ cut -d'|' -f2- infile
1356438283301|1356438284971|1356438292151697
1356438283301|1356438284971|1356438292151697
1356438283301|1356438284971|1356438292151697

Just redirect into the file you want:

$ cut -d'|' -f1 infile > outfile1

$ cut -d'|' -f2- infile > outfile2 && mv outfile2 file

score 7 · Accepted Answer · answered May 08 '13 at 18:59

7

Assuming your original CSV file is named "orig.csv":

awk -F'|' '{print $1 > "newfile"; sub(/^[^|]+\|/,"")}1' orig.csv > tmp && mv tmp orig.csv

answered May 08 '13 at 18:59

Ed Morton

172,331
17
70
167

3

`awk` solution works x20 times faster than `cut`. Tested on 15Gb CSV file. – Kirzilla Jun 05 '14 at 14:38
2

I'd never have expected that. Thanks for the info. – Ed Morton Jun 05 '14 at 14:50

Zombo · Answer 3 · 2014-12-26T06:14:49.403

2

GNU awk

awk '{$1="";$0=$0;$1=$1}1' FPAT='[^|]+' OFS='|'

Output

1356438283301|1356438284971|1356438292151697
1356438283301|1356438284971|1356438292151697
1356438283301|1356438284971|1356438292151697

edited Dec 26 '14 at 06:14

answered Nov 18 '14 at 06:20

Zombo

1
55
342
375

score 1 · Answer 4 · answered May 08 '13 at 19:00

Pipe is special regex symbol and sub function expectes you to pass a regex. Correct awk command should be this:

awk 'BEGIN {FS=OFS="|"} {$1=""; sub(/\|/, "")}'1 file

OUTPUT:

1356438283301|1356438284971|1356438292151697
1356438283301|1356438284971|1356438292151697
1356438283301|1356438284971|1356438292151697

score 0 · Answer 5 · answered Nov 18 '14 at 14:49

0

With sed :

sed 's/[^|]*|//' file.txt

answered Nov 18 '14 at 14:49

rook

5,292
4
36
50

awk - how to delete first column with field separator

5 Answers5

Linked

Related