use of alternation "|" in sed's regex

Question

I am using sed, GNU sed version 4.2.1. I want to use the alternation "|" symbol in a subexpression. For example :

echo "blia blib bou blf" | sed 's/bl\(ia|f\)//g'

should return

" blib bou "

but it returns

"blia blib bou blf".

How can I have the expected result ?

sleske · Accepted Answer · 2015-07-14T10:57:19.510

116

The "|" also needs a backslash to get its special meaning.

echo "blia blib bou blf" | sed 's/bl\(ia\|f\)//g'

will do what you want.

As you know, if all else fails, read the manual :-).

GNU sed user's manual, section 3.3 Overview of Regular Expression Syntax:

`REGEXP1\|REGEXP2'

Matches either REGEXP1 or REGEXP2.

Note the backslash...

Unfortunately, regex syntax is not really standardized... there are many variants, which differ among other things in which "special characters" need \ and which do not. In some it's even configurable or depends on switches (as in GNU grep, which you can switch between three different regex dialects).

This answer in particular is for GNU sed. There are other sed variants, for example the one used in the BSDs, which behave differently.

edited Jul 14 '15 at 10:57

answered Feb 22 '10 at 14:36

sleske

23,107

39

For anyone else confused by this answer | only works in gnu sed (gsed on os x) not vanilla sed (sed on os x). – Andrew Hancox Apr 04 '12 at 14:54
@AndrewHancox Thank you so much! I was about to rip all of the hair out of my head (and so far I'm doing pretty good compared to my manager on the hair-front) - I know I know RegEx enough to try | and | but I never thought about the fact that OSX might actually use a non-gnu sed. – phatskat Feb 01 '13 at 20:03
12

The standard BSD/OS X version of sed does support alternation, but only with "extended" regex syntax (-E) - which means no backslashes on either the pipes or the parentheses: echo "blia blib bou blf" | sed -E 's/bl(ia|f)//g' – Mark Reed Sep 30 '14 at 17:42
2

I edited my answer to note that it's for GNU sed only. – sleske Jul 14 '15 at 10:57

score 28 · Answer 2 · answered May 28 '13 at 18:56

Since there are several comments regarding non-Gnu sed implementations: At least on OS X, you can use the -E argument to sed:

Interpret regular expressions as extended (modern) regular expressions rather than basic regular expressions (BRE's). The re_format(7) manual page fully describes both formats.

Then you can use regular expression metacharacters without escaping them. Example:

$ echo "blia blib bou blf" | sed -E 's/bl(ia|f)//g'
 blib bou

score 15 · Answer 3 · answered Feb 18 '14 at 09:03

15

GNU sed also supports the -r option (extended regular expressions). This means you don't have to escape the metacharacters:

echo foohello barhello | sed -re "s/(foo|bar)hello/hi/g"

Output:

hi hi

answered Feb 18 '14 at 09:03

jco

253

Yes, -r option is really really helpful for the readability of the expressions. That should be the accepted answer. – рüффп Oct 05 '16 at 09:01

score 9 · Answer 4 · edited May 28 '13 at 18:36

9

The \| does not work with sed on Solaris 10 either. What I did was use

perl -p -e 's/bl(ia|f)//g'

edited May 28 '13 at 18:36

Oliver Salzburg

87,539
63
263
308

answered May 28 '13 at 17:42

Joe Tennies

91

2

+1 for portability since, if a system has perl, it will always use this syntax, unlike sed. – evilsoup May 30 '13 at 01:30

score 4 · Answer 5 · answered Aug 28 '13 at 20:15

4

Followup: sed -E allows it on MacOS. No backslash need for |.

 sed -E 's/this|orthat/oooo/g' infile

answered Aug 28 '13 at 20:15

some ideas

1,278

twobob · Answer 6 · 2018-07-09T13:40:03.053

1

In the GnuWin32 on Windows sed the syntax is sed "s/thing1\|thing2/ /g" source > destination.

The quotes must of type " - this is "Required" for the command to be parsed.

edited Jul 09 '18 at 13:40

answered Feb 18 '16 at 04:19

twobob

419

use of alternation "|" in sed's regex

6 Answers6