Metacharacter
A metacharacter is a character that has a special meaning to a computer program, such as a shell interpreter or a regular expression (regex) engine.
In POSIX extended regular expressions,[1] there are 14 metacharacters that must be escaped (preceded by a backslash (\
)) in order to drop their special meaning and be treated literally inside an expression: opening and closing square brackets ([
and ]
); backslash (\
); caret (^
); dollar sign ($
); period/full stop/dot (.
); vertical bar/pipe symbol (|
); question mark (?
); asterisk (*
); plus and minus signs (+
and -
); opening and closing curly brackets/braces ({
and }
); and opening and closing parentheses ((
and )
).[2][3]
For example, to match the arithmetic expression (1+1)*3=6
with a regex, the correct regex is \(1\+1\)\*3=6
; otherwise, the parentheses, plus sign, and asterisk will have special meanings.
Other examples
Some other characters may have special meaning in some environments.
- In some Unix shells the semicolon (";") is a statement separator.
- In XML and HTML, the ampersand ("&") introduces an HTML entity.[4] It also has special meaning in MS-DOS/Windows Command Prompt.[5]
- In some Unix shells and MS-DOS/Windows Command Prompt, the less-than sign and greater-than sign ("<" and ">") are used for redirection and the grave accent/backquote ("`") is used for command substitution.[5]
- In many programming languages, strings are delimited using quotes (" or '). In some cases, escape characters (and other methods) are used to avoid delimiter collision, e.g. "He said, \"Hello\"".
- In printf format strings, the percent sign ("%") is used to introduce format specifiers and must be escaped as "%%" to be interpreted literally.[6] In SQL, the percent is used as a wildcard character.[7]
- In SQL, the underscore ("_") is used to match any single character.[7]
Escaping
The term "to escape a metacharacter" means to make the metacharacter ineffective (to strip it of its special meaning), causing it to have its literal meaning. For example, in PCRE, a dot (".") stands for any single character. The regular expression "A.C" will match "ABC", "A3C", or even "A C". However, if the "." is escaped, it will lose its meaning as a metacharacter and will be interpreted literally as ".", causing the regular expression "A\.C" to only match the string "A.C".
The usual way to escape a character in a regex and elsewhere is by prefixing it with a backslash ("\"). Other environments may employ different methods, like MS-DOS/Windows Command Prompt, where a caret ("^") is used instead.[5]
See also
References
- "The Open Group Base Specifications Issue 6: Ch. 9 – Regular Expressions". pubs.opengroup.org. The Open Group. 2004. Retrieved 2018-11-19.
- Goyvaerts, Jan (December 8, 2016). "Regular Expressions Quick Start". www.regular-expressions.info. Retrieved 2018-11-19.
- Nield, Thomas (December 13, 2017). "An introduction to regular expressions". O'Reilly Media. Retrieved 2018-11-19.
- "Character entity references in HTML 4". www.w3.org. W3C. December 24, 1999. Retrieved 2018-11-19.
- "Command shell overview". docs.microsoft.com. Microsoft. September 10, 2009. Retrieved 2018-11-19.
- "The Open Group Base Specifications Issue 7: fprintf". pubs.opengroup.org. The Open Group. 2018. Retrieved 2018-11-19.
- "LIKE (Transact-SQL)". docs.microsoft.com. Microsoft. March 14, 2017. Retrieved 2018-11-19.