This module provides access to the Unicode Character Database which defines character properties for all Unicode characters. The data in this database is based on the UnicodeData.txt file version 3.2.0 which is publically available from ftp://ftp.unicode.org/.
The module uses the same names and symbols as defined by the UnicodeData File Format 3.2.0 (see http://www.unicode.org/Public/UNIDATA/UnicodeData.html). It defines the following functions:
name) |
unichr[, default]) |
unichr[, default]) |
unichr[, default]) |
unichr[, default]) |
unichr) |
unichr) |
unichr) |
0
if no combining
class is defined.
unichr) |
unichr) |
1
if the character has been
identified as a ``mirrored'' character in bidirectional text,
0
otherwise.
unichr) |
form, unistr) |
Return the normal form form for the Unicode string unistr. Valid values for form are 'NFC', 'NFKC', 'NFD', and 'NFKD'.
The Unicode standard defines various normalization forms of a Unicode string, based on the definition of canonical equivalence and compatibility equivalence. In Unicode, several characters can be expressed in various way. For example, the character U+00C7 (LATIN CAPITAL LETTER C WITH CEDILLA) can also be expressed as the sequence U+0043 (LATIN CAPITAL LETTER C) U+0327 (COMBINING CEDILLA).
For each character, there are two normal forms: normal form C and normal form D. Normal form D (NFD) is also known as canonical decomposition, and translates each character into its decomposed form. Normal form C (NFC) first applies a canonical decomposition, then composes pre-combined characters again.
In addition to these two forms, there two additional normal forms based on compatibility equivalence. In Unicode, certain characters are supported which normally would be unified with other characters. For example, U+2160 (ROMAN NUMERAL ONE) is really the same thing as U+0049 (LATIN CAPITAL LETTER I). However, it is supported in Unicode for compatibility with existing character sets (e.g. gb2312).
The normal form KD (NFKD) will apply the compatibility decomposition, i.e. replace all compatibility characters with their equivalents. The normal form KC (NFKC) first applies the compatibility decomposition, followed by the canonical composition.
New in version 2.3.
In addition, the module exposes the following constant:
New in version 2.3.