X-Git-Url: http://git.shadowcat.co.uk/gitweb/gitweb.cgi?a=blobdiff_plain;f=pod%2Fperlunicode.pod;h=12bee5c7a3932cb339bd8ec2fa466e453533d4ea;hb=dda47b01aa025c40b3278007f62051a5ef7daf60;hp=5b8d5be06cf3182e999198a980824f4a7d8786c2;hpb=e6739005830202de48080b28d51d1701a9bec0cd;p=p5sagit%2Fp5-mst-13.2.git diff --git a/pod/perlunicode.pod b/pod/perlunicode.pod index 5b8d5be..12bee5c 100644 --- a/pod/perlunicode.pod +++ b/pod/perlunicode.pod @@ -47,7 +47,8 @@ normally be used. However, as a compatibility measure, this pragma must be explicitly used to enable recognition of UTF-8 encoded literals and identifiers in the -source text. +source text on ASCII based machines or recognize UTF-EBCDIC encoded literals +and identifiers on EBCDIC based machines. =back @@ -55,7 +56,7 @@ source text. Beginning with version 5.6, Perl uses logically wide characters to represent strings internally. This internal representation of strings -uses the UTF-8 encoding. +uses either the UTF-8 or the UTF-EBCDIC encoding. In future, Perl-level operations can be expected to work with characters rather than bytes, in general. @@ -84,7 +85,7 @@ Regardless of the above, the C pragma can always be used to force byte semantics in a particular lexical scope. See L. The C pragma is primarily a compatibility device that enables -recognition of UTF-8 in literals encountered by the parser. It may also +recognition of UTF-(8|EBCDIC) in literals encountered by the parser. It may also be used for enabling some of the more experimental Unicode support features. Note that this pragma is only required until a future version of Perl in which character semantics will become the default. This pragma may @@ -104,6 +105,8 @@ bytes change to operating on characters. For ASCII data this makes no difference, because UTF-8 stores ASCII in single bytes, but for any character greater than C, the character may be stored in a sequence of two or more bytes, all of which have the high bit set. +For C1 controls or Latin 1 characters on an EBCDIC platform the character +may be stored in a UTF-EBCDIC multi byte sequence. But by and large, the user need not worry about this, because Perl hides it from the user. A character in Perl is logically just a number ranging from 0 to 2**32 or so. Larger characters encode to longer @@ -122,9 +125,9 @@ Strings and patterns may contain characters that have an ordinal value larger than 255. Presuming you use a Unicode editor to edit your program, such characters -will typically occur directly within the literal strings as UTF-8 +will typically occur directly within the literal strings as UTF-(8|EBCDIC) characters, but you can also specify a particular character with an -extension of the C<\x> notation. UTF-8 characters are specified by +extension of the C<\x> notation. UTF-X characters are specified by putting the hexadecimal code within curlies after the C<\x>. For instance, a Unicode smiley face is C<\x{263A}>. @@ -155,9 +158,12 @@ Named Unicode properties and block ranges make be used as character classes via the new C<\p{}> (matches property) and C<\P{}> (doesn't match property) constructs. For instance, C<\p{Lu}> matches any character with the Unicode uppercase property, while C<\p{M}> matches -any mark character. Single letter properties may omit the brackets, so -that can be written C<\pM> also. Many predefined character classes are -available, such as C<\p{IsMirrored}> and C<\p{InTibetan}>. +any mark character. Single letter properties may omit the brackets, +so that can be written C<\pM> also. Many predefined character classes +are available, such as C<\p{IsMirrored}> and C<\p{InTibetan}>. The +names of the C classes are the official Unicode block names but +with all non-alphanumeric characters removed, for example the block +name C<"Latin-1 Supplement"> becomes C<\p{InLatin1Supplement}>. =item * @@ -228,13 +234,13 @@ And finally, C reverses by character rather than by byte. =head2 Character encodings for input and output -[XXX: This feature is not yet implemented.] +See L. =head1 CAVEATS As of yet, there is no method for automatically coercing input and -output to some encoding other than UTF-8. This is planned in the near -future, however. +output to some encoding other than UTF-8 or UTF-EBCDIC. This is planned +in the near future, however. Whether an arbitrary piece of data will be treated as "characters" or "bytes" by internal operations cannot be divined at the current time.