# Revision history for Perl extension Encode.
#
-# $Id: Changes,v 1.89 2003/02/28 01:40:27 dankogai Exp dankogai $
+# $Id: Changes,v 2.10 2005/05/16 18:46:36 dankogai Exp dankogai $
#
-$Revision: 1.89 $ $Date: 2003/02/28 01:40:27 $
+$Revision: 2.10 $ $Date: 2005/05/16 18:46:36 $
+! Encode.pm
+ fixed decode_utf8() accordingly to RT#8872
+ http://rt.cpan.org/NoAuth/Bug.html?id=8872
+! Encode.xs AUTHORS
+ s/SvIVX/SvIV_set/ by Steve Peters.
+ Message-Id: <2297.67.96.185.36.1114626315.squirrel@webmail3.pair.com>
+! AUTHORS
+ GAAS was missing!
+! Encode.pm
+ New Pod section: "UTF-8 vs utf8"; explains utf-8-strict
++ t/utf8strict.t
+ Tests utf-8-strict, accordingly to
+ UTF-8 decoder capability and stress test" by Markus Kuhn
+ http://smontagu.damowmow.com/utf8test.html
+ Note that malformed and overlong sequences are not test here
+ because perl already does that for you, utf-8-strict or not.
+! Encode.pm Encode/encode.h t/fallback.t
+ Addressed "encode(..., Encode::LEAVE_SRC) does not work".
+ Now FB_(PERLQQ|HTMLCREF|XMLCREF) implies LEAVE_SRC so
+ you can (en|de)code constant strings with these fallbacks.
+ http://rt.cpan.org/NoAuth/Bug.html?id=8736
+! Encode.pm Encode.xs lib/Encode/Alias.pm t/Aliases.t
+ Make Encode.pm support the real UTF-8, by GAAS
+ Message-Id: <lrfz2mcngd.fsf@caliper.activestate.com>
+ Message-Id: <lr4qizbvvm.fsf@caliper.activestate.com>
+! Encode.pm Encode.xs
+ post-2.09 comment patches from GAAS applied.
+ Message-Id: <lroehacz6q.fsf@caliper.activestate.com>
+ Message-Id: <lrk6rycymu.fsf@caliper.activestate.com>
+
+2.09 2004/12/03 19:16:53
+! Encode.pm Encode.xs
+ Addressed " :encoding(utf8) broken in perl-5.8.6".
+ Message-Id: <lrllcfeank.fsf_-_@caliper.activestate.com>
+! Encode.pm
+ Addressed "(de|en)code($valid_encoding, undef) does not warn".
+ http://rt.cpan.org/NoAuth/Bug.html?id=8723
+! Encode.pm t/Encode.t
+ Addressed "Can't encode URI". When a reference is fed to (en|de)code,
+ Encode now stringifies instead of returning undef.
+ http://rt.cpan.org/NoAuth/Bug.html?id=8725
+! Encode.xs t/fallback.t
+ Addressed "FB_HTMLCREF and FB_XMLCREF for the UTF-8 decoder".
+ http://rt.cpan.org/NoAuth/Bug.html?id=8694
+! Encode.pm
+ Addressed "s/digit/number/".
+ http://rt.cpan.org/NoAuth/Bug.html?id=8695
+! Encode.pm
+ Addressed "while (defined(read )) { ... } is an infinite loop".
+ http://rt.cpan.org/NoAuth/Bug.html?id=8696
+! Encode.pm
+ Addressed "What the heck is UCM?".
+ Document fixed so that it no longer contains "UCM-Based Encodings".
+ http://rt.cpan.org/NoAuth/Bug.html?id=8697
+
+2.08 2004/10/24 13:00:29
+! Encode.xs lib/Encode/Encoding.pm Unicode/Unicode.{pm,xs}
+ Resolved the issue that was raised by 2.07 -- Encode::utf8 fallbacks
+ that was introduce messed up PerlIO::encoding.
+ * To do so, ->renew() is renewed and ->renewed() was introduced to
+ tell whether the caller is PerlIO or not.
+ Message-Id: <94B2EB12-25B7-11D9-9E6A-000A95DBB50A@dan.co.jp>
+
+2.07 2004/10/22 19:35:52
+! lib/Encode/Encoding.pm
+ "Remove Carp from warnings.pm" that influences Encode, by Tels.
+ Message-Id: <200410161618.29779@bloodgate.com>
+! Encode.xs AUTHORS t/fallback.t
+ Now Encode::utf8's fallbacks are compliant to Encode standard.
+ Thank Bjoern Hoehrmann for persistently convincing me.
+ Message-Id: <41a61aea.638409494@smtp.bjoern.hoehrmann.de>
+! Encode.pm
+ POD further revised.
+
+2.06 2004/10/22 06:23:11
+! ucm/mac*
+ RT #8083 reports that MacThai mapping was obsolete
+ Updated all mac* encodings accordingly to the URI below.
+ One remaining mystery is that MacRomanian vs. MacRumanian.
+ MacRumanian is not found in unicode.org...
+ http://www.unicode.org/Public/MAPPINGS/VENDORS/APPLE/
+! Encode.pm t/Encode.t
+ Fixed RT #8081: "decode(..., bless{},'x') segfault"
+ Two more tests added to test that.
+ http://rt.cpan.org/NoAuth/Bug.html?id=8081
+! Encode.pm
+ POD revised accordingly to RT #7966
+ http://rt.cpan.org/NoAuth/Bug.html?id=7966
+! Unicode/Unicode.pm
+ POD updated explaining why Encode::Unicode always croaks on error
+ rather than giving users choices.
+ http://rt.cpan.org/NoAuth/Bug.html?id=7892
+
+2.05 2004/10/19 04:55:01
+! encoding.pm
+ "unnuke" jhi's patch in bleedperl, with minor correction by dankogai.
+ Message-ID: <41210A84.6060506@iki.fi>
+ Message-ID: <20041018233442.7418113f@r2d2>
+ Message-Id: <2BA3DAC4-218A-11D9-906D-000A95DBB50A@dan.co.jp>
+
+2.04 2004/10/16 21:22:44
+! Makefle.PL
+ From: craigberry@mac.com
+ Subject: [PATCH ext/Encode/Makefile.PL] make Encode.c dependency explicit
+ Message-Id: <41716868.7000102@mac.com>
+
+2.03 2004/10/06 05:07:20
+! lib/Encode/Alias.pm
+ Resolved some alias case sensitivity glitches reported via RT.
+ http://rt.cpan.org/NoAuth/Bug.html?id=7835
+! bin/piconv
+ Resolved Win32 glitches reported via RT.
+ (Fixed by dankogai and tested by Steve Hay)
+ http://rt.cpan.org/Ticket/Display.html?id=7831
+! JP/JP.pm lib/Encode/Alias.pm lib/Encode/Supported.pod AUTHORS
+ /\bwindows-31j$/i is now an alias of CP932, by Steve Hay.
+ http://rt.cpan.org/NoAuth/Bug.html?id=6695
+
+2.02 2004/08/31 10:55:34
+! ucm/big5-hkscs.ucm AUTHORS t/big5-hkscs.enc t/big5-hkscs.utf
+ New map submitted by Deng Liu and Autrijus. Test data needed
+ to be upgrade as well, done by dankogai
+ Message-Id: <20040824204828.GB6999@aut.dyndns.org>
+! bin/ucmsort
+ Now works for characters U+10000 and above. This fix was needed
+ to "tidy" the original map that was submitted.
+! bin/enc2xs
+ "ucmsort" now mentioned in pod
+
+2.01 2004/05/25 16:27:14
+! bin/enc2xs AUTHORS
+ From: domo@computer.org
+ Subject: [PATCH] Correct statistics from enc2xs
+ <4AF60A4A-B8BB-11D8-BF99-000A27839BD6@computer.org>
+ <CDEBBD45-B91D-11D8-BF99-000A27839BD6@computer.org>
+! lib/Encode/Alias.pm
+ Addressed "False [] range "\s-" in regex;" in Encode::Alias.pm
+ <200405271148.i4RBm4KY026529@mail.mvnet.de>
+
+2.01 2004/05/25 16:27:14
+! lib/Encode/CN/HZ.pm lib/Encode/Unicode/UTF7.pm
+ "If someone thinks utf8::upgrade($1) should be croaked like
+ chom?p($1),please try the following patch for Encode.pm."
+ -- sadahiro-san
+ <20040522212704.C068.BQW10602@nifty.com>
+
+2.0 2004/05/16 20:55:15
+* version updated to 2.00
+ -- sorry, no big feature change. I just hate version 1.100 :)
+! lib/Encode/Guess.pm
+ Unicode/Unicode.pm
+ addressed UTF-(8|32LE) + BOM misguessing
+ https://rt.cpan.org/Ticket/Display.html?id=6279
+! Encode.pm
+ s/is_utif8/is_utf8/ in POD
+! Encode/lib/Encode/CN/HZ.pm
+ Fixes "make test" failure after the patch to pp_hot.c
+ by Sadahiro-san
+ Message-Id: <20040222182357.6B39.BQW10602@nifty.com>
+! bin/piconv
+ From: autrijus@autrijus.org
+ Subject: [PATCH] "piconv -C 512" badly broken
+ Message-Id: <1072870210.769.5.camel@localhost>
+
+1.99 2003/12/29 02:47:16
+! Unicode/Unicode.xs
+ find_encoding("UTF-16BE")->encode("abc") now null terminates
+ http://www.mail-archive.com/perl5-porters@perl.org/msg69766.html
+! Encode.pm
+ prototype bug in decode_utf8() fixed
+ Message-Id: <600A4CDA-F004-11D7-B570-000393AE4244@dan.co.jp>
+! Encode.pm /MANIFEST encoding.pm lib/Encode/Supported.pod
+ t/at-cn.t t/at-tw.t t/gsm0338.t ucm/gsm0338.ucm
++ t/gsm0338.t
+ Merged from maintperl@21987
+
+1.98 2003/08/20 11:15:31
+! lib/Encode/MIME/Header.pm AUTHORS t/mime-header.t
+ Dave Evans has found and corrected a bug in Encode::MIME::Header.
+ Test suite added by Dan Kogai.
+ Message-Id: <3F43440B.7060606@rudolf.org.uk>
+! encoding.pm
+ Typo fixes rolled back in from bleedperl
+! t/at-cn.t t/at-tw.t
+ v-strings, now depreciated in perl 5.8.1, is replaced by sadahiro
+ Message-Id: <20030805002313.9880.BQW10602@nifty.com>
+! bin/enc2xs
+ argv case nit for VMS by Craig
+ Message-ID: <3F2B02DE.10207@mac.com>
+! t/enc_eucjp.t t/enc_utf8.t AUTHORS
+ Encode test fixes for VMS by Peter Prymmer
+ Message-ID: <OFBD4A7559.D7CF9517-ON85256D6B.00534853-85256D6B.00538131@factset.com>
+! lib/Encode/Alias.pm t/Aliases.t
+ koi-8 aliases bug detected and patched by sadahiro.
+ Further fix and test suite by dankogai
+ Message-Id: <20030713102228.C76A.BQW10602@nifty.com>
+
+1.97 2003/07/08 21:52:14
+! encoding.pm lib/Encode/Guess.pm lib/Encode/Alias.pm
+ lib/Encode/JP/JIS7.pm lib/Encode/Encoder.pm Encode.pm
+ $DEBUG replaced with DEBUG() so perl optimizes better,
+ by Rafael with further fixes by dankogai
+ Message-Id: <20030705222023.1f24e041.rgarciasuarez@free.fr>
+! lib/Encode/Aliases.pm
+ Was: define_alias( qr/\bGB[-_ ]?2312(?:\D.*$|$)/i => '"euc-cn"' );
+ Now: define_alias( qr/\bGB[-_ ]?2312(?!-?raw)/i => '"euc-cn"' );
+ So new hash seeding introduced in bleedperl works.
+ Message-Id: <20030629100937.GD20285@vipunen.hut.fi>
+! lib/Encode/Guess.pm
+ $Encode::Guess::NoUTFAutoGuess is added so you can turn off
+ automatic utf(8|16|32) guessing -- originally by Autrijus
+ Message-Id: <20030626162731.GA2077@not.autrijus.org>
+! Encode.pm
+ Addressed the following;
+ Subject: [perl #22835] FB_QUIET doesn't work with Encode::encode
+ Message-Id: <rt-22835-59975.6.8650775354304@rt.perl.org>
+
+1.96 2003/06/18 09:29:02
+! lib/Encode/JP/JP.pm t/guess.t
+ m/(...)/ in void context then $1 is considered a Bad Thing
+ Message-Id: <B5AB34D0-A019-11D7-AF03-000393AE4244@dan.co.jp>
+! Encode.pm
+ Mentions in POD that as of perl 5.8.1 utf8::is_utf8() is
+ also available.
+! encengine.c
+ More typecast from maintperl@19739
+ Message-Id: <200306110645.h5B6j5D2009640@smtp3.ActiveState.com>
+! t/perlio.t
+ Tests 37 & 38 failed on Win32 -- yet another CRLF issue
+ Message-Id: <200306090733.h597XQPA031646@smtp3.ActiveState.com>
+! t/Encode.t
+ Now skips for EBCDIC platform.
+ Message-Id: <OF44B38062.A3998148-ON80256D27.004CF379@portsmouth.uk.ibm.com>
+! t/perlio.t
+ Craig's patch applied that addresses "Many systems (DOS, VMS) cannot
+ have more than one C<.> in their filenames." -- perlport.
+ Message-Id: <3ED79E01.8050401@mac.com>
+! bin/piconv
+ Found and fixed the back that -p,--perlqq does not work.
+ Induced by the change from Getopt::Std to Getopt::Long.
+! encoding.pm
+ Addressed [cpan #2629] Wrong assumption in numeric comparison
+ Message-Id: <rt-2629-7326.19.5700583232515@cpan.org>
+! Encode.pm Encode.xs Unicode/Unicode.pm Unicode/Unicode.xs
+ lib/Encode/Encoding.pm t/perlio.t
+ ! API Change: ->new_sequence() => ->renew()
+ + Encode::Unicode makes use of it so it can handle BOM on PerlIO
+ + Encode::XS and Encode::utf8 now supports ->renew()
+ + Encode::Encoding now documents this with examples
+ - Non-XS (en|de)code stripped out of Encode::Unicode
+ Message-Id: <146957DB-8C39-11D7-9C91-000393AE4244@dan.co.jp>
+
+1.95 2003/05/21 08:41:11
+! ucm/8859-*.ucm
+ Since bogus entries were found in iso-8859-6, all entries are
+ re-generated once again out of
+ http://www.unicode.org/Public/MAPPINGS/ISO8859/8859-*.TXT
+ Thank David Graff <graff@unagi.cis.upenn.edu> for the discovery
+ Message-Id: <200305201819.h4KIJRRU013746@unagi.cis.upenn.edu>
++ lib/Encode/Unicode/UTF7.pm
+! lib/Encode/Config.pm lib/Encode/Alias.pm Unicode/Unicode.pm t/Unicode.t
+ lib/Encode/Supported.pod
+ UTF-7 support is now added. With this Encode now has all transcoding
+ methods in Unicode::String.
+
+1.94 2003/05/10 18:13:59
+! lib/Encode/MIME/Header.pm
+ A more sophisticated solution for double-encoding by dankogai
+! lib/Encode/MIME/Header.pm AUTHORS
+ Two bugs fixed by Bjoern Jacke
+ * "Double Encoding" was not possible
+ i.e. encode("MIME-B" => "=?UTF-8?B?w4RwZmVs?=")
+ * encode("MIME-Q") had UTF-8 flag on
+ Message-Id: <rt-22166-57077.2.12980078979811@bugs6.perl.org>
+! lib/Encode/MIME/Header.pm AUTHORS
+ Two occurances of "croak ()" fixed as "croak qq()".
+ Simon Cozens is added to AUTHORS as a result.
+ Message-Id: <20030509103708.GA30664@deep-dark-truthful-mirror.pad>
+! bin/piconv
+ POD fixes that reflect enhancements by jhi
+! bin/piconv
+ Two enhancements by jhi.
+ + Now uses Getopt::Long so it accepts long name options
+ (--from for -f, for example)
+ + New option: -r,--resolve
+ Message-Id: <20030505114149.GA227075@kosh.hut.fi>
+! MANIFEST META.yml
+ META.yml added upon request of Schwern
+ Message-Id: <F3B0BD2C-7BCB-11D7-A488-000393AE4244@dan.co.jp>
+! AUTHORS
+ Enache Adrian removed upon request -- to live longer than Encode
+ and/or FreeBSD (toy-)?thread :)
+ Message-Id: <20030425015701.GA2069@ratsnest.hole>
+! t/enc_module.t
+ "close STDOUT unless $^O eq 'freebsd';" once again relocated
+ to keep VMS happy in which case "$^O eq 'freebsd'" is required
+ to keep FreeBSD+thread happy. Sigh.
+ Message-Id: <3EA88ADC.3000300@mac.com>
+
+1.93 2003/04/24 17:43:16
+! t/enc_eucjp.t
+ added "no warnings 'pack'" in for loop to keep bleedperl from
+ complaining "Character in 'C' format wrapped in pack".
+! Makefile.PL
+ More elegant perl core detection inspired by Ilya Zakharevich
+ (but further elaborated for general cases).
+! lib/Encode/Encoding.pm lib/Encode/PerlIO.pod
+ POD fixes.
+! t/euc-jp.ucm
+ like cp9??, \x80-\x9F (control + 0x80) are zapped so they
+ are less likely to be confused w/ ISO-8859-*
+! t/CJKT.t
+ RT tests added (vendor encodings are exemplified)
+ -- that successfully found a flaw on iso-2022-kr before the patch.
+! lib/Encode/CJKConstants.pm lib/Encode/KR/2022_KR.pm
+ decode("ISO-2022-KR") has been buggy but no one ever sited
+ that since no one seems to be using it. Bugs discovered by
+ SADAHIRO-san
+ Message-Id: <20030416231757.A545.BQW10602@nifty.com>
+! lib/Encode/CN/HZ.pm t/perlio.t
+ HZ is now perlio_ok, thanks to SADAHIRO-san. perlio.t modified
+ so it adds test for HZ.
+ Message-Id: <20030416231757.A545.BQW10602@nifty.com>
+! lib/Encode/Guess.pm
+ Now guesses UTF-(16|32)(BE|LE) when the string contains \x00.
+ So long as the string contains \x{00}-\x{ff} it does not fail.
+ See perldoc for details.
+ Message-Id: <D2F9BB3C-6DC8-11D7-8F19-000393AE4244@dan.co.jp>
+
+1.92 2003/03/31 03:27:27
+! ucm/big5-eten.ucm ucm/big5-hkscs.ucm
+ Extraneous single-byte chars in range \x80-\xA0 and \xFA-\xFF
+ removed. FYI, IBM's ICU has none of these for java-Big5-1.3_P.ucm
+ but glibc-BIG5-2.1.2.ucm does.
+ Message-Id: <20030325215213.4CA1.BQW10602@nifty.com>
+! ucm/cp932.ucm ucm/cp936.ucm ucm/cp949.ucm ucm/cp950.ucm
+ Maps regenerated again but this time based upon
+ http://oss.software.ibm.com/cvs/icu/charset/data/ucm/
+ (But where is THE DOCUMENT by MICROSOFT?)
+! t/enc_module.t AUTHORS
+ failure with threaded Perl on FreeBSD addressed.
+ Enache Adrian <enache@rdslink.ro> is added to AUTHORS for this.
+ Message-Id: <20030322230131.GA813@ratsnest.hole>
+! lib/Encode/Guess.pm
+ Some POD fixes.
+! t/CJKT.t
+ Change 18989: Make the :bytes conditional on PerlIO.
+ further Modified by Dan Kogai
+ <200303161730.h2GHU5B16265@smtp3.ActiveState.com>
+! t/enc_module.t
+ Chnage 18966: another fix for failing test on windows ("use encoding"
+ puts STDIN in :raw mode, so chomp() wasn't stripping the CR), by gsar
+ Message-Id: <200303140545.h2E5j5B08856@smtp3.ActiveState.com>
+! t/CJKT.t
+ Change 18970: Hopefully this works also in Win32, by jhi
+ Message-Id: <200303140745.h2E7j6B22729@smtp3.ActiveState.com>
+ Change 18965: fix CJKT.t failures on windows due to incorrect
+ binmode(), by gsar
+ Message-Id: <200303140530.h2E5U5B07046@smtp3.ActiveState.com>
+
+1.91 2003/03/09 20:07:37
+! encoding.pm
+ even more proofread by jhi.
+ Message-Id: <20030309194323.GT20843@kosh.hut.fi>
+! t/enc_module.t
+ -use lib 't';
+ +use lib qw(t ext/Encode/t ../ext/Encode/t);
+ Message-Id: <20030309182057.GR20843@kosh.hut.fi>
+! AUTHORS
+ s/Hirohito/Hiroto/ig; Sorry, Hiroto-san.
+ Message-Id: <20030309181748.GP20843@kosh.hut.fi>
+! encoding.pm
+ s/logner/longer/
+ Message-Id: <20030309181907.GQ20843@kosh.hut.fi>
+
+1.90 2003/03/09 17:32:43
+! encoding.pm
++ t/enc_data.t
+ Inaba-san has added a patch for perl 5.8.1 or later that makes
+ encoding.pm work for <DATA> filehandle. t/enc_data.t is to test
+ that. POD is further revised.
+ Message-Id: <200303091515.h29FF6B03903@smtp3.ActiveState.com>
+! encoding.pm t/enc_module.t
+ encoding vs. ${^UNICODE} resolved. POD revised accordingly.
+ Message-Id: <20030306112940.GN20652@kosh.hut.fi>
+
+1.89 2003/02/28
! Encode.xs
signed vs. unsigned issue discovered by Craig on OpenVM
Message-Id: <a05200f12ba81fe9d6298@[172.16.52.1]>