X-Git-Url: http://git.shadowcat.co.uk/gitweb/gitweb.cgi?a=blobdiff_plain;f=pod%2Fperltodo.pod;h=dab73b90c085735ead09a116b56b301975aaee51;hb=0661e9a4f58f56c330261e7c3fa4dc38e42204b1;hp=4b2ed48a09c0345cea9bc2f00ceb28ef85390824;hpb=87275199ef473a0bd08ce6f46db30d4d432f4876;p=p5sagit%2Fp5-mst-13.2.git diff --git a/pod/perltodo.pod b/pod/perltodo.pod index 4b2ed48..dab73b9 100644 --- a/pod/perltodo.pod +++ b/pod/perltodo.pod @@ -4,8 +4,7 @@ perltodo - Perl TO-DO List =head1 DESCRIPTION -This is a list of wishes for Perl. It is maintained by Nathan -Torkington for the Perl porters. Send updates to +This is a list of wishes for Perl. Send updates to I. If you want to work on any of these projects, be sure to check the perl5-porters archives for past ideas, flames, and propaganda. This will save you time and also prevent you @@ -14,905 +13,793 @@ of archives may be found at: http://www.xray.mpe.mpg.de/mailing-lists/perl5-porters/ +=head1 To do during 5.6.x -=head1 Infrastructure +=head2 Support for I/O disciplines -=head2 Mailing list archives - -Chaim suggests contacting egroup and asking them to archive the other -perl.org mailing lists. Probably not advocacy, but definitely -perl6-porters, etc. - -=head2 Bug tracking system - -Richard Foley I is writing one. We looked at -several, like gnats and the Debian system, but at the time we -investigated them, none met our needs. Since then, Jitterbug has -matured, and may be worth reinvestigation. - -The system we've developed will eventually be recipient of perlbug -mail. New bugs are entered into a mysql database, and sent on to -perl5-porters with the subject line rewritten to include a "ticket -number" (unique ID for the new bug). If the incoming message already -had a ticket number in the subject line, then the message is logged -against that bug. There is a separate email interface (not forwarding -to p5p) that permits porters to claim, categorize, and close tickets. - -The next desire is a web interface. It is hoped that code can be -reused between the mail and the web interfaces. - -The current delay in implementation is caused by perl.org lockups. -One suspect is the mail handling system, possibly going into loops. - -We're probably going to need a bugmaster, someone who will look at -every new "bug" and kill those that we already know about, those -that are not bugs at all, etc. - -=head2 Regression Tests +C provides this, but the interface could be a lot more +straightforward. -The test suite for Perl serves two needs: ensuring features work, and -ensuring old bugs have not been reintroduced. Both need work. +=head2 Eliminate need for "use utf8"; -Brent LaVelle (lavelle@metronet.com) has stepped forward to work on -performance tests and improving the size of the test suite. +While the C pragma is autoloaded when necessary, it's still needed +for things like Unicode characters in a source file. The UTF8 hint can +always be set to true, but it needs to be set to false when F +is being compiled. (To stop Perl trying to autoload the C +pragma...) -=over 4 +=head2 Create a char *sv_printify(sv, STRLEN *lenp, UV flags) -=item Coverage +For displaying PVs with control characters, embedded nulls, and Unicode. +This would be useful for printing warnings, or data and regex dumping, +not_a_number(), and so on. -Do the tests that come with Perl exercise every line (or every block, -or ...) of the Perl interpreter, and if not then how can we make them -do so? +Requirements: should handle both byte and UTF8 strings. isPRINT() +characters printed as-is, character less than 256 as \xHH, Unicode +characters as \x{HHH}. Don't assume ASCII-like, either, get somebody +on EBCDIC to test the output. -=item Regression +Possible options, controlled by the flags: +- whitespace (other than ' ' of isPRINT()) printed as-is +- use isPRINT_LC() instead of isPRINT() +- print control characters like this: "\cA" +- print control characters like this: "^A" +- non-PRINTables printed as '.' instead of \xHH +- use \OOO instead of \xHH +- use the C/Perl-metacharacters like \n, \t +- have a maximum length for the produced string (read it from *lenp) +- append a "..." to the produced string if the maximum length is exceeded +- really fancy: print unicode characters as \N{...} -No bug fixes should be made without a corresponding testsuite addition. -This needs a dedicated enforcer, as the current pumpking is either too -lazy or too stupid or both and lets enforcement wander all over the -map. :-) +=head2 Autoload byte.pm -=item __DIE__ +When the lexer sees, for instance, C, it should +automatically load the C pragma. -Tests that fail need to be of a form that can be readily mailed -to perlbug and diagnosed with minimal back-and-forth's to determine -which test failed, due to what cause, etc. +=head2 Make "\u{XXXX}" et al work -=item suidperl +Danger, Will Robinson! Discussing the semantics of C<"\x{F00}">, +C<"\xF00"> and C<"\U{F00}"> on P5P I lead to a long and boring +flamewar. -We need regression/sanity tests for suidperl +=head2 Overloadable regex assertions -=item The 25% slowdown from perl4 to perl5 +This may or may not be possible with the current regular expression +engine. The idea is that, for instance, C<\b> needs to be +algorithmically computed if you're dealing with Thai text. Hence, the +B<\b> assertion wants to be overloaded by a function. -This value may or may not be accurate, but it certainly is -eye-catching. For some things perl5 is faster than perl4, but often -the reliability and extensability have come at a cost of speed. The -benchmark suite that Gisle released earlier has been hailed as both a -fantastic solution and as a source of entirely meaningless figures. -Do we need to test "real applications"? Can you do so? Anyone have -machines to dedicate to the task? Identify the things that have grown -slower, and see if there's a way to make them faster. +=head2 Unicode collation and normalization -=back +Simon Cozens promises to work on this. -=head1 Configure + Collation? http://www.unicode.org/unicode/reports/tr10/ + Normalization? http://www.unicode.org/unicode/reports/tr15/ -Andy Dougherty maintain(ed|s) a list of "todo" items for the configure -that comes with Perl. See Porting/pumpkin.pod in the latest -source release. +=head2 Unicode case mappings -=head2 Install HTML + Case Mappings? http://www.unicode.org/unicode/reports/tr21/ -Have "make install" give you the option to install HTML as well. This -would be part of Configure. Andy Wardley (certified Perl studmuffin) -will look into the current problems of HTML installation--is -'installhtml' preventing this from happening cleanly, or is pod2html -the problem? If the latter, Brad Appleton's pod work may fix the -problem for free. +=head2 Unicode regular expression character classes -=head1 Perl Language +They have some tricks Perl doesn't yet implement. -=head2 our ($var) + http://www.unicode.org/unicode/reports/tr18/ -Declare global variables (lexically or otherwise). +=head2 use Thread for iThreads -=head2 64-bit Perl +Artur Bergman's C module is a start on this, but needs to +be more mature. -Verify complete 64 bit support so that the value of sysseek, or C<-s>, or -stat(), or tell can fit into a perl number without losing precision. -Work with the perl-64bit mailing list on perl.org. +=head2 make perl_clone optionally clone ops -=head2 Prototypes +So that pseudoforking, mod_perl, iThreads and nvi will work properly +(but not as efficiently) until the regex engine is fixed to be threadsafe. -=over 4 +=head2 Work out exit/die semantics for threads -=item Named prototypes +=head2 Typed lexicals for compiler -Add proper named prototypes that actually work usefully. +=head2 Compiler workarounds for Win32 -=item Indirect objects +=head2 AUTOLOADing in the compiler -Fix prototype bug that forgets indirect objects. +=head2 Fixing comppadlist when compiling -=item Method calls +=head2 Cleaning up exported namespace -Prototypes for method calls. +=head2 Complete signal handling -=item Context +Add C to opcodes which loop; replace C with +C; check C for signal safety. -Return context prototype declarations. +=head2 Out-of-source builds -=item Scoped subs +This was done for 5.6.0, but needs reworking for 5.7.x -lexically-scoped subs, e.g. my sub +=head2 POSIX realtime support -=back +POSIX 1003.1 1996 Edition support--realtime stuff: POSIX semaphores, +message queues, shared memory, realtime clocks, timers, signals (the +metaconfig units mostly already exist for these) -=head2 Built-in globbing +=head2 UNIX98 support -Currently the C*.cE> syntax calls the c shell. This causes -problems on sites without csh, systems where fork() is expensive, and -setuid environments. Decide between Glob::BSD and File::KGlob, move -it into the core, and make Perl use it for globbing. Ben Holzman and -Tye McQueen have claimed the pumpkin for this. +Reader-writer locks, realtime/asynchronous IO -=head1 Perl Internals +=head2 IPv6 Support -=head2 magic_setisa +There are non-core modules, such as C, but these will need +integrating when IPv6 actually starts to really happen. See RFC 2292 +and RFC 2553. -C should be made to update %FIELDS [???] +=head2 Long double conversion -=head2 Garbage Collection +Floating point formatting is still causing some weird test failures. -There was talk of a mark-and-sweep garbage collector at TPC2, but the -(to users) unpredictable nature of its behaviour put some off. -Sarathy, I believe, did the work. Here's what he has to say: +=head2 Locales -Yeah, I hope to implement it someday too. The points that were -raised in TPC2 were all to do with calling DESTROY() methods, but -I think we can accomodate that by extending bless() to stash -extra information for objects so we track their lifetime accurately -for those that want their DESTROY() to be predictable (this will be -a speed hit, naturally, and will therefore be optional, naturally. :) - -[N.B. Don't even ask me about this now! When I have the time to -write a cogent summary, I'll post it.] +Locales and Unicode interact with each other in unpleasant ways. +One possible solution would be to adopt/support ICU: -=head2 Reliable signals + http://oss.software.ibm.com/developerworks/opensource/icu/project/ -Sarathy and Dan Sugalski are working on this. Chip posted a patch -earlier, but it was not accepted into 5.005. The issue is tricky, -because it has the potential to greatly slow down the core. +=head2 Thread-safe regexes -There are at least three things to consider: +The regular expression engine is currently non-threadsafe. -=over 4 +=head2 Arithmetic on non-Arabic numerals -=item Alternate runops() for signal despatch +C<[1234567890]> aren't the only numerals any more. -Sarathy and Dan are discussed this on perl5-porters. +=head2 POSIX Unicode character classes -=item Figure out how to die() in delayed sighandler +([=a=] for equivalance classes, [.ch.] for collation.) +These are dependent on Unicode normalization and collation. -=item Add tests for Thread::Signal +=head2 Factoring out common suffices/prefices in regexps (trie optimization) -=item Automatic tests against CPAN +Currently, the user has to optimize C and C into +C and C<[fg]oo> by hand; this could be done automatically. -Is there some way to automatically build all/most of CPAN with -the new Perl and check that the modules there pass all the tests? +=head2 Security audit shipped utilities -=back +All the code we ship with Perl needs to be sensible about temporary file +handling, locking, input validation, and so on. -=head2 Interpolated regex performance bugs +=head2 Custom opcodes - while (<>) { - $found = 0; - foreach $pat (@patterns) { - $found++ if /$pat/o; - } - print if $found; - } +Have a way to introduce user-defined opcodes without the subroutine call +overhead of an XSUB; the user should be able to create PP code. Simon +Cozens has some ideas on this. -The qr// syntax added in 5.005 has solved this problem, but -it needs more thorough documentation. +=head2 spawnvp() on Win32 -=head2 Memory leaks from failed eval/regcomp +Win32 has problems spawning processes, particularly when the arguments +to the child process contain spaces, quotes or tab characters. -The only known memory leaks in Perl are in failed code or regexp -compilation. Fix this. Hugo Van Der Sanden will attempt this but -won't have tuits until January 1999. - -=head2 Make XS easier to use +=head2 DLL Versioning -There was interest in SWIG from porters, but nothing has happened -lately. +Windows needs a way to know what version of a XS or C DLL it's +loading. -=head2 Make embedded Perl easier to use +=head2 Introduce @( and @) -This is probably difficult for the same reasons that "XS For Dummies" -will be difficult. +C<$(> may return "foo bar baz". Unfortunately, since groups can +theoretically have spaces in their names, this could be one, two or +three groups. -=head2 Namespace cleanup +=head2 Floating point handling - CPP-space: restrict CPP symbols exported from headers - header-space: move into CORE/perl/ - API-space: begin list of things that constitute public api - env-space: Configure should use PERL_CONFIG instead of CONFIG etc. +C and C support is particularly troublesome. +(fp_classify(), fp_class(), fp_class_d(), class(), isinf(), +isfinite(), finite(), isnormal(), unordered(), , + (there are metaconfig units for all these) (I think), +fp_setmask(), fp_getmask(), fp_setround(), fp_getround() +(no metaconfig units yet for these). Don't forget finitel(), fp_classl(), +fp_class_l(), (yes, both do, unfortunately, exist), and unorderedl().) -=head2 MULTIPLICITY +As of Perl 5.6.1 is a Perl macro, Perl_isnan(). -Complete work on safe recursive interpreters Cnew()>. -Sarathy says that a reference implementation exists. +=head2 IV/UV preservation -=head2 MacPerl +Nicholas Clark has done a lot of work on this, but work is continuing. +C<+>, C<-> and C<*> work, but guards need to be in place for C<%>, C, +C<&>, C, C and C. -Chris Nandor and Matthias Neeracher are working on better integrating -MacPerl into the Perl distribution. +=head2 Replace pod2html with something using Pod::Parser -=head1 Documentation +The CPAN module C may be a more suitable basis for a +C convertor; the current one duplicates the functionality +abstracted in C, which makes updating the POD language +difficult. -There's a lot of documentation that comes with Perl. The quantity of -documentation makes it difficult for users to know which section of -which manpage to read in order to solve their problem. Tom -Christiansen has done much of the documentation work in the past. +=head2 Automate module testing on CPAN -=head2 A clear division into tutorial and reference +When a new Perl is being beta tested, porters have to manually grab +their favourite CPAN modules and test them - this should be done +automatically. -Some manpages (e.g., perltoot and perlreftut) clearly set out to -educate the reader about a subject. Other manpages (e.g., perlsub) -are references for which there is no tutorial, or are references with -a slight tutorial bent. If things are either tutorial or reference, -then the reader knows which manpage to read to learn about a subject, -and which manpage to read to learn all about an aspect of that -subject. Part of the solution to this is: +=head2 sendmsg and recvmsg -=head2 Remove the artificial distinction between operators and functions +We have all the other BSD socket functions but these. There are +metaconfig units for these functions which can be added. To avoid these +being new opcodes, a solution similar to the way C was added +would be preferable. (Autoload the C module.) -History shows us that users, and often porters, aren't clear on the -operator-function distinction. The present split in reference -material between perlfunc and perlop hinders user navigation. Given -that perlfunc is by far the larger of the two, move operator reference -into perlfunc. +=head2 Rewrite perlre documentation -=head2 More tutorials +The new-style patterns need full documentation, and the whole document +needs to be a lot clearer. -More documents of a tutorial nature could help. Here are some -candidates: +=head2 Convert example code to IO::Handle filehandles -=over 4 +=head2 Document Win32 choices -=item Regular expressions +=head2 Check new modules -Robin Berjon (r.berjon@ltconsulting.net) has volunteered. +=head2 Make roffitall find pods and libs itself -=item I/O +Simon Cozens has done some work on this but it needs a rethink. -Mark-Jason Dominus (mjd@plover.com) has an outline for perliotut. +=head1 To do at some point -=item pack/unpack +These are ideas that have been regularly tossed around, that most +people believe should be done maybe during 5.8.x -This is badly needed. There has been some discussion on the -subject on perl5-porters. +=head2 Remove regular expression recursion -=item Debugging +Because the regular expression engine is recursive, badly designed +expressions can lead to lots of recursion filling up the stack. Ilya +claims that it is easy to convert the engine to being iterative, but +this has still not yet been done. There may be a regular expression +engine hit squad meeting at TPC5. -Ronald Kimball (rjk@linguist.dartmouth.edu) has volunteered. +=head2 Memory leaks after failed eval -=head2 Include a search tool +Perl will leak memory if you C. This is +partially because it attempts to build up an op tree for that code and +doesn't properly free it. The same goes for non-syntactically-correct +regular expressions. Hugo looked into this, but decided it needed a +mark-and-sweep GC implementation. -perldoc should be able to 'grep' fulltext indices of installed POD -files. This would let people say: +Alan notes that: The basic idea was to extend the parser token stack +(C) to include a type field so we knew what sort of thing each +element of the stack was. The F< code would then have to be +postprocessed to record the type of each entry on the stack as it was +created, and the parser patched so that it could unroll the stack +properly on error. - perldoc -find printing numbers with commas +This is possible to do, but would be pretty messy to implement, as it +would rely on even more sed hackery in F. -and get back the perlfaq entry on 'commify'. +=head2 pack "(stuff)*" -This solution, however, requires documentation to contain the keywords -the user is searching for. Even when the users know what they're -looking for, often they can't spell it. +That's to say, C would be the same as C -=head2 Include a locate tool +=head2 bitfields in pack -perldoc should be able to help people find the manpages on a -particular high-level subject: +=head2 Cross compilation - perldoc -find web +Make Perl buildable with a cross-compiler. This will play havoc with +Configure, which needs to how how the target system will respond to +its tests; maybe C will be a good starting point here. +(Indeed, Bart Schuller reports that he compiled up C for +the Agenda PDA and it works fine.) A really big spanner in the works +is the bootstrapping build process of Perl: if the filesystem the +target systems sees is not the same what the build host sees, various +input, output, and (Perl) library files need to be copied back and forth. -would tell them manpages, web pages, and books with material on web -programming. Similarly C, C and so on. +=head2 Perl preprocessor / macros -We need something in the vicinity of: +Source filters help with this, but do not get us all the way. For +instance, it should be possible to implement the C operator somehow; +source filters don't (quite) cut it. - % perl -help random stuff - No documentation for perl function `random stuff' found - The following entry in perlfunc.pod matches /random/a: - =item rand EXPR - - =item rand - - Returns a random fractional number greater than or equal to C<0> and less - than the value of EXPR. (EXPR should be positive.) If EXPR is - omitted, the value C<1> is used. Automatically calls C unless - C has already been called. See also C. - - (Note: If your rand function consistently returns numbers that are too - large or too small, then your version of Perl was probably compiled - with the wrong number of RANDBITS.) - The following pod pages seem to have /stuff/a: - perlfunc.pod (7 hits) - perlfaq7.pod (6 hits) - perlmod.pod (4 hits) - perlsyn.pod (3 hits) - perlfaq8.pod (2 hits) - perlipc.pod (2 hits) - perl5004delta.pod (1 hit) - perl5005delta.pod (1 hit) - perlcall.pod (1 hit) - perldelta.pod (1 hit) - perlfaq3.pod (1 hit) - perlfaq5.pod (1 hit) - perlhist.pod (1 hit) - perlref.pod (1 hit) - perltoc.pod (1 hit) - perltrap.pod (1 hit) - Proceed to open perlfunc.pod? [y] n - Do you want to speak perl interactively? [y] n - Should I dial 911? [y] n - Do you need psychiatric help? [y] y - Hi, what bothers you today? - A Python programmer in the next cubby is driving me nuts! - Hmm, thats fixable. Just [rest censored] +=head2 Perl lexer in Perl -=head2 Separate function manpages by default +Damian Conway is planning to work on this, but it hasn't happened yet. -Perl should install 'manpages' for every function/operator into the -3pl or 3p manual section. By default. The splitman program in the -Perl source distribution does the work of turning big perlfunc into -little 3p pages. +=head2 Using POSIX calls internally -=head2 Users can't find the manpages +When faced with a BSD vs. SySV -style interface to some library or +system function, perl's roots show in that it typically prefers the BSD +interface (but falls back to the SysV one). One example is getpgrp(). +Other examples include C vs. C. There are others, mostly in +F<. -Make C tell users what they need to add to their .login or -.cshrc to set their MANPATH correctly. +Mostly, this item is a suggestion for which way to start a journey into +an C<#ifdef> forest. It is not primarily a suggestion to eliminate any of +the C<#ifdef> forests. -=head2 Install ALL Documentation +POSIX calls are perhaps more likely to be portable to unexpected +architectures. They are also perhaps more likely to be actively +maintained by a current vendor. They are also perhaps more likely to be +available in thread-safe versions, if appropriate. -Make the standard documentation kit include the VMS, OS/2, Win32, -Threads, etc information. installperl and pod/Makefile should know -enough to copy README.foo to perlfoo.pod before building everything, -when appropriate. +=head2 -i rename file when changed -=head2 Outstanding issues to be documented - -Tom has a list of 5.005_5* features or changes that require -documentation. - -Create one document that coherently explains the delta between the -last camel release and the current release. perldelta was supposed -to be that, but no longer. The things in perldelta never seemed to -get placed in the right places in the real manpages, either. This -needs work. - -=head2 Adapt www.linuxhq.com for Perl - -This should help glorify documentation and get more people involved in -perl development. - -=head2 Replace man with a perl program - -Can we reimplement man in Perl? Tom has a start. I believe some of -the Linux systems distribute a manalike. Alternatively, build on -perldoc to remove the unfeatures like "is slow" and "has no apropos". - -=head2 Unicode tutorial +It's only necessary to rename a file when inplace editing when the file +has changed. Detecting a change is perhaps the difficult bit. -We could use more work on helping people understand Perl's new -Unicode support that Larry has created. +=head2 All ARGV input should act like EE -=head1 Modules +=head2 Support for rerunning debugger -=head2 Update the POSIX extension to conform with the POSIX 1003.1 Edition 2 +There should be a way of restarting the debugger on demand. -The current state of the POSIX extension is as of Edition 1, 1991, -whereas the Edition 2 came out in 1996. ISO/IEC 9945:1-1996(E), -ANSI/IEEE Std 1003.1, 1996 Edition. ISBN 1-55937-573-6. The updates -were legion: threads, IPC, and real time extensions. +=head2 my sub foo { } -=head2 Module versions +The basic principle is sound, but there are problems with the semantics +of self-referential and mutually referential lexical subs: how to +declare the subs? -Automate the checking of versions in the standard distribution so -it's easy for a pumpking to check whether CPAN has a newer version -that we should be including? +=head2 One-pass global destruction -=head2 New modules +Sweeping away all the allocated memory in one go is a laudable goal, but +it's difficult and in most cases, it's easier to let the memory get +freed by exiting. -Which modules should be added to the standard distribution? This ties -in with the SDK discussed on the perl-sdk list at perl.org. +=head2 Rewrite regexp parser -=head2 Profiler +There has been talk recently of rewriting the regular expression parser +to produce an optree instead of a chain of opcodes; it's unclear whether +or not this would be a win. -Make the profiler (Devel::DProf) part of the standard release, and -document it well. +=head2 Cache recently used regexps -=head2 Tie Modules +This is to speed up -=over 4 + for my $re (@regexps) { + $matched++ if /$re/ + } -=item VecArray +C already gives us a way of saving compiled regexps, but it should +be done automatically. -Implement array using vec(). Nathan Torkington has working code to -do this. +=head2 Re-entrant functions -=item SubstrArray +Add configure probes for C<_r> forms of system calls and fit them to the +core. Unfortunately, calling conventions for these functions and not +standardised. -Implement array using substr() +=head2 Cross-compilation support -=item VirtualArray +Bart Schuller reports that using C and a cross-compiler, he +got Perl working on the Agenda PDA. However, one cannot build a full +Perl because Configure needs to get the results for the target platform, +for the host. -Implement array using a file +=head2 Bit-shifting bitvectors -=item ShiftSplice +Given: -Defines shift et al in terms of splice method + vec($v, 1000, 1) = 1; -=back +One should be able to do -=head2 Procedural options + $v <<= 1; -Support procedural interfaces for the common cases of Perl's -gratuitously OOO modules. Tom objects to "use IO::File" reading many -thousands of lines of code. +and have the 999'th bit set. -=head2 RPC +Currently if you try with shift bitvectors you shift the NV/UV, instead +of the bits in the PV. Not very logical. -Write a module for transparent, portable remote procedure calls. (Not -core). This touches on the CORBA and ILU work. +=head2 debugger pragma -=head2 y2k localtime/gmtime +The debugger is implemented in Perl in F; turning it into a +pragma should be easy, but making it work lexically might be more +difficult. Fiddling with C<$^P> would be necessary. -Write a module, Y2k::Catch, which overloads localtime and gmtime's -returned year value and catches "bad" attempts to use it. +=head2 use less pragma -=head2 Export File::Find variables +Identify areas where speed/memory tradeoffs can be made and have a hint +to switch between them. -Make File::Find export C<$name> etc manually, at least if asked to. +=head2 switch structures -=head2 Ioctl +Although we have C in core, Larry points to the dormant +C and C ops in F; using these opcodes would be +much faster. -Finish a proper Ioctl module. +=head2 Cache eval tree -=head2 Debugger attach/detach +=head2 rcatmaybe -Permit a user to debug an already-running program. +=head2 Shrink opcode tables -=head2 Regular Expression debugger +=head2 Optimize away @_ -Create a visual profiler/debugger tool that stepped you through the -execution of a regular expression point by point. Ilya has a module -to color-code and display regular expression parses and executions. -There's something at http://tkworld.org/ that might be a good start, -it's a Tk/Tcl RE wizard, that builds regexen of many flavours. +Look at the "reification" code in C -=head2 Alternative RE Syntax +=head2 Prototypes versus indirect objects -Make an alternative regular expression syntax that is accessed through -a module. For instance, +Currently, indirect object syntax bypasses prototype checks. - use RE; - $re = start_of_line() - ->literal("1998/10/08") - ->optional( whitespace() ) - ->literal("[") - ->remember( many( or( "-", digit() ) ) ); +=head2 Install HMTL - if (/$re/) { - print "time is $1\n"; - } +HTML versions of the documentation need to be installed by default; a +call to C from C may be all that's necessary. -Newbies to regular expressions typically only use a subset of the full -language. Perhaps you wouldn't have to implement the full feature set. +=head2 Prototype method calls -=head2 Bundled modules +=head2 Return context prototype declarations -Nicholas Clark (nick@flirble.org) had a patch for storing modules in -zipped format. This needs exploring and concluding. +=head2 magic_setisa -=head2 Expect +=head2 Garbage collection -Adopt IO::Tty, make it as portable as Don Libes' "expect" (can we link -against expect code?), and perfect a Perl version of expect. IO::Tty -and expect could then be distributed as part of the core distribution, -replacing Comm.pl and other hacks. +There have been persistent mumblings about putting a mark-and-sweep +garbage detector into Perl; Alan Burlison has some ideas about this. -=head2 GUI::Native +=head2 IO tutorial -A simple-to-use interface to native graphical abilities would -be welcomed. Oh, Perl's access Tk is nice enough, and reasonably -portable, but it's not particularly as fast as one would like. -Simple access to the mouse's cut buffer or mouse-presses shouldn't -required loading a few terabytes of Tk code. +Mark-Jason Dominus has the beginnings of one of these. -=head2 Update semibroken auxiliary tools; h2ph, a2p, etc. +=head2 pack/unpack tutorial -Kurt Starsinic is working on h2ph. mjd has fixed bugs in a2p in the -past. a2p apparently doesn't work on nawk and gawk extensions. -Graham Barr has an Include module that does h2ph work at runtime. +Simon Cozens has the beginnings of one of these. -=head2 POD Converters +=head2 Rewrite perldoc -Brad's PodParser code needs to become part of the core, and the Pod::* -and pod2* programs rewritten to use this standard parser. Currently -the converters take different options, some behave in different -fashions, and some are more picky than others in terms of the POD -files they accept. +There are a few suggestions for what to do with C: maybe a +full-text search, an index function, locating pages on a particular +high-level subject, and so on. -=head2 pod2html +=head2 Install .3p manpages -A short-term fix: pod2html generates absolute HTML links. Make it -generate relative links. +This is a bone of contention; we can create C<.3p> manpages for each +built-in function, but should we install them by default? Tcl does this, +and it clutters up C. -=head2 Podchecker +=head2 Unicode tutorial -Something like lint for Pod would be good. Something that catches -common errors as well as gross ones. Brad Appleton is putting -together something as part of his PodParser work. +Simon Cozens promises to do this before he gets old. -=head1 Tom's Wishes +=head2 Update POSIX.pm for 1003.1-2 -=head2 Webperl +=head2 Retargetable installation -Design a webperl environment that's as tightly integrated and as -easy-to-use as Perl's current command-line environment. +Allow C<@INC> to be changed after Perl is built. -=head2 Mobile agents +=head2 POSIX emulation on non-POSIX systems -More work on a safe and secure execution environment for mobile -agents would be neat; the Safe.pm module is a start, but there's a -still a lot to be done in that area. Adopt Penguin? +Make C behave as POSIXly as possible everywhere, meaning we +have to implement POSIX equivalents for some functions if necessary. -=head2 POSIX on non-POSIX +=head2 Rename Win32 headers -Standard programming constructs for non-POSIX systems would help a -lot of programmers stuck on primitive, legacy systems. For example, -Microsoft still hasn't made a usable POSIX interface on their clunky -systems, which means that standard operations such as alarm() and -fork(), both critical for sophisticated client-server programming, -must both be kludged around. +=head2 Finish off lvalue functions -I'm unsure whether Tom means to emulate alarm( )and fork(), or merely -to provide a document like perlport.pod to say which features are -portable and which are not. +They don't work in the debugger, and they don't work for list or hash +slices. -=head2 Portable installations +=head2 Update sprintf documentation -Figure out a portable semi-gelled installation, that is, one without -full paths. Larry has said that he's thinking about this. Ilya -pointed out that perllib_mangle() is good for this. +Hugo van der Sanden plans to look at this. -=head1 Win32 Stuff +=head2 Use fchown/fchmod internally -=head2 Get PERL_OBJECT building under gcc +This has been done in places, but needs a thorough code review. +Also fchdir is available in some platforms. -B, according to Sarathy. It builds under egcs on win32, -but doesn't run for occult reasons. If anyone knows the right -breed of chicken to sacrifice, please speak up. +=head1 Vague ideas -=head2 Rename new headers to be consistent with the rest +Ideas which have been discussed, and which may or may not happen. -=head2 Sort out the spawnvp() mess +=head2 ref() in list context -=head2 Work out DLL versioning +It's unclear what this should do or how to do it without breaking old +code. -=head2 Get PERL_OBJECT building on non-win32 +=head2 Make tr/// return histogram -=head2 Style-check +There is a patch for this, but it may require Unicodification. -=head1 Would be nice to have +=head2 Compile to real threaded code -=over 4 +=head2 Structured types -=item C +=head2 Modifiable $1 et al. -=item Contiguous bitfields in pack/unpack + ($x = "elephant") =~ /e(ph)/; + $1 = "g"; # $x = "elegant" -=item lexperl +What happens if there are multiple (nested?) brackets? What if the +string changes between the match and the assignment? -=item Bundled perl preprocessor +=head2 Procedural interfaces for IO::*, etc. -=item Use posix calls internally where possible +Some core modules have been accused of being overly-OO. Adding +procedural interfaces could demystify them. -=item format BOTTOM +=head2 RPC modules -=item -i rename file only when successfully changed +=head2 Attach/detach debugger from running program -=item All ARGV input should act like <> +With C, you can attach the debugger to a running program if you +pass the process ID. It would be good to do this with the Perl debugger +on a running Perl program, although I'm not sure how it would be done. -=item report HANDLE [formats]. +=head2 Alternative RE syntax module -=item support in perlmain to rerun debugger + use Regex::Newbie; + $re = Regex::Newbie->new + ->start + ->match("foo") + ->repeat(Regex::Newbie->class("char"),3) + ->end; + /$re/; -=item lvalue functions +=head2 GUI::Native -Tuomas Lukka, on behalf of the PDL project, greatly desires this and -Ilya has a patch for it (probably against an older version of Perl). -Tuomas points out that what PDL really wants is lvalue I, -not just subs. +A non-core module that would use "native" GUI to create graphical +applications. -=back +=head2 foreach(reverse ...) -=head1 Possible pragmas +Currently -=head2 'less' + foreach (reverse @_) { ... } -(use less memory, CPU) +puts C<@_> on the stack, reverses it putting the reversed version on the +stack, then iterates forwards. Instead, it could be special-cased to put +C<@_> on the stack then iterate backwards. -=head1 Optimizations +=head2 Constant function cache -=head2 constant function cache +=head2 Approximate regular expression matching -=head2 foreach(reverse...) +=head1 Ongoing -=head2 Cache eval tree +These items B need doing: -Unless lexical outer scope used (mark in &compiling?). +=head2 Update guts documentation -=head2 rcatmaybe +Simon Cozens tries to do this when possible, and contributions to the +C documentation is welcome. -=head2 Shrink opcode tables +=head2 Add more tests -Via multiple implementations selected in peep. +Michael Schwern will donate $500 to Yet Another Society when all core +modules have tests. -=head2 Cache hash value +=head2 Update auxiliary tools -Not a win, according to Guido. +The code we ship with Perl should look like good Perl 5. -=head2 Optimize away @_ where possible +=head1 Recently done things -=head2 Optimize sort by { $a <=> $b } +These are things which have been on the todo lists in previous releases +but have recently been completed. -Greg Bacon added several more sort optimizations. These have -made it into 5.005_55, thanks to Hans Mulder. +=head2 Safe signal handling -=head2 Rewrite regexp parser for better integrated optimization +A new signal model went into 5.7.1 without much fanfare. Operations and +Cs are no longer interrupted by signals, which are handled +between opcodes. This means that C now actually does +something. However, there are still a few things that need to be done. -The regexp parser was rewritten for 5.005. Ilya's the regexp guru. +=head2 Tie Modules -=head1 Vague possibilities +Modules which implement arrays in terms of strings, substrings or files +can be found on the CPAN. -=over 4 +=head2 gettimeofday -=item ref function in list context +C has been integrated into the core. -This seems impossible to do without substantially breaking code. +=head2 setitimer and getimiter -=item make tr/// return histogram in list context? +Adding C got us this too. -=item Loop control on do{} et al +=head2 Testing __DIE__ hook -=item Explicit switch statements +Tests have been added. -Nobody has yet managed to come up with a switch syntax that would -allow for mixed hash, constant, regexp checks. Submit implementation -with syntax, please. +=head2 CPP equivalent in Perl -=item compile to real threaded code +A C Yardley will probably have done this by the time you can read this. +This allows for a generalization of the C constant detection used in +building C. -=item structured types +=head2 Explicit switch statements -=item Modifiable $1 et al +C has been integrated into the core to give you all manner of +C semantics. -The intent is for this to be a means of editing the matched portions of -the target string. +=head2 autocroak -=back +This is C. -=head1 To Do Or Not To Do +=head2 UTF/EBCDIC -These are things that have been discussed in the past and roundly -criticized for being of questionable value. +Nick Ing-Simmons has made UTF-EBCDIC (UTR13) work with Perl. -=head2 Making my() work on "package" variables + EBCDIC? http://www.unicode.org/unicode/reports/tr16/ -Being able to say my($Foo::Bar), something that sounds ludicrous and -the 5.6 pumpking has mocked. +=head2 UTF Regexes -=head2 "or" testing defined not truth +Although there are probably some small bugs to be rooted out, Jarkko +Hietaniemi has made regular expressions polymorphic between bytes and +characters. -We tell people that C<||> can be used to give a default value to a -variable: +=head2 perlcc to produce executable - $children = shift || 5; # default is 5 children +C was recently rewritten, and can now produce standalone +executables. -which is almost (but not): +=head2 END blocks saved in compiled output - $children = shift; - $children = 5 unless $children; +=head2 Secure temporary file module -but if the first argument was given and is "0", then it will be -considered false by C<||> and C<5> used instead. Really we want -an C<||>-like operator that behaves like: +Tim Jenness' C is now in core. - $children = shift; - $children = 5 unless defined $children; +=head2 Integrate Time::HiRes -Namely, a C<||> that tests defined-ness rather than truth. One was -discussed, and a patch submitted, but the objections were many. While -there were objections, many still feel the need. At least it was -decided that C is the best name for the operator. +This module is now part of core. -=head2 "dynamic" lexicals +=head2 Turn Cwd into XS - my $x; - sub foo { - local $x; - } +Benjamin Sugars has done this. -Localizing, as Tim Bunce points out, is a separate concept from -whether the variable is global or lexical. Chip Salzenberg had -an implementation once, but Larry thought it had potential to -confuse. +=head2 Mmap for input -=head2 "class"-based, rather than package-based "lexicals" +Nick Ing-Simmons' C supports an C IO method. -This is like what the Alias module provides, but the variables would -be lexicals reserved by perl at compile-time, which really are indices -pointing into the pseudo-hash object visible inside every method so -declared. +=head2 Byte to/from UTF8 and UTF8 to/from local conversion -=head1 Threading +C provides this. -=head2 Modules +=head2 Add sockatmark support -Which of the standard modules are thread-safe? Which CPAN modules? -How easy is it to fix those non-safe modules? +Added in 5.7.1 -=head2 Testing +=head2 Mailing list archives -Threading is still experimental. Every reproducible bug identifies -something else for us to fix. Find and submit more of these problems. +http://lists.perl.org/, http://archive.develooper.com/ -=head2 $AUTOLOAD +=head2 Bug tracking -=head2 exit/die +Richard Foley has written the bug tracking system at http://bugs.perl.org/ -Consistent semantics for exit/die in threads. +=head2 Integrate MacPerl -=head2 External threads +Chris Nandor and Matthias Neeracher have integrated the MacPerl changes +into 5.6.0. -Better support for externally created threads. +=head2 Web "nerve center" for Perl -=head2 Thread::Pool +http://use.perl.org/ is what you're looking for. -=head2 thread-safety +=head2 Regular expression tutorial -Spot-check globals like statcache and global GVs for thread-safety. -"B", says Sarathy. +C, provided by Mark Kvale. -=head2 Per-thread GVs +=head2 Debugging Tutorial -According to Sarathy, this would make @_ be the same in threaded -and non-threaded, as well as helping solve problems like filehandles -(the same filehandle currently cannot be used in two threads). +C, written by Richard Foley. -=head1 Compiler +=head2 Integrate new modules -=head2 Optimization +Jarkko has been integrating madly into 5.7.x -The compiler's back-end code-generators for creating bytecode or -compilable C code could use optimization work. +=head2 Integrate profiler -=head2 Byteperl +C is now a core module. -Figure out how and where byteperl will be built for the various -platforms. +=head2 Y2K error detection -=head2 Precompiled modules +There's a configure option to detect unsafe concatenation with "19", and +a CPAN module. (C) -Save byte-compiled modules on disk. +=head2 Regular expression debugger -=head2 Executables +While not part of core, Mark-Jason Dominus has written C and has +also come up with a generalised strategy for regular expression +debugging. -Auto-produce executable. +=head2 POD checker -=head2 Typed lexicals +That's, uh, F -Typed lexicals should affect B::CC::load_pad. +=head2 "Dynamic" lexicals -=head2 Win32 +=head2 Cache precompiled modules -Workarounds to help Win32 dynamic loading. +=head1 Deprecated Wishes -=head2 END blocks +These are items which used to be in the todo file, but have been +deprecated for some reason. -END blocks need saving in compiled output. +=head2 Loop control on do{} -=head2 _AUTOLOAD +This would break old code; use C instead. -_AUTOLOAD prodding. +=head2 Lexically scoped typeglobs -=head2 comppadlist +Not needed now we have lexical IO handles. -Fix comppadlist (names in comppad_name can have fake SvCUR -from where newASSIGNOP steals the field). +=head2 format BOTTOM -=head2 Cached compilation +=head2 report HANDLE -Can we install modules as bytecode? +Damian Conway's text formatting modules seem to be the Way To Go. -=head1 Recently Finished Tasks +=head2 Generalised want()/caller()) -=head2 Figure a way out of $^(capital letter) +=head2 Named prototypes -Figure out a clean way to extend $^(capital letter) beyond -the 26 alphabets. (${^WORD} maybe?) +These both seem to be delayed until Perl 6. -Mark-Jason Dominus sent a patch which went into 5.005_56. +=head2 Built-in globbing -=head2 Filenames +The C module has been used to replace the C function. -Make filenames in the distribution and in the standard module set -be 8.3 friendly where feasible. Good luck changing the standard -modules, though. B. +=head2 Regression tests for suidperl -=head2 Proper tied array support +C is deprecated in favour of common sense. -This was B in 5.005 by Nick Ing-Simmons. +=head2 Cached hash values -=head2 Foreign lines +We have shared hash keys, which perform the same job. -Perl should be more generous in accepting foreign line terminations. -Mostly B in 5.005. +=head2 Add compression modules -=head2 Namespace cleanup +The compression modules are a little heavy; meanwhile, Nick Clark is +working on experimental pragmata to do transparent decompression on +input. - symbol-space: "pl_" prefix for all global vars - "Perl_" prefix for all functions +=head2 Reorganise documentation into tutorials/references - CPP-space: stop malloc()/free() pollution unless asked +Could not get consensus on P5P about this. -=head2 Explain tool +=head2 Remove distinction between functions and operators -Given a piece of Perl code, say what it does. B::Deparse is doing -this. B. +Caution: highly flammable. -=head2 ISA.pm +=head2 Make XS easier to use -Rename and alter ISA.pm. B. It is now base.pm. +Use C instead, or SWIG. -=head2 Automate maintenance of most PERL_OBJECT code +=head2 Make embedding easier to use -B, says Sarathy. +Use C. -=head2 -iprefix. +=head2 man for perl -Added in 5.004_70. B +See the Perl Power Tools. (http://language.perl.com/ppt/) -=head2 gettimeofday +=head2 my $Package::variable -See Time::HiRes. +Use C instead. -=head2 reference to compiled regexp +=head2 "or" tests defined, not truth -B This is the qr// support in 5.005. +Suggesting this on P5P B cause a boring and interminable flamewar. -=head2 eval qw() at compile time +=head2 "class"-based lexicals -qw() is presently compiled as a call to split. This means the split -happens at runtime. Change this so qw() is compiled as a real list -assignment. This also avoids surprises like: +Use flyweight objects, secure hashes or, dare I say it, pseudo-hashes instead. - $a = () = qw(What will $a hold?); +=head2 byteperl -B. Tom Hughes submitted a patch that went into 5.005_55. +C covers this. -=head2 autocroak? +=head2 Lazy evaluation / tail recursion removal -B. This is the Fatal.pm module, so any builtin that that does -not return success automatically die()s. If you're feeling brave, tie -this in with the unified exceptions scheme. +C in core gives some of these; tail recursion removal is +done manually, with C. (However, MJD has found that +C introduces a performance penalty, so maybe there should +be a way to do this after all: C is +better.) -=head2 Status variable +=head2 Make "use utf8" the default -$^C to track compiler/checker status. B in 5.005_54. +There is a patch available for this, search p5p archives for +the Subject "[EXPERIMENTAL PATCH] make unicode (utf8) default" +but this would be unacceptable because of backward compatibility: +scripts could not contain B. Also would +introduce a measurable slowdown of at least few percentages since all +regular expression operations would be done in full UTF-8. -=cut