* fix a perlop fix from debian: http://bugs.debian.org/514814
[p5sagit/p5-mst-13.2.git] / pod / perlfaq3.pod
CommitLineData
68dc0745 1=head1 NAME
2
109f0441 3perlfaq3 - Programming Tools
68dc0745 4
5=head1 DESCRIPTION
6
7This section of the FAQ answers questions related to programmer tools
8and programming support.
9
10=head2 How do I do (anything)?
11
12Have you looked at CPAN (see L<perlfaq2>)? The chances are that
13someone has already written a module that can solve your problem.
3958b146 14Have you read the appropriate manpages? Here's a brief index:
68dc0745 15
5a964f20 16 Basics perldata, perlvar, perlsyn, perlop, perlsub
17 Execution perlrun, perldebug
18 Functions perlfunc
68dc0745 19 Objects perlref, perlmod, perlobj, perltie
20 Data Structures perlref, perllol, perldsc
f102b883 21 Modules perlmod, perlmodlib, perlsub
d92eb7b0 22 Regexes perlre, perlfunc, perlop, perllocale
68dc0745 23 Moving to perl5 perltrap, perl
24 Linking w/C perlxstut, perlxs, perlcall, perlguts, perlembed
06a5f41f 25 Various http://www.cpan.org/misc/olddoc/FMTEYEWTK.tgz
26 (not a man-page but still useful, a collection
27 of various essays on Perl techniques)
68dc0745 28
3958b146 29A crude table of contents for the Perl manpage set is found in L<perltoc>.
68dc0745 30
31=head2 How can I use Perl interactively?
32
33The typical approach uses the Perl debugger, described in the
3bc3c5be 34C<perldebug(1)> manpage, on an "empty" program, like this:
68dc0745 35
36 perl -de 42
37
38Now just type in any legal Perl code, and it will be immediately
39evaluated. You can also examine the symbol table, get stack
40backtraces, check variable values, set breakpoints, and other
92c2ed05 41operations typically found in symbolic debuggers.
68dc0745 42
43=head2 Is there a Perl shell?
44
3bc3c5be 45The C<psh> (Perl sh) is currently at version 1.8. The Perl Shell is a shell
a05e4845 46that combines the interactive nature of a Unix shell with the power of
47Perl. The goal is a full featured shell that behaves as expected for
48normal shell activity and uses Perl syntax and functionality for
3bc3c5be 49control-flow statements and other things. You can get C<psh> at
a05e4845 50http://sourceforge.net/projects/psh/ .
55e174a4 51
3bc3c5be 52C<Zoidberg> is a similar project and provides a shell written in perl,
f3b9614f 53configured in perl and operated in perl. It is intended as a login shell
109f0441 54and development environment. It can be found at
55http://pardus-larus.student.utwente.nl/~pardus/projects/zoidberg/
f3b9614f 56or your local CPAN mirror.
57
3bc3c5be 58The C<Shell.pm> module (distributed with Perl) makes Perl try commands
59which aren't part of the Perl language as shell commands. C<perlsh> from
a05e4845 60the source distribution is simplistic and uninteresting, but may still
61be what you want.
68dc0745 62
49d635f9 63=head2 How do I find which modules are installed on my system?
64
109f0441 65From the command line, you can use the C<cpan> command's C<-l> switch:
66
67 $ cpan -l
68
69You can also use C<cpan>'s C<-a> switch to create an autobundle file
589a5df2 70that C<CPAN.pm> understands and can use to re-install every module:
109f0441 71
72 $ cpan -a
73
3bc3c5be 74Inside a Perl program, you can use the C<ExtUtils::Installed> module to
109f0441 75show all installed distributions, although it can take awhile to do
76its magic. The standard library which comes with Perl just shows up
589a5df2 77as "Perl" (although you can get those with C<Module::CoreList>).
49d635f9 78
79 use ExtUtils::Installed;
197aec24 80
49d635f9 81 my $inst = ExtUtils::Installed->new();
82 my @modules = $inst->modules();
83
84If you want a list of all of the Perl module filenames, you
589a5df2 85can use C<File::Find::Rule>:
49d635f9 86
87 use File::Find::Rule;
197aec24 88
109f0441 89 my @files = File::Find::Rule->
90 extras({follow => 1})->
91 file()->
92 name( '*.pm' )->
93 in( @INC )
94 ;
49d635f9 95
96If you do not have that module, you can do the same thing
3bc3c5be 97with C<File::Find> which is part of the standard library:
49d635f9 98
109f0441 99 use File::Find;
100 my @files;
101
102 find(
103 {
104 wanted => sub {
105 push @files, $File::Find::fullname
106 if -f $File::Find::fullname && /\.pm$/
107 },
108 follow => 1,
109 follow_skip => 2,
110 },
111 @INC
112 );
49d635f9 113
a05e4845 114 print join "\n", @files;
197aec24 115
49d635f9 116If you simply need to quickly check to see if a module is
117available, you can check for its documentation. If you can
197aec24 118read the documentation the module is most likely installed.
49d635f9 119If you cannot read the documentation, the module might not
589a5df2 120have any (in rare cases):
49d635f9 121
109f0441 122 $ perldoc Module::Name
49d635f9 123
124You can also try to include the module in a one-liner to see if
589a5df2 125perl finds it:
49d635f9 126
109f0441 127 $ perl -MModule::Name -e1
197aec24 128
68dc0745 129=head2 How do I debug my Perl programs?
130
500071f4 131(contributed by brian d foy)
132
133Before you do anything else, you can help yourself by ensuring that
134you let Perl tell you about problem areas in your code. By turning
ac9dac7f 135on warnings and strictures, you can head off many problems before
500071f4 136they get too big. You can find out more about these in L<strict>
137and L<warnings>.
138
139 #!/usr/bin/perl
140 use strict;
141 use warnings;
ac9dac7f 142
500071f4 143Beyond that, the simplest debugger is the C<print> function. Use it
144to look at values as you run your program:
145
146 print STDERR "The value is [$value]\n";
68dc0745 147
500071f4 148The C<Data::Dumper> module can pretty-print Perl data structures:
68dc0745 149
ac9dac7f 150 use Data::Dumper qw( Dumper );
151 print STDERR "The hash is " . Dumper( \%hash ) . "\n";
152
500071f4 153Perl comes with an interactive debugger, which you can start with the
154C<-d> switch. It's fully explained in L<perldebug>.
68dc0745 155
3bc3c5be 156If you'd like a graphical user interface and you have C<Tk>, you can use
500071f4 157C<ptkdb>. It's on CPAN and available for free.
68dc0745 158
c195e131 159If you need something much more sophisticated and controllable, Leon
3bc3c5be 160Brocard's C<Devel::ebug> (which you can call with the C<-D> switch as C<-Debug>)
500071f4 161gives you the programmatic hooks into everything you need to write your
162own (without too much pain and suffering).
92c2ed05 163
500071f4 164You can also use a commercial debugger such as Affrus (Mac OS X), Komodo
165from Activestate (Windows and Mac OS X), or EPIC (most platforms).
68dc0745 166
167=head2 How do I profile my Perl programs?
168
109f0441 169(contributed by brian d foy, updated Fri Jul 25 12:22:26 PDT 2008)
170
171The C<Devel> namespace has several modules which you can use to
172profile your Perl programs. The C<Devel::DProf> module comes with Perl
173and you can invoke it with the C<-d> switch:
174
175 perl -d:DProf program.pl
176
177After running your program under C<DProf>, you'll get a F<tmon.out> file
178with the profile data. To look at the data, you can turn it into a
179human-readable report with the C<dprofpp> program that comes with
180C<Devel::DProf>.
181
182 dprofpp
68dc0745 183
109f0441 184You can also do the profiling and reporting in one step with the C<-p>
3bc3c5be 185switch to C<dprofpp>:
92c2ed05 186
109f0441 187 dprofpp -p program.pl
92c2ed05 188
109f0441 189The C<Devel::NYTProf> (New York Times Profiler) does both statement
190and subroutine profiling. It's available from CPAN and you also invoke
191it with the C<-d> switch:
92c2ed05 192
109f0441 193 perl -d:NYTProf some_perl.pl
92c2ed05 194
109f0441 195Like C<DProf>, it creates a database of the profile information that you
196can turn into reports. The C<nytprofhtml> command turns the data into
197an HTML report similar to the C<Devel::Cover> report:
92c2ed05 198
109f0441 199 nytprofhtml
92c2ed05 200
109f0441 201CPAN has several other profilers that you can invoke in the same
202fashion. You might also be interested in using the C<Benchmark> to
203measure and compare code snippets.
204
205You can read more about profiling in I<Programming Perl>, chapter 20,
206or I<Mastering Perl>, chapter 5.
207
208L<perldebguts> documents creating a custom debugger if you need to
209create a special sort of profiler. brian d foy describes the process
210in I<The Perl Journal>, "Creating a Perl Debugger",
211http://www.ddj.com/184404522 , and "Profiling in Perl"
212http://www.ddj.com/184404580 .
213
214Perl.com has two interesting articles on profiling: "Profiling Perl",
215by Simon Cozens, http://www.perl.com/lpt/a/850 and "Debugging and
216Profiling mod_perl Applications", by Frank Wiles,
217http://www.perl.com/pub/a/2006/02/09/debug_mod_perl.html .
218
219Randal L. Schwartz writes about profiling in "Speeding up Your Perl
220Programs" for I<Unix Review>,
221http://www.stonehenge.com/merlyn/UnixReview/col49.html , and "Profiling
222in Template Toolkit via Overriding" for I<Linux Magazine>,
223http://www.stonehenge.com/merlyn/LinuxMag/col75.html .
65acb1b1 224
68dc0745 225=head2 How do I cross-reference my Perl programs?
226
3bc3c5be 227The C<B::Xref> module can be used to generate cross-reference reports
83ded9ee 228for Perl programs.
68dc0745 229
c8db1d39 230 perl -MO=Xref[,OPTIONS] scriptname.plx
68dc0745 231
232=head2 Is there a pretty-printer (formatter) for Perl?
233
3bc3c5be 234C<Perltidy> is a Perl script which indents and reformats Perl scripts
55e174a4 235to make them easier to read by trying to follow the rules of the
236L<perlstyle>. If you write Perl scripts, or spend much time reading
237them, you will probably find it useful. It is available at
3bc3c5be 238http://perltidy.sourceforge.net .
55e174a4 239
240Of course, if you simply follow the guidelines in L<perlstyle>,
241you shouldn't need to reformat. The habit of formatting your code
242as you write it will help prevent bugs. Your editor can and should
243help you with this. The perl-mode or newer cperl-mode for emacs
244can provide remarkable amounts of help with most (but not all)
245code, and even less programmable editors can provide significant
246assistance. Tom Christiansen and many other VI users swear by
247the following settings in vi and its clones:
65acb1b1 248
249 set ai sw=4
d92eb7b0 250 map! ^O {^M}^[O^T
65acb1b1 251
55e174a4 252Put that in your F<.exrc> file (replacing the caret characters
65acb1b1 253with control characters) and away you go. In insert mode, ^T is
ac9dac7f 254for indenting, ^D is for undenting, and ^O is for blockdenting--as
255it were. A more complete example, with comments, can be found at
213329dd 256http://www.cpan.org/authors/id/TOMC/scripts/toms.exrc.gz
92c2ed05 257
49d635f9 258The a2ps http://www-inf.enst.fr/%7Edemaille/a2ps/black+white.ps.gz does
06a5f41f 259lots of things related to generating nicely printed output of
c195e131 260documents.
65acb1b1 261
d92eb7b0 262=head2 Is there a ctags for Perl?
68dc0745 263
b68463f7 264(contributed by brian d foy)
265
ac9dac7f 266Ctags uses an index to quickly find things in source code, and many
267popular editors support ctags for several different languages,
268including Perl.
269
b68463f7 270Exuberent ctags supports Perl: http://ctags.sourceforge.net/
bc06af74 271
b68463f7 272You might also try pltags: http://www.mscha.com/pltags.zip
65acb1b1 273
274=head2 Is there an IDE or Windows Perl Editor?
275
6641ed39 276Perl programs are just plain text, so any editor will do.
277
6641ed39 278If you're on Unix, you already have an IDE--Unix itself. The UNIX
279philosophy is the philosophy of several small tools that each do one
280thing and do it well. It's like a carpenter's toolbox.
281
28b41a80 282If you want an IDE, check the following (in alphabetical order, not
283order of preference):
68fbfbd7 284
285=over 4
286
28b41a80 287=item Eclipse
288
b68463f7 289http://e-p-i-c.sf.net/
290
6670e5e7 291The Eclipse Perl Integration Project integrates Perl
28b41a80 292editing/debugging with Eclipse.
293
b68463f7 294=item Enginsite
295
296http://www.enginsite.com/
297
298Perl Editor by EngInSite is a complete integrated development
299environment (IDE) for creating, testing, and debugging Perl scripts;
300the tool runs on Windows 9x/NT/2000/XP or later.
28b41a80 301
68fbfbd7 302=item Komodo
303
b68463f7 304http://www.ActiveState.com/Products/Komodo/
305
28b41a80 306ActiveState's cross-platform (as of October 2004, that's Windows, Linux,
307and Solaris), multi-language IDE has Perl support, including a regular expression
b68463f7 308debugger and remote debugging.
68fbfbd7 309
589a5df2 310=item Notepad++
311
312http://notepad-plus.sourceforge.net/
313
ac1094a1 314=item Open Perl IDE
315
b68463f7 316http://open-perl-ide.sourceforge.net/
317
ac1094a1 318Open Perl IDE is an integrated development environment for writing
319and debugging Perl scripts with ActiveState's ActivePerl distribution
320under Windows 95/98/NT/2000.
321
28b41a80 322=item OptiPerl
323
b68463f7 324http://www.optiperl.com/
325
326OptiPerl is a Windows IDE with simulated CGI environment, including
327debugger and syntax highlighting editor.
28b41a80 328
109f0441 329=item Padre
330
331http://padre.perlide.org/
332
589a5df2 333Padre is cross-platform IDE for Perl written in Perl using wxWidgets to provide
334a native look and feel. It's open source under the Artistic License.
109f0441 335
5ca69f12 336=item PerlBuilder
337
b68463f7 338http://www.solutionsoft.com/perl.htm
339
109f0441 340PerlBuilder is an integrated development environment for Windows that
b68463f7 341supports Perl development.
8782d048 342
68fbfbd7 343=item visiPerl+
344
b68463f7 345http://helpconsulting.net/visiperl/
346
ac1094a1 347From Help Consulting, for Windows.
68fbfbd7 348
28b41a80 349=item Visual Perl
350
b68463f7 351http://www.activestate.com/Products/Visual_Perl/
352
28b41a80 353Visual Perl is a Visual Studio.NET plug-in from ActiveState.
29b1171f 354
b68463f7 355=item Zeus
356
357http://www.zeusedit.com/lookmain.html
358
359Zeus for Window is another Win32 multi-language editor/IDE
360that comes with support for Perl:
29b1171f 361
68fbfbd7 362=back
363
b68463f7 364For editors: if you're on Unix you probably have vi or a vi clone
365already, and possibly an emacs too, so you may not need to download
366anything. In any emacs the cperl-mode (M-x cperl-mode) gives you
367perhaps the best available Perl editing mode in any editor.
368
369If you are using Windows, you can use any editor that lets you work
589a5df2 370with plain text, such as NotePad or WordPad. Word processors, such as
b68463f7 371Microsoft Word or WordPerfect, typically do not work since they insert
372all sorts of behind-the-scenes information, although some allow you to
589a5df2 373save files as "Text Only". You can also download text editors designed
374specifically for programming, such as Textpad (
375http://www.textpad.com/ ) and UltraEdit ( http://www.ultraedit.com/ ),
376among others.
377
378If you are using MacOS, the same concerns apply. MacPerl (for Classic
379environments) comes with a simple editor. Popular external editors are
380BBEdit ( http://www.bbedit.com/ ) or Alpha (
381http://www.his.com/~jguyer/Alpha/Alpha8.html ). MacOS X users can use
382Unix editors as well.
383
384=over 4
385
386=item GNU Emacs
387
388http://www.gnu.org/software/emacs/windows/ntemacs.html
389
390=item MicroEMACS
391
392http://www.microemacs.de/
393
394=item XEmacs
395
396http://www.xemacs.org/Download/index.html
397
398=item Jed
399
400http://space.mit.edu/~davis/jed/
401
402=back
403
404or a vi clone such as
405
406=over 4
407
408=item Elvis
409
410ftp://ftp.cs.pdx.edu/pub/elvis/ http://www.fh-wedel.de/elvis/
411
412=item Vile
413
414http://dickey.his.com/vile/vile.html
415
416=item Vim
417
418http://www.vim.org/
419
420=back
421
422For vi lovers in general, Windows or elsewhere:
423
424 http://www.thomer.com/thomer/vi/vi.html
425
426nvi ( http://www.bostic.com/vi/ , available from CPAN in src/misc/) is
427yet another vi clone, unfortunately not available for Windows, but in
428UNIX platforms you might be interested in trying it out, firstly because
429strictly speaking it is not a vi clone, it is the real vi, or the new
430incarnation of it, and secondly because you can embed Perl inside it
431to use Perl as the scripting language. nvi is not alone in this,
432though: at least also vim and vile offer an embedded Perl.
433
434The following are Win32 multilanguage editor/IDEs that support Perl:
435
436=over 4
437
438=item Codewright
439
440http://www.borland.com/codewright/
441
442=item MultiEdit
443
444http://www.MultiEdit.com/
445
446=item SlickEdit
447
448http://www.slickedit.com/
449
450=item ConTEXT
451
452http://www.contexteditor.org/
453
454=back
455
456There is also a toyedit Text widget based editor written in Perl
457that is distributed with the Tk module on CPAN. The ptkdb
458( http://ptkdb.sourceforge.net/ ) is a Perl/tk based debugger that
459acts as a development environment of sorts. Perl Composer
460( http://perlcomposer.sourceforge.net/ ) is an IDE for Perl/Tk
461GUI creation.
462
463In addition to an editor/IDE you might be interested in a more
464powerful shell environment for Win32. Your options include
465
466=over 4
467
468=item Bash
469
470from the Cygwin package ( http://sources.redhat.com/cygwin/ )
471
472=item Ksh
473
474from the MKS Toolkit ( http://www.mkssoftware.com/ ), or the Bourne shell of
475the U/WIN environment ( http://www.research.att.com/sw/tools/uwin/ )
476
477=item Tcsh
478
479ftp://ftp.astron.com/pub/tcsh/ , see also
480http://www.primate.wisc.edu/software/csh-tcsh-book/
481
482=item Zsh
483
484http://www.zsh.org/
485
486=back
487
488MKS and U/WIN are commercial (U/WIN is free for educational and
489research purposes), Cygwin is covered by the GNU General Public
490License (but that shouldn't matter for Perl use). The Cygwin, MKS,
491and U/WIN all contain (in addition to the shells) a comprehensive set
492of standard UNIX toolkit utilities.
493
494If you're transferring text files between Unix and Windows using FTP
495be sure to transfer them in ASCII mode so the ends of lines are
496appropriately converted.
497
498On Mac OS the MacPerl Application comes with a simple 32k text editor
499that behaves like a rudimentary IDE. In contrast to the MacPerl Application
500the MPW Perl tool can make use of the MPW Shell itself as an editor (with
501no 32k limit).
502
503=over 4
504
505=item Affrus
506
507is a full Perl development environment with full debugger support
508( http://www.latenightsw.com ).
509
510=item Alpha
511
512is an editor, written and extensible in Tcl, that nonetheless has
513built in support for several popular markup and programming languages
514including Perl and HTML ( http://www.his.com/~jguyer/Alpha/Alpha8.html ).
515
516=item BBEdit and BBEdit Lite
517
518are text editors for Mac OS that have a Perl sensitivity mode
519( http://web.barebones.com/ ).
520
521=back
522
523=head2 Where can I get Perl macros for vi?
524
525For a complete version of Tom Christiansen's vi configuration file,
526see http://www.cpan.org/authors/Tom_Christiansen/scripts/toms.exrc.gz ,
527the standard benchmark file for vi emulators. The file runs best with nvi,
528the current version of vi out of Berkeley, which incidentally can be built
529with an embedded Perl interpreter--see http://www.cpan.org/src/misc/ .
530
531=head2 Where can I get perl-mode for emacs?
532
533Since Emacs version 19 patchlevel 22 or so, there have been both a
534perl-mode.el and support for the Perl debugger built in. These should
535come with the standard Emacs 19 distribution.
536
537In the Perl source directory, you'll find a directory called "emacs",
538which contains a cperl-mode that color-codes keywords, provides
539context-sensitive help, and other nifty things.
540
541Note that the perl-mode of emacs will have fits with C<"main'foo">
542(single quote), and mess up the indentation and highlighting. You
543are probably using C<"main::foo"> in new Perl code anyway, so this
544shouldn't be an issue.
545
546=head2 How can I use curses with Perl?
547
548The Curses module from CPAN provides a dynamically loadable object
549module interface to a curses library. A small demo can be found at the
550directory http://www.cpan.org/authors/Tom_Christiansen/scripts/rep.gz ;
551this program repeats a command and updates the screen as needed, rendering
552B<rep ps axu> similar to B<top>.
553
554=head2 How can I write a GUI (X, Tk, Gtk, etc.) in Perl?
555X<GUI> X<Tk> X<Wx> X<WxWidgets> X<Gtk> X<Gtk2> X<CamelBones> X<Qt>
556
557(contributed by Ben Morrow)
558
559There are a number of modules which let you write GUIs in Perl. Most
560GUI toolkits have a perl interface: an incomplete list follows.
561
562=over 4
563
564=item Tk
565
566This works under Unix and Windows, and the current version doesn't
567look half as bad under Windows as it used to. Some of the gui elements
568still don't 'feel' quite right, though. The interface is very natural
569and 'perlish', making it easy to use in small scripts that just need a
570simple gui. It hasn't been updated in a while.
571
572=item Wx
573
574This is a Perl binding for the cross-platform wxWidgets toolkit
575( http://www.wxwidgets.org ). It works under Unix, Win32 and Mac OS X,
576using native widgets (Gtk under Unix). The interface follows the C++
577interface closely, but the documentation is a little sparse for someone
578who doesn't know the library, mostly just referring you to the C++
579documentation.
580
581=item Gtk and Gtk2
582
583These are Perl bindings for the Gtk toolkit ( http://www.gtk.org ). The
584interface changed significantly between versions 1 and 2 so they have
585separate Perl modules. It runs under Unix, Win32 and Mac OS X (currently
586it requires an X server on Mac OS, but a 'native' port is underway), and
587the widgets look the same on every plaform: i.e., they don't match the
588native widgets. As with Wx, the Perl bindings follow the C API closely,
589and the documentation requires you to read the C documentation to
590understand it.
591
592=item Win32::GUI
593
594This provides access to most of the Win32 GUI widgets from Perl.
595Obviously, it only runs under Win32, and uses native widgets. The Perl
596interface doesn't really follow the C interface: it's been made more
597Perlish, and the documentation is pretty good. More advanced stuff may
598require familiarity with the C Win32 APIs, or reference to MSDN.
599
600=item CamelBones
601
602CamelBones ( http://camelbones.sourceforge.net ) is a Perl interface to
603Mac OS X's Cocoa GUI toolkit, and as such can be used to produce native
604GUIs on Mac OS X. It's not on CPAN, as it requires frameworks that
605CPAN.pm doesn't know how to install, but installation is via the
606standard OSX package installer. The Perl API is, again, very close to
607the ObjC API it's wrapping, and the documentation just tells you how to
608translate from one to the other.
609
610=item Qt
611
612There is a Perl interface to TrollTech's Qt toolkit, but it does not
613appear to be maintained.
614
615=item Athena
616
617Sx is an interface to the Athena widget set which comes with X, but
618again it appears not to be much used nowadays.
619
620=back
621
622=head2 How can I make my Perl program run faster?
623
624The best way to do this is to come up with a better algorithm. This
625can often make a dramatic difference. Jon Bentley's book
626I<Programming Pearls> (that's not a misspelling!) has some good tips
627on optimization, too. Advice on benchmarking boils down to: benchmark
628and profile to make sure you're optimizing the right part, look for
629better algorithms instead of microtuning your code, and when all else
630fails consider just buying faster hardware. You will probably want to
631read the answer to the earlier question "How do I profile my Perl
632programs?" if you haven't done so already.
633
634A different approach is to autoload seldom-used Perl code. See the
635AutoSplit and AutoLoader modules in the standard distribution for
636that. Or you could locate the bottleneck and think about writing just
637that part in C, the way we used to take bottlenecks in C code and
638write them in assembler. Similar to rewriting in C, modules that have
639critical sections can be written in C (for instance, the PDL module
640from CPAN).
641
642If you're currently linking your perl executable to a shared
643I<libc.so>, you can often gain a 10-25% performance benefit by
644rebuilding it to link with a static libc.a instead. This will make a
645bigger perl executable, but your Perl programs (and programmers) may
646thank you for it. See the F<INSTALL> file in the source distribution
647for more information.
648
649The undump program was an ancient attempt to speed up Perl program by
650storing the already-compiled form to disk. This is no longer a viable
651option, as it only worked on a few architectures, and wasn't a good
652solution anyway.
653
654=head2 How can I make my Perl program take less memory?
655
656When it comes to time-space tradeoffs, Perl nearly always prefers to
657throw memory at a problem. Scalars in Perl use more memory than
658strings in C, arrays take more than that, and hashes use even more. While
659there's still a lot to be done, recent releases have been addressing
660these issues. For example, as of 5.004, duplicate hash keys are
661shared amongst all hashes using them, so require no reallocation.
662
663In some cases, using substr() or vec() to simulate arrays can be
664highly beneficial. For example, an array of a thousand booleans will
665take at least 20,000 bytes of space, but it can be turned into one
666125-byte bit vector--a considerable memory savings. The standard
667Tie::SubstrHash module can also help for certain types of data
668structure. If you're working with specialist data structures
669(matrices, for instance) modules that implement these in C may use
670less memory than equivalent Perl modules.
671
672Another thing to try is learning whether your Perl was compiled with
673the system malloc or with Perl's builtin malloc. Whichever one it
674is, try using the other one and see whether this makes a difference.
675Information about malloc is in the F<INSTALL> file in the source
676distribution. You can find out whether you are using perl's malloc by
677typing C<perl -V:usemymalloc>.
678
679Of course, the best way to save memory is to not do anything to waste
680it in the first place. Good programming practices can go a long way
681toward this:
682
683=over 4
684
685=item * Don't slurp!
686
687Don't read an entire file into memory if you can process it line
688by line. Or more concretely, use a loop like this:
689
690 #
691 # Good Idea
692 #
693 while (<FILE>) {
694 # ...
695 }
696
697instead of this:
698
699 #
700 # Bad Idea
701 #
702 @data = <FILE>;
703 foreach (@data) {
704 # ...
705 }
706
707When the files you're processing are small, it doesn't much matter which
708way you do it, but it makes a huge difference when they start getting
709larger.
710
711=item * Use map and grep selectively
712
713Remember that both map and grep expect a LIST argument, so doing this:
714
715 @wanted = grep {/pattern/} <FILE>;
716
717will cause the entire file to be slurped. For large files, it's better
718to loop:
719
720 while (<FILE>) {
721 push(@wanted, $_) if /pattern/;
722 }
723
724=item * Avoid unnecessary quotes and stringification
725
726Don't quote large strings unless absolutely necessary:
727
728 my $copy = "$large_string";
729
730makes 2 copies of $large_string (one for $copy and another for the
731quotes), whereas
732
733 my $copy = $large_string;
734
735only makes one copy.
736
737Ditto for stringifying large arrays:
738
739 {
740 local $, = "\n";
741 print @big_array;
742 }
743
744is much more memory-efficient than either
745
746 print join "\n", @big_array;
747
748or
749
750 {
751 local $" = "\n";
752 print "@big_array";
753 }
754
755
756=item * Pass by reference
757
758Pass arrays and hashes by reference, not by value. For one thing, it's
759the only way to pass multiple lists or hashes (or both) in a single
760call/return. It also avoids creating a copy of all the contents. This
761requires some judgement, however, because any changes will be propagated
762back to the original data. If you really want to mangle (er, modify) a
763copy, you'll have to sacrifice the memory needed to make one.
764
765=item * Tie large variables to disk.
766
767For "big" data stores (i.e. ones that exceed available memory) consider
768using one of the DB modules to store it on disk instead of in RAM. This
769will incur a penalty in access time, but that's probably better than
770causing your hard disk to thrash due to massive swapping.
771
772=back
773
774=head2 Is it safe to return a reference to local or lexical data?
775
776Yes. Perl's garbage collection system takes care of this so
777everything works out right.
778
779 sub makeone {
780 my @a = ( 1 .. 10 );
781 return \@a;
782 }
783
784 for ( 1 .. 10 ) {
785 push @many, makeone();
786 }
787
788 print $many[4][5], "\n";
789
790 print "@many\n";
791
792=head2 How can I free an array or hash so my program shrinks?
793
794(contributed by Michael Carman)
795
796You usually can't. Memory allocated to lexicals (i.e. my() variables)
797cannot be reclaimed or reused even if they go out of scope. It is
798reserved in case the variables come back into scope. Memory allocated
799to global variables can be reused (within your program) by using
800undef() and/or delete().
801
802On most operating systems, memory allocated to a program can never be
803returned to the system. That's why long-running programs sometimes re-
804exec themselves. Some operating systems (notably, systems that use
805mmap(2) for allocating large chunks of memory) can reclaim memory that
806is no longer used, but on such systems, perl must be configured and
807compiled to use the OS's malloc, not perl's.
808
809In general, memory allocation and de-allocation isn't something you can
810or should be worrying about much in Perl.
811
812See also "How can I make my Perl program take less memory?"
813
814=head2 How can I make my CGI script more efficient?
815
816Beyond the normal measures described to make general Perl programs
817faster or smaller, a CGI program has additional issues. It may be run
818several times per second. Given that each time it runs it will need
819to be re-compiled and will often allocate a megabyte or more of system
820memory, this can be a killer. Compiling into C B<isn't going to help
821you> because the process start-up overhead is where the bottleneck is.
822
823There are two popular ways to avoid this overhead. One solution
824involves running the Apache HTTP server (available from
825http://www.apache.org/ ) with either of the mod_perl or mod_fastcgi
826plugin modules.
827
828With mod_perl and the Apache::Registry module (distributed with
829mod_perl), httpd will run with an embedded Perl interpreter which
830pre-compiles your script and then executes it within the same address
831space without forking. The Apache extension also gives Perl access to
832the internal server API, so modules written in Perl can do just about
833anything a module written in C can. For more on mod_perl, see
834http://perl.apache.org/
835
836With the FCGI module (from CPAN) and the mod_fastcgi
837module (available from http://www.fastcgi.com/ ) each of your Perl
838programs becomes a permanent CGI daemon process.
839
840Both of these solutions can have far-reaching effects on your system
841and on the way you write your CGI programs, so investigate them with
842care.
843
844See http://www.cpan.org/modules/by-category/15_World_Wide_Web_HTML_HTTP_CGI/ .
845
846=head2 How can I hide the source for my Perl program?
847
848Delete it. :-) Seriously, there are a number of (mostly
849unsatisfactory) solutions with varying levels of "security".
850
851First of all, however, you I<can't> take away read permission, because
852the source code has to be readable in order to be compiled and
853interpreted. (That doesn't mean that a CGI script's source is
854readable by people on the web, though--only by people with access to
855the filesystem.) So you have to leave the permissions at the socially
856friendly 0755 level.
857
858Some people regard this as a security problem. If your program does
859insecure things and relies on people not knowing how to exploit those
860insecurities, it is not secure. It is often possible for someone to
861determine the insecure things and exploit them without viewing the
862source. Security through obscurity, the name for hiding your bugs
863instead of fixing them, is little security indeed.
864
865You can try using encryption via source filters (Starting from Perl
8665.8 the Filter::Simple and Filter::Util::Call modules are included in
867the standard distribution), but any decent programmer will be able to
868decrypt it. You can try using the byte code compiler and interpreter
869described later in L<perlfaq3>, but the curious might still be able to
870de-compile it. You can try using the native-code compiler described
871later, but crackers might be able to disassemble it. These pose
872varying degrees of difficulty to people wanting to get at your code,
873but none can definitively conceal it (true of every language, not just
874Perl).
875
876It is very easy to recover the source of Perl programs. You simply
877feed the program to the perl interpreter and use the modules in
878the B:: hierarchy. The B::Deparse module should be able to
879defeat most attempts to hide source. Again, this is not
880unique to Perl.
881
882If you're concerned about people profiting from your code, then the
883bottom line is that nothing but a restrictive license will give you
884legal security. License your software and pepper it with threatening
885statements like "This is unpublished proprietary software of XYZ Corp.
886Your access to it does not give you permission to use it blah blah
887blah." We are not lawyers, of course, so you should see a lawyer if
888you want to be sure your license's wording will stand up in court.
889
890=head2 How can I compile my Perl program into byte code or C?
891
892(contributed by brian d foy)
893
894In general, you can't do this. There are some things that may work
895for your situation though. People usually ask this question
896because they want to distribute their works without giving away
897the source code, and most solutions trade disk space for convenience.
898You probably won't see much of a speed increase either, since most
899solutions simply bundle a Perl interpreter in the final product
900(but see L<How can I make my Perl program run faster?>).
901
902The Perl Archive Toolkit ( http://par.perl.org/ ) is Perl's
903analog to Java's JAR. It's freely available and on CPAN (
904http://search.cpan.org/dist/PAR/ ).
905
906There are also some commercial products that may work for you, although
907you have to buy a license for them.
908
909The Perl Dev Kit ( http://www.activestate.com/Products/Perl_Dev_Kit/ )
910from ActiveState can "Turn your Perl programs into ready-to-run
911executables for HP-UX, Linux, Solaris and Windows."
912
913Perl2Exe ( http://www.indigostar.com/perl2exe.htm ) is a command line
914program for converting perl scripts to executable files. It targets both
915Windows and unix platforms.
916
917=head2 How can I get C<#!perl> to work on [MS-DOS,NT,...]?
918
919For OS/2 just use
920
921 extproc perl -S -your_switches
922
923as the first line in C<*.cmd> file (C<-S> due to a bug in cmd.exe's
924"extproc" handling). For DOS one should first invent a corresponding
925batch file and codify it in C<ALTERNATE_SHEBANG> (see the
926F<dosish.h> file in the source distribution for more information).
927
928The Win95/NT installation, when using the ActiveState port of Perl,
929will modify the Registry to associate the C<.pl> extension with the
930perl interpreter. If you install another port, perhaps even building
931your own Win95/NT Perl from the standard sources by using a Windows port
932of gcc (e.g., with cygwin or mingw32), then you'll have to modify
933the Registry yourself. In addition to associating C<.pl> with the
934interpreter, NT people can use: C<SET PATHEXT=%PATHEXT%;.PL> to let them
935run the program C<install-linux.pl> merely by typing C<install-linux>.
936
937Under "Classic" MacOS, a perl program will have the appropriate Creator and
938Type, so that double-clicking them will invoke the MacPerl application.
939Under Mac OS X, clickable apps can be made from any C<#!> script using Wil
940Sanchez' DropScript utility: http://www.wsanchez.net/software/ .
941
942I<IMPORTANT!>: Whatever you do, PLEASE don't get frustrated, and just
943throw the perl interpreter into your cgi-bin directory, in order to
944get your programs working for a web server. This is an EXTREMELY big
945security risk. Take the time to figure out how to do it correctly.
946
947=head2 Can I write useful Perl programs on the command line?
948
949Yes. Read L<perlrun> for more information. Some examples follow.
950(These assume standard Unix shell quoting rules.)
951
952 # sum first and last fields
953 perl -lane 'print $F[0] + $F[-1]' *
954
955 # identify text files
956 perl -le 'for(@ARGV) {print if -f && -T _}' *
957
958 # remove (most) comments from C program
959 perl -0777 -pe 's{/\*.*?\*/}{}gs' foo.c
960
961 # make file a month younger than today, defeating reaper daemons
962 perl -e '$X=24*60*60; utime(time(),time() + 30 * $X,@ARGV)' *
963
964 # find first unused uid
965 perl -le '$i++ while getpwuid($i); print $i'
966
967 # display reasonable manpath
968 echo $PATH | perl -nl -072 -e '
969 s![^/+]*$!man!&&-d&&!$s{$_}++&&push@m,$_;END{print"@m"}'
970
971OK, the last one was actually an Obfuscated Perl Contest entry. :-)
972
973=head2 Why don't Perl one-liners work on my DOS/Mac/VMS system?
974
975The problem is usually that the command interpreters on those systems
976have rather different ideas about quoting than the Unix shells under
977which the one-liners were created. On some systems, you may have to
978change single-quotes to double ones, which you must I<NOT> do on Unix
979or Plan9 systems. You might also have to change a single % to a %%.
980
981For example:
982
983 # Unix (including Mac OS X)
984 perl -e 'print "Hello world\n"'
985
986 # DOS, etc.
987 perl -e "print \"Hello world\n\""
988
989 # Mac Classic
990 print "Hello world\n"
991 (then Run "Myscript" or Shift-Command-R)
992
993 # MPW
994 perl -e 'print "Hello world\n"'
995
996 # VMS
997 perl -e "print ""Hello world\n"""
998
999The problem is that none of these examples are reliable: they depend on the
1000command interpreter. Under Unix, the first two often work. Under DOS,
1001it's entirely possible that neither works. If 4DOS was the command shell,
1002you'd probably have better luck like this:
1003
1004 perl -e "print <Ctrl-x>"Hello world\n<Ctrl-x>""
1005
1006Under the Mac, it depends which environment you are using. The MacPerl
1007shell, or MPW, is much like Unix shells in its support for several
1008quoting variants, except that it makes free use of the Mac's non-ASCII
1009characters as control characters.
1010
1011Using qq(), q(), and qx(), instead of "double quotes", 'single
1012quotes', and `backticks`, may make one-liners easier to write.
1013
1014There is no general solution to all of this. It is a mess.
1015
1016[Some of this answer was contributed by Kenneth Albanowski.]
1017
1018=head2 Where can I learn about CGI or Web programming in Perl?
1019
1020For modules, get the CGI or LWP modules from CPAN. For textbooks,
1021see the two especially dedicated to web stuff in the question on
1022books. For problems and questions related to the web, like "Why
1023do I get 500 Errors" or "Why doesn't it run from the browser right
1024when it runs fine on the command line", see the troubleshooting
1025guides and references in L<perlfaq9> or in the CGI MetaFAQ:
1026
1027 http://www.perl.org/CGI_MetaFAQ.html
1028
1029=head2 Where can I learn about object-oriented Perl programming?
1030
1031A good place to start is L<perltoot>, and you can use L<perlobj>,
1032L<perlboot>, L<perltoot>, L<perltooc>, and L<perlbot> for reference.
1033
1034A good book on OO on Perl is the "Object-Oriented Perl"
1035by Damian Conway from Manning Publications, or "Intermediate Perl"
1036by Randal Schwartz, brian d foy, and Tom Phoenix from O'Reilly Media.
1037
1038=head2 Where can I learn about linking C with Perl?
1039
1040If you want to call C from Perl, start with L<perlxstut>,
1041moving on to L<perlxs>, L<xsubpp>, and L<perlguts>. If you want to
1042call Perl from C, then read L<perlembed>, L<perlcall>, and
1043L<perlguts>. Don't forget that you can learn a lot from looking at
1044how the authors of existing extension modules wrote their code and
1045solved their problems.
1046
1047You might not need all the power of XS. The Inline::C module lets
1048you put C code directly in your Perl source. It handles all the
1049magic to make it work. You still have to learn at least some of
1050the perl API but you won't have to deal with the complexity of the
1051XS support files.
1052
1053=head2 I've read perlembed, perlguts, etc., but I can't embed perl in my C program; what am I doing wrong?
1054
1055Download the ExtUtils::Embed kit from CPAN and run `make test'. If
1056the tests pass, read the pods again and again and again. If they
1057fail, see L<perlbug> and send a bug report with the output of
1058C<make test TEST_VERBOSE=1> along with C<perl -V>.
1059
1060=head2 When I tried to run my script, I got this message. What does it mean?
1061
1062A complete list of Perl's error messages and warnings with explanatory
1063text can be found in L<perldiag>. You can also use the splain program
1064(distributed with Perl) to explain the error messages:
1065
1066 perl program 2>diag.out
1067 splain [-v] [-p] diag.out
1068
1069or change your program to explain the messages for you:
1070
1071 use diagnostics;
1072
1073or
1074
1075 use diagnostics -verbose;
1076
1077=head2 What's MakeMaker?
1078
1079(contributed by brian d foy)
1080
1081The C<ExtUtils::MakeMaker> module, better known simply as "MakeMaker",
1082turns a Perl script, typically called C<Makefile.PL>, into a Makefile.
1083The unix tool C<make> uses this file to manage dependencies and actions
1084to process and install a Perl distribution.
1085
1086=head1 REVISION
1087
1088Revision: $Revision$
1089
1090Date: $Date$
1091
1092See L<perlfaq> for source control details and availability.
1093
1094=head1 AUTHOR AND COPYRIGHT
1095
1096Copyright (c) 1997-2009 Tom Christiansen, Nathan Torkington, and
1097other authors as noted. All rights reserved.
1098
1099This documentation is free; you can redistribute it and/or modify it
1100under the same terms as Perl itself.
1101
1102Irrespective of its distribution, all code examples here are in the public
1103domain. You are permitted and encouraged to use this code and any
1104derivatives thereof in your own programs for fun or for profit as you
1105see fit. A simple comment in the code giving credit to the FAQ would
1106be courteous but is not required.