The perlio warnings are not mandatory.
[p5sagit/p5-mst-13.2.git] / pod / perlipc.pod
CommitLineData
a0d0e21e 1=head1 NAME
2
184e9718 3perlipc - Perl interprocess communication (signals, fifos, pipes, safe subprocesses, sockets, and semaphores)
a0d0e21e 4
5=head1 DESCRIPTION
6
4633a7c4 7The basic IPC facilities of Perl are built out of the good old Unix
8signals, named pipes, pipe opens, the Berkeley socket routines, and SysV
9IPC calls. Each is used in slightly different situations.
10
11=head1 Signals
12
490f90af 13Perl uses a simple signal handling model: the %SIG hash contains names
14or references of user-installed signal handlers. These handlers will
15be called with an argument which is the name of the signal that
16triggered it. A signal may be generated intentionally from a
17particular keyboard sequence like control-C or control-Z, sent to you
18from another process, or triggered automatically by the kernel when
19special events transpire, like a child process exiting, your process
20running out of stack space, or hitting file size limit.
4633a7c4 21
a11adca0 22For example, to trap an interrupt signal, set up a handler like this:
4633a7c4 23
24 sub catch_zap {
25 my $signame = shift;
26 $shucks++;
27 die "Somebody sent me a SIG$signame";
54310121 28 }
4633a7c4 29 $SIG{INT} = 'catch_zap'; # could fail in modules
30 $SIG{INT} = \&catch_zap; # best strategy
31
490f90af 32Prior to Perl 5.7.3 it was necessary to do as little as you possibly
33could in your handler; notice how all we do is set a global variable
34and then raise an exception. That's because on most systems,
35libraries are not re-entrant; particularly, memory allocation and I/O
36routines are not. That meant that doing nearly I<anything> in your
37handler could in theory trigger a memory fault and subsequent core
38dump - see L<Deferred Signals> below.
a11adca0 39
4633a7c4 40The names of the signals are the ones listed out by C<kill -l> on your
41system, or you can retrieve them from the Config module. Set up an
42@signame list indexed by number to get the name and a %signo table
43indexed by name to get the number:
44
45 use Config;
46 defined $Config{sig_name} || die "No sigs?";
47 foreach $name (split(' ', $Config{sig_name})) {
48 $signo{$name} = $i;
49 $signame[$i] = $name;
50 $i++;
54310121 51 }
4633a7c4 52
6a3992aa 53So to check whether signal 17 and SIGALRM were the same, do just this:
4633a7c4 54
55 print "signal #17 = $signame[17]\n";
54310121 56 if ($signo{ALRM}) {
4633a7c4 57 print "SIGALRM is $signo{ALRM}\n";
54310121 58 }
4633a7c4 59
60You may also choose to assign the strings C<'IGNORE'> or C<'DEFAULT'> as
61the handler, in which case Perl will try to discard the signal or do the
f648820c 62default thing.
63
19799a22 64On most Unix platforms, the C<CHLD> (sometimes also known as C<CLD>) signal
f648820c 65has special behavior with respect to a value of C<'IGNORE'>.
66Setting C<$SIG{CHLD}> to C<'IGNORE'> on such a platform has the effect of
67not creating zombie processes when the parent process fails to C<wait()>
68on its child processes (i.e. child processes are automatically reaped).
69Calling C<wait()> with C<$SIG{CHLD}> set to C<'IGNORE'> usually returns
70C<-1> on such platforms.
71
72Some signals can be neither trapped nor ignored, such as
4633a7c4 73the KILL and STOP (but not the TSTP) signals. One strategy for
74temporarily ignoring signals is to use a local() statement, which will be
75automatically restored once your block is exited. (Remember that local()
76values are "inherited" by functions called from within that block.)
77
78 sub precious {
79 local $SIG{INT} = 'IGNORE';
80 &more_functions;
54310121 81 }
4633a7c4 82 sub more_functions {
83 # interrupts still ignored, for now...
54310121 84 }
4633a7c4 85
86Sending a signal to a negative process ID means that you send the signal
fb73857a 87to the entire Unix process-group. This code sends a hang-up signal to all
88processes in the current process group (and sets $SIG{HUP} to IGNORE so
89it doesn't kill itself):
4633a7c4 90
91 {
92 local $SIG{HUP} = 'IGNORE';
93 kill HUP => -$$;
94 # snazzy writing of: kill('HUP', -$$)
95 }
a0d0e21e 96
4633a7c4 97Another interesting signal to send is signal number zero. This doesn't
98actually affect another process, but instead checks whether it's alive
54310121 99or has changed its UID.
a0d0e21e 100
4633a7c4 101 unless (kill 0 => $kid_pid) {
102 warn "something wicked happened to $kid_pid";
54310121 103 }
a0d0e21e 104
4633a7c4 105You might also want to employ anonymous functions for simple signal
106handlers:
a0d0e21e 107
4633a7c4 108 $SIG{INT} = sub { die "\nOutta here!\n" };
a0d0e21e 109
4633a7c4 110But that will be problematic for the more complicated handlers that need
54310121 111to reinstall themselves. Because Perl's signal mechanism is currently
184e9718 112based on the signal(3) function from the C library, you may sometimes be so
4633a7c4 113misfortunate as to run on systems where that function is "broken", that
114is, it behaves in the old unreliable SysV way rather than the newer, more
115reasonable BSD and POSIX fashion. So you'll see defensive people writing
116signal handlers like this:
a0d0e21e 117
54310121 118 sub REAPER {
4633a7c4 119 $waitedpid = wait;
6a3992aa 120 # loathe sysV: it makes us not only reinstate
121 # the handler, but place it after the wait
54310121 122 $SIG{CHLD} = \&REAPER;
4633a7c4 123 }
124 $SIG{CHLD} = \&REAPER;
125 # now do something that forks...
126
816229cf 127or better still:
4633a7c4 128
6a3992aa 129 use POSIX ":sys_wait_h";
54310121 130 sub REAPER {
4633a7c4 131 my $child;
816229cf 132 # If a second child dies while in the signal handler caused by the
133 # first death, we won't get another signal. So must loop here else
134 # we will leave the unreaped child as a zombie. And the next time
135 # two children die we get another zombie. And so on.
1450d070 136 while (($child = waitpid(-1,WNOHANG)) > 0) {
4633a7c4 137 $Kid_Status{$child} = $?;
54310121 138 }
6a3992aa 139 $SIG{CHLD} = \&REAPER; # still loathe sysV
4633a7c4 140 }
141 $SIG{CHLD} = \&REAPER;
142 # do something that forks...
143
144Signal handling is also used for timeouts in Unix, While safely
145protected within an C<eval{}> block, you set a signal handler to trap
146alarm signals and then schedule to have one delivered to you in some
147number of seconds. Then try your blocking operation, clearing the alarm
148when it's done but not before you've exited your C<eval{}> block. If it
149goes off, you'll use die() to jump out of the block, much as you might
150using longjmp() or throw() in other languages.
151
152Here's an example:
153
54310121 154 eval {
4633a7c4 155 local $SIG{ALRM} = sub { die "alarm clock restart" };
54310121 156 alarm 10;
4633a7c4 157 flock(FH, 2); # blocking write lock
54310121 158 alarm 0;
4633a7c4 159 };
160 if ($@ and $@ !~ /alarm clock restart/) { die }
161
8a4f6ac2 162If the operation being timed out is system() or qx(), this technique
163is liable to generate zombies. If this matters to you, you'll
164need to do your own fork() and exec(), and kill the errant child process.
165
4633a7c4 166For more complex signal handling, you might see the standard POSIX
167module. Lamentably, this is almost entirely undocumented, but
168the F<t/lib/posix.t> file from the Perl source distribution has some
169examples in it.
170
28494392 171=head2 Handling the SIGHUP Signal in Daemons
172
173A process that usually starts when the system boots and shuts down
174when the system is shut down is called a daemon (Disk And Execution
175MONitor). If a daemon process has a configuration file which is
176modified after the process has been started, there should be a way to
177tell that process to re-read its configuration file, without stopping
178the process. Many daemons provide this mechanism using the C<SIGHUP>
179signal handler. When you want to tell the daemon to re-read the file
180you simply send it the C<SIGHUP> signal.
181
3031ea75 182Not all platforms automatically reinstall their (native) signal
183handlers after a signal delivery. This means that the handler works
184only the first time the signal is sent. The solution to this problem
185is to use C<POSIX> signal handlers if available, their behaviour
186is well-defined.
28494392 187
188The following example implements a simple daemon, which restarts
189itself every time the C<SIGHUP> signal is received. The actual code is
190located in the subroutine C<code()>, which simply prints some debug
191info to show that it works and should be replaced with the real code.
192
193 #!/usr/bin/perl -w
194
195 use POSIX ();
196 use FindBin ();
197 use File::Basename ();
198 use File::Spec::Functions;
199
200 $|=1;
201
202 # make the daemon cross-platform, so exec always calls the script
203 # itself with the right path, no matter how the script was invoked.
204 my $script = File::Basename::basename($0);
205 my $SELF = catfile $FindBin::Bin, $script;
206
207 # POSIX unmasks the sigprocmask properly
208 my $sigset = POSIX::SigSet->new();
209 my $action = POSIX::SigAction->new('sigHUP_handler',
210 $sigset,
211 &POSIX::SA_NODEFER);
212 POSIX::sigaction(&POSIX::SIGHUP, $action);
213
214 sub sigHUP_handler {
215 print "got SIGHUP\n";
216 exec($SELF, @ARGV) or die "Couldn't restart: $!\n";
217 }
218
219 code();
220
221 sub code {
222 print "PID: $$\n";
223 print "ARGV: @ARGV\n";
224 my $c = 0;
225 while (++$c) {
226 sleep 2;
227 print "$c\n";
228 }
229 }
230 __END__
231
232
4633a7c4 233=head1 Named Pipes
234
235A named pipe (often referred to as a FIFO) is an old Unix IPC
236mechanism for processes communicating on the same machine. It works
54310121 237just like a regular, connected anonymous pipes, except that the
4633a7c4 238processes rendezvous using a filename and don't have to be related.
239
240To create a named pipe, use the Unix command mknod(1) or on some
241systems, mkfifo(1). These may not be in your normal path.
242
243 # system return val is backwards, so && not ||
244 #
245 $ENV{PATH} .= ":/etc:/usr/etc";
54310121 246 if ( system('mknod', $path, 'p')
4633a7c4 247 && system('mkfifo', $path) )
248 {
5a964f20 249 die "mk{nod,fifo} $path failed";
54310121 250 }
4633a7c4 251
252
253A fifo is convenient when you want to connect a process to an unrelated
254one. When you open a fifo, the program will block until there's something
54310121 255on the other end.
4633a7c4 256
257For example, let's say you'd like to have your F<.signature> file be a
258named pipe that has a Perl program on the other end. Now every time any
6a3992aa 259program (like a mailer, news reader, finger program, etc.) tries to read
4633a7c4 260from that file, the reading program will block and your program will
6a3992aa 261supply the new signature. We'll use the pipe-checking file test B<-p>
4633a7c4 262to find out whether anyone (or anything) has accidentally removed our fifo.
263
264 chdir; # go home
265 $FIFO = '.signature';
266 $ENV{PATH} .= ":/etc:/usr/games";
267
268 while (1) {
269 unless (-p $FIFO) {
270 unlink $FIFO;
54310121 271 system('mknod', $FIFO, 'p')
4633a7c4 272 && die "can't mknod $FIFO: $!";
54310121 273 }
4633a7c4 274
275 # next line blocks until there's a reader
276 open (FIFO, "> $FIFO") || die "can't write $FIFO: $!";
277 print FIFO "John Smith (smith\@host.org)\n", `fortune -s`;
278 close FIFO;
6a3992aa 279 sleep 2; # to avoid dup signals
4633a7c4 280 }
a0d0e21e 281
a11adca0 282=head2 Deferred Signals
5a964f20 283
490f90af 284In Perls before Perl 5.7.3 by installing Perl code to deal with
285signals, you were exposing yourself to danger from two things. First,
286few system library functions are re-entrant. If the signal interrupts
287while Perl is executing one function (like malloc(3) or printf(3)),
288and your signal handler then calls the same function again, you could
289get unpredictable behavior--often, a core dump. Second, Perl isn't
290itself re-entrant at the lowest levels. If the signal interrupts Perl
291while Perl is changing its own internal data structures, similarly
292unpredictable behaviour may result.
5a964f20 293
a11adca0 294There were two things you could do, knowing this: be paranoid or be
295pragmatic. The paranoid approach was to do as little as possible in your
5a964f20 296signal handler. Set an existing integer variable that already has a
297value, and return. This doesn't help you if you're in a slow system call,
298which will just restart. That means you have to C<die> to longjump(3) out
299of the handler. Even this is a little cavalier for the true paranoiac,
300who avoids C<die> in a handler because the system I<is> out to get you.
a11adca0 301The pragmatic approach was to say ``I know the risks, but prefer the
302convenience'', and to do anything you wanted in your signal handler,
303and be prepared to clean up core dumps now and again.
304
490f90af 305In Perl 5.7.3 and later to avoid these problems signals are
306"deferred"-- that is when the signal is delivered to the process by
307the system (to the C code that implements Perl) a flag is set, and the
308handler returns immediately. Then at strategic "safe" points in the
309Perl interpreter (e.g. when it is about to execute a new opcode) the
310flags are checked and the Perl level handler from %SIG is
311executed. The "deferred" scheme allows much more flexibility in the
312coding of signal handler as we know Perl interpreter is in a safe
313state, and that we are not in a system library function when the
314handler is called. However the implementation does differ from
315previous Perls in the following ways:
5a964f20 316
a11adca0 317=over 4
5a964f20 318
a11adca0 319=item Long running opcodes
320
490f90af 321As Perl interpreter only looks at the signal flags when it about to
322execute a new opcode if a signal arrives during a long running opcode
323(e.g. a regular expression operation on a very large string) then
324signal will not be seen until operation completes.
a11adca0 325
326=item Interrupting IO
327
490f90af 328When a signal is delivered (e.g. INT control-C) the operating system
329breaks into IO operations like C<read> (used to implement Perls
330E<lt>E<gt> operator). On older Perls the handler was called
331immediately (and as C<read> is not "unsafe" this worked well). With
332the "deferred" scheme the handler is not called immediately, and if
333Perl is using system's C<stdio> library that library may re-start the
334C<read> without returning to Perl and giving it a chance to call the
335%SIG handler. If this happens on your system the solution is to use
336C<:perlio> layer to do IO - at least on those handles which you want
337to be able to break into with signals. (The C<:perlio> layer checks
338the signal flags and calls %SIG handlers before resuming IO operation.)
339
340Note that the default in Perl 5.7.3 and later is to automatically use
341the C<:perlio> layer.
a11adca0 342
343=item Signals as "faults"
344
490f90af 345Certain signals e.g. SEGV, ILL, BUS are generated as a result of
346virtual memory or other "faults". These are normally fatal and there
347is little a Perl-level handler can do with them. (In particular the
348old signal scheme was particularly unsafe in such cases.) However if
349a %SIG handler is set the new scheme simply sets a flag and returns as
350described above. This may cause the operating system to try the
351offending machine instruction again and - as nothing has changed - it
352will generate the signal again. The result of this is a rather odd
353"loop". In future Perl's signal mechanism may be changed to avoid this
354- perhaps by simply disallowing %SIG handlers on signals of that
355type. Until then the work-round is not to set a %SIG handler on those
356signals. (Which signals they are is operating system dependant.)
a11adca0 357
358=item Signals triggered by operating system state
359
490f90af 360On some operating systems certain signal handlers are supposed to "do
361something" before returning. One example can be CHLD or CLD which
362indicates a child process has completed. On some operating systems the
363signal handler is expected to C<wait> for the completed child
364process. On such systems the deferred signal scheme will not work for
365those signals (it does not do the C<wait>). Again the failure will
366look like a loop as the operating system will re-issue the signal as
367there are un-waited-for completed child processes.
a11adca0 368
818c4caa 369=back
a0d0e21e 370
4633a7c4 371=head1 Using open() for IPC
372
490f90af 373Perl's basic open() statement can also be used for unidirectional
374interprocess communication by either appending or prepending a pipe
375symbol to the second argument to open(). Here's how to start
376something up in a child process you intend to write to:
4633a7c4 377
54310121 378 open(SPOOLER, "| cat -v | lpr -h 2>/dev/null")
4633a7c4 379 || die "can't fork: $!";
380 local $SIG{PIPE} = sub { die "spooler pipe broke" };
381 print SPOOLER "stuff\n";
382 close SPOOLER || die "bad spool: $! $?";
383
384And here's how to start up a child process you intend to read from:
385
386 open(STATUS, "netstat -an 2>&1 |")
387 || die "can't fork: $!";
388 while (<STATUS>) {
389 next if /^(tcp|udp)/;
390 print;
54310121 391 }
a2eb9003 392 close STATUS || die "bad netstat: $! $?";
4633a7c4 393
394If one can be sure that a particular program is a Perl script that is
395expecting filenames in @ARGV, the clever programmer can write something
396like this:
397
5a964f20 398 % program f1 "cmd1|" - f2 "cmd2|" f3 < tmpfile
4633a7c4 399
400and irrespective of which shell it's called from, the Perl program will
401read from the file F<f1>, the process F<cmd1>, standard input (F<tmpfile>
402in this case), the F<f2> file, the F<cmd2> command, and finally the F<f3>
403file. Pretty nifty, eh?
404
54310121 405You might notice that you could use backticks for much the
4633a7c4 406same effect as opening a pipe for reading:
407
408 print grep { !/^(tcp|udp)/ } `netstat -an 2>&1`;
409 die "bad netstat" if $?;
410
411While this is true on the surface, it's much more efficient to process the
412file one line or record at a time because then you don't have to read the
19799a22 413whole thing into memory at once. It also gives you finer control of the
4633a7c4 414whole process, letting you to kill off the child process early if you'd
415like.
416
417Be careful to check both the open() and the close() return values. If
418you're I<writing> to a pipe, you should also trap SIGPIPE. Otherwise,
419think of what happens when you start up a pipe to a command that doesn't
420exist: the open() will in all likelihood succeed (it only reflects the
421fork()'s success), but then your output will fail--spectacularly. Perl
422can't know whether the command worked because your command is actually
423running in a separate process whose exec() might have failed. Therefore,
6a3992aa 424while readers of bogus commands return just a quick end of file, writers
4633a7c4 425to bogus command will trigger a signal they'd better be prepared to
426handle. Consider:
427
5a964f20 428 open(FH, "|bogus") or die "can't fork: $!";
429 print FH "bang\n" or die "can't write: $!";
430 close FH or die "can't close: $!";
431
432That won't blow up until the close, and it will blow up with a SIGPIPE.
433To catch it, you could use this:
434
435 $SIG{PIPE} = 'IGNORE';
436 open(FH, "|bogus") or die "can't fork: $!";
437 print FH "bang\n" or die "can't write: $!";
438 close FH or die "can't close: status=$?";
4633a7c4 439
68dc0745 440=head2 Filehandles
441
5a964f20 442Both the main process and any child processes it forks share the same
443STDIN, STDOUT, and STDERR filehandles. If both processes try to access
45bc9206 444them at once, strange things can happen. You may also want to close
5a964f20 445or reopen the filehandles for the child. You can get around this by
446opening your pipe with open(), but on some systems this means that the
447child process cannot outlive the parent.
68dc0745 448
449=head2 Background Processes
450
451You can run a command in the background with:
452
7b05b7e3 453 system("cmd &");
68dc0745 454
455The command's STDOUT and STDERR (and possibly STDIN, depending on your
456shell) will be the same as the parent's. You won't need to catch
457SIGCHLD because of the double-fork taking place (see below for more
458details).
459
460=head2 Complete Dissociation of Child from Parent
461
462In some cases (starting server processes, for instance) you'll want to
893af57a 463completely dissociate the child process from the parent. This is
464often called daemonization. A well behaved daemon will also chdir()
465to the root directory (so it doesn't prevent unmounting the filesystem
466containing the directory from which it was launched) and redirect its
467standard file descriptors from and to F</dev/null> (so that random
468output doesn't wind up on the user's terminal).
469
470 use POSIX 'setsid';
471
472 sub daemonize {
473 chdir '/' or die "Can't chdir to /: $!";
474 open STDIN, '/dev/null' or die "Can't read /dev/null: $!";
475 open STDOUT, '>/dev/null'
476 or die "Can't write to /dev/null: $!";
477 defined(my $pid = fork) or die "Can't fork: $!";
478 exit if $pid;
479 setsid or die "Can't start a new session: $!";
480 open STDERR, '>&STDOUT' or die "Can't dup stdout: $!";
481 }
5a964f20 482
893af57a 483The fork() has to come before the setsid() to ensure that you aren't a
484process group leader (the setsid() will fail if you are). If your
485system doesn't have the setsid() function, open F</dev/tty> and use the
486C<TIOCNOTTY> ioctl() on it instead. See L<tty(4)> for details.
5a964f20 487
893af57a 488Non-Unix users should check their Your_OS::Process module for other
489solutions.
68dc0745 490
4633a7c4 491=head2 Safe Pipe Opens
492
493Another interesting approach to IPC is making your single program go
494multiprocess and communicate between (or even amongst) yourselves. The
495open() function will accept a file argument of either C<"-|"> or C<"|-">
496to do a very interesting thing: it forks a child connected to the
497filehandle you've opened. The child is running the same program as the
498parent. This is useful for safely opening a file when running under an
499assumed UID or GID, for example. If you open a pipe I<to> minus, you can
500write to the filehandle you opened and your kid will find it in his
501STDIN. If you open a pipe I<from> minus, you can read from the filehandle
502you opened whatever your kid writes to his STDOUT.
503
a1ce9542 504 use English '-no_match_vars';
4633a7c4 505 my $sleep_count = 0;
506
54310121 507 do {
c07a80fd 508 $pid = open(KID_TO_WRITE, "|-");
4633a7c4 509 unless (defined $pid) {
510 warn "cannot fork: $!";
511 die "bailing out" if $sleep_count++ > 6;
512 sleep 10;
54310121 513 }
4633a7c4 514 } until defined $pid;
515
516 if ($pid) { # parent
c07a80fd 517 print KID_TO_WRITE @some_data;
518 close(KID_TO_WRITE) || warn "kid exited $?";
4633a7c4 519 } else { # child
520 ($EUID, $EGID) = ($UID, $GID); # suid progs only
54310121 521 open (FILE, "> /safe/file")
4633a7c4 522 || die "can't open /safe/file: $!";
523 while (<STDIN>) {
524 print FILE; # child's STDIN is parent's KID
54310121 525 }
4633a7c4 526 exit; # don't forget this
54310121 527 }
4633a7c4 528
529Another common use for this construct is when you need to execute
530something without the shell's interference. With system(), it's
54310121 531straightforward, but you can't use a pipe open or backticks safely.
4633a7c4 532That's because there's no way to stop the shell from getting its hands on
533your arguments. Instead, use lower-level control to call exec() directly.
534
54310121 535Here's a safe backtick or pipe open for read:
4633a7c4 536
537 # add error processing as above
c07a80fd 538 $pid = open(KID_TO_READ, "-|");
4633a7c4 539
540 if ($pid) { # parent
c07a80fd 541 while (<KID_TO_READ>) {
4633a7c4 542 # do something interesting
54310121 543 }
c07a80fd 544 close(KID_TO_READ) || warn "kid exited $?";
4633a7c4 545
546 } else { # child
547 ($EUID, $EGID) = ($UID, $GID); # suid only
548 exec($program, @options, @args)
549 || die "can't exec program: $!";
550 # NOTREACHED
54310121 551 }
4633a7c4 552
553
554And here's a safe pipe open for writing:
555
556 # add error processing as above
c07a80fd 557 $pid = open(KID_TO_WRITE, "|-");
4633a7c4 558 $SIG{ALRM} = sub { die "whoops, $program pipe broke" };
559
560 if ($pid) { # parent
561 for (@data) {
c07a80fd 562 print KID_TO_WRITE;
54310121 563 }
c07a80fd 564 close(KID_TO_WRITE) || warn "kid exited $?";
4633a7c4 565
566 } else { # child
567 ($EUID, $EGID) = ($UID, $GID);
568 exec($program, @options, @args)
569 || die "can't exec program: $!";
570 # NOTREACHED
54310121 571 }
4633a7c4 572
573Note that these operations are full Unix forks, which means they may not be
574correctly implemented on alien systems. Additionally, these are not true
54310121 575multithreading. If you'd like to learn more about threading, see the
184e9718 576F<modules> file mentioned below in the SEE ALSO section.
4633a7c4 577
7b05b7e3 578=head2 Bidirectional Communication with Another Process
4633a7c4 579
580While this works reasonably well for unidirectional communication, what
581about bidirectional communication? The obvious thing you'd like to do
582doesn't actually work:
583
c07a80fd 584 open(PROG_FOR_READING_AND_WRITING, "| some program |")
4633a7c4 585
9f1b1f2d 586and if you forget to use the C<use warnings> pragma or the B<-w> flag,
587then you'll miss out entirely on the diagnostic message:
4633a7c4 588
589 Can't do bidirectional pipe at -e line 1.
590
591If you really want to, you can use the standard open2() library function
7b05b7e3 592to catch both ends. There's also an open3() for tridirectional I/O so you
4633a7c4 593can also catch your child's STDERR, but doing so would then require an
594awkward select() loop and wouldn't allow you to use normal Perl input
595operations.
596
597If you look at its source, you'll see that open2() uses low-level
5a964f20 598primitives like Unix pipe() and exec() calls to create all the connections.
4633a7c4 599While it might have been slightly more efficient by using socketpair(), it
600would have then been even less portable than it already is. The open2()
601and open3() functions are unlikely to work anywhere except on a Unix
602system or some other one purporting to be POSIX compliant.
603
604Here's an example of using open2():
605
606 use FileHandle;
607 use IPC::Open2;
5a964f20 608 $pid = open2(*Reader, *Writer, "cat -u -n" );
4633a7c4 609 print Writer "stuff\n";
610 $got = <Reader>;
611
6a3992aa 612The problem with this is that Unix buffering is really going to
613ruin your day. Even though your C<Writer> filehandle is auto-flushed,
4633a7c4 614and the process on the other end will get your data in a timely manner,
6a3992aa 615you can't usually do anything to force it to give it back to you
54310121 616in a similarly quick fashion. In this case, we could, because we
4633a7c4 617gave I<cat> a B<-u> flag to make it unbuffered. But very few Unix
618commands are designed to operate over pipes, so this seldom works
54310121 619unless you yourself wrote the program on the other end of the
4633a7c4 620double-ended pipe.
621
54310121 622A solution to this is the nonstandard F<Comm.pl> library. It uses
4633a7c4 623pseudo-ttys to make your program behave more reasonably:
624
625 require 'Comm.pl';
626 $ph = open_proc('cat -n');
627 for (1..10) {
628 print $ph "a line\n";
629 print "got back ", scalar <$ph>;
630 }
a0d0e21e 631
4633a7c4 632This way you don't have to have control over the source code of the
54310121 633program you're using. The F<Comm> library also has expect()
634and interact() functions. Find the library (and we hope its
4633a7c4 635successor F<IPC::Chat>) at your nearest CPAN archive as detailed
184e9718 636in the SEE ALSO section below.
a0d0e21e 637
c8db1d39 638The newer Expect.pm module from CPAN also addresses this kind of thing.
639This module requires two other modules from CPAN: IO::Pty and IO::Stty.
640It sets up a pseudo-terminal to interact with programs that insist on
a11adca0 641using talking to the terminal device driver. If your system is
c8db1d39 642amongst those supported, this may be your best bet.
643
5a964f20 644=head2 Bidirectional Communication with Yourself
645
646If you want, you may make low-level pipe() and fork()
647to stitch this together by hand. This example only
648talks to itself, but you could reopen the appropriate
649handles to STDIN and STDOUT and call other processes.
650
651 #!/usr/bin/perl -w
652 # pipe1 - bidirectional communication using two pipe pairs
653 # designed for the socketpair-challenged
654 use IO::Handle; # thousands of lines just for autoflush :-(
655 pipe(PARENT_RDR, CHILD_WTR); # XXX: failure?
656 pipe(CHILD_RDR, PARENT_WTR); # XXX: failure?
657 CHILD_WTR->autoflush(1);
658 PARENT_WTR->autoflush(1);
659
660 if ($pid = fork) {
661 close PARENT_RDR; close PARENT_WTR;
662 print CHILD_WTR "Parent Pid $$ is sending this\n";
663 chomp($line = <CHILD_RDR>);
664 print "Parent Pid $$ just read this: `$line'\n";
665 close CHILD_RDR; close CHILD_WTR;
666 waitpid($pid,0);
667 } else {
668 die "cannot fork: $!" unless defined $pid;
669 close CHILD_RDR; close CHILD_WTR;
670 chomp($line = <PARENT_RDR>);
671 print "Child Pid $$ just read this: `$line'\n";
672 print PARENT_WTR "Child Pid $$ is sending this\n";
673 close PARENT_RDR; close PARENT_WTR;
674 exit;
675 }
676
a11adca0 677But you don't actually have to make two pipe calls. If you
5a964f20 678have the socketpair() system call, it will do this all for you.
679
680 #!/usr/bin/perl -w
681 # pipe2 - bidirectional communication using socketpair
682 # "the best ones always go both ways"
683
684 use Socket;
685 use IO::Handle; # thousands of lines just for autoflush :-(
686 # We say AF_UNIX because although *_LOCAL is the
687 # POSIX 1003.1g form of the constant, many machines
688 # still don't have it.
689 socketpair(CHILD, PARENT, AF_UNIX, SOCK_STREAM, PF_UNSPEC)
690 or die "socketpair: $!";
691
692 CHILD->autoflush(1);
693 PARENT->autoflush(1);
694
695 if ($pid = fork) {
696 close PARENT;
697 print CHILD "Parent Pid $$ is sending this\n";
698 chomp($line = <CHILD>);
699 print "Parent Pid $$ just read this: `$line'\n";
700 close CHILD;
701 waitpid($pid,0);
702 } else {
703 die "cannot fork: $!" unless defined $pid;
704 close CHILD;
705 chomp($line = <PARENT>);
706 print "Child Pid $$ just read this: `$line'\n";
707 print PARENT "Child Pid $$ is sending this\n";
708 close PARENT;
709 exit;
710 }
711
4633a7c4 712=head1 Sockets: Client/Server Communication
a0d0e21e 713
6a3992aa 714While not limited to Unix-derived operating systems (e.g., WinSock on PCs
4633a7c4 715provides socket support, as do some VMS libraries), you may not have
184e9718 716sockets on your system, in which case this section probably isn't going to do
6a3992aa 717you much good. With sockets, you can do both virtual circuits (i.e., TCP
718streams) and datagrams (i.e., UDP packets). You may be able to do even more
4633a7c4 719depending on your system.
720
721The Perl function calls for dealing with sockets have the same names as
722the corresponding system calls in C, but their arguments tend to differ
723for two reasons: first, Perl filehandles work differently than C file
724descriptors. Second, Perl already knows the length of its strings, so you
725don't need to pass that information.
a0d0e21e 726
4633a7c4 727One of the major problems with old socket code in Perl was that it used
728hard-coded values for some of the constants, which severely hurt
729portability. If you ever see code that does anything like explicitly
730setting C<$AF_INET = 2>, you know you're in for big trouble: An
731immeasurably superior approach is to use the C<Socket> module, which more
732reliably grants access to various constants and functions you'll need.
a0d0e21e 733
68dc0745 734If you're not writing a server/client for an existing protocol like
735NNTP or SMTP, you should give some thought to how your server will
736know when the client has finished talking, and vice-versa. Most
737protocols are based on one-line messages and responses (so one party
4a6725af 738knows the other has finished when a "\n" is received) or multi-line
68dc0745 739messages and responses that end with a period on an empty line
740("\n.\n" terminates a message/response).
741
5a964f20 742=head2 Internet Line Terminators
743
744The Internet line terminator is "\015\012". Under ASCII variants of
745Unix, that could usually be written as "\r\n", but under other systems,
746"\r\n" might at times be "\015\015\012", "\012\012\015", or something
747completely different. The standards specify writing "\015\012" to be
748conformant (be strict in what you provide), but they also recommend
749accepting a lone "\012" on input (but be lenient in what you require).
750We haven't always been very good about that in the code in this manpage,
751but unless you're on a Mac, you'll probably be ok.
752
4633a7c4 753=head2 Internet TCP Clients and Servers
a0d0e21e 754
4633a7c4 755Use Internet-domain sockets when you want to do client-server
756communication that might extend to machines outside of your own system.
757
758Here's a sample TCP client using Internet-domain sockets:
759
760 #!/usr/bin/perl -w
4633a7c4 761 use strict;
762 use Socket;
763 my ($remote,$port, $iaddr, $paddr, $proto, $line);
764
765 $remote = shift || 'localhost';
766 $port = shift || 2345; # random port
767 if ($port =~ /\D/) { $port = getservbyname($port, 'tcp') }
768 die "No port" unless $port;
769 $iaddr = inet_aton($remote) || die "no host: $remote";
770 $paddr = sockaddr_in($port, $iaddr);
771
772 $proto = getprotobyname('tcp');
773 socket(SOCK, PF_INET, SOCK_STREAM, $proto) || die "socket: $!";
774 connect(SOCK, $paddr) || die "connect: $!";
54310121 775 while (defined($line = <SOCK>)) {
4633a7c4 776 print $line;
54310121 777 }
4633a7c4 778
779 close (SOCK) || die "close: $!";
780 exit;
781
782And here's a corresponding server to go along with it. We'll
783leave the address as INADDR_ANY so that the kernel can choose
54310121 784the appropriate interface on multihomed hosts. If you want sit
c07a80fd 785on a particular interface (like the external side of a gateway
786or firewall machine), you should fill this in with your real address
787instead.
788
789 #!/usr/bin/perl -Tw
c07a80fd 790 use strict;
791 BEGIN { $ENV{PATH} = '/usr/ucb:/bin' }
792 use Socket;
793 use Carp;
5865a7df 794 my $EOL = "\015\012";
c07a80fd 795
54310121 796 sub logmsg { print "$0 $$: @_ at ", scalar localtime, "\n" }
c07a80fd 797
798 my $port = shift || 2345;
799 my $proto = getprotobyname('tcp');
51ee6500 800
5865a7df 801 ($port) = $port =~ /^(\d+)$/ or die "invalid port";
6a3992aa 802
c07a80fd 803 socket(Server, PF_INET, SOCK_STREAM, $proto) || die "socket: $!";
54310121 804 setsockopt(Server, SOL_SOCKET, SO_REUSEADDR,
c07a80fd 805 pack("l", 1)) || die "setsockopt: $!";
806 bind(Server, sockaddr_in($port, INADDR_ANY)) || die "bind: $!";
807 listen(Server,SOMAXCONN) || die "listen: $!";
808
809 logmsg "server started on port $port";
810
811 my $paddr;
812
813 $SIG{CHLD} = \&REAPER;
814
815 for ( ; $paddr = accept(Client,Server); close Client) {
816 my($port,$iaddr) = sockaddr_in($paddr);
817 my $name = gethostbyaddr($iaddr,AF_INET);
818
54310121 819 logmsg "connection from $name [",
820 inet_ntoa($iaddr), "]
c07a80fd 821 at port $port";
822
54310121 823 print Client "Hello there, $name, it's now ",
5a964f20 824 scalar localtime, $EOL;
54310121 825 }
c07a80fd 826
54310121 827And here's a multithreaded version. It's multithreaded in that
828like most typical servers, it spawns (forks) a slave server to
c07a80fd 829handle the client request so that the master server can quickly
830go back to service a new client.
4633a7c4 831
832 #!/usr/bin/perl -Tw
4633a7c4 833 use strict;
834 BEGIN { $ENV{PATH} = '/usr/ucb:/bin' }
a0d0e21e 835 use Socket;
4633a7c4 836 use Carp;
5865a7df 837 my $EOL = "\015\012";
a0d0e21e 838
4633a7c4 839 sub spawn; # forward declaration
54310121 840 sub logmsg { print "$0 $$: @_ at ", scalar localtime, "\n" }
a0d0e21e 841
4633a7c4 842 my $port = shift || 2345;
843 my $proto = getprotobyname('tcp');
51ee6500 844
5865a7df 845 ($port) = $port =~ /^(\d+)$/ or die "invalid port";
54310121 846
c07a80fd 847 socket(Server, PF_INET, SOCK_STREAM, $proto) || die "socket: $!";
54310121 848 setsockopt(Server, SOL_SOCKET, SO_REUSEADDR,
c07a80fd 849 pack("l", 1)) || die "setsockopt: $!";
850 bind(Server, sockaddr_in($port, INADDR_ANY)) || die "bind: $!";
851 listen(Server,SOMAXCONN) || die "listen: $!";
a0d0e21e 852
4633a7c4 853 logmsg "server started on port $port";
a0d0e21e 854
4633a7c4 855 my $waitedpid = 0;
856 my $paddr;
a0d0e21e 857
816229cf 858 use POSIX ":sys_wait_h";
54310121 859 sub REAPER {
816229cf 860 my $child;
861 while (($waitedpid = waitpid(-1,WNOHANG)) > 0) {
862 logmsg "reaped $waitedpid" . ($? ? " with exit $?" : '');
863 }
6a3992aa 864 $SIG{CHLD} = \&REAPER; # loathe sysV
4633a7c4 865 }
866
867 $SIG{CHLD} = \&REAPER;
868
54310121 869 for ( $waitedpid = 0;
870 ($paddr = accept(Client,Server)) || $waitedpid;
871 $waitedpid = 0, close Client)
4633a7c4 872 {
6a3992aa 873 next if $waitedpid and not $paddr;
4633a7c4 874 my($port,$iaddr) = sockaddr_in($paddr);
875 my $name = gethostbyaddr($iaddr,AF_INET);
876
54310121 877 logmsg "connection from $name [",
878 inet_ntoa($iaddr), "]
4633a7c4 879 at port $port";
a0d0e21e 880
54310121 881 spawn sub {
b921b357 882 $|=1;
5a964f20 883 print "Hello there, $name, it's now ", scalar localtime, $EOL;
884 exec '/usr/games/fortune' # XXX: `wrong' line terminators
4633a7c4 885 or confess "can't exec fortune: $!";
886 };
a0d0e21e 887
54310121 888 }
a0d0e21e 889
4633a7c4 890 sub spawn {
891 my $coderef = shift;
a0d0e21e 892
54310121 893 unless (@_ == 0 && $coderef && ref($coderef) eq 'CODE') {
4633a7c4 894 confess "usage: spawn CODEREF";
a0d0e21e 895 }
4633a7c4 896
897 my $pid;
898 if (!defined($pid = fork)) {
899 logmsg "cannot fork: $!";
900 return;
901 } elsif ($pid) {
902 logmsg "begat $pid";
6a3992aa 903 return; # I'm the parent
4633a7c4 904 }
6a3992aa 905 # else I'm the child -- go spawn
4633a7c4 906
c07a80fd 907 open(STDIN, "<&Client") || die "can't dup client to stdin";
908 open(STDOUT, ">&Client") || die "can't dup client to stdout";
4633a7c4 909 ## open(STDERR, ">&STDOUT") || die "can't dup stdout to stderr";
910 exit &$coderef();
54310121 911 }
4633a7c4 912
913This server takes the trouble to clone off a child version via fork() for
914each incoming request. That way it can handle many requests at once,
915which you might not always want. Even if you don't fork(), the listen()
916will allow that many pending connections. Forking servers have to be
917particularly careful about cleaning up their dead children (called
918"zombies" in Unix parlance), because otherwise you'll quickly fill up your
919process table.
920
921We suggest that you use the B<-T> flag to use taint checking (see L<perlsec>)
922even if we aren't running setuid or setgid. This is always a good idea
923for servers and other programs run on behalf of someone else (like CGI
924scripts), because it lessens the chances that people from the outside will
925be able to compromise your system.
926
927Let's look at another TCP client. This one connects to the TCP "time"
928service on a number of different machines and shows how far their clocks
929differ from the system on which it's being run:
930
931 #!/usr/bin/perl -w
4633a7c4 932 use strict;
933 use Socket;
934
935 my $SECS_of_70_YEARS = 2208988800;
54310121 936 sub ctime { scalar localtime(shift) }
4633a7c4 937
54310121 938 my $iaddr = gethostbyname('localhost');
939 my $proto = getprotobyname('tcp');
940 my $port = getservbyname('time', 'tcp');
4633a7c4 941 my $paddr = sockaddr_in(0, $iaddr);
942 my($host);
943
944 $| = 1;
945 printf "%-24s %8s %s\n", "localhost", 0, ctime(time());
946
947 foreach $host (@ARGV) {
948 printf "%-24s ", $host;
949 my $hisiaddr = inet_aton($host) || die "unknown host";
950 my $hispaddr = sockaddr_in($port, $hisiaddr);
951 socket(SOCKET, PF_INET, SOCK_STREAM, $proto) || die "socket: $!";
952 connect(SOCKET, $hispaddr) || die "bind: $!";
953 my $rtime = ' ';
954 read(SOCKET, $rtime, 4);
955 close(SOCKET);
956 my $histime = unpack("N", $rtime) - $SECS_of_70_YEARS ;
957 printf "%8d %s\n", $histime - time, ctime($histime);
a0d0e21e 958 }
959
4633a7c4 960=head2 Unix-Domain TCP Clients and Servers
961
a2eb9003 962That's fine for Internet-domain clients and servers, but what about local
4633a7c4 963communications? While you can use the same setup, sometimes you don't
964want to. Unix-domain sockets are local to the current host, and are often
54310121 965used internally to implement pipes. Unlike Internet domain sockets, Unix
4633a7c4 966domain sockets can show up in the file system with an ls(1) listing.
967
5a964f20 968 % ls -l /dev/log
4633a7c4 969 srw-rw-rw- 1 root 0 Oct 31 07:23 /dev/log
a0d0e21e 970
4633a7c4 971You can test for these with Perl's B<-S> file test:
972
973 unless ( -S '/dev/log' ) {
3ba19564 974 die "something's wicked with the log system";
54310121 975 }
4633a7c4 976
977Here's a sample Unix-domain client:
978
979 #!/usr/bin/perl -w
4633a7c4 980 use Socket;
981 use strict;
982 my ($rendezvous, $line);
983
984 $rendezvous = shift || '/tmp/catsock';
985 socket(SOCK, PF_UNIX, SOCK_STREAM, 0) || die "socket: $!";
9607fc9c 986 connect(SOCK, sockaddr_un($rendezvous)) || die "connect: $!";
54310121 987 while (defined($line = <SOCK>)) {
4633a7c4 988 print $line;
54310121 989 }
4633a7c4 990 exit;
991
5a964f20 992And here's a corresponding server. You don't have to worry about silly
993network terminators here because Unix domain sockets are guaranteed
994to be on the localhost, and thus everything works right.
4633a7c4 995
996 #!/usr/bin/perl -Tw
4633a7c4 997 use strict;
998 use Socket;
999 use Carp;
1000
1001 BEGIN { $ENV{PATH} = '/usr/ucb:/bin' }
5865a7df 1002 sub spawn; # forward declaration
5a964f20 1003 sub logmsg { print "$0 $$: @_ at ", scalar localtime, "\n" }
4633a7c4 1004
1005 my $NAME = '/tmp/catsock';
1006 my $uaddr = sockaddr_un($NAME);
1007 my $proto = getprotobyname('tcp');
1008
c07a80fd 1009 socket(Server,PF_UNIX,SOCK_STREAM,0) || die "socket: $!";
4633a7c4 1010 unlink($NAME);
c07a80fd 1011 bind (Server, $uaddr) || die "bind: $!";
1012 listen(Server,SOMAXCONN) || die "listen: $!";
4633a7c4 1013
1014 logmsg "server started on $NAME";
1015
5a964f20 1016 my $waitedpid;
1017
816229cf 1018 use POSIX ":sys_wait_h";
5a964f20 1019 sub REAPER {
816229cf 1020 my $child;
1021 while (($waitedpid = waitpid(-1,WNOHANG)) > 0) {
1022 logmsg "reaped $waitedpid" . ($? ? " with exit $?" : '');
1023 }
5a964f20 1024 $SIG{CHLD} = \&REAPER; # loathe sysV
5a964f20 1025 }
1026
4633a7c4 1027 $SIG{CHLD} = \&REAPER;
1028
5a964f20 1029
54310121 1030 for ( $waitedpid = 0;
1031 accept(Client,Server) || $waitedpid;
1032 $waitedpid = 0, close Client)
4633a7c4 1033 {
1034 next if $waitedpid;
1035 logmsg "connection on $NAME";
54310121 1036 spawn sub {
4633a7c4 1037 print "Hello there, it's now ", scalar localtime, "\n";
1038 exec '/usr/games/fortune' or die "can't exec fortune: $!";
1039 };
54310121 1040 }
4633a7c4 1041
5865a7df 1042 sub spawn {
1043 my $coderef = shift;
1044
1045 unless (@_ == 0 && $coderef && ref($coderef) eq 'CODE') {
1046 confess "usage: spawn CODEREF";
1047 }
1048
1049 my $pid;
1050 if (!defined($pid = fork)) {
1051 logmsg "cannot fork: $!";
1052 return;
1053 } elsif ($pid) {
1054 logmsg "begat $pid";
1055 return; # I'm the parent
1056 }
1057 # else I'm the child -- go spawn
1058
1059 open(STDIN, "<&Client") || die "can't dup client to stdin";
1060 open(STDOUT, ">&Client") || die "can't dup client to stdout";
1061 ## open(STDERR, ">&STDOUT") || die "can't dup stdout to stderr";
1062 exit &$coderef();
1063 }
1064
4633a7c4 1065As you see, it's remarkably similar to the Internet domain TCP server, so
1066much so, in fact, that we've omitted several duplicate functions--spawn(),
1067logmsg(), ctime(), and REAPER()--which are exactly the same as in the
1068other server.
1069
1070So why would you ever want to use a Unix domain socket instead of a
1071simpler named pipe? Because a named pipe doesn't give you sessions. You
1072can't tell one process's data from another's. With socket programming,
1073you get a separate session for each client: that's why accept() takes two
1074arguments.
1075
1076For example, let's say that you have a long running database server daemon
1077that you want folks from the World Wide Web to be able to access, but only
1078if they go through a CGI interface. You'd have a small, simple CGI
1079program that does whatever checks and logging you feel like, and then acts
1080as a Unix-domain client and connects to your private server.
1081
7b05b7e3 1082=head1 TCP Clients with IO::Socket
1083
1084For those preferring a higher-level interface to socket programming, the
1085IO::Socket module provides an object-oriented approach. IO::Socket is
1086included as part of the standard Perl distribution as of the 5.004
1087release. If you're running an earlier version of Perl, just fetch
106325ad 1088IO::Socket from CPAN, where you'll also find modules providing easy
7b05b7e3 1089interfaces to the following systems: DNS, FTP, Ident (RFC 931), NIS and
1090NISPlus, NNTP, Ping, POP3, SMTP, SNMP, SSLeay, Telnet, and Time--just
1091to name a few.
1092
1093=head2 A Simple Client
1094
1095Here's a client that creates a TCP connection to the "daytime"
1096service at port 13 of the host name "localhost" and prints out everything
1097that the server there cares to provide.
1098
1099 #!/usr/bin/perl -w
1100 use IO::Socket;
1101 $remote = IO::Socket::INET->new(
1102 Proto => "tcp",
1103 PeerAddr => "localhost",
1104 PeerPort => "daytime(13)",
1105 )
1106 or die "cannot connect to daytime port at localhost";
1107 while ( <$remote> ) { print }
1108
1109When you run this program, you should get something back that
1110looks like this:
1111
1112 Wed May 14 08:40:46 MDT 1997
1113
1114Here are what those parameters to the C<new> constructor mean:
1115
13a2d996 1116=over 4
7b05b7e3 1117
1118=item C<Proto>
1119
1120This is which protocol to use. In this case, the socket handle returned
1121will be connected to a TCP socket, because we want a stream-oriented
1122connection, that is, one that acts pretty much like a plain old file.
1123Not all sockets are this of this type. For example, the UDP protocol
1124can be used to make a datagram socket, used for message-passing.
1125
1126=item C<PeerAddr>
1127
1128This is the name or Internet address of the remote host the server is
1129running on. We could have specified a longer name like C<"www.perl.com">,
1130or an address like C<"204.148.40.9">. For demonstration purposes, we've
1131used the special hostname C<"localhost">, which should always mean the
1132current machine you're running on. The corresponding Internet address
1133for localhost is C<"127.1">, if you'd rather use that.
1134
1135=item C<PeerPort>
1136
1137This is the service name or port number we'd like to connect to.
1138We could have gotten away with using just C<"daytime"> on systems with a
1139well-configured system services file,[FOOTNOTE: The system services file
1140is in I</etc/services> under Unix] but just in case, we've specified the
1141port number (13) in parentheses. Using just the number would also have
1142worked, but constant numbers make careful programmers nervous.
1143
1144=back
1145
1146Notice how the return value from the C<new> constructor is used as
1147a filehandle in the C<while> loop? That's what's called an indirect
1148filehandle, a scalar variable containing a filehandle. You can use
1149it the same way you would a normal filehandle. For example, you
1150can read one line from it this way:
1151
1152 $line = <$handle>;
1153
1154all remaining lines from is this way:
1155
1156 @lines = <$handle>;
1157
1158and send a line of data to it this way:
1159
1160 print $handle "some data\n";
1161
1162=head2 A Webget Client
1163
1164Here's a simple client that takes a remote host to fetch a document
1165from, and then a list of documents to get from that host. This is a
1166more interesting client than the previous one because it first sends
1167something to the server before fetching the server's response.
1168
1169 #!/usr/bin/perl -w
1170 use IO::Socket;
1171 unless (@ARGV > 1) { die "usage: $0 host document ..." }
1172 $host = shift(@ARGV);
5a964f20 1173 $EOL = "\015\012";
1174 $BLANK = $EOL x 2;
7b05b7e3 1175 foreach $document ( @ARGV ) {
1176 $remote = IO::Socket::INET->new( Proto => "tcp",
1177 PeerAddr => $host,
1178 PeerPort => "http(80)",
1179 );
1180 unless ($remote) { die "cannot connect to http daemon on $host" }
1181 $remote->autoflush(1);
5a964f20 1182 print $remote "GET $document HTTP/1.0" . $BLANK;
7b05b7e3 1183 while ( <$remote> ) { print }
1184 close $remote;
1185 }
1186
1187The web server handing the "http" service, which is assumed to be at
4375e838 1188its standard port, number 80. If the web server you're trying to
7b05b7e3 1189connect to is at a different port (like 1080 or 8080), you should specify
c47ff5f1 1190as the named-parameter pair, C<< PeerPort => 8080 >>. The C<autoflush>
7b05b7e3 1191method is used on the socket because otherwise the system would buffer
1192up the output we sent it. (If you're on a Mac, you'll also need to
1193change every C<"\n"> in your code that sends data over the network to
1194be a C<"\015\012"> instead.)
1195
1196Connecting to the server is only the first part of the process: once you
1197have the connection, you have to use the server's language. Each server
1198on the network has its own little command language that it expects as
1199input. The string that we send to the server starting with "GET" is in
1200HTTP syntax. In this case, we simply request each specified document.
1201Yes, we really are making a new connection for each document, even though
1202it's the same host. That's the way you always used to have to speak HTTP.
1203Recent versions of web browsers may request that the remote server leave
1204the connection open a little while, but the server doesn't have to honor
1205such a request.
1206
1207Here's an example of running that program, which we'll call I<webget>:
1208
5a964f20 1209 % webget www.perl.com /guanaco.html
7b05b7e3 1210 HTTP/1.1 404 File Not Found
1211 Date: Thu, 08 May 1997 18:02:32 GMT
1212 Server: Apache/1.2b6
1213 Connection: close
1214 Content-type: text/html
1215
1216 <HEAD><TITLE>404 File Not Found</TITLE></HEAD>
1217 <BODY><H1>File Not Found</H1>
1218 The requested URL /guanaco.html was not found on this server.<P>
1219 </BODY>
1220
1221Ok, so that's not very interesting, because it didn't find that
1222particular document. But a long response wouldn't have fit on this page.
1223
1224For a more fully-featured version of this program, you should look to
1225the I<lwp-request> program included with the LWP modules from CPAN.
1226
1227=head2 Interactive Client with IO::Socket
1228
1229Well, that's all fine if you want to send one command and get one answer,
1230but what about setting up something fully interactive, somewhat like
1231the way I<telnet> works? That way you can type a line, get the answer,
1232type a line, get the answer, etc.
1233
1234This client is more complicated than the two we've done so far, but if
1235you're on a system that supports the powerful C<fork> call, the solution
1236isn't that rough. Once you've made the connection to whatever service
1237you'd like to chat with, call C<fork> to clone your process. Each of
1238these two identical process has a very simple job to do: the parent
1239copies everything from the socket to standard output, while the child
1240simultaneously copies everything from standard input to the socket.
1241To accomplish the same thing using just one process would be I<much>
1242harder, because it's easier to code two processes to do one thing than it
1243is to code one process to do two things. (This keep-it-simple principle
5a964f20 1244a cornerstones of the Unix philosophy, and good software engineering as
1245well, which is probably why it's spread to other systems.)
7b05b7e3 1246
1247Here's the code:
1248
1249 #!/usr/bin/perl -w
1250 use strict;
1251 use IO::Socket;
1252 my ($host, $port, $kidpid, $handle, $line);
1253
1254 unless (@ARGV == 2) { die "usage: $0 host port" }
1255 ($host, $port) = @ARGV;
1256
1257 # create a tcp connection to the specified host and port
1258 $handle = IO::Socket::INET->new(Proto => "tcp",
1259 PeerAddr => $host,
1260 PeerPort => $port)
1261 or die "can't connect to port $port on $host: $!";
1262
1263 $handle->autoflush(1); # so output gets there right away
1264 print STDERR "[Connected to $host:$port]\n";
1265
1266 # split the program into two processes, identical twins
1267 die "can't fork: $!" unless defined($kidpid = fork());
1268
1269 # the if{} block runs only in the parent process
1270 if ($kidpid) {
1271 # copy the socket to standard output
1272 while (defined ($line = <$handle>)) {
1273 print STDOUT $line;
1274 }
1275 kill("TERM", $kidpid); # send SIGTERM to child
1276 }
1277 # the else{} block runs only in the child process
1278 else {
1279 # copy standard input to the socket
1280 while (defined ($line = <STDIN>)) {
1281 print $handle $line;
1282 }
1283 }
1284
1285The C<kill> function in the parent's C<if> block is there to send a
1286signal to our child process (current running in the C<else> block)
1287as soon as the remote server has closed its end of the connection.
1288
7b05b7e3 1289If the remote server sends data a byte at time, and you need that
1290data immediately without waiting for a newline (which might not happen),
1291you may wish to replace the C<while> loop in the parent with the
1292following:
1293
1294 my $byte;
1295 while (sysread($handle, $byte, 1) == 1) {
1296 print STDOUT $byte;
1297 }
1298
1299Making a system call for each byte you want to read is not very efficient
1300(to put it mildly) but is the simplest to explain and works reasonably
1301well.
1302
1303=head1 TCP Servers with IO::Socket
1304
5a964f20 1305As always, setting up a server is little bit more involved than running a client.
7b05b7e3 1306The model is that the server creates a special kind of socket that
1307does nothing but listen on a particular port for incoming connections.
c47ff5f1 1308It does this by calling the C<< IO::Socket::INET->new() >> method with
7b05b7e3 1309slightly different arguments than the client did.
1310
13a2d996 1311=over 4
7b05b7e3 1312
1313=item Proto
1314
1315This is which protocol to use. Like our clients, we'll
1316still specify C<"tcp"> here.
1317
1318=item LocalPort
1319
1320We specify a local
1321port in the C<LocalPort> argument, which we didn't do for the client.
1322This is service name or port number for which you want to be the
1323server. (Under Unix, ports under 1024 are restricted to the
1324superuser.) In our sample, we'll use port 9000, but you can use
1325any port that's not currently in use on your system. If you try
1326to use one already in used, you'll get an "Address already in use"
19799a22 1327message. Under Unix, the C<netstat -a> command will show
7b05b7e3 1328which services current have servers.
1329
1330=item Listen
1331
1332The C<Listen> parameter is set to the maximum number of
1333pending connections we can accept until we turn away incoming clients.
1334Think of it as a call-waiting queue for your telephone.
1335The low-level Socket module has a special symbol for the system maximum, which
1336is SOMAXCONN.
1337
1338=item Reuse
1339
1340The C<Reuse> parameter is needed so that we restart our server
1341manually without waiting a few minutes to allow system buffers to
1342clear out.
1343
1344=back
1345
1346Once the generic server socket has been created using the parameters
1347listed above, the server then waits for a new client to connect
d1be9408 1348to it. The server blocks in the C<accept> method, which eventually accepts a
1349bidirectional connection from the remote client. (Make sure to autoflush
7b05b7e3 1350this handle to circumvent buffering.)
1351
1352To add to user-friendliness, our server prompts the user for commands.
1353Most servers don't do this. Because of the prompt without a newline,
1354you'll have to use the C<sysread> variant of the interactive client above.
1355
1356This server accepts one of five different commands, sending output
1357back to the client. Note that unlike most network servers, this one
1358only handles one incoming client at a time. Multithreaded servers are
f83494b9 1359covered in Chapter 6 of the Camel.
7b05b7e3 1360
1361Here's the code. We'll
1362
1363 #!/usr/bin/perl -w
1364 use IO::Socket;
1365 use Net::hostent; # for OO version of gethostbyaddr
1366
1367 $PORT = 9000; # pick something not in use
1368
1369 $server = IO::Socket::INET->new( Proto => 'tcp',
1370 LocalPort => $PORT,
1371 Listen => SOMAXCONN,
1372 Reuse => 1);
1373
1374 die "can't setup server" unless $server;
1375 print "[Server $0 accepting clients]\n";
1376
1377 while ($client = $server->accept()) {
1378 $client->autoflush(1);
1379 print $client "Welcome to $0; type help for command list.\n";
1380 $hostinfo = gethostbyaddr($client->peeraddr);
1381 printf "[Connect from %s]\n", $hostinfo->name || $client->peerhost;
1382 print $client "Command? ";
1383 while ( <$client>) {
1384 next unless /\S/; # blank line
1385 if (/quit|exit/i) { last; }
1386 elsif (/date|time/i) { printf $client "%s\n", scalar localtime; }
1387 elsif (/who/i ) { print $client `who 2>&1`; }
1388 elsif (/cookie/i ) { print $client `/usr/games/fortune 2>&1`; }
1389 elsif (/motd/i ) { print $client `cat /etc/motd 2>&1`; }
1390 else {
1391 print $client "Commands: quit date who cookie motd\n";
1392 }
1393 } continue {
1394 print $client "Command? ";
1395 }
1396 close $client;
1397 }
1398
1399=head1 UDP: Message Passing
4633a7c4 1400
1401Another kind of client-server setup is one that uses not connections, but
1402messages. UDP communications involve much lower overhead but also provide
1403less reliability, as there are no promises that messages will arrive at
1404all, let alone in order and unmangled. Still, UDP offers some advantages
1405over TCP, including being able to "broadcast" or "multicast" to a whole
1406bunch of destination hosts at once (usually on your local subnet). If you
1407find yourself overly concerned about reliability and start building checks
6a3992aa 1408into your message system, then you probably should use just TCP to start
4633a7c4 1409with.
1410
90034919 1411Note that UDP datagrams are I<not> a bytestream and should not be treated
1412as such. This makes using I/O mechanisms with internal buffering
1413like stdio (i.e. print() and friends) especially cumbersome. Use syswrite(),
1414or better send(), like in the example below.
1415
4633a7c4 1416Here's a UDP program similar to the sample Internet TCP client given
7b05b7e3 1417earlier. However, instead of checking one host at a time, the UDP version
4633a7c4 1418will check many of them asynchronously by simulating a multicast and then
1419using select() to do a timed-out wait for I/O. To do something similar
1420with TCP, you'd have to use a different socket handle for each host.
1421
1422 #!/usr/bin/perl -w
1423 use strict;
4633a7c4 1424 use Socket;
1425 use Sys::Hostname;
1426
54310121 1427 my ( $count, $hisiaddr, $hispaddr, $histime,
1428 $host, $iaddr, $paddr, $port, $proto,
4633a7c4 1429 $rin, $rout, $rtime, $SECS_of_70_YEARS);
1430
1431 $SECS_of_70_YEARS = 2208988800;
1432
1433 $iaddr = gethostbyname(hostname());
1434 $proto = getprotobyname('udp');
1435 $port = getservbyname('time', 'udp');
1436 $paddr = sockaddr_in(0, $iaddr); # 0 means let kernel pick
1437
1438 socket(SOCKET, PF_INET, SOCK_DGRAM, $proto) || die "socket: $!";
1439 bind(SOCKET, $paddr) || die "bind: $!";
1440
1441 $| = 1;
1442 printf "%-12s %8s %s\n", "localhost", 0, scalar localtime time;
1443 $count = 0;
1444 for $host (@ARGV) {
1445 $count++;
1446 $hisiaddr = inet_aton($host) || die "unknown host";
1447 $hispaddr = sockaddr_in($port, $hisiaddr);
1448 defined(send(SOCKET, 0, 0, $hispaddr)) || die "send $host: $!";
1449 }
1450
1451 $rin = '';
1452 vec($rin, fileno(SOCKET), 1) = 1;
1453
1454 # timeout after 10.0 seconds
1455 while ($count && select($rout = $rin, undef, undef, 10.0)) {
1456 $rtime = '';
1457 ($hispaddr = recv(SOCKET, $rtime, 4, 0)) || die "recv: $!";
1458 ($port, $hisiaddr) = sockaddr_in($hispaddr);
1459 $host = gethostbyaddr($hisiaddr, AF_INET);
1460 $histime = unpack("N", $rtime) - $SECS_of_70_YEARS ;
1461 printf "%-12s ", $host;
1462 printf "%8d %s\n", $histime - time, scalar localtime($histime);
1463 $count--;
1464 }
1465
90034919 1466Note that this example does not include any retries and may consequently
1467fail to contact a reachable host. The most prominent reason for this
1468is congestion of the queues on the sending host if the number of
a31a806a 1469list of hosts to contact is sufficiently large.
90034919 1470
4633a7c4 1471=head1 SysV IPC
1472
1473While System V IPC isn't so widely used as sockets, it still has some
1474interesting uses. You can't, however, effectively use SysV IPC or
1475Berkeley mmap() to have shared memory so as to share a variable amongst
1476several processes. That's because Perl would reallocate your string when
1477you weren't wanting it to.
1478
54310121 1479Here's a small example showing shared memory usage.
a0d0e21e 1480
41d6edb2 1481 use IPC::SysV qw(IPC_PRIVATE IPC_RMID S_IRWXU);
0ade1984 1482
a0d0e21e 1483 $size = 2000;
41d6edb2 1484 $id = shmget(IPC_PRIVATE, $size, S_IRWXU) || die "$!";
1485 print "shm key $id\n";
a0d0e21e 1486
1487 $message = "Message #1";
41d6edb2 1488 shmwrite($id, $message, 0, 60) || die "$!";
0ade1984 1489 print "wrote: '$message'\n";
41d6edb2 1490 shmread($id, $buff, 0, 60) || die "$!";
0ade1984 1491 print "read : '$buff'\n";
a0d0e21e 1492
0ade1984 1493 # the buffer of shmread is zero-character end-padded.
1494 substr($buff, index($buff, "\0")) = '';
1495 print "un" unless $buff eq $message;
1496 print "swell\n";
a0d0e21e 1497
41d6edb2 1498 print "deleting shm $id\n";
1499 shmctl($id, IPC_RMID, 0) || die "$!";
a0d0e21e 1500
1501Here's an example of a semaphore:
1502
0ade1984 1503 use IPC::SysV qw(IPC_CREAT);
1504
a0d0e21e 1505 $IPC_KEY = 1234;
41d6edb2 1506 $id = semget($IPC_KEY, 10, 0666 | IPC_CREAT ) || die "$!";
1507 print "shm key $id\n";
a0d0e21e 1508
a2eb9003 1509Put this code in a separate file to be run in more than one process.
a0d0e21e 1510Call the file F<take>:
1511
1512 # create a semaphore
1513
1514 $IPC_KEY = 1234;
41d6edb2 1515 $id = semget($IPC_KEY, 0 , 0 );
1516 die if !defined($id);
a0d0e21e 1517
1518 $semnum = 0;
1519 $semflag = 0;
1520
1521 # 'take' semaphore
1522 # wait for semaphore to be zero
1523 $semop = 0;
41d6edb2 1524 $opstring1 = pack("s!s!s!", $semnum, $semop, $semflag);
a0d0e21e 1525
1526 # Increment the semaphore count
1527 $semop = 1;
41d6edb2 1528 $opstring2 = pack("s!s!s!", $semnum, $semop, $semflag);
a0d0e21e 1529 $opstring = $opstring1 . $opstring2;
1530
41d6edb2 1531 semop($id,$opstring) || die "$!";
a0d0e21e 1532
a2eb9003 1533Put this code in a separate file to be run in more than one process.
a0d0e21e 1534Call this file F<give>:
1535
4633a7c4 1536 # 'give' the semaphore
a0d0e21e 1537 # run this in the original process and you will see
1538 # that the second process continues
1539
1540 $IPC_KEY = 1234;
41d6edb2 1541 $id = semget($IPC_KEY, 0, 0);
1542 die if !defined($id);
a0d0e21e 1543
1544 $semnum = 0;
1545 $semflag = 0;
1546
1547 # Decrement the semaphore count
1548 $semop = -1;
41d6edb2 1549 $opstring = pack("s!s!s!", $semnum, $semop, $semflag);
a0d0e21e 1550
41d6edb2 1551 semop($id,$opstring) || die "$!";
a0d0e21e 1552
7b05b7e3 1553The SysV IPC code above was written long ago, and it's definitely
0ade1984 1554clunky looking. For a more modern look, see the IPC::SysV module
1555which is included with Perl starting from Perl 5.005.
4633a7c4 1556
41d6edb2 1557A small example demonstrating SysV message queues:
1558
1559 use IPC::SysV qw(IPC_PRIVATE IPC_RMID IPC_CREAT S_IRWXU);
1560
1561 my $id = msgget(IPC_PRIVATE, IPC_CREAT | S_IRWXU);
1562
1563 my $sent = "message";
1564 my $type = 1234;
1565 my $rcvd;
1566 my $type_rcvd;
1567
1568 if (defined $id) {
1569 if (msgsnd($id, pack("l! a*", $type_sent, $sent), 0)) {
1570 if (msgrcv($id, $rcvd, 60, 0, 0)) {
1571 ($type_rcvd, $rcvd) = unpack("l! a*", $rcvd);
1572 if ($rcvd eq $sent) {
1573 print "okay\n";
1574 } else {
1575 print "not okay\n";
1576 }
1577 } else {
1578 die "# msgrcv failed\n";
1579 }
1580 } else {
1581 die "# msgsnd failed\n";
1582 }
1583 msgctl($id, IPC_RMID, 0) || die "# msgctl failed: $!\n";
1584 } else {
1585 die "# msgget failed\n";
1586 }
1587
4633a7c4 1588=head1 NOTES
1589
5a964f20 1590Most of these routines quietly but politely return C<undef> when they
1591fail instead of causing your program to die right then and there due to
1592an uncaught exception. (Actually, some of the new I<Socket> conversion
1593functions croak() on bad arguments.) It is therefore essential to
1594check return values from these functions. Always begin your socket
1595programs this way for optimal success, and don't forget to add B<-T>
1596taint checking flag to the #! line for servers:
4633a7c4 1597
5a964f20 1598 #!/usr/bin/perl -Tw
4633a7c4 1599 use strict;
1600 use sigtrap;
1601 use Socket;
1602
1603=head1 BUGS
1604
1605All these routines create system-specific portability problems. As noted
1606elsewhere, Perl is at the mercy of your C libraries for much of its system
1607behaviour. It's probably safest to assume broken SysV semantics for
6a3992aa 1608signals and to stick with simple TCP and UDP socket operations; e.g., don't
a2eb9003 1609try to pass open file descriptors over a local UDP datagram socket if you
4633a7c4 1610want your code to stand a chance of being portable.
1611
5a964f20 1612As mentioned in the signals section, because few vendors provide C
1613libraries that are safely re-entrant, the prudent programmer will do
1614little else within a handler beyond setting a numeric variable that
1615already exists; or, if locked into a slow (restarting) system call,
1616using die() to raise an exception and longjmp(3) out. In fact, even
1617these may in some cases cause a core dump. It's probably best to avoid
a11adca0 1618signals except where they are absolutely inevitable. This
5a964f20 1619will be addressed in a future release of Perl.
4633a7c4 1620
1621=head1 AUTHOR
1622
1623Tom Christiansen, with occasional vestiges of Larry Wall's original
7b05b7e3 1624version and suggestions from the Perl Porters.
4633a7c4 1625
1626=head1 SEE ALSO
1627
7b05b7e3 1628There's a lot more to networking than this, but this should get you
1629started.
1630
5a964f20 1631For intrepid programmers, the indispensable textbook is I<Unix Network
1632Programming> by W. Richard Stevens (published by Addison-Wesley). Note
1633that most books on networking address networking from the perspective of
1634a C programmer; translation to Perl is left as an exercise for the reader.
7b05b7e3 1635
1636The IO::Socket(3) manpage describes the object library, and the Socket(3)
1637manpage describes the low-level interface to sockets. Besides the obvious
1638functions in L<perlfunc>, you should also check out the F<modules> file
1639at your nearest CPAN site. (See L<perlmodlib> or best yet, the F<Perl
1640FAQ> for a description of what CPAN is and where to get it.)
1641
4633a7c4 1642Section 5 of the F<modules> file is devoted to "Networking, Device Control
6a3992aa 1643(modems), and Interprocess Communication", and contains numerous unbundled
4633a7c4 1644modules numerous networking modules, Chat and Expect operations, CGI
1645programming, DCE, FTP, IPC, NNTP, Proxy, Ptty, RPC, SNMP, SMTP, Telnet,
1646Threads, and ToolTalk--just to name a few.