pthread_condattr_init in thread.h for OLD_PTHREADS_API.
[p5sagit/p5-mst-13.2.git] / pod / perlembed.pod
CommitLineData
a0d0e21e 1=head1 NAME
2
cb1a09d0 3perlembed - how to embed perl in your C program
a0d0e21e 4
5=head1 DESCRIPTION
6
cb1a09d0 7=head2 PREAMBLE
8
9Do you want to:
10
11=over 5
12
96dbc785 13=item B<Use C from Perl?>
cb1a09d0 14
15Read L<perlcall> and L<perlxs>.
16
54310121 17=item B<Use a Unix program from Perl?>
cb1a09d0 18
5f05dabc 19Read about back-quotes and about C<system> and C<exec> in L<perlfunc>.
cb1a09d0 20
96dbc785 21=item B<Use Perl from Perl?>
cb1a09d0 22
8a7dc658 23Read about L<perlfunc/do> and L<perlfunc/eval> and L<perlfunc/require>
24and L<perlfunc/use>.
cb1a09d0 25
96dbc785 26=item B<Use C from C?>
cb1a09d0 27
28Rethink your design.
29
96dbc785 30=item B<Use Perl from C?>
cb1a09d0 31
32Read on...
33
34=back
35
36=head2 ROADMAP
37
38L<Compiling your C program>
39
53f52f58 40There's one example in each of the nine sections:
cb1a09d0 41
42L<Adding a Perl interpreter to your C program>
43
44L<Calling a Perl subroutine from your C program>
45
46L<Evaluating a Perl statement from your C program>
47
48L<Performing Perl pattern matches and substitutions from your C program>
49
50L<Fiddling with the Perl stack from your C program>
51
a6006777 52L<Maintaining a persistent interpreter>
53
8ebc5c01 54L<Maintaining multiple interpreter instances>
55
96dbc785 56L<Using Perl modules, which themselves use C libraries, from your C program>
57
53f52f58 58L<Embedding Perl under Win32>
cb1a09d0 59
60=head2 Compiling your C program
61
8a7dc658 62If you have trouble compiling the scripts in this documentation,
63you're not alone. The cardinal rule: COMPILE THE PROGRAMS IN EXACTLY
64THE SAME WAY THAT YOUR PERL WAS COMPILED. (Sorry for yelling.)
cb1a09d0 65
8a7dc658 66Also, every C program that uses Perl must link in the I<perl library>.
cb1a09d0 67What's that, you ask? Perl is itself written in C; the perl library
68is the collection of compiled C programs that were used to create your
69perl executable (I</usr/bin/perl> or equivalent). (Corollary: you
70can't use Perl from your C program unless Perl has been compiled on
71your machine, or installed properly--that's why you shouldn't blithely
72copy Perl executables from machine to machine without also copying the
73I<lib> directory.)
74
8a7dc658 75When you use Perl from C, your C program will--usually--allocate,
76"run", and deallocate a I<PerlInterpreter> object, which is defined by
77the perl library.
cb1a09d0 78
79If your copy of Perl is recent enough to contain this documentation
a6006777 80(version 5.002 or later), then the perl library (and I<EXTERN.h> and
8a7dc658 81I<perl.h>, which you'll also need) will reside in a directory
82that looks like this:
cb1a09d0 83
84 /usr/local/lib/perl5/your_architecture_here/CORE
85
86or perhaps just
87
88 /usr/local/lib/perl5/CORE
89
90or maybe something like
91
92 /usr/opt/perl5/CORE
93
94Execute this statement for a hint about where to find CORE:
95
96dbc785 96 perl -MConfig -e 'print $Config{archlib}'
cb1a09d0 97
54310121 98Here's how you'd compile the example in the next section,
8a7dc658 99L<Adding a Perl interpreter to your C program>, on my Linux box:
cb1a09d0 100
54310121 101 % gcc -O2 -Dbool=char -DHAS_BOOL -I/usr/local/include
8a7dc658 102 -I/usr/local/lib/perl5/i586-linux/5.003/CORE
54310121 103 -L/usr/local/lib/perl5/i586-linux/5.003/CORE
8a7dc658 104 -o interp interp.c -lperl -lm
cb1a09d0 105
54310121 106(That's all one line.) On my DEC Alpha running 5.003_05, the incantation
8a7dc658 107is a bit different:
108
54310121 109 % cc -O2 -Olimit 2900 -DSTANDARD_C -I/usr/local/include
110 -I/usr/local/lib/perl5/alpha-dec_osf/5.00305/CORE
111 -L/usr/local/lib/perl5/alpha-dec_osf/5.00305/CORE -L/usr/local/lib
8a7dc658 112 -D__LANGUAGE_C__ -D_NO_PROTO -o interp interp.c -lperl -lm
113
114How can you figure out what to add? Assuming your Perl is post-5.001,
115execute a C<perl -V> command and pay special attention to the "cc" and
54310121 116"ccflags" information.
8a7dc658 117
54310121 118You'll have to choose the appropriate compiler (I<cc>, I<gcc>, et al.) for
8a7dc658 119your machine: C<perl -MConfig -e 'print $Config{cc}'> will tell you what
54310121 120to use.
8a7dc658 121
122You'll also have to choose the appropriate library directory
123(I</usr/local/lib/...>) for your machine. If your compiler complains
124that certain functions are undefined, or that it can't locate
125I<-lperl>, then you need to change the path following the C<-L>. If it
126complains that it can't find I<EXTERN.h> and I<perl.h>, you need to
127change the path following the C<-I>.
cb1a09d0 128
129You may have to add extra libraries as well. Which ones?
96dbc785 130Perhaps those printed by
131
132 perl -MConfig -e 'print $Config{libs}'
133
54310121 134Provided your perl binary was properly configured and installed the
8a7dc658 135B<ExtUtils::Embed> module will determine all of this information for
136you:
96dbc785 137
138 % cc -o interp interp.c `perl -MExtUtils::Embed -e ccopts -e ldopts`
139
8a7dc658 140If the B<ExtUtils::Embed> module isn't part of your Perl distribution,
141you can retrieve it from
142http://www.perl.com/perl/CPAN/modules/by-module/ExtUtils::Embed. (If
143this documentation came from your Perl distribution, then you're
144running 5.004 or better and you already have it.)
96dbc785 145
8a7dc658 146The B<ExtUtils::Embed> kit on CPAN also contains all source code for
54310121 147the examples in this document, tests, additional examples and other
8a7dc658 148information you may find useful.
cb1a09d0 149
150=head2 Adding a Perl interpreter to your C program
151
152In a sense, perl (the C program) is a good example of embedding Perl
153(the language), so I'll demonstrate embedding with I<miniperlmain.c>,
54310121 154from the source distribution. Here's a bastardized, nonportable
8a7dc658 155version of I<miniperlmain.c> containing the essentials of embedding:
cb1a09d0 156
cb1a09d0 157 #include <EXTERN.h> /* from the Perl distribution */
158 #include <perl.h> /* from the Perl distribution */
96dbc785 159
cb1a09d0 160 static PerlInterpreter *my_perl; /*** The Perl interpreter ***/
96dbc785 161
c07a80fd 162 int main(int argc, char **argv, char **env)
cb1a09d0 163 {
164 my_perl = perl_alloc();
165 perl_construct(my_perl);
96dbc785 166 perl_parse(my_perl, NULL, argc, argv, (char **)NULL);
cb1a09d0 167 perl_run(my_perl);
168 perl_destruct(my_perl);
169 perl_free(my_perl);
170 }
171
8a7dc658 172Notice that we don't use the C<env> pointer. Normally handed to
173C<perl_parse> as its final argument, C<env> here is replaced by
174C<NULL>, which means that the current environment will be used.
96dbc785 175
cb1a09d0 176Now compile this program (I'll call it I<interp.c>) into an executable:
177
96dbc785 178 % cc -o interp interp.c `perl -MExtUtils::Embed -e ccopts -e ldopts`
cb1a09d0 179
180After a successful compilation, you'll be able to use I<interp> just
181like perl itself:
182
183 % interp
184 print "Pretty Good Perl \n";
185 print "10890 - 9801 is ", 10890 - 9801;
186 <CTRL-D>
187 Pretty Good Perl
188 10890 - 9801 is 1089
189
190or
191
192 % interp -e 'printf("%x", 3735928559)'
193 deadbeef
194
195You can also read and execute Perl statements from a file while in the
196midst of your C program, by placing the filename in I<argv[1]> before
96dbc785 197calling I<perl_run()>.
cb1a09d0 198
199=head2 Calling a Perl subroutine from your C program
200
8ebc5c01 201To call individual Perl subroutines, you can use any of the B<perl_call_*>
54310121 202functions documented in the L<perlcall> manpage.
8ebc5c01 203In this example we'll use I<perl_call_argv>.
cb1a09d0 204
205That's shown below, in a program I'll call I<showtime.c>.
206
cb1a09d0 207 #include <EXTERN.h>
96dbc785 208 #include <perl.h>
209
210 static PerlInterpreter *my_perl;
211
c07a80fd 212 int main(int argc, char **argv, char **env)
cb1a09d0 213 {
8ebc5c01 214 char *args[] = { NULL };
cb1a09d0 215 my_perl = perl_alloc();
216 perl_construct(my_perl);
96dbc785 217
218 perl_parse(my_perl, NULL, argc, argv, NULL);
219
8ebc5c01 220 /*** skipping perl_run() ***/
221
222 perl_call_argv("showtime", G_DISCARD | G_NOARGS, args);
223
cb1a09d0 224 perl_destruct(my_perl);
225 perl_free(my_perl);
226 }
227
228where I<showtime> is a Perl subroutine that takes no arguments (that's the
96dbc785 229I<G_NOARGS>) and for which I'll ignore the return value (that's the
cb1a09d0 230I<G_DISCARD>). Those flags, and others, are discussed in L<perlcall>.
231
232I'll define the I<showtime> subroutine in a file called I<showtime.pl>:
233
234 print "I shan't be printed.";
96dbc785 235
cb1a09d0 236 sub showtime {
237 print time;
238 }
239
240Simple enough. Now compile and run:
241
96dbc785 242 % cc -o showtime showtime.c `perl -MExtUtils::Embed -e ccopts -e ldopts`
243
cb1a09d0 244 % showtime showtime.pl
245 818284590
246
247yielding the number of seconds that elapsed between January 1, 1970
8a7dc658 248(the beginning of the Unix epoch), and the moment I began writing this
cb1a09d0 249sentence.
250
8a7dc658 251In this particular case we don't have to call I<perl_run>, but in
252general it's considered good practice to ensure proper initialization
253of library code, including execution of all object C<DESTROY> methods
254and package C<END {}> blocks.
8ebc5c01 255
8a7dc658 256If you want to pass arguments to the Perl subroutine, you can add
257strings to the C<NULL>-terminated C<args> list passed to
258I<perl_call_argv>. For other data types, or to examine return values,
259you'll need to manipulate the Perl stack. That's demonstrated in the
260last section of this document: L<Fiddling with the Perl stack from
261your C program>.
cb1a09d0 262
263=head2 Evaluating a Perl statement from your C program
264
137443ea 265Perl provides two API functions to evaluate pieces of Perl code.
266These are L<perlguts/perl_eval_sv()> and L<perlguts/perl_eval_pv()>.
267
268Arguably, these are the only routines you'll ever need to execute
269snippets of Perl code from within your C program. Your code can be
8a7dc658 270as long as you wish; it can contain multiple statements; it can employ
271L<perlfunc/use>, L<perlfunc/require> and L<perlfunc/do> to include
272external Perl files.
cb1a09d0 273
137443ea 274I<perl_eval_pv()> lets us evaluate individual Perl strings, and then
96dbc785 275extract variables for coercion into C types. The following program,
cb1a09d0 276I<string.c>, executes three Perl strings, extracting an C<int> from
277the first, a C<float> from the second, and a C<char *> from the third.
278
cb1a09d0 279 #include <EXTERN.h>
280 #include <perl.h>
137443ea 281
cb1a09d0 282 static PerlInterpreter *my_perl;
137443ea 283
c07a80fd 284 main (int argc, char **argv, char **env)
cb1a09d0 285 {
137443ea 286 char *embedding[] = { "", "-e", "0" };
287
288 my_perl = perl_alloc();
289 perl_construct( my_perl );
290
291 perl_parse(my_perl, NULL, 3, embedding, NULL);
292 perl_run(my_perl);
293
294 /** Treat $a as an integer **/
295 perl_eval_pv("$a = 3; $a **= 2", TRUE);
296 printf("a = %d\n", SvIV(perl_get_sv("a", FALSE)));
297
298 /** Treat $a as a float **/
299 perl_eval_pv("$a = 3.14; $a **= 2", TRUE);
300 printf("a = %f\n", SvNV(perl_get_sv("a", FALSE)));
301
302 /** Treat $a as a string **/
303 perl_eval_pv("$a = 'rekcaH lreP rehtonA tsuJ'; $a = reverse($a);", TRUE);
304 printf("a = %s\n", SvPV(perl_get_sv("a", FALSE), na));
305
306 perl_destruct(my_perl);
307 perl_free(my_perl);
cb1a09d0 308 }
309
310All of those strange functions with I<sv> in their names help convert Perl scalars to C types. They're described in L<perlguts>.
311
312If you compile and run I<string.c>, you'll see the results of using
313I<SvIV()> to create an C<int>, I<SvNV()> to create a C<float>, and
314I<SvPV()> to create a string:
315
316 a = 9
317 a = 9.859600
318 a = Just Another Perl Hacker
319
8f183262 320In the example above, we've created a global variable to temporarily
321store the computed value of our eval'd expression. It is also
322possible and in most cases a better strategy to fetch the return value
137443ea 323from L<perl_eval_pv> instead. Example:
8f183262 324
8f183262 325 ...
137443ea 326 SV *val = perl_eval_pv("reverse 'rekcaH lreP rehtonA tsuJ'", TRUE);
8f183262 327 printf("%s\n", SvPV(val,na));
328 ...
329
330This way, we avoid namespace pollution by not creating global
331variables and we've simplified our code as well.
cb1a09d0 332
333=head2 Performing Perl pattern matches and substitutions from your C program
334
1f05cdcd 335The I<perl_eval_sv()> function lets us evaluate chunks of Perl code, so we can
cb1a09d0 336define some functions that use it to "specialize" in matches and
337substitutions: I<match()>, I<substitute()>, and I<matches()>.
338
1f05cdcd 339 char match(SV *string, char *pattern);
cb1a09d0 340
8a7dc658 341Given a string and a pattern (e.g., C<m/clasp/> or C</\b\w*\b/>, which
342in your C program might appear as "/\\b\\w*\\b/"), match()
cb1a09d0 343returns 1 if the string matches the pattern and 0 otherwise.
344
1f05cdcd 345 int substitute(SV **string, char *pattern);
cb1a09d0 346
1f05cdcd 347Given a pointer to an C<SV> and an C<=~> operation (e.g.,
8a7dc658 348C<s/bob/robert/g> or C<tr[A-Z][a-z]>), substitute() modifies the string
1f05cdcd 349within the C<AV> at according to the operation, returning the number of substitutions
8a7dc658 350made.
cb1a09d0 351
1f05cdcd 352 int matches(SV *string, char *pattern, AV **matches);
cb1a09d0 353
1f05cdcd 354Given an C<SV>, a pattern, and a pointer to an empty C<AV>,
8a7dc658 355matches() evaluates C<$string =~ $pattern> in an array context, and
1f05cdcd 356fills in I<matches> with the array elements, returning the number of matches found.
cb1a09d0 357
96dbc785 358Here's a sample program, I<match.c>, that uses all three (long lines have
359been wrapped here):
cb1a09d0 360
1f05cdcd 361 #include <EXTERN.h>
362 #include <perl.h>
363
364 /** my_perl_eval_sv(code, error_check)
365 ** kinda like perl_eval_sv(),
366 ** but we pop the return value off the stack
367 **/
368 SV* my_perl_eval_sv(SV *sv, I32 croak_on_error)
369 {
370 dSP;
371 SV* retval;
372
373 PUSHMARK(sp);
374 perl_eval_sv(sv, G_SCALAR);
375
376 SPAGAIN;
377 retval = POPs;
378 PUTBACK;
379
380 if (croak_on_error && SvTRUE(GvSV(errgv)))
381 croak(SvPVx(GvSV(errgv), na));
382
383 return retval;
384 }
385
386 /** match(string, pattern)
387 **
388 ** Used for matches in a scalar context.
389 **
390 ** Returns 1 if the match was successful; 0 otherwise.
391 **/
392
393 I32 match(SV *string, char *pattern)
394 {
395 SV *command = newSV(0), *retval;
396
397 sv_setpvf(command, "my $string = '%s'; $string =~ %s",
398 SvPV(string,na), pattern);
399
400 retval = my_perl_eval_sv(command, TRUE);
401 SvREFCNT_dec(command);
402
403 return SvIV(retval);
404 }
405
406 /** substitute(string, pattern)
407 **
408 ** Used for =~ operations that modify their left-hand side (s/// and tr///)
409 **
410 ** Returns the number of successful matches, and
411 ** modifies the input string if there were any.
412 **/
413
414 I32 substitute(SV **string, char *pattern)
415 {
416 SV *command = newSV(0), *retval;
417
418 sv_setpvf(command, "$string = '%s'; ($string =~ %s)",
419 SvPV(*string,na), pattern);
420
421 retval = my_perl_eval_sv(command, TRUE);
422 SvREFCNT_dec(command);
423
424 *string = perl_get_sv("string", FALSE);
425 return SvIV(retval);
426 }
427
428 /** matches(string, pattern, matches)
429 **
430 ** Used for matches in an array context.
431 **
432 ** Returns the number of matches,
433 ** and fills in **matches with the matching substrings
434 **/
435
436 I32 matches(SV *string, char *pattern, AV **match_list)
437 {
438 SV *command = newSV(0);
cb1a09d0 439 I32 num_matches;
1f05cdcd 440
441 sv_setpvf(command, "my $string = '%s'; @array = ($string =~ %s)",
442 SvPV(string,na), pattern);
443
444 my_perl_eval_sv(command, TRUE);
445 SvREFCNT_dec(command);
446
447 *match_list = perl_get_av("array", FALSE);
448 num_matches = av_len(*match_list) + 1; /** assume $[ is 0 **/
449
cb1a09d0 450 return num_matches;
1f05cdcd 451 }
452
453 main (int argc, char **argv, char **env)
454 {
455 PerlInterpreter *my_perl = perl_alloc();
a6006777 456 char *embedding[] = { "", "-e", "0" };
1f05cdcd 457 AV *match_list;
458 I32 num_matches, i;
459 SV *text = newSV(0);
460
461 perl_construct(my_perl);
96dbc785 462 perl_parse(my_perl, NULL, 3, embedding, NULL);
1f05cdcd 463
464 sv_setpv(text, "When he is at a convenience store and the bill comes to some amount like 76 cents, Maynard is aware that there is something he *should* do, something that will enable him to get back a quarter, but he has no idea *what*. He fumbles through his red squeezey changepurse and gives the boy three extra pennies with his dollar, hoping that he might luck into the correct amount. The boy gives him back two of his own pennies and then the big shiny quarter that is his prize. -RICHH");
465
96dbc785 466 if (match(text, "m/quarter/")) /** Does text contain 'quarter'? **/
1f05cdcd 467 printf("match: Text contains the word 'quarter'.\n\n");
96dbc785 468 else
1f05cdcd 469 printf("match: Text doesn't contain the word 'quarter'.\n\n");
470
96dbc785 471 if (match(text, "m/eighth/")) /** Does text contain 'eighth'? **/
1f05cdcd 472 printf("match: Text contains the word 'eighth'.\n\n");
96dbc785 473 else
1f05cdcd 474 printf("match: Text doesn't contain the word 'eighth'.\n\n");
475
96dbc785 476 /** Match all occurrences of /wi../ **/
477 num_matches = matches(text, "m/(wi..)/g", &match_list);
478 printf("matches: m/(wi..)/g found %d matches...\n", num_matches);
1f05cdcd 479
96dbc785 480 for (i = 0; i < num_matches; i++)
1f05cdcd 481 printf("match: %s\n", SvPV(*av_fetch(match_list, i, FALSE),na));
cb1a09d0 482 printf("\n");
1f05cdcd 483
96dbc785 484 /** Remove all vowels from text **/
485 num_matches = substitute(&text, "s/[aeiou]//gi");
cb1a09d0 486 if (num_matches) {
1f05cdcd 487 printf("substitute: s/[aeiou]//gi...%d substitutions made.\n",
488 num_matches);
489 printf("Now text is: %s\n\n", SvPV(text,na));
cb1a09d0 490 }
1f05cdcd 491
96dbc785 492 /** Attempt a substitution **/
493 if (!substitute(&text, "s/Perl/C/")) {
1f05cdcd 494 printf("substitute: s/Perl/C...No substitution made.\n\n");
cb1a09d0 495 }
1f05cdcd 496
497 SvREFCNT_dec(text);
498 perl_destruct_level = 1;
cb1a09d0 499 perl_destruct(my_perl);
500 perl_free(my_perl);
1f05cdcd 501 }
cb1a09d0 502
96dbc785 503which produces the output (again, long lines have been wrapped here)
cb1a09d0 504
8a7dc658 505 match: Text contains the word 'quarter'.
96dbc785 506
8a7dc658 507 match: Text doesn't contain the word 'eighth'.
96dbc785 508
8a7dc658 509 matches: m/(wi..)/g found 2 matches...
cb1a09d0 510 match: will
511 match: with
96dbc785 512
8a7dc658 513 substitute: s/[aeiou]//gi...139 substitutions made.
54310121 514 Now text is: Whn h s t cnvnnc str nd th bll cms t sm mnt lk 76 cnts,
96dbc785 515 Mynrd s wr tht thr s smthng h *shld* d, smthng tht wll nbl hm t gt bck
516 qrtr, bt h hs n d *wht*. H fmbls thrgh hs rd sqzy chngprs nd gvs th by
517 thr xtr pnns wth hs dllr, hpng tht h mght lck nt th crrct mnt. Th by gvs
518 hm bck tw f hs wn pnns nd thn th bg shny qrtr tht s hs prz. -RCHH
519
8a7dc658 520 substitute: s/Perl/C...No substitution made.
96dbc785 521
cb1a09d0 522=head2 Fiddling with the Perl stack from your C program
523
524When trying to explain stacks, most computer science textbooks mumble
525something about spring-loaded columns of cafeteria plates: the last
526thing you pushed on the stack is the first thing you pop off. That'll
527do for our purposes: your C program will push some arguments onto "the Perl
528stack", shut its eyes while some magic happens, and then pop the
529results--the return value of your Perl subroutine--off the stack.
96dbc785 530
cb1a09d0 531First you'll need to know how to convert between C types and Perl
532types, with newSViv() and sv_setnv() and newAV() and all their
533friends. They're described in L<perlguts>.
534
535Then you'll need to know how to manipulate the Perl stack. That's
536described in L<perlcall>.
537
96dbc785 538Once you've understood those, embedding Perl in C is easy.
cb1a09d0 539
54310121 540Because C has no builtin function for integer exponentiation, let's
cb1a09d0 541make Perl's ** operator available to it (this is less useful than it
5f05dabc 542sounds, because Perl implements ** with C's I<pow()> function). First
cb1a09d0 543I'll create a stub exponentiation function in I<power.pl>:
544
545 sub expo {
546 my ($a, $b) = @_;
547 return $a ** $b;
548 }
549
550Now I'll create a C program, I<power.c>, with a function
551I<PerlPower()> that contains all the perlguts necessary to push the
552two arguments into I<expo()> and to pop the return value out. Take a
553deep breath...
554
cb1a09d0 555 #include <EXTERN.h>
556 #include <perl.h>
96dbc785 557
cb1a09d0 558 static PerlInterpreter *my_perl;
96dbc785 559
cb1a09d0 560 static void
561 PerlPower(int a, int b)
562 {
563 dSP; /* initialize stack pointer */
564 ENTER; /* everything created after here */
565 SAVETMPS; /* ...is a temporary variable. */
566 PUSHMARK(sp); /* remember the stack pointer */
567 XPUSHs(sv_2mortal(newSViv(a))); /* push the base onto the stack */
568 XPUSHs(sv_2mortal(newSViv(b))); /* push the exponent onto stack */
569 PUTBACK; /* make local stack pointer global */
570 perl_call_pv("expo", G_SCALAR); /* call the function */
571 SPAGAIN; /* refresh stack pointer */
572 /* pop the return value from stack */
573 printf ("%d to the %dth power is %d.\n", a, b, POPi);
96dbc785 574 PUTBACK;
cb1a09d0 575 FREETMPS; /* free that return value */
576 LEAVE; /* ...and the XPUSHed "mortal" args.*/
577 }
96dbc785 578
579 int main (int argc, char **argv, char **env)
cb1a09d0 580 {
95b76e31 581 char *my_argv[] = { "", "power.pl" };
96dbc785 582
cb1a09d0 583 my_perl = perl_alloc();
584 perl_construct( my_perl );
96dbc785 585
95b76e31 586 perl_parse(my_perl, NULL, 2, my_argv, (char **)NULL);
8ebc5c01 587 perl_run(my_perl);
96dbc785 588
cb1a09d0 589 PerlPower(3, 4); /*** Compute 3 ** 4 ***/
96dbc785 590
cb1a09d0 591 perl_destruct(my_perl);
592 perl_free(my_perl);
593 }
96dbc785 594
cb1a09d0 595
596
597Compile and run:
598
96dbc785 599 % cc -o power power.c `perl -MExtUtils::Embed -e ccopts -e ldopts`
600
601 % power
cb1a09d0 602 3 to the 4th power is 81.
603
a6006777 604=head2 Maintaining a persistent interpreter
605
8a7dc658 606When developing interactive and/or potentially long-running
607applications, it's a good idea to maintain a persistent interpreter
608rather than allocating and constructing a new interpreter multiple
609times. The major reason is speed: since Perl will only be loaded into
54310121 610memory once.
8a7dc658 611
612However, you have to be more cautious with namespace and variable
613scoping when using a persistent interpreter. In previous examples
614we've been using global variables in the default package C<main>. We
615knew exactly what code would be run, and assumed we could avoid
616variable collisions and outrageous symbol table growth.
617
618Let's say your application is a server that will occasionally run Perl
619code from some arbitrary file. Your server has no way of knowing what
620code it's going to run. Very dangerous.
621
622If the file is pulled in by C<perl_parse()>, compiled into a newly
623constructed interpreter, and subsequently cleaned out with
624C<perl_destruct()> afterwards, you're shielded from most namespace
625troubles.
626
627One way to avoid namespace collisions in this scenario is to translate
628the filename into a guaranteed-unique package name, and then compile
629the code into that package using L<perlfunc/eval>. In the example
630below, each file will only be compiled once. Or, the application
631might choose to clean out the symbol table associated with the file
632after it's no longer needed. Using L<perlcall/perl_call_argv>, We'll
633call the subroutine C<Embed::Persistent::eval_file> which lives in the
634file C<persistent.pl> and pass the filename and boolean cleanup/cache
a6006777 635flag as arguments.
636
8a7dc658 637Note that the process will continue to grow for each file that it
638uses. In addition, there might be C<AUTOLOAD>ed subroutines and other
639conditions that cause Perl's symbol table to grow. You might want to
640add some logic that keeps track of the process size, or restarts
641itself after a certain number of requests, to ensure that memory
642consumption is minimized. You'll also want to scope your variables
643with L<perlfunc/my> whenever possible.
a6006777 644
54310121 645
a6006777 646 package Embed::Persistent;
647 #persistent.pl
54310121 648
a6006777 649 use strict;
650 use vars '%Cache';
54310121 651
a6006777 652 sub valid_package_name {
653 my($string) = @_;
654 $string =~ s/([^A-Za-z0-9\/])/sprintf("_%2x",unpack("C",$1))/eg;
655 # second pass only for words starting with a digit
656 $string =~ s|/(\d)|sprintf("/_%2x",unpack("C",$1))|eg;
54310121 657
a6006777 658 # Dress it up as a real package name
659 $string =~ s|/|::|g;
660 return "Embed" . $string;
661 }
54310121 662
a6006777 663 #borrowed from Safe.pm
664 sub delete_package {
665 my $pkg = shift;
666 my ($stem, $leaf);
54310121 667
a6006777 668 no strict 'refs';
8ebc5c01 669 $pkg = "main::$pkg\::"; # expand to full symbol table name
a6006777 670 ($stem, $leaf) = $pkg =~ m/(.*::)(\w+::)$/;
54310121 671
a6006777 672 my $stem_symtab = *{$stem}{HASH};
54310121 673
a6006777 674 delete $stem_symtab->{$leaf};
675 }
54310121 676
a6006777 677 sub eval_file {
678 my($filename, $delete) = @_;
679 my $package = valid_package_name($filename);
680 my $mtime = -M $filename;
681 if(defined $Cache{$package}{mtime}
682 &&
54310121 683 $Cache{$package}{mtime} <= $mtime)
a6006777 684 {
54310121 685 # we have compiled this subroutine already,
8ebc5c01 686 # it has not been updated on disk, nothing left to do
687 print STDERR "already compiled $package->handler\n";
a6006777 688 }
689 else {
8ebc5c01 690 local *FH;
691 open FH, $filename or die "open '$filename' $!";
692 local($/) = undef;
693 my $sub = <FH>;
694 close FH;
54310121 695
8ebc5c01 696 #wrap the code into a subroutine inside our unique package
697 my $eval = qq{package $package; sub handler { $sub; }};
698 {
699 # hide our variables within this block
700 my($filename,$mtime,$package,$sub);
701 eval $eval;
702 }
703 die $@ if $@;
54310121 704
8ebc5c01 705 #cache it unless we're cleaning out each time
706 $Cache{$package}{mtime} = $mtime unless $delete;
a6006777 707 }
54310121 708
a6006777 709 eval {$package->handler;};
710 die $@ if $@;
54310121 711
a6006777 712 delete_package($package) if $delete;
54310121 713
a6006777 714 #take a look if you want
715 #print Devel::Symdump->rnew($package)->as_string, $/;
716 }
54310121 717
a6006777 718 1;
54310121 719
a6006777 720 __END__
721
722 /* persistent.c */
54310121 723 #include <EXTERN.h>
724 #include <perl.h>
725
a6006777 726 /* 1 = clean out filename's symbol table after each request, 0 = don't */
727 #ifndef DO_CLEAN
728 #define DO_CLEAN 0
729 #endif
54310121 730
a6006777 731 static PerlInterpreter *perl = NULL;
54310121 732
a6006777 733 int
734 main(int argc, char **argv, char **env)
735 {
736 char *embedding[] = { "", "persistent.pl" };
737 char *args[] = { "", DO_CLEAN, NULL };
738 char filename [1024];
739 int exitstatus = 0;
54310121 740
a6006777 741 if((perl = perl_alloc()) == NULL) {
8ebc5c01 742 fprintf(stderr, "no memory!");
743 exit(1);
a6006777 744 }
54310121 745 perl_construct(perl);
746
a6006777 747 exitstatus = perl_parse(perl, NULL, 2, embedding, NULL);
54310121 748
749 if(!exitstatus) {
8ebc5c01 750 exitstatus = perl_run(perl);
54310121 751
8ebc5c01 752 while(printf("Enter file name: ") && gets(filename)) {
54310121 753
8ebc5c01 754 /* call the subroutine, passing it the filename as an argument */
755 args[0] = filename;
54310121 756 perl_call_argv("Embed::Persistent::eval_file",
8ebc5c01 757 G_DISCARD | G_EVAL, args);
54310121 758
8ebc5c01 759 /* check $@ */
54310121 760 if(SvTRUE(GvSV(errgv)))
8ebc5c01 761 fprintf(stderr, "eval error: %s\n", SvPV(GvSV(errgv),na));
762 }
a6006777 763 }
54310121 764
a6006777 765 perl_destruct_level = 0;
54310121 766 perl_destruct(perl);
767 perl_free(perl);
a6006777 768 exit(exitstatus);
769 }
770
a6006777 771Now compile:
772
54310121 773 % cc -o persistent persistent.c `perl -MExtUtils::Embed -e ccopts -e ldopts`
a6006777 774
775Here's a example script file:
776
777 #test.pl
778 my $string = "hello";
779 foo($string);
780
781 sub foo {
782 print "foo says: @_\n";
783 }
784
785Now run:
786
787 % persistent
788 Enter file name: test.pl
789 foo says: hello
790 Enter file name: test.pl
791 already compiled Embed::test_2epl->handler
792 foo says: hello
793 Enter file name: ^C
794
8ebc5c01 795=head2 Maintaining multiple interpreter instances
796
8a7dc658 797Some rare applications will need to create more than one interpreter
798during a session. Such an application might sporadically decide to
54310121 799release any resources associated with the interpreter.
8a7dc658 800
801The program must take care to ensure that this takes place I<before>
802the next interpreter is constructed. By default, the global variable
803C<perl_destruct_level> is set to C<0>, since extra cleaning isn't
804needed when a program has only one interpreter.
805
806Setting C<perl_destruct_level> to C<1> makes everything squeaky clean:
807
54310121 808 perl_destruct_level = 1;
8ebc5c01 809
8ebc5c01 810 while(1) {
811 ...
812 /* reset global variables here with perl_destruct_level = 1 */
54310121 813 perl_construct(my_perl);
8ebc5c01 814 ...
815 /* clean and reset _everything_ during perl_destruct */
54310121 816 perl_destruct(my_perl);
817 perl_free(my_perl);
8ebc5c01 818 ...
819 /* let's go do it again! */
820 }
821
54310121 822When I<perl_destruct()> is called, the interpreter's syntax parse tree
823and symbol tables are cleaned up, and global variables are reset.
8ebc5c01 824
8a7dc658 825Now suppose we have more than one interpreter instance running at the
826same time. This is feasible, but only if you used the
827C<-DMULTIPLICITY> flag when building Perl. By default, that sets
828C<perl_destruct_level> to C<1>.
8ebc5c01 829
830Let's give it a try:
831
832
833 #include <EXTERN.h>
8a7dc658 834 #include <perl.h>
8ebc5c01 835
836 /* we're going to embed two interpreters */
837 /* we're going to embed two interpreters */
838
8ebc5c01 839 #define SAY_HELLO "-e", "print qq(Hi, I'm $^X\n)"
840
8ebc5c01 841 int main(int argc, char **argv, char **env)
842 {
54310121 843 PerlInterpreter
8ebc5c01 844 *one_perl = perl_alloc(),
54310121 845 *two_perl = perl_alloc();
8ebc5c01 846 char *one_args[] = { "one_perl", SAY_HELLO };
847 char *two_args[] = { "two_perl", SAY_HELLO };
848
849 perl_construct(one_perl);
850 perl_construct(two_perl);
851
852 perl_parse(one_perl, NULL, 3, one_args, (char **)NULL);
853 perl_parse(two_perl, NULL, 3, two_args, (char **)NULL);
854
855 perl_run(one_perl);
856 perl_run(two_perl);
857
858 perl_destruct(one_perl);
859 perl_destruct(two_perl);
860
861 perl_free(one_perl);
862 perl_free(two_perl);
863 }
864
865
866Compile as usual:
867
868 % cc -o multiplicity multiplicity.c `perl -MExtUtils::Embed -e ccopts -e ldopts`
869
870Run it, Run it:
871
872 % multiplicity
873 Hi, I'm one_perl
874 Hi, I'm two_perl
875
96dbc785 876=head2 Using Perl modules, which themselves use C libraries, from your C program
877
878If you've played with the examples above and tried to embed a script
879that I<use()>s a Perl module (such as I<Socket>) which itself uses a C or C++ library,
880this probably happened:
881
882
883 Can't load module Socket, dynamic loading not available in this perl.
884 (You may need to build a new perl executable which either supports
885 dynamic loading or has the Socket module statically linked into it.)
886
887
888What's wrong?
889
890Your interpreter doesn't know how to communicate with these extensions
891on its own. A little glue will help. Up until now you've been
892calling I<perl_parse()>, handing it NULL for the second argument:
893
894 perl_parse(my_perl, NULL, argc, my_argv, NULL);
895
896That's where the glue code can be inserted to create the initial contact between
897Perl and linked C/C++ routines. Let's take a look some pieces of I<perlmain.c>
898to see how Perl does this:
899
900
901 #ifdef __cplusplus
902 # define EXTERN_C extern "C"
903 #else
904 # define EXTERN_C extern
905 #endif
906
907 static void xs_init _((void));
908
909 EXTERN_C void boot_DynaLoader _((CV* cv));
910 EXTERN_C void boot_Socket _((CV* cv));
911
912
913 EXTERN_C void
914 xs_init()
915 {
916 char *file = __FILE__;
917 /* DynaLoader is a special case */
918 newXS("DynaLoader::boot_DynaLoader", boot_DynaLoader, file);
919 newXS("Socket::bootstrap", boot_Socket, file);
920 }
921
922Simply put: for each extension linked with your Perl executable
923(determined during its initial configuration on your
924computer or when adding a new extension),
925a Perl subroutine is created to incorporate the extension's
926routines. Normally, that subroutine is named
927I<Module::bootstrap()> and is invoked when you say I<use Module>. In
928turn, this hooks into an XSUB, I<boot_Module>, which creates a Perl
929counterpart for each of the extension's XSUBs. Don't worry about this
930part; leave that to the I<xsubpp> and extension authors. If your
931extension is dynamically loaded, DynaLoader creates I<Module::bootstrap()>
932for you on the fly. In fact, if you have a working DynaLoader then there
5f05dabc 933is rarely any need to link in any other extensions statically.
96dbc785 934
935
936Once you have this code, slap it into the second argument of I<perl_parse()>:
937
938
939 perl_parse(my_perl, xs_init, argc, my_argv, NULL);
940
941
942Then compile:
943
8a7dc658 944 % cc -o interp interp.c `perl -MExtUtils::Embed -e ccopts -e ldopts`
96dbc785 945
946 % interp
947 use Socket;
948 use SomeDynamicallyLoadedModule;
949
950 print "Now I can use extensions!\n"'
951
952B<ExtUtils::Embed> can also automate writing the I<xs_init> glue code.
953
8a7dc658 954 % perl -MExtUtils::Embed -e xsinit -- -o perlxsi.c
96dbc785 955 % cc -c perlxsi.c `perl -MExtUtils::Embed -e ccopts`
956 % cc -c interp.c `perl -MExtUtils::Embed -e ccopts`
8a7dc658 957 % cc -o interp perlxsi.o interp.o `perl -MExtUtils::Embed -e ldopts`
96dbc785 958
959Consult L<perlxs> and L<perlguts> for more details.
960
53f52f58 961=head1 Embedding Perl under Win32
962
963At the time of this writing, there are two versions of Perl which run
964under Win32. Interfacing to Activeware's Perl library is quite
965different from the examples in this documentation, as significant
966changes were made to the internal Perl API. However, it is possible
967to embed Activeware's Perl runtime, see the Perl for Win32 FAQ:
968http://www.perl.com/perl/faq/win32/Perl_for_Win32_FAQ.html
969
970With the "official" Perl version 5.004 or higher, all the examples
971within this documentation will compile and run untouched, although,
972the build process is slightly different between Unix and Win32.
973
974For starters, backticks don't work under the Win32 native command shell!
975The ExtUtils::Embed kit on CPAN ships with a script called
976B<genmake>, which generates a simple makefile to build a program from
977a single C source file. It can be used like so:
978
979 C:\ExtUtils-Embed\eg> perl genmake interp.c
980 C:\ExtUtils-Embed\eg> nmake
981 C:\ExtUtils-Embed\eg> interp -e "print qq{I'm embedded in Win32!\n}"
982
983You may wish to use a more robust environment such as the MS Developer
984stdio. In this case, to generate perlxsi.c run:
985
986 perl -MExtUtils::Embed -e xsinit
987
988Create a new project, Insert -> Files into Project: perlxsi.c, perl.lib,
989and your own source files, e.g. interp.c. Typically you'll find
990perl.lib in B<C:\perl\lib\CORE>, if not, you should see the B<CORE>
991directory relative to C<perl -V:archlib>.
992The studio will also need this path so it knows where to find Perl
993include files. This path can be added via the Tools -> Options ->
994Directories menu. Finnally, select Build -> Build interp.exe and
995you're ready to go!
96dbc785 996
cb1a09d0 997=head1 MORAL
998
999You can sometimes I<write faster code> in C, but
5f05dabc 1000you can always I<write code faster> in Perl. Because you can use
cb1a09d0 1001each from the other, combine them as you wish.
1002
1003
1004=head1 AUTHOR
1005
9607fc9c 1006Jon Orwant and <F<orwant@tpj.com>> and Doug MacEachern <F<dougm@osf.org>>,
1007with small contributions from Tim Bunce, Tom Christiansen, Hallvard Furuseth,
1008Dov Grobgeld, and Ilya Zakharevich.
8a7dc658 1009
1010Check out Doug's article on embedding in Volume 1, Issue 4 of The Perl
1011Journal. Info about TPJ is available from http://tpj.com.
cb1a09d0 1012
84902520 1013July 17, 1997
cb1a09d0 1014
8a7dc658 1015Some of this material is excerpted from Jon Orwant's book: I<Perl 5
1016Interactive>, Waite Group Press, 1996 (ISBN 1-57169-064-6) and appears
cb1a09d0 1017courtesy of Waite Group Press.
8a7dc658 1018
1019=head1 COPYRIGHT
1020
1021Copyright (C) 1995, 1996, 1997 Doug MacEachern and Jon Orwant. All
1022Rights Reserved.
1023
1024Although destined for release with the standard Perl distribution,
1025this document is not public domain, nor is any of Perl and its
1026documentation. Permission is granted to freely distribute verbatim
1027copies of this document provided that no modifications outside of
1028formatting be made, and that this notice remain intact. You are
1029permitted and encouraged to use its code and derivatives thereof in
1030your own source code for fun or for profit as you see fit.