3 perlapio - perl's IO abstraction interface.
7 #define PERLIO_NOT_STDIO 0 /* For co-existence with stdio only */
8 #include <perlio.h> /* Usually via #include <perl.h> */
10 PerlIO *PerlIO_stdin(void);
11 PerlIO *PerlIO_stdout(void);
12 PerlIO *PerlIO_stderr(void);
14 PerlIO *PerlIO_open(const char *path,const char *mode);
15 PerlIO *PerlIO_fdopen(int fd, const char *mode);
16 PerlIO *PerlIO_reopen(const char *path, const char *mode, PerlIO *old); /* deprecated */
17 int PerlIO_close(PerlIO *f);
19 int PerlIO_stdoutf(const char *fmt,...)
20 int PerlIO_puts(PerlIO *f,const char *string);
21 int PerlIO_putc(PerlIO *f,int ch);
22 int PerlIO_write(PerlIO *f,const void *buf,size_t numbytes);
23 int PerlIO_printf(PerlIO *f, const char *fmt,...);
24 int PerlIO_vprintf(PerlIO *f, const char *fmt, va_list args);
25 int PerlIO_flush(PerlIO *f);
27 int PerlIO_eof(PerlIO *f);
28 int PerlIO_error(PerlIO *f);
29 void PerlIO_clearerr(PerlIO *f);
31 int PerlIO_getc(PerlIO *d);
32 int PerlIO_ungetc(PerlIO *f,int ch);
33 int PerlIO_read(PerlIO *f, void *buf, size_t numbytes);
35 int PerlIO_fileno(PerlIO *f);
37 void PerlIO_setlinebuf(PerlIO *f);
39 Off_t PerlIO_tell(PerlIO *f);
40 int PerlIO_seek(PerlIO *f, Off_t offset, int whence);
41 void PerlIO_rewind(PerlIO *f);
43 int PerlIO_getpos(PerlIO *f, SV *save); /* prototype changed */
44 int PerlIO_setpos(PerlIO *f, SV *saved); /* prototype changed */
46 int PerlIO_fast_gets(PerlIO *f);
47 int PerlIO_has_cntptr(PerlIO *f);
48 int PerlIO_get_cnt(PerlIO *f);
49 char *PerlIO_get_ptr(PerlIO *f);
50 void PerlIO_set_ptrcnt(PerlIO *f, char *ptr, int count);
52 int PerlIO_canset_cnt(PerlIO *f); /* deprecated */
53 void PerlIO_set_cnt(PerlIO *f, int count); /* deprecated */
55 int PerlIO_has_base(PerlIO *f);
56 char *PerlIO_get_base(PerlIO *f);
57 int PerlIO_get_bufsiz(PerlIO *f);
59 PerlIO *PerlIO_importFILE(FILE *stdio, const char *mode);
60 FILE *PerlIO_exportFILE(PerlIO *f, int flags);
61 FILE *PerlIO_findFILE(PerlIO *f);
62 void PerlIO_releaseFILE(PerlIO *f,FILE *stdio);
64 int PerlIO_apply_layers(PerlIO *f, const char *mode, const char *layers);
65 int PerlIO_binmode(PerlIO *f, int ptype, int imode, const char *layers);
66 void PerlIO_debug(const char *fmt,...)
70 Perl's source code, and extensions that want maximum portability,
71 should use the above functions instead of those defined in ANSI C's
72 I<stdio.h>. The perl headers (in particular "perlio.h") will
73 C<#define> them to the I/O mechanism selected at Configure time.
75 The functions are modeled on those in I<stdio.h>, but parameter order
76 has been "tidied up a little".
78 C<PerlIO *> takes the place of FILE *. Like FILE * it should be
79 treated as opaque (it is probably safe to assume it is a pointer to
82 There are currently three implementations:
88 All above are #define'd to stdio functions or are trivial wrapper
89 functions which call stdio. In this case I<only> PerlIO * is a FILE *.
90 This has been the default implementation since the abstraction was
91 introduced in perl5.003_02.
95 A "legacy" implementation in terms of the "sfio" library. Used for
96 some specialist applications on Unix machines ("sfio" is not widely
97 ported away from Unix). Most of above are #define'd to the sfio
98 functions. PerlIO * is in this case Sfio_t *.
102 Introduced just after perl5.7.0, this is a re-implementation of the
103 above abstraction which allows perl more control over how IO is done
104 as it decouples IO from the way the operating system and C library
105 choose to do things. For USE_PERLIO PerlIO * has an extra layer of
106 indirection - it is a pointer-to-a-pointer. This allows the PerlIO *
107 to remain with a known value while swapping the implementation around
108 underneath I<at run time>. In this case all the above are true (but
109 very simple) functions which call the underlying implementation.
111 This is the only implementation for which C<PerlIO_apply_layers()>
112 does anything "interesting".
114 The USE_PERLIO implementation is described in L<perliol>.
118 Because "perlio.h" is a thin layer (for efficiency) the semantics of
119 these functions are somewhat dependent on the underlying implementation.
120 Where these variations are understood they are noted below.
122 Unless otherwise noted, functions return 0 on success, or a negative
123 value (usually C<EOF> which is usually -1) and set C<errno> on error.
127 =item B<PerlIO_stdin()>, B<PerlIO_stdout()>, B<PerlIO_stderr()>
129 Use these rather than C<stdin>, C<stdout>, C<stderr>. They are written
130 to look like "function calls" rather than variables because this makes
131 it easier to I<make them> function calls if platform cannot export data
132 to loaded modules, or if (say) different "threads" might have different
135 =item B<PerlIO_open(path, mode)>, B<PerlIO_fdopen(fd,mode)>
137 These correspond to fopen()/fdopen() and the arguments are the same.
138 Return C<NULL> and set C<errno> if there is an error. There may be an
139 implementation limit on the number of open handles, which may be lower
140 than the limit on the number of open files - C<errno> may not be set
141 when C<NULL> is returned if this limit is exceeded.
143 =item B<PerlIO_reopen(path,mode,f)>
145 While this currently exists in all three implementations perl itself
146 does not use it. I<As perl does not use it, it is not well tested.>
148 Perl prefers to C<dup> the new low-level descriptor to the descriptor
149 used by the existing PerlIO. This may become the behaviour of this
150 function in the future.
152 =item B<PerlIO_printf(f,fmt,...)>, B<PerlIO_vprintf(f,fmt,a)>
154 These are fprintf()/vfprintf() equivalents.
156 =item B<PerlIO_stdoutf(fmt,...)>
158 This is printf() equivalent. printf is #defined to this function,
159 so it is (currently) legal to use C<printf(fmt,...)> in perl sources.
161 =item B<PerlIO_read(f,buf,count)>, B<PerlIO_write(f,buf,count)>
163 These correspond to fread() and fwrite(). Note that arguments are
164 different, there is only one "count" and order has "file"
165 first. Returns a byte count if successful (which may be zero or
166 positive), returns negative value and sets C<errno> on error.
167 Depending on implementation C<errno> may be C<EINTR> if operation was
168 interrupted by a signal.
170 =item B<PerlIO_close(f)>
172 Depending on implementation C<errno> may be C<EINTR> if operation was
173 interrupted by a signal.
175 =item B<PerlIO_puts(f,s)>, B<PerlIO_putc(f,c)>
177 These correspond to fputs() and fputc().
178 Note that arguments have been revised to have "file" first.
180 =item B<PerlIO_ungetc(f,c)>
182 This corresponds to ungetc(). Note that arguments have been revised
183 to have "file" first. Arranges that next read operation will return
184 the byte B<c>. Despite the implied "character" in the name only
185 values in the range 0..0xFF are defined. Returns the byte B<c> on
186 success or -1 (C<EOF>) on error. The number of bytes that can be
187 "pushed back" may vary, only 1 character is certain, and then only if
188 it is the last character that was read from the handle.
190 =item B<PerlIO_getc(f)>
192 This corresponds to getc().
193 Despite the c in the name only byte range 0..0xFF is supported.
194 Returns the character read or -1 (C<EOF>) on error.
196 =item B<PerlIO_eof(f)>
198 This corresponds to feof(). Returns a true/false indication of
199 whether the handle is at end of file. For terminal devices this may
200 or may not be "sticky" depending on the implementation. The flag is
201 cleared by PerlIO_seek(), or PerlIO_rewind().
203 =item B<PerlIO_error(f)>
205 This corresponds to ferror(). Returns a true/false indication of
206 whether there has been an IO error on the handle.
208 =item B<PerlIO_fileno(f)>
210 This corresponds to fileno(), note that on some platforms, the meaning
211 of "fileno" may not match Unix. Returns -1 if the handle has no open
212 descriptor associated with it.
214 =item B<PerlIO_clearerr(f)>
216 This corresponds to clearerr(), i.e., clears 'error' and (usually)
217 'eof' flags for the "stream". Does not return a value.
219 =item B<PerlIO_flush(f)>
221 This corresponds to fflush(). Sends any buffered write data to the
222 underlying file. If called with C<NULL> this may flush all open
223 streams (or core dump with some USE_STDIO implementattions). Calling
224 on a handle open for read only, or on which last operation was a read
225 of some kind may lead to undefined behaviour on some USE_STDIO
226 implementations. The USE_PERLIO (layers) implementation tries to
227 behave better: it flushes all open streams when passed C<NULL>, and
228 attempts to retain data on read streams either in the buffer or by
229 seeking the handle to the current logical position.
231 =item B<PerlIO_seek(f,offset,whence)>
233 This corresponds to fseek(). Sends buffered write data to the
234 underlying file, or discards any buffered read data, then positions
235 the file desciptor as specified by B<offset> and B<whence> (sic).
236 This is the correct thing to do when switching between read and write
237 on the same handle (see issues with PerlIO_flush() above). Offset is
238 of type C<Off_t> which is a perl Configure value which may not be same
241 =item B<PerlIO_tell(f)>
243 This corresponds to ftell(). Returns the current file position, or
244 (Off_t) -1 on error. May just return value system "knows" without
245 making a system call or checking the underlying file descriptor (so
246 use on shared file descriptors is not safe without a
247 PerlIO_seek()). Return value is of type C<Off_t> which is a perl
248 Configure value which may not be same as stdio's C<off_t>.
250 =item B<PerlIO_getpos(f,p)>, B<PerlIO_setpos(f,p)>
252 These correspond (loosely) to fgetpos() and fsetpos(). Rather than
253 stdio's Fpos_t they expect a "Perl Scalar Value" to be passed. What is
254 stored there should be considered opaque. The layout of the data may
255 vary from handle to handle. When not using stdio or if platform does
256 not have the stdio calls then they are implemented in terms of
257 PerlIO_tell() and PerlIO_seek().
259 =item B<PerlIO_rewind(f)>
261 This corresponds to rewind(). It is usually defined as being
263 PerlIO_seek(f,(Off_t)0L, SEEK_SET);
266 =item B<PerlIO_tmpfile()>
268 This corresponds to tmpfile(), i.e., returns an anonymous PerlIO or
269 NULL on error. The system will attempt to automatically delete the
270 file when closed. On Unix the file is usually C<unlink>-ed just after
271 it is created so it does not matter how it gets closed. On other
272 systems the file may only be deleted if closed via PerlIO_close()
273 and/or the program exits via C<exit>. Depending on the implementation
274 there may be "race conditions" which allow other processes access to
275 the file, though in general it will be safer in this regard than
278 =item B<PerlIO_setlinebuf(f)>
280 This corresponds to setlinebuf(). Does not return a value. What
281 constitutes a "line" is implementation dependent but usually means
282 that writing "\n" flushes the buffer. What happens with things like
283 "this\nthat" is uncertain. (Perl core uses it I<only> when "dumping";
284 it has nothing to do with $| auto-flush.)
288 =head2 Co-existence with stdio
290 There is outline support for co-existence of PerlIO with stdio.
291 Obviously if PerlIO is implemented in terms of stdio there is no
292 problem. However in other cases then mechanisms must exist to create a
293 FILE * which can be passed to library code which is going to use stdio
296 The first step is to add this line:
298 #define PERLIO_NOT_STDIO 0
300 I<before> including any perl header files. (This will probably become
301 the default at some point). That prevents "perlio.h" from attempting
302 to #define stdio functions onto PerlIO functions.
304 XS code is probably better using "typemap" if it expects FILE *
305 arguments. The standard typemap will be adjusted to comprehend any
306 changes in this area.
310 =item B<PerlIO_importFILE(f,mode)>
312 Used to get a PerlIO * from a FILE *.
314 The mode argument should be a string as would be passed to
315 fopen/PerlIO_open. If it is NULL then - for legacy support - the code
316 will (depending upon the platform and the implementation) either
317 attempt to empirically determine the mode in which I<f> is open, or
318 use "r+" to indicate a read/write stream.
320 Once called the FILE * should I<ONLY> be closed by calling
321 C<PerlIO_close()> on the returned PerlIO *.
323 The PerlIO is set to textmode. Use PerlIO_binmode if this is
324 not the desired mode.
326 This is B<not> the reverse of PerlIO_exportFILE().
328 =item B<PerlIO_exportFILE(f,mode)>
330 Given a PerlIO * create a 'native' FILE * suitable for passing to code
331 expecting to be compiled and linked with ANSI C I<stdio.h>. The mode
332 argument should be a string as would be passed to fopen/PerlIO_open.
333 If it is NULL then - for legacy support - the FILE * is opened in same
334 mode as the PerlIO *.
336 The fact that such a FILE * has been 'exported' is recorded, (normally
337 by pushing a new :stdio "layer" onto the PerlIO *), which may affect
338 future PerlIO operations on the original PerlIO *. You should not
339 call C<fclose()> on the file unless you call C<PerlIO_releaseFILE()>
340 to disassociate it from the PerlIO *. (Do not use PerlIO_importFILE()
341 for doing the disassociation.)
343 Calling this function repeatedly will create a FILE * on each call
344 (and will push an :stdio layer each time as well).
346 =item B<PerlIO_releaseFILE(p,f)>
348 Calling PerlIO_releaseFILE informs PerlIO that all use of FILE * is
349 complete. It is removed from the list of 'exported' FILE *s, and the
350 associated PerlIO * should revert to its original behaviour.
352 Use this to disassociate a file from a PerlIO * that was associated
353 using PerlIO_exportFILE().
355 =item B<PerlIO_findFILE(f)>
357 Returns a native FILE * used by a stdio layer. If there is none, it
358 will create one with PerlIO_exportFILE. In either case the FILE *
359 should be considered as belonging to PerlIO subsystem and should
360 only be closed by calling C<PerlIO_close()>.
365 =head2 "Fast gets" Functions
367 In addition to standard-like API defined so far above there is an
368 "implementation" interface which allows perl to get at internals of
369 PerlIO. The following calls correspond to the various FILE_xxx macros
370 determined by Configure - or their equivalent in other
371 implementations. This section is really of interest to only those
372 concerned with detailed perl-core behaviour, implementing a PerlIO
373 mapping or writing code which can make use of the "read ahead" that
374 has been done by the IO system in the same way perl does. Note that
375 any code that uses these interfaces must be prepared to do things the
376 traditional way if a handle does not support them.
380 =item B<PerlIO_fast_gets(f)>
382 Returns true if implementation has all the interfaces required to
383 allow perl's C<sv_gets> to "bypass" normal IO mechanism. This can
384 vary from handle to handle.
386 PerlIO_fast_gets(f) = PerlIO_has_cntptr(f) && \
387 PerlIO_canset_cnt(f) && \
388 `Can set pointer into buffer'
391 =item B<PerlIO_has_cntptr(f)>
393 Implementation can return pointer to current position in the "buffer"
394 and a count of bytes available in the buffer. Do not use this - use
397 =item B<PerlIO_get_cnt(f)>
399 Return count of readable bytes in the buffer. Zero or negative return
400 means no more bytes available.
402 =item B<PerlIO_get_ptr(f)>
404 Return pointer to next readable byte in buffer, accessing via the
405 pointer (dereferencing) is only safe if PerlIO_get_cnt() has returned
406 a positive value. Only positive offsets up to value returned by
407 PerlIO_get_cnt() are allowed.
409 =item B<PerlIO_set_ptrcnt(f,p,c)>
411 Set pointer into buffer, and a count of bytes still in the
412 buffer. Should be used only to set pointer to within range implied by
413 previous calls to C<PerlIO_get_ptr> and C<PerlIO_get_cnt>. The two
414 values I<must> be consistent with each other (implementation may only
415 use one or the other or may require both).
417 =item B<PerlIO_canset_cnt(f)>
419 Implementation can adjust its idea of number of bytes in the buffer.
420 Do not use this - use PerlIO_fast_gets.
422 =item B<PerlIO_set_cnt(f,c)>
424 Obscure - set count of bytes in the buffer. Deprecated. Only usable
425 if PerlIO_canset_cnt() returns true. Currently used in only doio.c to
426 force count less than -1 to -1. Perhaps should be PerlIO_set_empty or
427 similar. This call may actually do nothing if "count" is deduced from
428 pointer and a "limit". Do not use this - use PerlIO_set_ptrcnt().
430 =item B<PerlIO_has_base(f)>
432 Returns true if implementation has a buffer, and can return pointer
433 to whole buffer and its size. Used by perl for B<-T> / B<-B> tests.
434 Other uses would be very obscure...
436 =item B<PerlIO_get_base(f)>
438 Return I<start> of buffer. Access only positive offsets in the buffer
439 up to the value returned by PerlIO_get_bufsiz().
441 =item B<PerlIO_get_bufsiz(f)>
443 Return the I<total number of bytes> in the buffer, this is neither the
444 number that can be read, nor the amount of memory allocated to the
445 buffer. Rather it is what the operating system and/or implementation
446 happened to C<read()> (or whatever) last time IO was requested.
450 =head2 Other Functions
454 =item PerlIO_apply_layers(f,mode,layers)
456 The new interface to the USE_PERLIO implementation. The layers ":crlf"
457 and ":raw" are only ones allowed for other implementations and those
458 are silently ignored. (As of perl5.8 ":raw" is deprecated.) Use
459 PerlIO_binmode() below for the portable case.
461 =item PerlIO_binmode(f,ptype,imode,layers)
463 The hook used by perl's C<binmode> operator.
464 B<ptype> is perl's character for the kind of IO:
476 B<imode> is C<O_BINARY> or C<O_TEXT>.
478 B<layers> is a string of layers to apply, only ":crlf" makes sense in
479 the non USE_PERLIO case. (As of perl5.8 ":raw" is deprecated in favour
484 PerlIO_binmode(f,ptype,O_BINARY,Nullch);
486 PerlIO_binmode(f,ptype,O_TEXT,":crlf");
488 On Unix these calls probably have no effect whatsoever. Elsewhere
489 they alter "\n" to CR,LF translation and possibly cause a special text
490 "end of file" indicator to be written or honoured on read. The effect
491 of making the call after doing any IO to the handle depends on the
492 implementation. (It may be ignored, affect any data which is already
493 buffered as well, or only apply to subsequent data.)
495 =item PerlIO_debug(fmt,...)
497 PerlIO_debug is a printf()-like function which can be used for
498 debugging. No return value. Its main use is inside PerlIO where using
499 real printf, warn() etc. would recursively call PerlIO and be a
502 PerlIO_debug writes to the file named by $ENV{'PERLIO_DEBUG'} typical
505 Bourne shells (sh, ksh, bash, zsh, ash, ...):
506 PERLIO_DEBUG=/dev/tty ./perl somescript some args
509 setenv PERLIO_DEBUG /dev/tty
510 ./perl somescript some args
512 If you have the "env" utility:
513 env PERLIO_DEBUG=/dev/tty ./perl somescript some args
517 perl somescript some args
519 If $ENV{'PERLIO_DEBUG'} is not set PerlIO_debug() is a no-op.