Annotation of embedaddon/php/ext/pcre/pcrelib/NEWS, revision 1.1.1.2
1.1 misho 1: News about PCRE releases
2: ------------------------
3:
1.1.1.2 ! misho 4: Release 8.32 30-November-2012
! 5: -----------------------------
! 6:
! 7: This release fixes a number of bugs, but also has some new features. These are
! 8: the highlights:
! 9:
! 10: . There is now support for 32-bit character strings and UTF-32. Like the
! 11: 16-bit support, this is done by compiling a separate 32-bit library.
! 12:
! 13: . \X now matches a Unicode extended grapheme cluster.
! 14:
! 15: . Case-independent matching of Unicode characters that have more than one
! 16: "other case" now makes all three (or more) characters equivalent. This
! 17: applies, for example, to Greek Sigma, which has two lowercase versions.
! 18:
! 19: . Unicode character properties are updated to Unicode 6.2.0.
! 20:
! 21: . The EBCDIC support, which had decayed, has had a spring clean.
! 22:
! 23: . A number of JIT optimizations have been added, which give faster JIT
! 24: execution speed. In addition, a new direct interface to JIT execution is
! 25: available. This bypasses some of the sanity checks of pcre_exec() to give a
! 26: noticeable speed-up.
! 27:
! 28: . A number of issues in pcregrep have been fixed, making it more compatible
! 29: with GNU grep. In particular, --exclude and --include (and variants) apply
! 30: to all files now, not just those obtained from scanning a directory
! 31: recursively. In Windows environments, the default action for directories is
! 32: now "skip" instead of "read" (which provokes an error).
! 33:
! 34: . If the --only-matching (-o) option in pcregrep is specified multiple
! 35: times, each one causes appropriate output. For example, -o1 -o2 outputs the
! 36: substrings matched by the 1st and 2nd capturing parentheses. A separating
! 37: string can be specified by --om-separator (default empty).
! 38:
! 39: . When PCRE is built via Autotools using a version of gcc that has the
! 40: "visibility" feature, it is used to hide internal library functions that are
! 41: not part of the public API.
! 42:
! 43:
! 44: Release 8.31 06-July-2012
! 45: -------------------------
! 46:
! 47: This is mainly a bug-fixing release, with a small number of developments:
! 48:
! 49: . The JIT compiler now supports partial matching and the (*MARK) and
! 50: (*COMMIT) verbs.
! 51:
! 52: . PCRE_INFO_MAXLOOKBEHIND can be used to find the longest lookbehind in a
! 53: pattern.
! 54:
! 55: . There should be a performance improvement when using the heap instead of the
! 56: stack for recursion.
! 57:
! 58: . pcregrep can now be linked with libedit as an alternative to libreadline.
! 59:
! 60: . pcregrep now has a --file-list option where the list of files to scan is
! 61: given as a file.
! 62:
! 63: . pcregrep now recognizes binary files and there are related options.
! 64:
! 65: . The Unicode tables have been updated to 6.1.0.
! 66:
! 67: As always, the full list of changes is in the ChangeLog file.
! 68:
! 69:
! 70: Release 8.30 04-February-2012
! 71: -----------------------------
! 72:
! 73: Release 8.30 introduces a major new feature: support for 16-bit character
! 74: strings, compiled as a separate library. There are a few changes to the
! 75: 8-bit library, in addition to some bug fixes.
! 76:
! 77: . The pcre_info() function, which has been obsolete for over 10 years, has
! 78: been removed.
! 79:
! 80: . When a compiled pattern was saved to a file and later reloaded on a host
! 81: with different endianness, PCRE used automatically to swap the bytes in some
! 82: of the data fields. With the advent of the 16-bit library, where more of this
! 83: swapping is needed, it is no longer done automatically. Instead, the bad
! 84: endianness is detected and a specific error is given. The user can then call
! 85: a new function called pcre_pattern_to_host_byte_order() (or an equivalent
! 86: 16-bit function) to do the swap.
! 87:
! 88: . In UTF-8 mode, the values 0xd800 to 0xdfff are not legal Unicode
! 89: code points and are now faulted. (They are the so-called "surrogates"
! 90: that are reserved for coding high values in UTF-16.)
! 91:
! 92:
! 93: Release 8.21 12-Dec-2011
! 94: ------------------------
! 95:
! 96: This is almost entirely a bug-fix release. The only new feature is the ability
! 97: to obtain the size of the memory used by the JIT compiler.
! 98:
! 99:
! 100: Release 8.20 21-Oct-2011
! 101: ------------------------
! 102:
! 103: The main change in this release is the inclusion of Zoltan Herczeg's
! 104: just-in-time compiler support, which can be accessed by building PCRE with
! 105: --enable-jit. Large performance benefits can be had in many situations. 8.20
! 106: also fixes an unfortunate bug that was introduced in 8.13 as well as tidying up
! 107: a number of infelicities and differences from Perl.
! 108:
! 109:
! 110: Release 8.13 16-Aug-2011
! 111: ------------------------
! 112:
! 113: This is mainly a bug-fix release. There has been a lot of internal refactoring.
! 114: The Unicode tables have been updated. The only new feature in the library is
! 115: the passing of *MARK information to callouts. Some additions have been made to
! 116: pcretest to make testing easier and more comprehensive. There is a new option
! 117: for pcregrep to adjust its internal buffer size.
! 118:
! 119:
1.1 misho 120: Release 8.12 15-Jan-2011
121: ------------------------
122:
123: This release fixes some bugs in pcregrep, one of which caused the tests to fail
124: on 64-bit big-endian systems. There are no changes to the code of the library.
125:
126:
127: Release 8.11 10-Dec-2010
128: ------------------------
129:
130: A number of bugs in the library and in pcregrep have been fixed. As always, see
131: ChangeLog for details. The following are the non-bug-fix changes:
132:
133: . Added --match-limit and --recursion-limit to pcregrep.
134:
135: . Added an optional parentheses number to the -o and --only-matching options
136: of pcregrep.
137:
138: . Changed the way PCRE_PARTIAL_HARD affects the matching of $, \z, \Z, \b, and
139: \B.
140:
141: . Added PCRE_ERROR_SHORTUTF8 to make it possible to distinguish between a
142: bad UTF-8 sequence and one that is incomplete when using PCRE_PARTIAL_HARD.
143:
144: . Recognize (*NO_START_OPT) at the start of a pattern to set the PCRE_NO_
145: START_OPTIMIZE option, which is now allowed at compile time
146:
147:
148: Release 8.10 25-Jun-2010
149: ------------------------
150:
151: There are two major additions: support for (*MARK) and friends, and the option
152: PCRE_UCP, which changes the behaviour of \b, \d, \s, and \w (and their
153: opposites) so that they make use of Unicode properties. There are also a number
154: of lesser new features, and several bugs have been fixed. A new option,
155: --line-buffered, has been added to pcregrep, for use when it is connected to
156: pipes.
157:
158:
159: Release 8.02 19-Mar-2010
160: ------------------------
161:
162: Another bug-fix release.
163:
164:
165: Release 8.01 19-Jan-2010
166: ------------------------
167:
168: This is a bug-fix release. Several bugs in the code itself and some bugs and
169: infelicities in the build system have been fixed.
170:
171:
172: Release 8.00 19-Oct-09
173: ----------------------
174:
175: Bugs have been fixed in the library and in pcregrep. There are also some
176: enhancements. Restrictions on patterns used for partial matching have been
177: removed, extra information is given for partial matches, the partial matching
178: process has been improved, and an option to make a partial match override a
179: full match is available. The "study" process has been enhanced by finding a
180: lower bound matching length. Groups with duplicate numbers may now have
181: duplicated names without the use of PCRE_DUPNAMES. However, they may not have
182: different names. The documentation has been revised to reflect these changes.
183: The version number has been expanded to 3 digits as it is clear that the rate
184: of change is not slowing down.
185:
186:
187: Release 7.9 11-Apr-09
188: ---------------------
189:
190: Mostly bugfixes and tidies with just a couple of minor functional additions.
191:
192:
193: Release 7.8 05-Sep-08
194: ---------------------
195:
196: More bug fixes, plus a performance improvement in Unicode character property
197: lookup.
198:
199:
200: Release 7.7 07-May-08
201: ---------------------
202:
203: This is once again mainly a bug-fix release, but there are a couple of new
204: features.
205:
206:
207: Release 7.6 28-Jan-08
208: ---------------------
209:
210: The main reason for having this release so soon after 7.5 is because it fixes a
211: potential buffer overflow problem in pcre_compile() when run in UTF-8 mode. In
212: addition, the CMake configuration files have been brought up to date.
213:
214:
215: Release 7.5 10-Jan-08
216: ---------------------
217:
218: This is mainly a bug-fix release. However the ability to link pcregrep with
219: libz or libbz2 and the ability to link pcretest with libreadline have been
220: added. Also the --line-offsets and --file-offsets options were added to
221: pcregrep.
222:
223:
224: Release 7.4 21-Sep-07
225: ---------------------
226:
227: The only change of specification is the addition of options to control whether
228: \R matches any Unicode line ending (the default) or just CR, LF, and CRLF.
229: Otherwise, the changes are bug fixes and a refactoring to reduce the number of
230: relocations needed in a shared library. There have also been some documentation
231: updates, in particular, some more information about using CMake to build PCRE
232: has been added to the NON-UNIX-USE file.
233:
234:
235: Release 7.3 28-Aug-07
236: ---------------------
237:
238: Most changes are bug fixes. Some that are not:
239:
240: 1. There is some support for Perl 5.10's experimental "backtracking control
241: verbs" such as (*PRUNE).
242:
243: 2. UTF-8 checking is now as per RFC 3629 instead of RFC 2279; this is more
244: restrictive in the strings it accepts.
245:
246: 3. Checking for potential integer overflow has been made more dynamic, and as a
247: consequence there is no longer a hard limit on the size of a subpattern that
248: has a limited repeat count.
249:
250: 4. When CRLF is a valid line-ending sequence, pcre_exec() and pcre_dfa_exec()
251: no longer advance by two characters instead of one when an unanchored match
252: fails at CRLF if there are explicit CR or LF matches within the pattern.
253: This gets rid of some anomalous effects that previously occurred.
254:
255: 5. Some PCRE-specific settings for varying the newline options at the start of
256: a pattern have been added.
257:
258:
259: Release 7.2 19-Jun-07
260: ---------------------
261:
262: WARNING: saved patterns that were compiled by earlier versions of PCRE must be
263: recompiled for use with 7.2 (necessitated by the addition of \K, \h, \H, \v,
264: and \V).
265:
266: Correction to the notes for 7.1: the note about shared libraries for Windows is
267: wrong. Previously, three libraries were built, but each could function
268: independently. For example, the pcreposix library also included all the
269: functions from the basic pcre library. The change is that the three libraries
270: are no longer independent. They are like the Unix libraries. To use the
271: pcreposix functions, for example, you need to link with both the pcreposix and
272: the basic pcre library.
273:
274: Some more features from Perl 5.10 have been added:
275:
276: (?-n) and (?+n) relative references for recursion and subroutines.
277:
278: (?(-n) and (?(+n) relative references as conditions.
279:
280: \k{name} and \g{name} are synonyms for \k<name>.
281:
282: \K to reset the start of the matched string; for example, (foo)\Kbar
283: matches bar preceded by foo, but only sets bar as the matched string.
284:
285: (?| introduces a group where the capturing parentheses in each alternative
286: start from the same number; for example, (?|(abc)|(xyz)) sets capturing
287: parentheses number 1 in both cases.
288:
289: \h, \H, \v, \V match horizontal and vertical whitespace, respectively.
290:
291:
292: Release 7.1 24-Apr-07
293: ---------------------
294:
295: There is only one new feature in this release: a linebreak setting of
296: PCRE_NEWLINE_ANYCRLF. It is a cut-down version of PCRE_NEWLINE_ANY, which
297: recognizes only CRLF, CR, and LF as linebreaks.
298:
299: A few bugs are fixed (see ChangeLog for details), but the major change is a
300: complete re-implementation of the build system. This now has full Autotools
301: support and so is now "standard" in some sense. It should help with compiling
302: PCRE in a wide variety of environments.
303:
304: NOTE: when building shared libraries for Windows, three dlls are now built,
305: called libpcre, libpcreposix, and libpcrecpp. Previously, everything was
306: included in a single dll.
307:
308: Another important change is that the dftables auxiliary program is no longer
309: compiled and run at "make" time by default. Instead, a default set of character
310: tables (assuming ASCII coding) is used. If you want to use dftables to generate
311: the character tables as previously, add --enable-rebuild-chartables to the
312: "configure" command. You must do this if you are compiling PCRE to run on a
313: system that uses EBCDIC code.
314:
315: There is a discussion about character tables in the README file. The default is
316: not to use dftables so that that there is no problem when cross-compiling.
317:
318:
319: Release 7.0 19-Dec-06
320: ---------------------
321:
322: This release has a new major number because there have been some internal
323: upheavals to facilitate the addition of new optimizations and other facilities,
324: and to make subsequent maintenance and extension easier. Compilation is likely
325: to be a bit slower, but there should be no major effect on runtime performance.
326: Previously compiled patterns are NOT upwards compatible with this release. If
327: you have saved compiled patterns from a previous release, you will have to
328: re-compile them. Important changes that are visible to users are:
329:
330: 1. The Unicode property tables have been updated to Unicode 5.0.0, which adds
331: some more scripts.
332:
333: 2. The option PCRE_NEWLINE_ANY causes PCRE to recognize any Unicode newline
334: sequence as a newline.
335:
336: 3. The \R escape matches a single Unicode newline sequence as a single unit.
337:
338: 4. New features that will appear in Perl 5.10 are now in PCRE. These include
339: alternative Perl syntax for named parentheses, and Perl syntax for
340: recursion.
341:
342: 5. The C++ wrapper interface has been extended by the addition of a
343: QuoteMeta function and the ability to allow copy construction and
344: assignment.
345:
346: For a complete list of changes, see the ChangeLog file.
347:
348:
349: Release 6.7 04-Jul-06
350: ---------------------
351:
352: The main additions to this release are the ability to use the same name for
353: multiple sets of parentheses, and support for CRLF line endings in both the
354: library and pcregrep (and in pcretest for testing).
355:
356: Thanks to Ian Taylor, the stack usage for many kinds of pattern has been
357: significantly reduced for certain subject strings.
358:
359:
360: Release 6.5 01-Feb-06
361: ---------------------
362:
363: Important changes in this release:
364:
365: 1. A number of new features have been added to pcregrep.
366:
367: 2. The Unicode property tables have been updated to Unicode 4.1.0, and the
368: supported properties have been extended with script names such as "Arabic",
369: and the derived properties "Any" and "L&". This has necessitated a change to
370: the interal format of compiled patterns. Any saved compiled patterns that
371: use \p or \P must be recompiled.
372:
373: 3. The specification of recursion in patterns has been changed so that all
374: recursive subpatterns are automatically treated as atomic groups. Thus, for
375: example, (?R) is treated as if it were (?>(?R)). This is necessary because
376: otherwise there are situations where recursion does not work.
377:
378: See the ChangeLog for a complete list of changes, which include a number of bug
379: fixes and tidies.
380:
381:
382: Release 6.0 07-Jun-05
383: ---------------------
384:
385: The release number has been increased to 6.0 because of the addition of several
386: major new pieces of functionality.
387:
388: A new function, pcre_dfa_exec(), which implements pattern matching using a DFA
389: algorithm, has been added. This has a number of advantages for certain cases,
390: though it does run more slowly, and lacks the ability to capture substrings. On
391: the other hand, it does find all matches, not just the first, and it works
392: better for partial matching. The pcrematching man page discusses the
393: differences.
394:
395: The pcretest program has been enhanced so that it can make use of the new
396: pcre_dfa_exec() matching function and the extra features it provides.
397:
398: The distribution now includes a C++ wrapper library. This is built
399: automatically if a C++ compiler is found. The pcrecpp man page discusses this
400: interface.
401:
402: The code itself has been re-organized into many more files, one for each
403: function, so it no longer requires everything to be linked in when static
404: linkage is used. As a consequence, some internal functions have had to have
405: their names exposed. These functions all have names starting with _pcre_. They
406: are undocumented, and are not intended for use by outside callers.
407:
408: The pcregrep program has been enhanced with new functionality such as
409: multiline-matching and options for output more matching context. See the
410: ChangeLog for a complete list of changes to the library and the utility
411: programs.
412:
413:
414: Release 5.0 13-Sep-04
415: ---------------------
416:
417: The licence under which PCRE is released has been changed to the more
418: conventional "BSD" licence.
419:
420: In the code, some bugs have been fixed, and there are also some major changes
421: in this release (which is why I've increased the number to 5.0). Some changes
422: are internal rearrangements, and some provide a number of new facilities. The
423: new features are:
424:
425: 1. There's an "automatic callout" feature that inserts callouts before every
426: item in the regex, and there's a new callout field that gives the position
427: in the pattern - useful for debugging and tracing.
428:
429: 2. The extra_data structure can now be used to pass in a set of character
430: tables at exec time. This is useful if compiled regex are saved and re-used
431: at a later time when the tables may not be at the same address. If the
432: default internal tables are used, the pointer saved with the compiled
433: pattern is now set to NULL, which means that you don't need to do anything
434: special unless you are using custom tables.
435:
436: 3. It is possible, with some restrictions on the content of the regex, to
437: request "partial" matching. A special return code is given if all of the
438: subject string matched part of the regex. This could be useful for testing
439: an input field as it is being typed.
440:
441: 4. There is now some optional support for Unicode character properties, which
442: means that the patterns items such as \p{Lu} and \X can now be used. Only
443: the general category properties are supported. If PCRE is compiled with this
444: support, an additional 90K data structure is include, which increases the
445: size of the library dramatically.
446:
447: 5. There is support for saving compiled patterns and re-using them later.
448:
449: 6. There is support for running regular expressions that were compiled on a
450: different host with the opposite endianness.
451:
452: 7. The pcretest program has been extended to accommodate the new features.
453:
454: The main internal rearrangement is that sequences of literal characters are no
455: longer handled as strings. Instead, each character is handled on its own. This
456: makes some UTF-8 handling easier, and makes the support of partial matching
457: possible. Compiled patterns containing long literal strings will be larger as a
458: result of this change; I hope that performance will not be much affected.
459:
460:
461: Release 4.5 01-Dec-03
462: ---------------------
463:
464: Again mainly a bug-fix and tidying release, with only a couple of new features:
465:
466: 1. It's possible now to compile PCRE so that it does not use recursive
467: function calls when matching. Instead it gets memory from the heap. This slows
468: things down, but may be necessary on systems with limited stacks.
469:
470: 2. UTF-8 string checking has been tightened to reject overlong sequences and to
471: check that a starting offset points to the start of a character. Failure of the
472: latter returns a new error code: PCRE_ERROR_BADUTF8_OFFSET.
473:
474: 3. PCRE can now be compiled for systems that use EBCDIC code.
475:
476:
477: Release 4.4 21-Aug-03
478: ---------------------
479:
480: This is mainly a bug-fix and tidying release. The only new feature is that PCRE
481: checks UTF-8 strings for validity by default. There is an option to suppress
482: this, just in case anybody wants that teeny extra bit of performance.
483:
484:
485: Releases 4.1 - 4.3
486: ------------------
487:
488: Sorry, I forgot about updating the NEWS file for these releases. Please take a
489: look at ChangeLog.
490:
491:
492: Release 4.0 17-Feb-03
493: ---------------------
494:
495: There have been a lot of changes for the 4.0 release, adding additional
496: functionality and mending bugs. Below is a list of the highlights of the new
497: functionality. For full details of these features, please consult the
498: documentation. For a complete list of changes, see the ChangeLog file.
499:
500: 1. Support for Perl's \Q...\E escapes.
501:
502: 2. "Possessive quantifiers" ?+, *+, ++, and {,}+ which come from Sun's Java
503: package. They provide some syntactic sugar for simple cases of "atomic
504: grouping".
505:
506: 3. Support for the \G assertion. It is true when the current matching position
507: is at the start point of the match.
508:
509: 4. A new feature that provides some of the functionality that Perl provides
510: with (?{...}). The facility is termed a "callout". The way it is done in PCRE
511: is for the caller to provide an optional function, by setting pcre_callout to
512: its entry point. To get the function called, the regex must include (?C) at
513: appropriate points.
514:
515: 5. Support for recursive calls to individual subpatterns. This makes it really
516: easy to get totally confused.
517:
518: 6. Support for named subpatterns. The Python syntax (?P<name>...) is used to
519: name a group.
520:
521: 7. Several extensions to UTF-8 support; it is now fairly complete. There is an
522: option for pcregrep to make it operate in UTF-8 mode.
523:
524: 8. The single man page has been split into a number of separate man pages.
525: These also give rise to individual HTML pages which are put in a separate
526: directory. There is an index.html page that lists them all. Some hyperlinking
527: between the pages has been installed.
528:
529:
530: Release 3.5 15-Aug-01
531: ---------------------
532:
533: 1. The configuring system has been upgraded to use later versions of autoconf
534: and libtool. By default it builds both a shared and a static library if the OS
535: supports it. You can use --disable-shared or --disable-static on the configure
536: command if you want only one of them.
537:
538: 2. The pcretest utility is now installed along with pcregrep because it is
539: useful for users (to test regexs) and by doing this, it automatically gets
540: relinked by libtool. The documentation has been turned into a man page, so
541: there are now .1, .txt, and .html versions in /doc.
542:
543: 3. Upgrades to pcregrep:
544: (i) Added long-form option names like gnu grep.
545: (ii) Added --help to list all options with an explanatory phrase.
546: (iii) Added -r, --recursive to recurse into sub-directories.
547: (iv) Added -f, --file to read patterns from a file.
548:
549: 4. Added --enable-newline-is-cr and --enable-newline-is-lf to the configure
550: script, to force use of CR or LF instead of \n in the source. On non-Unix
551: systems, the value can be set in config.h.
552:
553: 5. The limit of 200 on non-capturing parentheses is a _nesting_ limit, not an
554: absolute limit. Changed the text of the error message to make this clear, and
555: likewise updated the man page.
556:
557: 6. The limit of 99 on the number of capturing subpatterns has been removed.
558: The new limit is 65535, which I hope will not be a "real" limit.
559:
560:
561: Release 3.3 01-Aug-00
562: ---------------------
563:
564: There is some support for UTF-8 character strings. This is incomplete and
565: experimental. The documentation describes what is and what is not implemented.
566: Otherwise, this is just a bug-fixing release.
567:
568:
569: Release 3.0 01-Feb-00
570: ---------------------
571:
572: 1. A "configure" script is now used to configure PCRE for Unix systems. It
573: builds a Makefile, a config.h file, and the pcre-config script.
574:
575: 2. PCRE is built as a shared library by default.
576:
577: 3. There is support for POSIX classes such as [:alpha:].
578:
579: 5. There is an experimental recursion feature.
580:
581: ----------------------------------------------------------------------------
582: IMPORTANT FOR THOSE UPGRADING FROM VERSIONS BEFORE 2.00
583:
584: Please note that there has been a change in the API such that a larger
585: ovector is required at matching time, to provide some additional workspace.
586: The new man page has details. This change was necessary in order to support
587: some of the new functionality in Perl 5.005.
588:
589: IMPORTANT FOR THOSE UPGRADING FROM VERSION 2.00
590:
591: Another (I hope this is the last!) change has been made to the API for the
592: pcre_compile() function. An additional argument has been added to make it
593: possible to pass over a pointer to character tables built in the current
1.1.1.2 ! misho 594: locale by pcre_maketables(). To use the default tables, this new argument
1.1 misho 595: should be passed as NULL.
596:
597: IMPORTANT FOR THOSE UPGRADING FROM VERSION 2.05
598:
599: Yet another (and again I hope this really is the last) change has been made
600: to the API for the pcre_exec() function. An additional argument has been
601: added to make it possible to start the match other than at the start of the
602: subject string. This is important if there are lookbehinds. The new man
603: page has the details, but you just want to convert existing programs, all
604: you need to do is to stick in a new fifth argument to pcre_exec(), with a
605: value of zero. For example, change
606:
607: pcre_exec(pattern, extra, subject, length, options, ovec, ovecsize)
608: to
609: pcre_exec(pattern, extra, subject, length, 0, options, ovec, ovecsize)
610:
611: ****
FreeBSD-CVSweb <freebsd-cvsweb@FreeBSD.org>