Annotation of embedaddon/pcre/NEWS, revision 1.1.1.2
1.1 misho 1: News about PCRE releases
2: ------------------------
3:
1.1.1.2 ! misho 4: Release 8.30 04-February-2012
! 5: -----------------------------
! 6:
! 7: Release 8.30 introduces a major new feature: support for 16-bit character
! 8: strings, compiled as a separate library. There are a few changes to the
! 9: 8-bit library, in addition to some bug fixes.
! 10:
! 11: . The pcre_info() function, which has been obsolete for over 10 years, has
! 12: been removed.
! 13:
! 14: . When a compiled pattern was saved to a file and later reloaded on a host
! 15: with different endianness, PCRE used automatically to swap the bytes in some
! 16: of the data fields. With the advent of the 16-bit library, where more of this
! 17: swapping is needed, it is no longer done automatically. Instead, the bad
! 18: endianness is detected and a specific error is given. The user can then call
! 19: a new function called pcre_pattern_to_host_byte_order() (or an equivalent
! 20: 16-bit function) to do the swap.
! 21:
! 22: . In UTF-8 mode, the values 0xd800 to 0xdfff are not legal Unicode
! 23: code points and are now faulted. (They are the so-called "surrogates"
! 24: that are reserved for coding high values in UTF-16.)
! 25:
! 26:
1.1 misho 27: Release 8.21 12-Dec-2011
28: ------------------------
29:
30: This is almost entirely a bug-fix release. The only new feature is the ability
31: to obtain the size of the memory used by the JIT compiler.
32:
33:
34: Release 8.20 21-Oct-2011
35: ------------------------
36:
37: The main change in this release is the inclusion of Zoltan Herczeg's
38: just-in-time compiler support, which can be accessed by building PCRE with
39: --enable-jit. Large performance benefits can be had in many situations. 8.20
40: also fixes an unfortunate bug that was introduced in 8.13 as well as tidying up
41: a number of infelicities and differences from Perl.
42:
43:
44: Release 8.13 16-Aug-2011
45: ------------------------
46:
47: This is mainly a bug-fix release. There has been a lot of internal refactoring.
48: The Unicode tables have been updated. The only new feature in the library is
49: the passing of *MARK information to callouts. Some additions have been made to
50: pcretest to make testing easier and more comprehensive. There is a new option
51: for pcregrep to adjust its internal buffer size.
52:
53:
54: Release 8.12 15-Jan-2011
55: ------------------------
56:
57: This release fixes some bugs in pcregrep, one of which caused the tests to fail
58: on 64-bit big-endian systems. There are no changes to the code of the library.
59:
60:
61: Release 8.11 10-Dec-2010
62: ------------------------
63:
64: A number of bugs in the library and in pcregrep have been fixed. As always, see
65: ChangeLog for details. The following are the non-bug-fix changes:
66:
67: . Added --match-limit and --recursion-limit to pcregrep.
68:
69: . Added an optional parentheses number to the -o and --only-matching options
70: of pcregrep.
71:
72: . Changed the way PCRE_PARTIAL_HARD affects the matching of $, \z, \Z, \b, and
73: \B.
74:
75: . Added PCRE_ERROR_SHORTUTF8 to make it possible to distinguish between a
76: bad UTF-8 sequence and one that is incomplete when using PCRE_PARTIAL_HARD.
77:
78: . Recognize (*NO_START_OPT) at the start of a pattern to set the PCRE_NO_
79: START_OPTIMIZE option, which is now allowed at compile time
80:
81:
82: Release 8.10 25-Jun-2010
83: ------------------------
84:
85: There are two major additions: support for (*MARK) and friends, and the option
86: PCRE_UCP, which changes the behaviour of \b, \d, \s, and \w (and their
87: opposites) so that they make use of Unicode properties. There are also a number
88: of lesser new features, and several bugs have been fixed. A new option,
89: --line-buffered, has been added to pcregrep, for use when it is connected to
90: pipes.
91:
92:
93: Release 8.02 19-Mar-2010
94: ------------------------
95:
96: Another bug-fix release.
97:
98:
99: Release 8.01 19-Jan-2010
100: ------------------------
101:
102: This is a bug-fix release. Several bugs in the code itself and some bugs and
103: infelicities in the build system have been fixed.
104:
105:
106: Release 8.00 19-Oct-09
107: ----------------------
108:
109: Bugs have been fixed in the library and in pcregrep. There are also some
110: enhancements. Restrictions on patterns used for partial matching have been
111: removed, extra information is given for partial matches, the partial matching
112: process has been improved, and an option to make a partial match override a
113: full match is available. The "study" process has been enhanced by finding a
114: lower bound matching length. Groups with duplicate numbers may now have
115: duplicated names without the use of PCRE_DUPNAMES. However, they may not have
116: different names. The documentation has been revised to reflect these changes.
117: The version number has been expanded to 3 digits as it is clear that the rate
118: of change is not slowing down.
119:
120:
121: Release 7.9 11-Apr-09
122: ---------------------
123:
124: Mostly bugfixes and tidies with just a couple of minor functional additions.
125:
126:
127: Release 7.8 05-Sep-08
128: ---------------------
129:
130: More bug fixes, plus a performance improvement in Unicode character property
131: lookup.
132:
133:
134: Release 7.7 07-May-08
135: ---------------------
136:
137: This is once again mainly a bug-fix release, but there are a couple of new
138: features.
139:
140:
141: Release 7.6 28-Jan-08
142: ---------------------
143:
144: The main reason for having this release so soon after 7.5 is because it fixes a
145: potential buffer overflow problem in pcre_compile() when run in UTF-8 mode. In
146: addition, the CMake configuration files have been brought up to date.
147:
148:
149: Release 7.5 10-Jan-08
150: ---------------------
151:
152: This is mainly a bug-fix release. However the ability to link pcregrep with
153: libz or libbz2 and the ability to link pcretest with libreadline have been
154: added. Also the --line-offsets and --file-offsets options were added to
155: pcregrep.
156:
157:
158: Release 7.4 21-Sep-07
159: ---------------------
160:
161: The only change of specification is the addition of options to control whether
162: \R matches any Unicode line ending (the default) or just CR, LF, and CRLF.
163: Otherwise, the changes are bug fixes and a refactoring to reduce the number of
164: relocations needed in a shared library. There have also been some documentation
165: updates, in particular, some more information about using CMake to build PCRE
166: has been added to the NON-UNIX-USE file.
167:
168:
169: Release 7.3 28-Aug-07
170: ---------------------
171:
172: Most changes are bug fixes. Some that are not:
173:
174: 1. There is some support for Perl 5.10's experimental "backtracking control
175: verbs" such as (*PRUNE).
176:
177: 2. UTF-8 checking is now as per RFC 3629 instead of RFC 2279; this is more
178: restrictive in the strings it accepts.
179:
180: 3. Checking for potential integer overflow has been made more dynamic, and as a
181: consequence there is no longer a hard limit on the size of a subpattern that
182: has a limited repeat count.
183:
184: 4. When CRLF is a valid line-ending sequence, pcre_exec() and pcre_dfa_exec()
185: no longer advance by two characters instead of one when an unanchored match
186: fails at CRLF if there are explicit CR or LF matches within the pattern.
187: This gets rid of some anomalous effects that previously occurred.
188:
189: 5. Some PCRE-specific settings for varying the newline options at the start of
190: a pattern have been added.
191:
192:
193: Release 7.2 19-Jun-07
194: ---------------------
195:
196: WARNING: saved patterns that were compiled by earlier versions of PCRE must be
197: recompiled for use with 7.2 (necessitated by the addition of \K, \h, \H, \v,
198: and \V).
199:
200: Correction to the notes for 7.1: the note about shared libraries for Windows is
201: wrong. Previously, three libraries were built, but each could function
202: independently. For example, the pcreposix library also included all the
203: functions from the basic pcre library. The change is that the three libraries
204: are no longer independent. They are like the Unix libraries. To use the
205: pcreposix functions, for example, you need to link with both the pcreposix and
206: the basic pcre library.
207:
208: Some more features from Perl 5.10 have been added:
209:
210: (?-n) and (?+n) relative references for recursion and subroutines.
211:
212: (?(-n) and (?(+n) relative references as conditions.
213:
214: \k{name} and \g{name} are synonyms for \k<name>.
215:
216: \K to reset the start of the matched string; for example, (foo)\Kbar
217: matches bar preceded by foo, but only sets bar as the matched string.
218:
219: (?| introduces a group where the capturing parentheses in each alternative
220: start from the same number; for example, (?|(abc)|(xyz)) sets capturing
221: parentheses number 1 in both cases.
222:
223: \h, \H, \v, \V match horizontal and vertical whitespace, respectively.
224:
225:
226: Release 7.1 24-Apr-07
227: ---------------------
228:
229: There is only one new feature in this release: a linebreak setting of
230: PCRE_NEWLINE_ANYCRLF. It is a cut-down version of PCRE_NEWLINE_ANY, which
231: recognizes only CRLF, CR, and LF as linebreaks.
232:
233: A few bugs are fixed (see ChangeLog for details), but the major change is a
234: complete re-implementation of the build system. This now has full Autotools
235: support and so is now "standard" in some sense. It should help with compiling
236: PCRE in a wide variety of environments.
237:
238: NOTE: when building shared libraries for Windows, three dlls are now built,
239: called libpcre, libpcreposix, and libpcrecpp. Previously, everything was
240: included in a single dll.
241:
242: Another important change is that the dftables auxiliary program is no longer
243: compiled and run at "make" time by default. Instead, a default set of character
244: tables (assuming ASCII coding) is used. If you want to use dftables to generate
245: the character tables as previously, add --enable-rebuild-chartables to the
246: "configure" command. You must do this if you are compiling PCRE to run on a
247: system that uses EBCDIC code.
248:
249: There is a discussion about character tables in the README file. The default is
250: not to use dftables so that that there is no problem when cross-compiling.
251:
252:
253: Release 7.0 19-Dec-06
254: ---------------------
255:
256: This release has a new major number because there have been some internal
257: upheavals to facilitate the addition of new optimizations and other facilities,
258: and to make subsequent maintenance and extension easier. Compilation is likely
259: to be a bit slower, but there should be no major effect on runtime performance.
260: Previously compiled patterns are NOT upwards compatible with this release. If
261: you have saved compiled patterns from a previous release, you will have to
262: re-compile them. Important changes that are visible to users are:
263:
264: 1. The Unicode property tables have been updated to Unicode 5.0.0, which adds
265: some more scripts.
266:
267: 2. The option PCRE_NEWLINE_ANY causes PCRE to recognize any Unicode newline
268: sequence as a newline.
269:
270: 3. The \R escape matches a single Unicode newline sequence as a single unit.
271:
272: 4. New features that will appear in Perl 5.10 are now in PCRE. These include
273: alternative Perl syntax for named parentheses, and Perl syntax for
274: recursion.
275:
276: 5. The C++ wrapper interface has been extended by the addition of a
277: QuoteMeta function and the ability to allow copy construction and
278: assignment.
279:
280: For a complete list of changes, see the ChangeLog file.
281:
282:
283: Release 6.7 04-Jul-06
284: ---------------------
285:
286: The main additions to this release are the ability to use the same name for
287: multiple sets of parentheses, and support for CRLF line endings in both the
288: library and pcregrep (and in pcretest for testing).
289:
290: Thanks to Ian Taylor, the stack usage for many kinds of pattern has been
291: significantly reduced for certain subject strings.
292:
293:
294: Release 6.5 01-Feb-06
295: ---------------------
296:
297: Important changes in this release:
298:
299: 1. A number of new features have been added to pcregrep.
300:
301: 2. The Unicode property tables have been updated to Unicode 4.1.0, and the
302: supported properties have been extended with script names such as "Arabic",
303: and the derived properties "Any" and "L&". This has necessitated a change to
304: the interal format of compiled patterns. Any saved compiled patterns that
305: use \p or \P must be recompiled.
306:
307: 3. The specification of recursion in patterns has been changed so that all
308: recursive subpatterns are automatically treated as atomic groups. Thus, for
309: example, (?R) is treated as if it were (?>(?R)). This is necessary because
310: otherwise there are situations where recursion does not work.
311:
312: See the ChangeLog for a complete list of changes, which include a number of bug
313: fixes and tidies.
314:
315:
316: Release 6.0 07-Jun-05
317: ---------------------
318:
319: The release number has been increased to 6.0 because of the addition of several
320: major new pieces of functionality.
321:
322: A new function, pcre_dfa_exec(), which implements pattern matching using a DFA
323: algorithm, has been added. This has a number of advantages for certain cases,
324: though it does run more slowly, and lacks the ability to capture substrings. On
325: the other hand, it does find all matches, not just the first, and it works
326: better for partial matching. The pcrematching man page discusses the
327: differences.
328:
329: The pcretest program has been enhanced so that it can make use of the new
330: pcre_dfa_exec() matching function and the extra features it provides.
331:
332: The distribution now includes a C++ wrapper library. This is built
333: automatically if a C++ compiler is found. The pcrecpp man page discusses this
334: interface.
335:
336: The code itself has been re-organized into many more files, one for each
337: function, so it no longer requires everything to be linked in when static
338: linkage is used. As a consequence, some internal functions have had to have
339: their names exposed. These functions all have names starting with _pcre_. They
340: are undocumented, and are not intended for use by outside callers.
341:
342: The pcregrep program has been enhanced with new functionality such as
343: multiline-matching and options for output more matching context. See the
344: ChangeLog for a complete list of changes to the library and the utility
345: programs.
346:
347:
348: Release 5.0 13-Sep-04
349: ---------------------
350:
351: The licence under which PCRE is released has been changed to the more
352: conventional "BSD" licence.
353:
354: In the code, some bugs have been fixed, and there are also some major changes
355: in this release (which is why I've increased the number to 5.0). Some changes
356: are internal rearrangements, and some provide a number of new facilities. The
357: new features are:
358:
359: 1. There's an "automatic callout" feature that inserts callouts before every
360: item in the regex, and there's a new callout field that gives the position
361: in the pattern - useful for debugging and tracing.
362:
363: 2. The extra_data structure can now be used to pass in a set of character
364: tables at exec time. This is useful if compiled regex are saved and re-used
365: at a later time when the tables may not be at the same address. If the
366: default internal tables are used, the pointer saved with the compiled
367: pattern is now set to NULL, which means that you don't need to do anything
368: special unless you are using custom tables.
369:
370: 3. It is possible, with some restrictions on the content of the regex, to
371: request "partial" matching. A special return code is given if all of the
372: subject string matched part of the regex. This could be useful for testing
373: an input field as it is being typed.
374:
375: 4. There is now some optional support for Unicode character properties, which
376: means that the patterns items such as \p{Lu} and \X can now be used. Only
377: the general category properties are supported. If PCRE is compiled with this
378: support, an additional 90K data structure is include, which increases the
379: size of the library dramatically.
380:
381: 5. There is support for saving compiled patterns and re-using them later.
382:
383: 6. There is support for running regular expressions that were compiled on a
384: different host with the opposite endianness.
385:
386: 7. The pcretest program has been extended to accommodate the new features.
387:
388: The main internal rearrangement is that sequences of literal characters are no
389: longer handled as strings. Instead, each character is handled on its own. This
390: makes some UTF-8 handling easier, and makes the support of partial matching
391: possible. Compiled patterns containing long literal strings will be larger as a
392: result of this change; I hope that performance will not be much affected.
393:
394:
395: Release 4.5 01-Dec-03
396: ---------------------
397:
398: Again mainly a bug-fix and tidying release, with only a couple of new features:
399:
400: 1. It's possible now to compile PCRE so that it does not use recursive
401: function calls when matching. Instead it gets memory from the heap. This slows
402: things down, but may be necessary on systems with limited stacks.
403:
404: 2. UTF-8 string checking has been tightened to reject overlong sequences and to
405: check that a starting offset points to the start of a character. Failure of the
406: latter returns a new error code: PCRE_ERROR_BADUTF8_OFFSET.
407:
408: 3. PCRE can now be compiled for systems that use EBCDIC code.
409:
410:
411: Release 4.4 21-Aug-03
412: ---------------------
413:
414: This is mainly a bug-fix and tidying release. The only new feature is that PCRE
415: checks UTF-8 strings for validity by default. There is an option to suppress
416: this, just in case anybody wants that teeny extra bit of performance.
417:
418:
419: Releases 4.1 - 4.3
420: ------------------
421:
422: Sorry, I forgot about updating the NEWS file for these releases. Please take a
423: look at ChangeLog.
424:
425:
426: Release 4.0 17-Feb-03
427: ---------------------
428:
429: There have been a lot of changes for the 4.0 release, adding additional
430: functionality and mending bugs. Below is a list of the highlights of the new
431: functionality. For full details of these features, please consult the
432: documentation. For a complete list of changes, see the ChangeLog file.
433:
434: 1. Support for Perl's \Q...\E escapes.
435:
436: 2. "Possessive quantifiers" ?+, *+, ++, and {,}+ which come from Sun's Java
437: package. They provide some syntactic sugar for simple cases of "atomic
438: grouping".
439:
440: 3. Support for the \G assertion. It is true when the current matching position
441: is at the start point of the match.
442:
443: 4. A new feature that provides some of the functionality that Perl provides
444: with (?{...}). The facility is termed a "callout". The way it is done in PCRE
445: is for the caller to provide an optional function, by setting pcre_callout to
446: its entry point. To get the function called, the regex must include (?C) at
447: appropriate points.
448:
449: 5. Support for recursive calls to individual subpatterns. This makes it really
450: easy to get totally confused.
451:
452: 6. Support for named subpatterns. The Python syntax (?P<name>...) is used to
453: name a group.
454:
455: 7. Several extensions to UTF-8 support; it is now fairly complete. There is an
456: option for pcregrep to make it operate in UTF-8 mode.
457:
458: 8. The single man page has been split into a number of separate man pages.
459: These also give rise to individual HTML pages which are put in a separate
460: directory. There is an index.html page that lists them all. Some hyperlinking
461: between the pages has been installed.
462:
463:
464: Release 3.5 15-Aug-01
465: ---------------------
466:
467: 1. The configuring system has been upgraded to use later versions of autoconf
468: and libtool. By default it builds both a shared and a static library if the OS
469: supports it. You can use --disable-shared or --disable-static on the configure
470: command if you want only one of them.
471:
472: 2. The pcretest utility is now installed along with pcregrep because it is
473: useful for users (to test regexs) and by doing this, it automatically gets
474: relinked by libtool. The documentation has been turned into a man page, so
475: there are now .1, .txt, and .html versions in /doc.
476:
477: 3. Upgrades to pcregrep:
478: (i) Added long-form option names like gnu grep.
479: (ii) Added --help to list all options with an explanatory phrase.
480: (iii) Added -r, --recursive to recurse into sub-directories.
481: (iv) Added -f, --file to read patterns from a file.
482:
483: 4. Added --enable-newline-is-cr and --enable-newline-is-lf to the configure
484: script, to force use of CR or LF instead of \n in the source. On non-Unix
485: systems, the value can be set in config.h.
486:
487: 5. The limit of 200 on non-capturing parentheses is a _nesting_ limit, not an
488: absolute limit. Changed the text of the error message to make this clear, and
489: likewise updated the man page.
490:
491: 6. The limit of 99 on the number of capturing subpatterns has been removed.
492: The new limit is 65535, which I hope will not be a "real" limit.
493:
494:
495: Release 3.3 01-Aug-00
496: ---------------------
497:
498: There is some support for UTF-8 character strings. This is incomplete and
499: experimental. The documentation describes what is and what is not implemented.
500: Otherwise, this is just a bug-fixing release.
501:
502:
503: Release 3.0 01-Feb-00
504: ---------------------
505:
506: 1. A "configure" script is now used to configure PCRE for Unix systems. It
507: builds a Makefile, a config.h file, and the pcre-config script.
508:
509: 2. PCRE is built as a shared library by default.
510:
511: 3. There is support for POSIX classes such as [:alpha:].
512:
513: 5. There is an experimental recursion feature.
514:
515: ----------------------------------------------------------------------------
516: IMPORTANT FOR THOSE UPGRADING FROM VERSIONS BEFORE 2.00
517:
518: Please note that there has been a change in the API such that a larger
519: ovector is required at matching time, to provide some additional workspace.
520: The new man page has details. This change was necessary in order to support
521: some of the new functionality in Perl 5.005.
522:
523: IMPORTANT FOR THOSE UPGRADING FROM VERSION 2.00
524:
525: Another (I hope this is the last!) change has been made to the API for the
526: pcre_compile() function. An additional argument has been added to make it
527: possible to pass over a pointer to character tables built in the current
528: locale by pcre_maketables(). To use the default tables, this new arguement
529: should be passed as NULL.
530:
531: IMPORTANT FOR THOSE UPGRADING FROM VERSION 2.05
532:
533: Yet another (and again I hope this really is the last) change has been made
534: to the API for the pcre_exec() function. An additional argument has been
535: added to make it possible to start the match other than at the start of the
536: subject string. This is important if there are lookbehinds. The new man
537: page has the details, but you just want to convert existing programs, all
538: you need to do is to stick in a new fifth argument to pcre_exec(), with a
539: value of zero. For example, change
540:
541: pcre_exec(pattern, extra, subject, length, options, ovec, ovecsize)
542: to
543: pcre_exec(pattern, extra, subject, length, 0, options, ovec, ovecsize)
544:
545: ****
FreeBSD-CVSweb <freebsd-cvsweb@FreeBSD.org>