2023-10-20
- Unicode 15.1 support (#253).
2022-10-30
- Unicode 15 support (#247).
2021-12-16
-
Unicode 14 support (#233).
-
Support
GNUInstallDirs
in CMake build (#159). -
cmake
build now installspkg-config
file (#224). -
Various build and portability improvements.
2020-12-15
- Bugfix in
utf8proc_grapheme_break_stateful
forNULL
state argument, which also brokeutf8proc_grapheme_break
.
2020-11-23
-
New
utf8proc_islower
andutf8proc_isupper
functions (#196). -
Bugfix for manual calls to
grapheme_break_extended
for initial characters (#205). -
Various build and portability improvements.
2019-03-27
-
Unicode 13 support (#179).
-
No longer report zero width for category Sk (#167).
-
cmake
support improvements (#173).
2019-05-10
-
Unicode 12.1 support (#156).
-
New
-DUTF8PROC_INSTALL=No
option forcmake
builds to disable installation (#152). -
Better
make
support for HP-UX (#154). -
Fixed incorrect
UTF8PROC_VERSION_MINOR
version number in header and bumped shared-library version.
2019-03-30
-
Unicode 12 support (#148).
-
New function
utf8proc_unicode_version
to return the supported Unicode version (#151). -
Simpler character-width computation that no longer uses GNU Unifont metrics: East-Asian wide characters have width 2, and all other printable characters have width 1 (#150).
-
Fix
CHARBOUND
option forutf8proc_map
to preserve U+FFFE and U+FFFF non-characters (#149).
2018-07-24
-
utf8proc_NFKC_Casefold
convenience function forNFKC_Casefold
normalization (#133). -
UTF8PROC_STRIPNA
option to strip unassigned codepoints (#133). -
Support building static libraries on Windows (callers need to
#define UTF8PROC_STATIC
) (#123). -
cmake
fix to avoid definingUTF8PROC_EXPORTS
globally (#121). -
toupper
of ß (U+00df) now yields ẞ (U+1E9E) (#134), similar to musl; case-folding still yields the standard "ss" mapping. -
utf8proc_charwidth
now returns1
for U+00AD (soft hyphen) and for unassigned/PUA codepoints (#135).
2018-04-27
2016-12-26:
-
New functions
utf8proc_map_custom
andutf8proc_decompose_custom
to allow user-supplied transformations of codepoints, in conjunction with other transformations (#89). -
New function
utf8proc_normalize_utf32
to apply normalizations directly to UTF-32 data (not just UTF-8) (#88). -
Fixed stack overflow that could occur due to incorrect definition of
UINT16_MAX
with some compilers (#84). -
Fixed conflict with
stdbool.h
in Visual Studio (#90). -
Updated font metrics to use Unifont 9.0.04.
2016-07-27:
-
Move
-Wmissing-prototypes
warning flag fromMakefile
to.travis.yml
since MSVC does not understand this flag and it is occasionally useful to build using MSVC through theMakefile
(#79). -
Use a different variable name for a nested loop in
bench/bench.c
, and declare it in a C89 way rather than inside thefor
to avoid "error: 'for' loop initial declarations are only allowed in C99 mode" (#80).
2016-07-13:
-
Bug fix in
utf8proc_grapheme_break_stateful
(#77). -
Tests now use versioned Unicode files, so they will no longer break when a new version of Unicode is released (#78).
2016-07-13:
-
Updated for Unicode 9.0 (#70).
-
New
utf8proc_grapheme_break_stateful
to handle the complicated grapheme-breaking rules in Unicode 9. The oldutf8proc_grapheme_break
is still provided, but may incorrectly identify grapheme breaks in some Unicode-9 sequences. -
Smaller Unicode tables (#62, #68). This required changes in the
utf8proc_property_t
structure, which breaks backward compatibility if you access thisstruct
directly. The functions in the API remain backward-compatible, however. -
Buffer overrun fix (#66).
2015-11-02:
-
Do not export symbol for internal function
unsafe_encode_char()
(#55). -
Install relative symbolic links for shared libraries (#58).
-
Add missing files to
make clean
(#58).
2015-07-06:
-
Updated for Unicode 8.0 (#45).
-
New
utf8proc_tolower
andutf8proc_toupper
functions, portable replacements fortowlower
andtowupper
in the C library (#40). -
Don't treat Unicode "non-characters" as invalid, and improved validity checking in general (#35).
-
Prefix all typedefs with
utf8proc_
, e.g.utf8proc_int32_t
, to avoid collisions with other libraries (#32). -
Rename
DLLEXPORT
toUTF8PROC_DLLEXPORT
to prevent collisions. -
Fix build breakage in the benchmark routines.
-
More fine-grained Makefile variables (
PICFLAG
etcetera), so that compilation flags can be selectively overridden, and in particular so thatCFLAGS
can be changed without accidentally eliminating necessary flags like-fPIC
and-std=c99
(#43). -
Updated character-width tables based on Unifont 8.0.01 (#51) and the Unicode 8 character categories (#47).
2015-03-28:
-
Updated for Unicode 7.0 (#6).
-
New function
utf8proc_grapheme_break(c1,c2)
that returns whether there is a grapheme break betweenc1
andc2
(#20). -
New function
utf8proc_charwidth(c)
that returns the number of column-positions that should be required forc
; essentially a portable replacment forwcwidth(c)
(#27). -
New function
utf8proc_category(c)
that returns the Unicode category ofc
(as one of the constantsUTF8PROC_CATEGORY_xx
). Also, a functionutf8proc_category_string(c)
that returns the Unicode category ofc
as a two-character string. -
cmake
scriptCMakeLists.txt
, in addition toMakefile
, for easier compilation on Windows (#28). -
Various
Makefile
improvements: amake check
target to perform tests (#13),make install
, a rule to automate updating the Unicode tables, etcetera. -
The shared library is now versioned (e.g. has a soname on GNU/Linux) (#24).
-
C++/MSVC compatibility (#17).
-
Most
#defined
constants are nowenums
(#29). -
New preprocessor constants
UTF8PROC_VERSION_MAJOR
,UTF8PROC_VERSION_MINOR
, andUTF8PROC_VERSION_PATCH
for compile-time detection of the API version. -
Doxygen-formatted documentation (#29).
-
The Ruby and PostgreSQL plugins have been removed due to lack of testing (#22).
2013-11-27:
- PostgreSQL 9.2 and 9.3 compatibility (lowercase
c
language name)
2009-08-20:
- Use
RSTRING_PTR()
andRSTRING_LEN()
instead ofRSTRING()->ptr
andRSTRING()->len
for ruby1.9 compatibility (and#define
them, if not existent)
2009-10-02:
- Patches for compatibility with Microsoft Visual Studio
2009-10-08:
- Fixes to make utf8proc usable in C++ programs
2009-10-16:
2009-06-14:
- replaced C++ style comments for compatibility reasons
- added typecasts to suppress compiler warnings
- removed redundant source files for ruby-gemfile generation
2009-08-19:
- Changed copyright notice for Public Software Group e. V.
- Minor changes in the
README
file
2008-10-04:
- Added a function
utf8proc_version
returning a string containing the version number of the library. - Included a target
libutf8proc.dylib
for MacOSX.
2009-05-01:
- PostgreSQL 8.3 compatibility (use of
SET_VARSIZE
macro)
2007-07-25:
- Fixed a serious bug in the data file generator, which caused characters being treated incorrectly, when stripping default ignorable characters or calculating grapheme cluster boundaries.
2007-06-25:
- Added a new PostgreSQL function
unistrip
, which behaves likeunifold
, but also removes all character marks (e.g. accents).
2007-07-22:
- Changed license from BSD to MIT style.
- Added a new function
utf8proc_codepoint_valid
to the C library. - Changed compiler flags in
Makefile
from-g -O0
to-O2
- The ruby script, which was used to build the
utf8proc_data.c
file, is now included in the distribution.
2007-03-16:
- Fixed a bug in the ruby library, which caused an error, when splitting an
empty string at grapheme cluster boundaries (method
String#utf8chars
).
2006-09-21:
- included a check in
Integer#utf8
, which raises an exception, if the given code-point is invalid because of being too high (this was missing yet)
2006-12-26:
- added support for PostgreSQL version 8.2
2006-09-20:
- included a gem file for the ruby version of the library
Release of version 1.0.1
2006-09-17:
- added the
LUMP
option, which lumps certain characters together (seelump.md
) (also used for the PostgreSQLunifold
function) - added the
STRIPMARK
option, which strips marking characters (or marks of composed characters) - deprecated ruby method
String#char_ary
in favour ofString#utf8chars
2006-07-18:
- changed normalization from NFC to NFKC for postgresql unifold function
2006-08-04:
- added support to mark the beginning of a grapheme cluster with 0xFF (option:
CHARBOUND
) - added the ruby method
String#chars
, which is returning an array of UTF-8 encoded grapheme clusters - added
NLF2LF
transformation in postgresqlunifold
function - added the
DECOMPOSE
option, if you neither useCOMPOSE
orDECOMPOSE
, no normalization will be performed (different from previous versions) - using integer constants rather than C-strings for character properties
- fixed (hopefully) a problem with the ruby library on Mac OS X, which occurred when compiler optimization was switched on
2006-06-05:
- changed behaviour of PostgreSQL function to return NULL in case of invalid input, rather than raising an exceptional condition
- improved efficiency of PostgreSQL function (no transformation to C string is done)
2006-06-20:
- added -fpic compiler flag in Makefile
- fixed bug in the C code for the ruby library (usage of non-existent function)
2006-06-02: initial release of version 0.1