msgpack protocol is modified by our needs, and the never used tag 0xc1 is used for customized data
such as set, tuple, and class instances (including new style and old style python class).
pymsgpack will temporarily not support other languages and will be used among same run time environments (with same import path and class definition)
the detailed reason for this limitation is that when we pack an instance, we extract the __dict__, __class__.__name__, __module__ of it,
and when we unpack the instance, we re-import the module and class, and build the instance using __new__, then set __dict__ to it.
the fallback supports is not available anymore.
0.5 is important step toward 1.0. There are some deprecations.
Please read changes carefully.
- Drop Python 2.6 and 3.2 support
- Deprecate useless custom exceptions. Use ValueError instead of PackValueError,
Exception instead of PackException and UnpackException, etc...
See msgpack/exceptions.py
- Add strict_types option to packer. It can be used to serialize subclass of
builtin types. For example, when packing object which type is subclass of dict,
default() is called.
- Pure Python implementation supports packing memoryview object.
- Calling ext_hook with wrong length. (Only on Windows, maybe. #203)
- Memory leak when unpack is failed
- Reduce compiler warnings while building extension module
- unpack() now accepts ext_hook argument like Unpacker and unpackb()
- Update Cython version to 0.23.4
- default function is called when integer overflow
- fallback.Unpacker: Fix Data corruption when OutOfData.
This bug only affects "Streaming unpacking."
- Fix test failure on pytest 2.3. (by @ktdreyer)
- Fix typos in ChangeLog. (Thanks to @dmick)
- Improve README.rst (by @msabramo)
- Unpacker may unpack wrong uint32 value on 32bit or LLP64 environment. (#101)
- Build failed on Windows Python 2.7.
- Unpacker doesn't increment refcount of ExtType hook.
- Packer raises no exception for inputs doesn't fit to msgpack format.
- fallback.Unpacker.feed() supports bytearray.
- Unpacker doesn't increment refcount of hooks. Hooks may be GCed while unpacking.
- Unpacker may read unfilled internal buffer.
- Raises TypeError instead of ValueError when packer receives unsupported type.
- Support New msgpack spec.
- Default value of
use_list is True for now. (It was False for 0.2.x)
You should pass it explicitly for compatibility to 0.2.x.
- Unpacker.unpack() and some unpack methods now raise OutOfData instead of
StopIteration. StopIteration is used for iterator protocol only.
- Pure Python fallback module is added. (thanks to bwesterb)
- Add
.skip() method to Unpacker (thanks to jnothman)
- Add capturing feature. You can pass the writable object to
Unpacker.unpack() as a second parameter.
- Add
Packer.pack_array_header and Packer.pack_map_header.
These methods only pack header of each type.
- Add
autoreset option to Packer (default: True).
Packer doesn't return packed bytes and clear internal buffer.
- Add
Packer.pack_map_pairs. It packs sequence of pair to map type.
- Fix SEGV when object_hook or object_pairs_hook raise Exception. (#39)
- Warn when use_list is not specified. It's default value will be changed in 0.3.
- Can't pack subclass of dict.
- Add
use_single_float option to Packer. When it is true, packs float
object in single precision format.
unpack() didn't restores gc state when it called with gc disabled.
unpack() doesn't control gc now instead of restoring gc state collectly.
User can control gc state when gc cause performance issue.Unpacker's read_size option didn't used.
- Add
max_buffer_size parameter to Unpacker. It limits internal buffer size
and allows unpack data from untrusted source safely.
- Unpacker's buffer reallocation algorithm is less greedy now. It cause perforamce
derease in rare case but memory efficient and don't allocate than
max_buffer_size.
- Fix msgpack didn't work on SPARC Solaris. It was because choosing wrong byteorder
on compilation time. Use
sys.byteorder to get correct byte order.
Very thanks to Chris Casey for giving test environment to me.
- Drop supporting Python 2.5 and unify tests for Py2 and Py3.
- Use new version of msgpack-c. It packs correctly on big endian platforms.
- Remove deprecated packs and unpacks API.
- #8 Packing subclass of dict raises TypeError. (Thanks to Steeve Morin.)
- Don't accept subtype of list and tuple as msgpack list. (Steeve Morin)
It allows customize how it serialized with
default argument.
- Fix wrong error message. (David Wolever)
- Fix memory leak while unpacking when
object_hook or list_hook is used.
(Steeve Morin)
- setup.py works on Python 2.5 (Steffen Siering)
- Optimization for serializing dict.
- Re-enable packs/unpacks removed at 0.1.11. It will be removed when 0.2 is released.
- Include test code for Python3 to sdist. (Johan Bergström)
- Fix compilation error on MSVC. (davidgaleano)
- Add
encoding and unicode_errors option to packer and unpacker.
When this option is specified, (un)packs unicode object instead of bytes.
This enables using msgpack as a replacement of json. (tailhook)
use_list option is added to unpack(b) like Unpacker.
(Use keyword argument because order of parameters are different)
- Fix typo.
- Add MemoryError check.
- Support
loads and dumps aliases for API compatibility with
simplejson and pickle.
- Add object_hook and list_hook option to unpacker. It allows you to
hook unpacing mapping type and array type.
- Add default option to packer. It allows you to pack unsupported types.
- unpacker accepts (old) buffer types.
- Fix segv around
Unpacker.feed or Unpacker(file).
- Add object_hook and list_hook option to unpacker. It allows you to
hook unpacing mapping type and array type.
- Add default option to packer. It allows you to pack unsupported types.
- unpacker accepts (old) buffer types.
- Compilation error on win32.