pickleloadsb

pickleloadsb is a Python library conceived to extend the standard pickle module by enabling deserialization of multiple pickled objects from a single input source, such as a bytes buffer or a file-like stream. It is not part of the Python standard library and is distributed separately on package indexes or repositories.

The primary API, also named pickleloadsb, accepts a bytes-like object or a stream and returns a list of deserialized objects. It reads the input sequentially, unpickling objects until the end of the source is reached, and it can optionally stop after a specified count. This design facilitates working with concatenated or batched pickle payloads without manually managing partial unpickling rounds.

Design goals for pickleloadsb include improved memory efficiency for large streams and streamlined handling of concatenated pickle payloads. It supports Python 3.x and uses the same protocol versions as the built-in module where possible, adapting to the capabilities of the running interpreter.

Security considerations are central to any discussion of unpickling. Because pickle can execute arbitrary code during deserialization, pickleloadsb should be used only with trusted data. Some variants or configurations may offer a restricted unpickler mode to limit executed code, though no approach can fully guarantee safety against crafted payloads.

Notes: In practice, similar behavior can be achieved with the standard library by repeatedly invoking pickle.load or a custom Unpickler for a sequence of objects. pickleloadsb aims to streamline that pattern and provide a dedicated, batched API. Related topics include the Python pickle module, serialization, and data streams.