Blog Logo
TAGS

MPIRE (MultiProcessing Is Really Easy)

``MPIRE``, short for MultiProcessing Is Really Easy, is a Python package for multiprocessing. ``MPIRE`` is faster in most scenarios, packs more features, and is generally more user-friendly than the default multiprocessing package. It combines the convenient map like functions of ``multiprocessing.Pool`` with the benefits of using copy-on-write shared objects of ``multiprocessing.Process``, together with easy-to-use worker state, worker insights, worker init and exit functions, timeouts, and progress bar functionality. Full documentation is available at https://sybrenjansen.github.io/mpire/. Features include faster execution than other multiprocessing libraries, intuitive, Pythonic syntax, easy use of copy-on-write shared objects with a pool of workers, worker init and exit functionality, progress bar support, worker insights, graceful exception handling, timeouts, automatic task chunking, adjustable maximum number of active tasks, automatic restarting of workers, nested pool of workers, and utilization of dill as serialization backend.