Feature Request: return iterable instead of list

[tjyuyao]

• Parallel TQDM version: 0.2.0

Description

I need to post-process the results returned by pqdm(). The number of tasks is very large, so it is not acceptable to store all the results in the memory. Is it possible to return an iterable, instead of a list, so I can consume the results on the fly? In this case, pqdm pre-fetch a number of results instead of produce as quick as possible to keep the memory usage constant.

[searchivarius]

Hi @tjyuyao would you try a pqdm-like library that supports lazy iteration? It uses very different principles (not based on concurrent futures, which have several issues/limitations). So no pull request for PQDM sorry, but rather a new library: https://github.com/searchivarius/py_mtasklite