fetch_pool library

A library to download a list of URLs in parallel while limiting max concurrent downloads.

Classes

FetchPool
Class used to fetch a list of URLs in parallel, only using a set number of operations in parallel.
FetchPoolResult
Result of fetching a single URL

Enums

FetchPoolFileNamingStrategy
Enum describing the different file naming strategies.
FetchPoolFileOverwritingStrategy
Enum describing the different file overwriting strategies.
FetchPoolFilePersistenceResult
Enum describing the different file persistence results.