spidr_storage 0.0.1 copy "spidr_storage: ^0.0.1" to clipboard
spidr_storage: ^0.0.1 copied to clipboard

Modular storage abstractions supporting SQLite, Isar, and IndexedDB for SPIDR.

spidr_storage #

The modular storage and persistence abstraction layer of the SPIDR framework.

Abstractions #

  • StorageAdapter: Interface for persisting HTTP request cookies, crawler queue frontiers, session contexts, and scraped element fingerprints.
  • MemoryStorageAdapter: A lightweight, in-memory reference implementation suitable for testing and ephemeral crawls.
0
likes
160
points
142
downloads

Documentation

API reference

Publisher

unverified uploader

Weekly Downloads

Modular storage abstractions supporting SQLite, Isar, and IndexedDB for SPIDR.

Homepage
Repository (GitHub)
View/report issues

License

MIT (license)

Dependencies

meta, spidr_core

More

Packages that depend on spidr_storage