spidr_storage 1.0.0 copy "spidr_storage: ^1.0.0" to clipboard
spidr_storage: ^1.0.0 copied to clipboard

Modular storage abstractions supporting SQLite, Isar, and IndexedDB for SPIDR.

spidr_storage #

The modular storage and persistence abstraction layer of the SPIDR framework.

Abstractions #

  • StorageAdapter: Interface for persisting HTTP request cookies, crawler queue frontiers, session contexts, and scraped element fingerprints.
  • MemoryStorageAdapter: A lightweight, in-memory reference implementation suitable for testing and ephemeral crawls.
0
likes
130
points
142
downloads

Documentation

API reference

Publisher

unverified uploader

Weekly Downloads

Modular storage abstractions supporting SQLite, Isar, and IndexedDB for SPIDR.

Homepage
Repository (GitHub)
View/report issues
Contributing

License

MIT (license)

Dependencies

isar, meta, spidr_core, sqlite3

More

Packages that depend on spidr_storage