spidr_crawler 1.1.0 copy "spidr_crawler: ^1.1.0" to clipboard
spidr_crawler: ^1.1.0 copied to clipboard

Scalable crawling framework including Spider, queues, and scheduling logic for SPIDR.

1.1.0 #

  • FEAT: implement Phase 10 - Concurrent Execution.
  • FEAT: implement Phase 9 - Crawler Framework.

Changelog #

1.0.0 - 2026-06-03 #

  • Stable production release version 1.0.0.

0.0.1 - 2026-06-01 #

Added #

  • Standard abstract interfaces for Spider, CrawlerQueue, CrawlerScheduler.
  • Basic crawler execution manager SpidrCrawler.
  • Unit tests and examples scaffolding.
0
likes
160
points
136
downloads

Documentation

API reference

Publisher

unverified uploader

Weekly Downloads

Scalable crawling framework including Spider, queues, and scheduling logic for SPIDR.

Homepage
Repository (GitHub)
View/report issues
Contributing

License

MIT (license)

Dependencies

meta, spidr_core

More

Packages that depend on spidr_crawler