Skip to content

Releases: fredwu/crawler

v1.5.0

10 Oct 11:14
Compare
Choose a tag to compare
  • [Added] Add :force option
  • [Added] Add :scope option

Full Changelog: v1.4.0...v1.5.0

v1.4.0

07 Oct 11:25
Compare
Choose a tag to compare
  • [Added] Allow multiple instances of Crawler sharing the same queue
  • [Improved] Logger will now log entries as debug or warn

Full Changelog: v1.3.0...v1.4.0

v1.3.0

30 Sep 03:45
Compare
Choose a tag to compare
  • [Added] :store option, defaults to nil to save memory usage
  • [Added] :max_pages option
  • [Added] Crawler.running?/1 to check whether Crawler is running
  • [Improved] The queue is being supervised now

Full Changelog: v1.2.0...v1.3.0

v1.2.0

28 Sep 16:00
Compare
Choose a tag to compare

v1.2.0 [2023-09-29]

  • [Added] Crawler.Store.all_urls/0 to find all scraped URLs
  • [Improved] Memory usage optimisations

Full Changelog: v1.1.2...v1.2.0

v1.1.2

14 Oct 03:21
Compare
Choose a tag to compare
mix test

v1.1.1

14 May 23:13
Compare
Choose a tag to compare
Prepare for v1.1.1

v1.1.0

25 Feb 01:13
Compare
Choose a tag to compare
Prepare for v1.1.0