Skip to content

v0.8.9: Progress hooks on write_fragments and write_dataset

Compare
Choose a tag to compare
@wjones127 wjones127 released this 31 Oct 18:51
· 979 commits to main since this release

New features

  • feat: expose progress on write_fragments and write_dataset by @wjones127 in #1464
  • feat: split out datagen utilities, expand them, expose to python by @westonpace in #1315

Bug fixes

Performance Improvements

  • perf: support multi-threading shuffler by @eddyxu in #1474
  • perf: use simd lib to implement dot by @eddyxu in #1480
  • perf: improve kmeans and make pq training multi-threaded by @eddyxu in #1479

Other changes

  • refactor: move commit traits to lance-core by @eddyxu in #1469
  • chore: use ruff format to replace isort and black by @eddyxu in #1472
  • refactor: move ObjectStore, FileReader and FileWriter to lance-core by @eddyxu in #1473
  • feat: poor man's SIMD lib by @eddyxu in #1478
  • chore: remove outdated warnings about prefiltering with a vector index by @westonpace in #1484
  • chore: mention GPU support in README by @eddyxu in #1489

Full Changelog: v0.8.8...v0.8.9