v0.8.9: Progress hooks on write_fragments and write_dataset
New features
- feat: expose progress on write_fragments and write_dataset by @wjones127 in #1464
- feat: split out datagen utilities, expand them, expose to python by @westonpace in #1315
Bug fixes
Performance Improvements
- perf: support multi-threading shuffler by @eddyxu in #1474
- perf: use simd lib to implement dot by @eddyxu in #1480
- perf: improve kmeans and make pq training multi-threaded by @eddyxu in #1479
Other changes
- refactor: move commit traits to lance-core by @eddyxu in #1469
- chore: use ruff format to replace isort and black by @eddyxu in #1472
- refactor: move ObjectStore, FileReader and FileWriter to lance-core by @eddyxu in #1473
- feat: poor man's SIMD lib by @eddyxu in #1478
- chore: remove outdated warnings about prefiltering with a vector index by @westonpace in #1484
- chore: mention GPU support in README by @eddyxu in #1489
Full Changelog: v0.8.8...v0.8.9