v0.10.4 Faster merge insert, fix for compaction race condition
What's Changed
- fix: assume default rust toolchain as stable by @kerryeon in #2055
- chore: extend JNI to get strings by @eddyxu in #2047
- chore: bump datafusion version by @universalmind303 in #2035
- chore: skip empty batch while chunking batches by @BubbleCal in #2026
- chore: utility to convert RecordBatchStream to FFI_ArrowArrayStream by @eddyxu in #2065
- feat: use a scalar index, if available, during a merge insert operation by @westonpace in #1987
- chore: write HNSW partitions by @BubbleCal in #2056
- chore: add struct for parameters of HNSW by @BubbleCal in #2057
- docs: add llm dataset creation example by @tanaymeh in #2060
- fix: update merge_insert code to use latest df version by @westonpace in #2071
- feat: support filter while searching in HNSW by @BubbleCal in #2058
- feat(java): fragment reader by @eddyxu in #2072
- fix: force fragments to be stored in the manifest in id-order by @westonpace in #2075
- chore: building
IVF_HNSW
index by @BubbleCal in #2066 - fix: fix bug in indexed merge insert where new data could cause merge insert to panic by @westonpace in #2076
- feat: emit warnings if f16 kernels not built by @westonpace in #2077
New Contributors
Full Changelog: v0.10.3...v0.10.4