v0.10.4 Faster merge insert, fix for compaction race condition

What's Changed

• fix: assume default rust toolchain as stable by @kerryeon in #2055
• chore: extend JNI to get strings by @eddyxu in #2047
• chore: bump datafusion version by @universalmind303 in #2035
• chore: skip empty batch while chunking batches by @BubbleCal in #2026
• chore: utility to convert RecordBatchStream to FFI_ArrowArrayStream by @eddyxu in #2065
• feat: use a scalar index, if available, during a merge insert operation by @westonpace in #1987
• chore: write HNSW partitions by @BubbleCal in #2056
• chore: add struct for parameters of HNSW by @BubbleCal in #2057
• docs: add llm dataset creation example by @tanaymeh in #2060
• fix: update merge_insert code to use latest df version by @westonpace in #2071
• feat: support filter while searching in HNSW by @BubbleCal in #2058
• feat(java): fragment reader by @eddyxu in #2072
• fix: force fragments to be stored in the manifest in id-order by @westonpace in #2075
• chore: building IVF_HNSW index by @BubbleCal in #2066
• fix: fix bug in indexed merge insert where new data could cause merge insert to panic by @westonpace in #2076
• feat: emit warnings if f16 kernels not built by @westonpace in #2077

New Contributors

• @kerryeon made their first contribution in #2055
• @tanaymeh made their first contribution in #2060

Full Changelog: v0.10.3...v0.10.4