v0.9.6: Query plan fixes, additional functions allowed in filters

New features

• feat: switch to using datafusion to parse functions by @westonpace in #1793
• feat: allow externally generated shuffle buffer and multiple of them by @chebbyChefNEQ in #1801
• feat: expose shuffler parameters for controlling memory usage by @chebbyChefNEQ in #1790

Bug fixes

• fix: ensure query plans are correct by @wjones127 in #1785
  • This fixes an issue where ANN queries with prefilters can have irrelevant results if there is a scalar index that is not up-to-date.

Other changes

• chore: init sharded iterator from pytorch distributed environment by @eddyxu in #1795
• chore: make create_plan a public API by @eddyxu in #1796
• chore: fix clippy lints on rust 1.75 by @eddyxu in #1767
• chore: migrate shuffle to lance-index by @eddyxu in #1803
• fix: fix 1.75 clippy by @chebbyChefNEQ in #1806
• chore: relax the footer-max-line-length rule (github takes care of this) by @westonpace in #1811
• chore: use local temp directory to store spilled precomputed partitions by @eddyxu in #1812
• ci: add set -e to linux script by @wjones127 in #1816

Full Changelog: v0.9.5...v0.9.6