v0.4.17 Release

What's Changed

• feat: typecheck arrow objects before sending to Rust by @wjones127 in #914
• Implementing more granular Errors using snafu. by @gsilvestrin in #913
• Check an object store is on local file system by @eddyxu in #918

Full Changelog: v0.4.16...v0.4.17

v0.4.16 Regex support in filter expression

What's Changed

• [CI] fix typo in make-release-commit workflow by @changhiskhan in #903
• [Rust] allow filter with regex expression on columns by @chebbyChefNEQ in #899
• [CI] bump windows-build storage to 1gb by @chebbyChefNEQ in #905
• [Doc] cloud storage support by @eddyxu in #907
• [CI] fix action yaml, storage config needs to be on the first step by @chebbyChefNEQ in #906
• [Rust] ObjectStore::read_dir method by @eddyxu in #911

New Contributors

• @chebbyChefNEQ made their first contribution in #899

Full Changelog: v0.4.15...v0.4.16

v0.4.15 Smaller footprint and docs improvements

DuckDB was unnecessarily included as a required dependency, which increases the overall footprint by ~42mb. Removing it makes Lance easier to install in small containers with limited space or more stringent startup time needs.

What's Changed

• ci: fix path in cargo release ci by @wjones127 in #893
• Update docs page link by @gsilvestrin in #900
• update lancedb org references by @jaichopra in #897
• Remove duckdb as python package dependency by @eddyxu in #902

Full Changelog: v0.4.14...v0.4.15

v0.4.14

What's Changed

New features:

• feat: allow setting offset without limit by @wjones127 in #892
• Customize index type in index creation benchmark by @eddyxu in #886
• [Rust] Experimental: DiskANN search by @eddyxu in #798

Bug fixes:

• [DuckDB] Fix linux build by @eddyxu in #887

Internal changes:

• fix: update minimal futures version by @wjones127 in #883
• ci: pass both mac os targets to macos release job by @wjones127 in #882
• ci: use rust cache by @wjones127 in #881
• Update GHA workflow to make a new commit by @changhiskhan in #889
• Github workflow to run cargo publish on release by @changhiskhan in #888
• resolve name conflict for workflows by @changhiskhan in #890

Full Changelog: v0.4.13...v0.4.14

v0.4.13 More concurrent scans

What's Changed

• fix: fetch remainder of metadata if it is large by @wjones127 in #873
• wip: allow scanning data in out of order by @wjones127 in #874
• feat: add fragments option to the scanner itself by @wjones127 in #877

Full Changelog: v0.4.12...v0.4.13

v0.4.12 Expose Scanner from_fragments

What's Changed

• Add format string for the assertion by @haoxins in #866
• GH-860: Create a scanner from fragments by @wjones127 in #869

New Contributors

• @wjones127 made their first contribution in #869

Full Changelog: v0.4.11...v0.4.12

v0.4.11 Expose fragment data files in python

What's Changed

• fix benchmarks by @changhiskhan in #862
• [Python] Expose Fragment data files in Python by @eddyxu in #864

Full Changelog: v0.4.10...v0.4.11

v0.4.10: It is all about performance

Welcome our newest contributor @LiWeiJie!

This release introduces several performance improvements, including index caching and customized prefetching.

What's Changed

• remove unnecessary simd alignment check by @changhiskhan in #852
• Fix projection for null struct fields by @LiWeiJie in #857
• [Rust] Caching index in LRU by @eddyxu in #829
• Expose batch_readahead via Python scanner API by @eddyxu in #859

New Contributors

• @LiWeiJie made their first contribution in #857

Full Changelog: v0.4.9...v0.4.10

v0.4.9 Document improvement, and Distributed Fragments

What's Changed

• [Doc] improvement on read related functionalities. by @eddyxu in #848
• Expose schema in Fragment object by @eddyxu in #850
• Pickle Fragment Metadata by @eddyxu in #851

Full Changelog: v0.4.8...v0.4.9

v0.4.8 Better support for nested fields and more supported predicates

Previously predicates on nested (and deeply nested) fields were not properly supported. This release adds support for filtering on struct sub-fields or deeply nested structs.

We also add support for more filter predicates and fixed a regression in NULL handling for string columns.

What's Changed

• Fix nested schema merge by @changhiskhan in #836
• Fix nested field filtering by @changhiskhan in #837
• Fix Projection for struct fields by @changhiskhan in #844
• [Bug] Calculating the nulls from position slices in chunks. by @eddyxu in #846
• Add tests for is_NULL, is_not_null, and invert in filter by @eddyxu in #847

Full Changelog: v0.4.7...v0.4.8