feat(rust/drivers): adbc driver for datafusion

[tokoko]

Fixes #2263

An initial driver implementation for datafusion:

• bunch of todos everywhere
• options are not supported
• get_objects ignores filters
• get_objects takes depth into account, but only when returning results, not for info retrieval
• minimal testing

P.S. I'm not much of a rust person, so I'd appreciate any kind of pointers

[mbrobbel]

Very cool! I'll split my review over multiple chunks.

The failing test is known to be flaky.

[mbrobbel]

Instead of adding arrow we can add the arrow subcrates to reduce the size of our dependency tree.
It looks like we need to add:

• arrow-cast for https://docs.rs/arrow-cast/latest/arrow_cast/pretty/fn.print_batches.html (dev-dependency)
• arrow-select for https://docs.rs/arrow-select/latest/arrow_select/concat/fn.concat_batches.html

[tokoko]

thanks. makes sense, didn't realize most of these functions could be imported from multiple crates. Added both as a dev-dependency.

[mbrobbel]

To fix the failing CI job we need to install protoc (required by the substrait crate):

You could add

- name: Install Protoc
  uses: arduino/setup-protoc@v3
  with:
    repo-token: ${{ secrets.GITHUB_TOKEN }}

as a step after

arrow-adbc/.github/workflows/rust.yml

Lines 68 to 72 in 4639ca8

	- name: Use stable Rust
	id: rust
	run: |
	rustup toolchain install stable --no-self-update
	rustup default stable

.

[tokoko]

@mbrobbel thanks, got everything green. I had to temporarily add #![allow(refining_impl_trait)] to lib.rs, couldn't get unimplemented methods that return Result<impl RecordBatchReader + Send> to pass clippy checks otherwise.

[mbrobbel]

I think this looks good as an initial commit for this driver. The todo!()s and unwraps can be handled in follow-up PRs.