Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LanceDB Destination #1375

Merged
merged 179 commits into from
Jun 27, 2024
Merged

LanceDB Destination #1375

merged 179 commits into from
Jun 27, 2024

Commits on May 16, 2024

  1. Added lancedb as an optional dependency 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed May 16, 2024
    Configuration menu
    Copy the full SHA
    5c35057 View commit details
    Browse the repository at this point in the history

  2. Added lancedb to dependencies in test workflow 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed May 16, 2024
    Configuration menu
    Copy the full SHA
    f4450a7 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. Merge branch 'refs/heads/devel' into 1370-lancedb-destination

    @Pipboyguy
    Pipboyguy committed May 17, 2024
    Configuration menu
    Copy the full SHA
    0808bb2 View commit details
    Browse the repository at this point in the history

  2. Add initial capabilities for LanceDB destination 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed May 17, 2024
    Configuration menu
    Copy the full SHA
    5380892 View commit details
    Browse the repository at this point in the history

  3. Added new lancedb_adapter 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed May 17, 2024
    Configuration menu
    Copy the full SHA
    0f40ffa View commit details
    Browse the repository at this point in the history

  4. Added LanceDB factory in destinations implementation 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed May 17, 2024
    Configuration menu
    Copy the full SHA
    d34ab6f View commit details
    Browse the repository at this point in the history

  5. Added LanceDB client configuration with embedding details 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed May 17, 2024
    Configuration menu
    Copy the full SHA
    0f3d57f View commit details
    Browse the repository at this point in the history

  6. Merge branch 'refs/heads/devel' into 1370-lancedb-destination

    @Pipboyguy
    Pipboyguy committed May 17, 2024
    Configuration menu
    Copy the full SHA
    69e1daa View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. Added LanceDB Client with data load and schema management functionali… 

    …ties

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed May 20, 2024
    Configuration menu
    Copy the full SHA
    c51a9bc View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Merge remote-tracking branch 'origin/devel' into 1370-lancedb-destina… 

    …tion
    @Pipboyguy
    Pipboyguy committed May 29, 2024
    Configuration menu
    Copy the full SHA
    c49ee2b View commit details
    Browse the repository at this point in the history

  2. Lockfile 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed May 29, 2024
    Configuration menu
    Copy the full SHA
    389d06b View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. Wireframe LanceDB client implementation 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed May 30, 2024
    Configuration menu
    Copy the full SHA
    1d9a072 View commit details
    Browse the repository at this point in the history

  2. Add abstract methods 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed May 30, 2024
    Configuration menu
    Copy the full SHA
    8c0de4c View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. Enhance LanceDB client with additional functionality 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed May 31, 2024
    Configuration menu
    Copy the full SHA
    d6d02b2 View commit details
    Browse the repository at this point in the history

Commits on Jun 1, 2024

  1. Add tests and GitHub workflow for LanceDB destination 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 1, 2024
    Configuration menu
    Copy the full SHA
    ada3ebe View commit details
    Browse the repository at this point in the history

Commits on Jun 2, 2024

  1. Update Python version to 3.11.x in GitHub workflow 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 2, 2024
    Configuration menu
    Copy the full SHA
    5d961b5 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. Merge branch 'refs/heads/devel' into 1370-lancedb-destination

    @Pipboyguy
    Pipboyguy committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    c3cad2f View commit details
    Browse the repository at this point in the history

  2. Refactor and cleanup LanceDBClient and LoadLanceDBJob classes 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    f97256e View commit details
    Browse the repository at this point in the history

  3. Refactor load tests in lancedb/utils.py and add test for LanceDB mode… 

    …l inference

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    1b68391 View commit details
    Browse the repository at this point in the history

  4. Added functionality to infer LanceDB model from data and refactored n… 

    …ame for reserved fields

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    ae70f97 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. Remove storage options 

    Storage options are only available in asynchronous Python API. See https://lancedb.github.io/lancedb/guides/storage/

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    2222a88 View commit details
    Browse the repository at this point in the history

  2. Refactor test pipeline and implement lancedb_adapter in LanceDBClient 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    f819c25 View commit details
    Browse the repository at this point in the history

  3. Add schema argument to LoadLanceDBJob function 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    8bbd515 View commit details
    Browse the repository at this point in the history

  4. Format 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    fb7565e View commit details
    Browse the repository at this point in the history

  5. Refactor LanceDB related code and increase type hint coverage 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    4c73541 View commit details
    Browse the repository at this point in the history

  6. Refactor LanceDB client and tests, enhance DB type mapping 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    bfcc8bb View commit details
    Browse the repository at this point in the history

  7. Refactor code to improve readability by reducing line breaks 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    4827798 View commit details
    Browse the repository at this point in the history

  8. Refactor LanceDB client code by adding schema_conversion and utils mo… 

    …dules

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    53c0b0d View commit details
    Browse the repository at this point in the history

  9. Remove redundant variables in lancedb_client.py 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    2cfbdb4 View commit details
    Browse the repository at this point in the history

  10. Refactor code to improve readability and move environment variable se… 

    …t function to utils.py

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    092fcf0 View commit details
    Browse the repository at this point in the history

  11. Refactor LanceDB client implementation and error handling 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    b1783b2 View commit details
    Browse the repository at this point in the history

  12. Refactor code for better readability and add type ignore comments 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    08dcea1 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. Added lancedb as an optional dependency 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    ad43996 View commit details
    Browse the repository at this point in the history

  2. Added lancedb to dependencies in test workflow 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    c225916 View commit details
    Browse the repository at this point in the history

  3. Add initial capabilities for LanceDB destination 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    cfc4038 View commit details
    Browse the repository at this point in the history

  4. Added new lancedb_adapter 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    7e1b651 View commit details
    Browse the repository at this point in the history

  5. Added LanceDB factory in destinations implementation 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    892c4f8 View commit details
    Browse the repository at this point in the history

  6. Added LanceDB client configuration with embedding details 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    b4e8ad5 View commit details
    Browse the repository at this point in the history

  7. Added LanceDB Client with data load and schema management functionali… 

    …ties

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    605ec89 View commit details
    Browse the repository at this point in the history

  8. Wireframe LanceDB client implementation 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    8cd3208 View commit details
    Browse the repository at this point in the history

  9. Add abstract methods 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    d4a9314 View commit details
    Browse the repository at this point in the history

  10. Enhance LanceDB client with additional functionality 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    99fb712 View commit details
    Browse the repository at this point in the history

  11. Add tests and GitHub workflow for LanceDB destination 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    e024925 View commit details
    Browse the repository at this point in the history

  12. Update Python version to 3.11.x in GitHub workflow 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    c1e84b5 View commit details
    Browse the repository at this point in the history

  13. Refactor and cleanup LanceDBClient and LoadLanceDBJob classes 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    fe0cfbe View commit details
    Browse the repository at this point in the history

  14. Refactor load tests in lancedb/utils.py and add test for LanceDB mode… 

    …l inference

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    32fd5c8 View commit details
    Browse the repository at this point in the history

  15. Added functionality to infer LanceDB model from data and refactored n… 

    …ame for reserved fields

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    1eea62a View commit details
    Browse the repository at this point in the history

  16. Remove storage options 

    Storage options are only available in asynchronous Python API. See https://lancedb.github.io/lancedb/guides/storage/

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    eb05fcd View commit details
    Browse the repository at this point in the history

  17. Refactor test pipeline and implement lancedb_adapter in LanceDBClient 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    d560269 View commit details
    Browse the repository at this point in the history

  18. Add schema argument to LoadLanceDBJob function 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    80eef96 View commit details
    Browse the repository at this point in the history

  19. Format 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    1414ded View commit details
    Browse the repository at this point in the history

  20. Refactor LanceDB related code and increase type hint coverage 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    033c981 View commit details
    Browse the repository at this point in the history

  21. Refactor LanceDB client and tests, enhance DB type mapping 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    c655c8a View commit details
    Browse the repository at this point in the history

  22. Refactor code to improve readability by reducing line breaks 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    1815da4 View commit details
    Browse the repository at this point in the history

  23. Refactor LanceDB client code by adding schema_conversion and utils mo… 

    …dules

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    32478ae View commit details
    Browse the repository at this point in the history

  24. Remove redundant variables in lancedb_client.py 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    c4bd4f2 View commit details
    Browse the repository at this point in the history

  25. Refactor code to improve readability and move environment variable se… 

    …t function to utils.py

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    6c74cc5 View commit details
    Browse the repository at this point in the history

  26. Refactor LanceDB client implementation and error handling 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    9e5d6db View commit details
    Browse the repository at this point in the history

  27. Refactor code for better readability and add type ignore comments 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    fb6974d View commit details
    Browse the repository at this point in the history

  28. Dependency Versioning 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    ee239e5 View commit details
    Browse the repository at this point in the history

  29. Merge remote-tracking branch 'origin/1370-lancedb-destination' into 1… 

    …370-lancedb-destination

# Conflicts:
#	poetry.lock
#	pyproject.toml
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    42e32d9 View commit details
    Browse the repository at this point in the history

  30. Remove unnecessary dependencies and update lancedb and pylance versions 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    827ebd3 View commit details
    Browse the repository at this point in the history

  31. Silence mypy warnings 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    71e3579 View commit details
    Browse the repository at this point in the history

  32. Revert mypy ignores 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    d5b8cda View commit details
    Browse the repository at this point in the history

  33. Revert mypy ignores 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    3ea0a3a View commit details
    Browse the repository at this point in the history

  34. Fix versioning with 3.8 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    395e1b7 View commit details
    Browse the repository at this point in the history

  35. Fix versioning 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    ec2774d View commit details
    Browse the repository at this point in the history

  36. Update default URI and dataset separator in LanceDB configuration 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    1591a1f View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Merge branch 'refs/heads/devel' into 1370-lancedb-destination

    @Pipboyguy
    Pipboyguy committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    7f3c772 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2024

  1. Merge branch 'refs/heads/devel' into 1370-lancedb-destination

    @Pipboyguy
    Pipboyguy committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    a727cf3 View commit details
    Browse the repository at this point in the history

  2. Refactor LanceDB typemapper with timestamp and decimal precision adju… 

    …stments

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    66d1cc7 View commit details
    Browse the repository at this point in the history

  3. Updated method for retrieving sentinel table name 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    21bc285 View commit details
    Browse the repository at this point in the history

  4. Remove redundant table normalisation for version_table_name 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    7fadbe5 View commit details
    Browse the repository at this point in the history

  5. Refactor LanceDB functionalities and improve handling of optional emb… 

    …edding fields

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    bda6123 View commit details
    Browse the repository at this point in the history

  6. Refactor LanceDBClient and update parameter defaults in schema.py 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    74ac9f3 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2024

  1. Added lancedb to default vector configs and improved type annotations… 

    … in tests.

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    e4b3a8d View commit details
    Browse the repository at this point in the history

  2. Return self in enter context manager method 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    5e8718c View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Merge branch 'refs/heads/devel' into 1370-lancedb-destination

    @Pipboyguy
    Pipboyguy committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    310eccf View commit details
    Browse the repository at this point in the history

  2. Handle FileNotFoundError 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    6a5db5c View commit details
    Browse the repository at this point in the history

  3. Replace FileNotFoundError with DestinationUndefinedEntity in lancedb_… 

    …client.py

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    f4bcfe7 View commit details
    Browse the repository at this point in the history

  4. Refactor LanceDB client for simplified table name handling 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    b193f38 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'refs/heads/devel' into 1370-lancedb-destination

    @Pipboyguy
    Pipboyguy committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    6e61c7a View commit details
    Browse the repository at this point in the history

  6. Refactored LanceDB schema creation and storage update processes to py… 

    …arrow

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    4701547 View commit details
    Browse the repository at this point in the history

  7. Remove LanceModels 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    74080a4 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Ensure 'records' is a list in lancedb_client.py 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    f3ac7e2 View commit details
    Browse the repository at this point in the history

  2. Refactor code and add batch error handling in lancedb client 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    173be9e View commit details
    Browse the repository at this point in the history

  3. Refactor LanceDB client and schema for improved embedding handling 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    9d6c6d2 View commit details
    Browse the repository at this point in the history

  4. Improve error handling and retries in LanceDB client 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    bb165a8 View commit details
    Browse the repository at this point in the history

  5. Add error decorator to get_stored_state method in lancedb_client 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    2adeaea View commit details
    Browse the repository at this point in the history

  6. Change error handling from FileNotFoundError to IndexError 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    ba02ed5 View commit details
    Browse the repository at this point in the history

  7. Refactor lancedb_client.py and add error decorators 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    432dd76 View commit details
    Browse the repository at this point in the history

  8. Add configurable read consistency to LanceDB client 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    fa1202e View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Merge branch 'refs/heads/devel' into 1370-lancedb-destination 

    # Conflicts:
#	poetry.lock
#	pyproject.toml
    @Pipboyguy
    Pipboyguy committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    8963876 View commit details
    Browse the repository at this point in the history

  2. Versioning 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    26f497e View commit details
    Browse the repository at this point in the history

  3. Refactor code for readability and change return type in tests 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    30cc9a7 View commit details
    Browse the repository at this point in the history

  4. Update queries in lancedb_client to order by insertion date 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    175b6db View commit details
    Browse the repository at this point in the history

  5. Refactor LanceDB client and schema for better table creation and mana… 

    …gement

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    719fcfb View commit details
    Browse the repository at this point in the history

  6. Combine "skip" and "append" write dispositions in batch upload 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    aa683da View commit details
    Browse the repository at this point in the history

  7. Add schema version hash check in LanceDB client write operations 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    6483152 View commit details
    Browse the repository at this point in the history

  8. Remove testing code 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    65ede6f View commit details
    Browse the repository at this point in the history

  9. Refactor return statement in lancedb_client for successful state loads 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    fbc558f View commit details
    Browse the repository at this point in the history

  10. Update lancedb_client.py to improve table handling and embedding fields 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    8fbae21 View commit details
    Browse the repository at this point in the history

  11. Refactor LanceDB schema generation and handle metadata for embedding … 

    …functions

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    88bc519 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Merge branch 'refs/heads/devel' into 1370-lancedb-destination

    @Pipboyguy
    Pipboyguy committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    aab21a6 View commit details
    Browse the repository at this point in the history

  2. Refactor schema creation and remove unused code 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    3b85442 View commit details
    Browse the repository at this point in the history

  3. Add mapping for provider environment variables and update schema comment 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    31e1895 View commit details
    Browse the repository at this point in the history

  4. Update package versions in pyproject.toml and poetry.lock 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    9400e02 View commit details
    Browse the repository at this point in the history

  5. Refactor LanceDB utils and client, handle exception and remove unnece… 

    …ssary comment

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    10c41a8 View commit details
    Browse the repository at this point in the history

  6. Refactor utility functions in lancedb tests 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    9ba97a8 View commit details
    Browse the repository at this point in the history

  7. Update 'replace' mode and improve table handling in lancedb client 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    97127a5 View commit details
    Browse the repository at this point in the history

  8. Refactor assert_unordered_list_equal to handle dictionaries 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    b77b6f7 View commit details
    Browse the repository at this point in the history

  9. Refactor code for better readability and remove unnecessary blank lines 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    bc8948e View commit details
    Browse the repository at this point in the history

  10. Refactor code for readability and remove redundant comments 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    c9a1667 View commit details
    Browse the repository at this point in the history

  11. Update sentinel table name in test_pipeline.py 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    84357d7 View commit details
    Browse the repository at this point in the history

  12. "Add order by clause to database query in lancedb_client" 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    a334c98 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. Use super method to reduce redundancy 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    d4b56da View commit details
    Browse the repository at this point in the history

  2. Syntax 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    8f89d38 View commit details
    Browse the repository at this point in the history

  3. Remove bare except clauses 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    3b44631 View commit details
    Browse the repository at this point in the history

  4. Revert "Remove bare except clauses" 

    This reverts commit 3b44631.
    @Pipboyguy
    Pipboyguy committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    ee6f525 View commit details
    Browse the repository at this point in the history

  5. Remove bare except clause 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    d8db465 View commit details
    Browse the repository at this point in the history

  6. Remove bare except clause 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    5aed9e5 View commit details
    Browse the repository at this point in the history

  7. Remove bare except clause 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    cd68966 View commit details
    Browse the repository at this point in the history

  8. Remove bare except clause 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    11f562f View commit details
    Browse the repository at this point in the history

  9. Refactor error handling in LanceDB client 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    06408b9 View commit details
    Browse the repository at this point in the history

  10. Add configurable sentinel table name in LanceDB client configuration 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    cf41859 View commit details
    Browse the repository at this point in the history

  11. Update embedding model config and schema in LanceDB 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    bbc00a5 View commit details
    Browse the repository at this point in the history

  12. Refactor lancedb_client.py, remove unused methods and imports 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    9322477 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2024

  1. Add support for adding multiple fields to LanceDB table in a single o… 

    …peration

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    9b4c519 View commit details
    Browse the repository at this point in the history

  2. Only filter by successful loads 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    71ffaaa View commit details
    Browse the repository at this point in the history

  3. Remove redundant exception handling in JSON extraction 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    9a7c0b5 View commit details
    Browse the repository at this point in the history

  4. Refactor lancedb_client.py for better code readability 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    a854649 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/1370-lancedb-destination' into 1… 

    …370-lancedb-destination

# Conflicts:
#	dlt/destinations/impl/lancedb/lancedb_client.py
    @Pipboyguy
    Pipboyguy committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    2751699 View commit details
    Browse the repository at this point in the history

  6. Refactor lancedb_client.py for improved code readability 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    348825f View commit details
    Browse the repository at this point in the history

  7. Fix module docstring 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    4bfee6d View commit details
    Browse the repository at this point in the history

  8. Remove embedding_fields from make_arrow_field_schema function 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    54ef1ac View commit details
    Browse the repository at this point in the history

  9. Add merge key support 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    a11f0e4 View commit details
    Browse the repository at this point in the history

  10. Refactor get_stored_state to perform join in memory 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    aff0032 View commit details
    Browse the repository at this point in the history

  11. Packaging 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    7c693b8 View commit details
    Browse the repository at this point in the history

  12. Format 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    78cb85d View commit details
    Browse the repository at this point in the history

  13. Update dependencies in GitHub workflow for testing lancedb 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    de23786 View commit details
    Browse the repository at this point in the history

  14. Add "cohere" to package dependencies in pyproject.toml 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    894585c View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2024

  1. Dependencies 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    c228ea3 View commit details
    Browse the repository at this point in the history

  2. Update dependencies installation in GitHub workflow 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    d472e16 View commit details
    Browse the repository at this point in the history

  3. Dependencies 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    ba6d8b8 View commit details
    Browse the repository at this point in the history

  4. Update dependency in GitHub workflow 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    71b7fce View commit details
    Browse the repository at this point in the history

  5. Dependencies 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    b7d1ebf View commit details
    Browse the repository at this point in the history

  6. Dependencies 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    a4f355d View commit details
    Browse the repository at this point in the history

  7. Add documentation for LanceDB 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    a7249b2 View commit details
    Browse the repository at this point in the history

  8. Add limitations 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    1052757 View commit details
    Browse the repository at this point in the history

  9. Offload ordering logic from LanceDB 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    5c7288b View commit details
    Browse the repository at this point in the history

  10. Update import statements in lancedb client and exceptions files 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    554c471 View commit details
    Browse the repository at this point in the history

  11. Create _get_table_name getter 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    3750aae View commit details
    Browse the repository at this point in the history

  12. Format 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    289d679 View commit details
    Browse the repository at this point in the history

  13. Avoid race conditions by delegating all state management to dlt 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    a8e4e62 View commit details
    Browse the repository at this point in the history

  14. Imports 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    b977e5c View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. small doc and test fixes

    @sh-rp
    sh-rp committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    232a84f View commit details
    Browse the repository at this point in the history

  2. Fix OpenAI embedding handling of empty strings 

    Replace empty strings with a placeholder before sending to the OpenAI API, and handle the placeholder as an empty embedding in the results. This avoids BadRequestErrors from the API when empty strings are present in the input data.

Implemented by subclassing OpenAIEmbeddings and overriding sanitize_input and generate_embeddings methods.

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    e08bb8a View commit details
    Browse the repository at this point in the history

  3. Add 'embeddings' dependencies manually 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    a862742 View commit details
    Browse the repository at this point in the history

  4. Finally... 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    c722979 View commit details
    Browse the repository at this point in the history

  5. Dependencies 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    eb16858 View commit details
    Browse the repository at this point in the history

  6. Dependencies 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    d510af1 View commit details
    Browse the repository at this point in the history

  7. Docs 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    15a65c9 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. Remove superfluous helper method. 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    5d42963 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. Merge branch 'refs/heads/devel' into 1370-lancedb-destination 

    # Conflicts:
#	poetry.lock
    @Pipboyguy
    Pipboyguy committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    9e4d8bd View commit details
    Browse the repository at this point in the history

  2. Lock File 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    e07ab1f View commit details
    Browse the repository at this point in the history

  3. Make api_key and embedding_model_provider_api_key optional 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    ec78282 View commit details
    Browse the repository at this point in the history

  4. Clear environment for config test 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    9d3c57d View commit details
    Browse the repository at this point in the history

  5. Minor test config 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    7f08f85 View commit details
    Browse the repository at this point in the history

  6. test config 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    db761e9 View commit details
    Browse the repository at this point in the history

  7. lancedb config 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    e450f47 View commit details
    Browse the repository at this point in the history

  8. Config test 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    44405d7 View commit details
    Browse the repository at this point in the history

  9. Config 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    656a9b7 View commit details
    Browse the repository at this point in the history

  10. config 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    107907a View commit details
    Browse the repository at this point in the history

  11. Import lancedb_adapter function instead of module in adapter collecti… 

    …on module

Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    114e74d View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. Merge branch 'devel' into 1370-lancedb-destination 

    # Conflicts:
#	poetry.lock
    @Pipboyguy
    Pipboyguy committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    433ce28 View commit details
    Browse the repository at this point in the history

  2. Clarify embedding facilities in LanceDB docs 

    Signed-off-by: Marcel Coetzee <[email protected]>
    @Pipboyguy
    Pipboyguy committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    38f9e11 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. Merge branch 'devel' into 1370-lancedb-destination 

    # Conflicts:
#	dlt/destinations/adapters.py
#	poetry.lock
    @sh-rp
    sh-rp committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    a318ccb View commit details
    Browse the repository at this point in the history

  2. update lancedb to support new naming setup (cleanup will follow)

    @sh-rp
    sh-rp committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    19f583d View commit details
    Browse the repository at this point in the history

  3. update lockfile

    @sh-rp
    sh-rp committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    db1e81d View commit details
    Browse the repository at this point in the history