Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

incremental scd2 with merge_key #1818

Merged
merged 19 commits into from
Sep 29, 2024
Merged

incremental scd2 with merge_key #1818

merged 19 commits into from
Sep 29, 2024
+462 −136

Commits on Sep 16, 2024

  1. remove unused imports

    @jorritsandbrink
    jorritsandbrink committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    a3a29ac View commit details
    Browse the repository at this point in the history

  2. add scd2 retire_if_absent option

    @jorritsandbrink
    jorritsandbrink committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    aa62983 View commit details
    Browse the repository at this point in the history

  3. rewrite scd2 retire logic

    @jorritsandbrink
    jorritsandbrink committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    bcbd0c7 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. include new keys in typing

    @jorritsandbrink
    jorritsandbrink committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    70d036d View commit details
    Browse the repository at this point in the history

  2. finetune scd2 typing

    @jorritsandbrink
    jorritsandbrink committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    5cfc5c8 View commit details
    Browse the repository at this point in the history

  3. update typeddict validation test

    @jorritsandbrink
    jorritsandbrink committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    54dfe14 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. rename to retire_absent_rows

    @jorritsandbrink
    jorritsandbrink committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    c28f8ba View commit details
    Browse the repository at this point in the history

  2. add reinsert test case

    @jorritsandbrink
    jorritsandbrink committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    7d1aad9 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. replace natural_key with merge_key

    @jorritsandbrink
    jorritsandbrink committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    a0aa99c View commit details
    Browse the repository at this point in the history

  2. rewrite natural key presence check

    @jorritsandbrink
    jorritsandbrink committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    65838e4 View commit details
    Browse the repository at this point in the history

  3. simplify scd2 test and remove redundancy

    @jorritsandbrink
    jorritsandbrink committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    16e52cd View commit details
    Browse the repository at this point in the history

  4. set constants once

    @jorritsandbrink
    jorritsandbrink committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    c826afc View commit details
    Browse the repository at this point in the history

  5. document incremental scd2

    @jorritsandbrink
    jorritsandbrink committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    ae7cd00 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'devel' of https://github.com/dlt-hub/dlt into feat/1789… 

    …-scd2-incremental
    @jorritsandbrink
    jorritsandbrink committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    5888a07 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. remove natural_key remnants

    @jorritsandbrink
    jorritsandbrink committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    8ecf7c6 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. remove retire_absent_rows flag

    @jorritsandbrink
    jorritsandbrink committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    1035ffa View commit details
    Browse the repository at this point in the history

  2. add scd2 merge key partition test

    @jorritsandbrink
    jorritsandbrink committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    c5be436 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2024

  1. fix typos

    @jorritsandbrink
    jorritsandbrink committed Sep 28, 2024
    Configuration menu
    Copy the full SHA
    21ce4f8 View commit details
    Browse the repository at this point in the history

  2. update incremental scd2 docs

    @jorritsandbrink
    jorritsandbrink committed Sep 28, 2024
    Configuration menu
    Copy the full SHA
    84c101b View commit details
    Browse the repository at this point in the history