Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support to run dbt Python models #375

Merged
merged 12 commits into from
Jul 23, 2023
Merged

Add support to run dbt Python models #375

merged 12 commits into from
Jul 23, 2023

Commits on Jul 23, 2023

  1. Copy original jaffle shop example using: 

    cp dev/dags/basic_cosmos_dag.py dev/dags/example_cosmos_python_models.py
cp -r dev/dags/dbt/jaffle_shop  dev/dags/dbt/jaffle_shop_python
    @tatiana
    tatiana committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    99b9446 View commit details
    Browse the repository at this point in the history

  2. Add support to Python models when using LoadMode.DBT_LS 

    Relates to: #182
    @tatiana
    tatiana committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    5e697f0 View commit details
    Browse the repository at this point in the history

  3. Fix issues with load_mode=LoadMode.CUSTOM

    @tatiana
    tatiana committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    625d9ac View commit details
    Browse the repository at this point in the history

  4. Add tests and fix issue in LoadMode.CUSTOM

    @tatiana
    tatiana committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    bc1f7ee View commit details
    Browse the repository at this point in the history

  5. Add misisng manifest_py file

    @tatiana
    tatiana committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    a24d269 View commit details
    Browse the repository at this point in the history

  6. Add databricks dependency to run integration tests

    @tatiana
    tatiana committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    75e856b View commit details
    Browse the repository at this point in the history

  7. Expose databricks envvars in the CI integration tests

    @tatiana
    tatiana committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    67e2929 View commit details
    Browse the repository at this point in the history

  8. Solve issue of running concurrently integration tests on databricks

    @tatiana
    tatiana committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    3d020f6 View commit details
    Browse the repository at this point in the history

  9. Add missing part to fix CI

    @tatiana
    tatiana committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    e45c08b View commit details
    Browse the repository at this point in the history

  10. Make databricks schema valid

    @tatiana
    tatiana committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    708ecff View commit details
    Browse the repository at this point in the history

  11. Try to fix CI isuse runnning databricks

    @tatiana
    tatiana committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    a052523 View commit details
    Browse the repository at this point in the history

  12. Change integration tests selector

    @tatiana
    tatiana committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    dc71269 View commit details
    Browse the repository at this point in the history