Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add matrix testing #2803

Draft
wants to merge 3 commits into
base: e2e-tests
Choose a base branch
from
Draft

Add matrix testing #2803

wants to merge 3 commits into from

Conversation

danielrbradley
Copy link
Member

@danielrbradley danielrbradley commented Oct 4, 2023

Can be run locally by using PROVIDER_TEST_TAGS=all make test_provider.

Structures tests as:

  • TestStorageBlob/
    • yaml
    • typescript
    • python
    • csharp
    • go

Tests can opt-out of specific languages e.g. if their conversion fails, using SkipMatrixLanguages.

Learnings from this spike:

  1. We should just add the StartProvider callback to the existing github.com/pulumi/pulumi/pkg/v3/testing/integration module.
  2. The temp dir is not exposed by the existing framework, making it impossible to perform only select sub-steps. We should expose more of this and make the individual program test steps easier to call directly.

Can be run locally by using `PULUMI_MATRIX_TEST_LANGUAGES=typescript,dotnet PROVIDER_TEST_TAGS=all make test_provider`
@danielrbradley danielrbradley self-assigned this Oct 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant