Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run CI here automatically for every new PR to master branch #574

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

frenzymadness
Copy link
Member

Cc: @zmiklank @phracek @pkubatrh

This is what we have here in the settings:

Screenshot from 2022-12-13 15-46-43

So it should be safe because all collaborators from outside our group will need someone inside the group to approve the CI first every time they open a PR. I will test this because I'm working on another PR and I'll also ask somebody from my team to open an external PR to test the workflow approval process.

@frenzymadness
Copy link
Member Author

It seems to work now. Interesting is that it runs all possible combinations but for some of them, it only checks that the respective Dockerfiles aren't present and skips the test. I'm fine with that. What about you?

@zmiklank
Copy link
Contributor

It seems to work now. Interesting is that it runs all possible combinations but for some of them, it only checks that the respective Dockerfiles aren't present and skips the test. I'm fine with that. What about you?

It seems to me that in this pull_request action the PR status is created by default and not by the Testing Farm as a GitHub Action at it was before. That would explain why the statuses are being created even when the TFaGA is not ran. If that is the case we should disable the statuses in TFaGA with disabling update_pull_request_status input and not setting the pull_request_status_name input.

@zmiklank
Copy link
Contributor

I see one problem in getting to the test logs now.
In the original approach you got to the testing farm results by clicking on "Details" button in the Status. Now this button takes you to the GithubActions tab, where is difficult to find the right URL.

@phracek
Copy link
Member

phracek commented Jan 2, 2023

I see one problem in getting to the test logs now.
In the original approach you got to the testing farm results by clicking on "Details" button in the Status. Now this button takes you to the GithubActions tab, where is difficult to find the right URL.

Good catch, this is really mandatory to have logs available under link details. Otherwise, we have to search and memorize what logs have failed and find them in the GitHub Actions tab.

@zmiklank
Copy link
Contributor

zmiklank commented Jan 11, 2023

New testing farm is released, so that failed tests cause failed action and also the summary is available.
I will trigger the tests again to see, how would it look like here.
[test-all]

Edit: this triggered the other suite that I wanted to trigger.

@zmiklank
Copy link
Contributor

Depends on: sclorg/testing-farm-as-github-action#81

@zmiklank
Copy link
Contributor

zmiklank commented Mar 7, 2023

If we want to continue with this new approach we need to move this to use the tfaga-wrapper too. There are no more changes planned for the testing GitHub Actions so if we decide to continue with this PR there is a possibility to start with that now (or later of course).
I think there would need to be some changes made in the wrapper itself. I propose to do that on a separate branch in the wrapper's repository.

Lumir what do you think?

@zmiklank
Copy link
Contributor

zmiklank commented Mar 7, 2023

Moreover, there is still the problem with displaying the result when the TFaGA action is triggered by the pull_request trigger.
The issue exists for that with some examples how we can implement the thing. However it is in the 'nice to have' category :).

@frenzymadness
Copy link
Member Author

I'd like to have that but you know much more than I do about the whole process and configuration. Let me know if there is anything I can do to move this forward. Of course, it's not a top priority.

@zmiklank
Copy link
Contributor

I think we can move the work here: sclorg/testing-farm-as-github-action#139.
And when some safe minimal example of using pull_request / pull_request_target exists in the upstream, we can simply copy it here :).

@phracek
Copy link
Member

phracek commented Oct 1, 2024

@frenzymadness Do we really still need this pull request?

@frenzymadness
Copy link
Member Author

The point is to run CI automatically without the need to add a comment. AFAIK you still need to add one of the comments to run the CI, don't you?

@SlouchyButton
Copy link

without the need to add a comment

Didn't know this was possible with GitHub features only, instead of using comments. Randomly found this PR now because of the recent activity. I'd very much be for implementing this as constant test comments are irrelevant spam both on the PRs itself and in the inbox.

@frenzymadness
Copy link
Member Author

without the need to add a comment

Didn't know this was possible with GitHub features only, instead of using comments. Randomly found this PR now because of the recent activity. I'd very much be for implementing this as constant test comments are irrelevant spam both on the PRs itself and in the inbox.

That's exactly the reason I'd like to have it implemented. PRs in sclorg are mostly from us so having the ability for the CI to start automatically would be great.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants