Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

./backend.ai test run-cli command returns exit code 0 even on failure #2666

Open
why-arong opened this issue Aug 7, 2024 · 0 comments
Open
Assignees
Labels
type:bug Reports about that are not working

Comments

@why-arong
Copy link
Contributor

What Operating System(s) are you seeing this problem on?

Linux (x86-64)

Backend.AI version

24.09

Describe the bug

While investigating why our integration tests in a GitHub Action workflow were not failing as expected,
I discovered that the ./backend.ai test run-cli command returns an exit code of 0 even when it encounters a failure.

This behavior is misleading because it causes CI/CD pipelines to treat failing tests as successful, leading to false positives.

To Reproduce

  1. Run the ./backend.ai test run-cli admin
  2. Check the exit code immediately after the command finishes using echo $?

Expected Behavior

The command should return a non-zero exit code if it encounters any errors during execution.

Anything else?

No response

@why-arong why-arong added the type:bug Reports about that are not working label Aug 7, 2024
@why-arong why-arong changed the title ./backend.ai test run-cli command returns exit code 0 even on failure ./backend.ai test run-cli command returns exit code 0 even on failure Aug 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type:bug Reports about that are not working
Projects
None yet
Development

No branches or pull requests

2 participants