Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: ensure all defined performance tests compile and run #732

Closed
wants to merge 10 commits into from

Conversation

ghost
Copy link

@ghost ghost commented Sep 27, 2023

Overview

This PR fixes all perforrmance tests currently part of the k6 code base. Previously - some didn't work due to issues with the json() serialisation function and there was inconsitency in scenarios and thresholds.
Now - all tests run and pass on a local testing stack (will commit this in a future PR) and use the same defaults for a smoke test

Checklist

My PR contains...

  • No code changes (changes to documentation, CI, metadata, etc.)
  • Bug fixes (non-breaking change which fixes an issue)
  • Improvements (misc. changes to existing features)
  • Features (non-breaking change which adds functionality)

My changes...

  • are breaking changes
  • are not breaking changes
  • If yes to above: I have updated the documentation accordingly

Documentation

  • My changes do not require a change to the project documentation
  • My changes require a change to the project documentation
  • If yes to above: I have updated the documentation accordingly

Tests

  • My changes can not or do not need to be tested
  • My changes can and should be tested by unit and/or integration tests
  • If yes to above: I have added tests to cover my changes
  • If yes to above: I have taken care to cover edge cases in my tests

@ghost ghost requested a review from antonbaliasnikov as a code owner September 27, 2023 15:34
@atala-dev atala-dev added the ci label Sep 27, 2023
@github-actions
Copy link
Contributor

github-actions bot commented Sep 27, 2023

Atala PRISM Test Results

  77 files  ±0    77 suites  ±0   15m 1s ⏱️ -1s
672 tests ±0  661 ✔️ ±0  11 💤 ±0  0 ±0 
678 runs  ±0  667 ✔️ ±0  11 💤 ±0  0 ±0 

Results for commit 15a1c7d. ± Comparison against base commit 77b3588.

♻️ This comment has been updated with latest results.

@ghost ghost force-pushed the feature/running-local-performance-tests-squashed branch from 23e1f2a to 325236f Compare September 27, 2023 15:51
@github-actions
Copy link
Contributor

github-actions bot commented Sep 27, 2023

Integration Test Results

11 files  ±0  11 suites  ±0   3s ⏱️ -1s
25 tests ±0  25 ✔️ ±0  0 💤 ±0  0 ±0 
37 runs  ±0  37 ✔️ ±0  0 💤 ±0  0 ±0 

Results for commit 15a1c7d. ± Comparison against base commit 77b3588.

♻️ This comment has been updated with latest results.

@ghost ghost force-pushed the feature/running-local-performance-tests-squashed branch from 9737693 to 406855d Compare September 29, 2023 15:07
with:
cmd: webpack
dir: ${{ env.BENCHMARKING_DIR }}

- name: Connection Flow Smoke Test
- name: All Smoke Tests
env:
ISSUER_AGENT_API_KEY: default
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@davidpoltorak-io, you need to make the length of the key at least 16 bytes. I will not work with the current Agent with default value.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @yshyn-iohk - I've been struggling to get this branch ready for merging - between performance thresholds being passed and some failed runs - this really helps - I'll make the change and retest

@ghost
Copy link
Author

ghost commented Oct 9, 2023

Deprecating this PR in favour of https://github.com/hyperledger-labs/open-enterprise-agent/pull/750/files which includes a one command test everything locally

@ghost ghost closed this Oct 9, 2023
@ghost ghost deleted the feature/running-local-performance-tests-squashed branch October 9, 2023 12:14
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants