Skip to content

Commit

Permalink
fix: nightly tests (#1355)
Browse files Browse the repository at this point in the history
* Fix Nightly Tests

This (hopefully) fixes the nightly tests by: (1) no longer supporting
`corset` for checking constraints (since this runs out of memory on
large traces); (2) uploads the test report after `go-corset` has run.
That will then allow us to see what has gone wrong.

* Renable output for failing tests

This re-enables output to be written to the Github action console for
failing tests.  This has been previously disabled for reasons unknown,
but it ends up hiding important information.
  • Loading branch information
DavePearce authored Oct 2, 2024
1 parent 15767e9 commit 3a1bfb0
Show file tree
Hide file tree
Showing 2 changed files with 10 additions and 59 deletions.
65 changes: 8 additions & 57 deletions .github/workflows/gradle-nightly-tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,64 +9,8 @@ env:
CARGO_NET_GIT_FETCH_WITH_CLI: true

jobs:
tests:
nightly-tests:
runs-on: ubuntu-latest-128
steps:
- uses: webfactory/[email protected]
with:
ssh-private-key: |
${{ secrets.CONSTRAINTS_SSH_KEY }}
- name: Checkout repository
uses: actions/checkout@v3
with:
submodules: recursive

- name: Set up JDK 21
uses: actions/setup-java@v3
with:
java-version: 21
distribution: temurin

- name: Install Rust
uses: actions-rust-lang/setup-rust-toolchain@v1

# The asset URL for the latest release can be found with:
# curl -L -H "Accept: application/vnd.github+json" \
# -H "Authorization: Bearer YOUR_GH_API_TOKEN" \
# -H "X-GitHub-Api-Version: 2022-11-28" \
# https://api.github.com/repos/ConsenSys/corset/releases/latest
# | jq '.assets[] | select(.name|endswith("x86_64-unknown-linux-musl.tar.gz")) | .url'
- name: Install Corset
run: RUSTFLAGS=-Awarnings cargo install --git ssh://[email protected]/ConsenSys/corset --tag v9.7.13 --locked --force
# run: |
# curl -L \
# -H "Accept: application/octet-stream" \
# -H "Authorization: Bearer ${{ secrets.GITHUB_TOKEN }}" \
# -H "X-GitHub-Api-Version: 2022-11-28" \
# -o corset.tar.gz \
# https://api.github.com/repos/Consensys/corset/releases/assets/151396061
# tar xzf corset.tar.gz
# mv corset $HOME
# echo $HOME >> $GITHUB_PATH

- name: Run Nightly tests
run: ./gradlew nightlyTests
env:
JAVA_OPTS: -Dorg.gradle.daemon=false
CORSET_FLAGS: fields,expand,expand,expand
NIGHTLY_TESTS_PARALLELISM: 4

- name: Upload test report
if: always()
uses: actions/upload-artifact@v3
with:
name: nightly-tests-report
path: build/reports/tests/**/*

go-corset-tests:
runs-on: ubuntu-latest-128
continue-on-error: true
steps:
- uses: webfactory/[email protected]
with:
Expand Down Expand Up @@ -102,3 +46,10 @@ jobs:
JAVA_OPTS: -Dorg.gradle.daemon=false
CORSET_FLAGS: disable
GOCORSET_FLAGS: -wd --ansi-escapes=false --report --air

- name: Upload test report
if: always()
uses: actions/upload-artifact@v3
with:
name: nightly-tests-report
path: build/reports/tests/**/*
4 changes: 2 additions & 2 deletions gradle/tests.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -98,7 +98,7 @@ tasks.withType(Test).configureEach {
showSkipped false

// set to false to hide failed tests
showFailed false
showFailed true

// enable to see standard out and error streams inline with the test results
showStandardStreams true
Expand All @@ -110,7 +110,7 @@ tasks.withType(Test).configureEach {
showSkippedStandardStreams false

// set to false to hide failed standard out and error streams
showFailedStandardStreams false
showFailedStandardStreams true
}

useJUnitPlatform()
Expand Down

0 comments on commit 3a1bfb0

Please sign in to comment.