Skip to content

Commit

Permalink
[ci] Use parity common runners in all workflows (#5949)
Browse files Browse the repository at this point in the history
  • Loading branch information
alvicsam authored Oct 7, 2024
1 parent e354d66 commit ee0c460
Show file tree
Hide file tree
Showing 4 changed files with 34 additions and 35 deletions.
48 changes: 24 additions & 24 deletions .github/workflows/build-publish-images.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,6 @@ env:
COMMIT_SHA: ${{ github.event.pull_request.head.sha || github.sha }}

jobs:

#
#
#
Expand All @@ -24,7 +23,7 @@ jobs:
if: contains(github.event.label.name, 'GHA-migration') || contains(github.event.pull_request.labels.*.name, 'GHA-migration')
uses: ./.github/workflows/reusable-preflight.yml

### Build ########################
### Build ########################

#
#
Expand Down Expand Up @@ -240,7 +239,7 @@ jobs:
with:
# tldr: we need to checkout the branch HEAD explicitly because of our dynamic versioning approach while building the substrate binary
# see https://github.com/paritytech/ci_cd/issues/682#issuecomment-1340953589
ref: ${{ github.head_ref || github.ref_name }}
ref: ${{ github.head_ref || github.ref_name }}
- name: build
run: |
mkdir -p ./artifacts/substrate/
Expand Down Expand Up @@ -299,14 +298,14 @@ jobs:
path: artifacts.tar
retention-days: 1

### Publish ########################
### Publish ########################

#
#
#
build-push-image-test-parachain:
needs: [preflight, build-test-parachain]
runs-on: arc-runners-polkadot-sdk
runs-on: ${{ needs.preflight.outputs.RUNNER_DEFAULT }}
timeout-minutes: 60
steps:
- name: Checkout
Expand All @@ -330,7 +329,7 @@ jobs:
#
build-push-image-polkadot-debug:
needs: [preflight, build-linux-stable]
runs-on: arc-runners-polkadot-sdk
runs-on: ${{ needs.preflight.outputs.RUNNER_DEFAULT }}
timeout-minutes: 60
steps:
- name: Checkout
Expand All @@ -349,13 +348,12 @@ jobs:
image-name: "europe-docker.pkg.dev/parity-ci-2024/temp-images/polkadot-debug"
dockerfile: "docker/dockerfiles/polkadot/polkadot_injected_debug.Dockerfile"


#
#
#
build-push-image-colander:
needs: [preflight, build-test-collators]
runs-on: arc-runners-polkadot-sdk
runs-on: ${{ needs.preflight.outputs.RUNNER_DEFAULT }}
timeout-minutes: 60
steps:
- name: Checkout
Expand All @@ -374,13 +372,12 @@ jobs:
image-name: "europe-docker.pkg.dev/parity-ci-2024/temp-images/colander"
dockerfile: "docker/dockerfiles/collator_injected.Dockerfile"


#
#
#
build-push-image-malus:
needs: [preflight, build-malus]
runs-on: arc-runners-polkadot-sdk
runs-on: ${{ needs.preflight.outputs.RUNNER_DEFAULT }}
timeout-minutes: 60
steps:
- name: Checkout
Expand All @@ -399,13 +396,12 @@ jobs:
image-name: "europe-docker.pkg.dev/parity-ci-2024/temp-images/malus"
dockerfile: "docker/dockerfiles/malus_injected.Dockerfile"


#
#
#
build-push-image-substrate-pr:
needs: [preflight, build-linux-substrate]
runs-on: arc-runners-polkadot-sdk
runs-on: ${{ needs.preflight.outputs.RUNNER_DEFAULT }}
timeout-minutes: 60
steps:
- name: Checkout
Expand All @@ -424,15 +420,20 @@ jobs:
image-name: "europe-docker.pkg.dev/parity-ci-2024/temp-images/substrate"
dockerfile: "docker/dockerfiles/substrate_injected.Dockerfile"


#
#
#
# unlike other images, bridges+zombienet image is based on Zombienet image that pulls required binaries
# from other fresh images (polkadot and cumulus)
build-push-image-bridges-zombienet-tests:
needs: [preflight, build-linux-stable, build-linux-stable-cumulus, prepare-bridges-zombienet-artifacts]
runs-on: arc-runners-polkadot-sdk
needs:
[
preflight,
build-linux-stable,
build-linux-stable-cumulus,
prepare-bridges-zombienet-artifacts,
]
runs-on: ${{ needs.preflight.outputs.RUNNER_DEFAULT }}
timeout-minutes: 60
steps:
- name: Checkout
Expand All @@ -443,38 +444,37 @@ jobs:
name: build-linux-stable-${{ needs.preflight.outputs.SOURCE_REF_NAME }}
- name: tar
run: |
tar -xvf artifacts.tar
rm artifacts.tar
tar -xvf artifacts.tar
rm artifacts.tar
- uses: actions/[email protected]
with:
name: build-linux-stable-cumulus-${{ needs.preflight.outputs.SOURCE_REF_NAME }}
- name: tar
run: |
tar -xvf artifacts.tar
rm artifacts.tar
tar -xvf artifacts.tar
rm artifacts.tar
- uses: actions/[email protected]
with:
name: prepare-bridges-zombienet-artifacts-${{ needs.preflight.outputs.SOURCE_REF_NAME }}
- name: tar
run: |
tar -xvf artifacts.tar
rm artifacts.tar
tar -xvf artifacts.tar
rm artifacts.tar
- name: build and push image
uses: ./.github/actions/build-push-image
with:
image-name: "europe-docker.pkg.dev/parity-ci-2024/temp-images/bridges-zombienet-tests"
dockerfile: "docker/dockerfiles/bridges_zombienet_tests_injected.Dockerfile"


#
#
#
build-push-image-polkadot-parachain-debug:
needs: [preflight, build-linux-stable-cumulus]
runs-on: arc-runners-polkadot-sdk
runs-on: ${{ needs.preflight.outputs.RUNNER_DEFAULT }}
timeout-minutes: 60
steps:
- name: Checkout
Expand All @@ -491,4 +491,4 @@ jobs:
uses: ./.github/actions/build-push-image
with:
image-name: "europe-docker.pkg.dev/parity-ci-2024/temp-images/polkadot-parachain-debug"
dockerfile: "docker/dockerfiles/polkadot-parachain/polkadot-parachain-debug_unsigned_injected.Dockerfile"
dockerfile: "docker/dockerfiles/polkadot-parachain/polkadot-parachain-debug_unsigned_injected.Dockerfile"
18 changes: 9 additions & 9 deletions .github/workflows/check-getting-started.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ name: Check the getting-started.sh script
#
# There are two jobs inside.
# One for systems that can run in a docker container, and one for macOS.
#
#
# Each job consists of:
# 1. Some necessary prerequisites for the workflow itself.
# 2. A first pass of the script, which will install dependencies and clone a template.
Expand All @@ -24,10 +24,10 @@ name: Check the getting-started.sh script
on:
pull_request:
paths:
- '.github/workflows/check-getting-started.yml'
- 'scripts/getting-started.sh'
- ".github/workflows/check-getting-started.yml"
- "scripts/getting-started.sh"
schedule:
- cron: '0 5 * * *'
- cron: "0 5 * * *"
workflow_dispatch:

concurrency:
Expand Down Expand Up @@ -60,7 +60,7 @@ jobs:
container: opensuse/tumbleweed
template: solochain
shell: sh
runs-on: arc-runners-polkadot-sdk-beefy
runs-on: parity-large
container: ${{ matrix.container }}:latest
steps:
# A minimal amount of prerequisites required before we can run the actual getting-started script,
Expand Down Expand Up @@ -116,7 +116,7 @@ jobs:
expect "start with one of the templates" {
send "y\r"
}
expect -re "(.)\\) ${{ matrix.template }} template" {
send "$expect_out(1,string)\r"
}
Expand Down Expand Up @@ -150,7 +150,7 @@ jobs:
expect "start with one of the templates" {
send "y\r"
}
expect -re "(.)\\) ${{ matrix.template }} template" {
send "$expect_out(1,string)\r"
expect "directory already exists" {}
Expand Down Expand Up @@ -227,7 +227,7 @@ jobs:
expect "start with one of the templates" {
send "y\r"
}
expect -re "(.)\\) ${{ matrix.template }} template" {
send "$expect_out(1,string)\r"
}
Expand Down Expand Up @@ -267,7 +267,7 @@ jobs:
expect "start with one of the templates" {
send "y\r"
}
expect -re "(.)\\) ${{ matrix.template }} template" {
send "$expect_out(1,string)\r"
expect "directory already exists" {}
Expand Down
1 change: 0 additions & 1 deletion .github/workflows/tests-misc.yml
Original file line number Diff line number Diff line change
Expand Up @@ -157,7 +157,6 @@ jobs:
node-bench-regression-guard:
timeout-minutes: 20
if: always() && !cancelled()
# runs-on: arc-runners-polkadot-sdk
runs-on: ubuntu-latest
needs: [preflight, cargo-check-benches]
steps:
Expand Down
2 changes: 1 addition & 1 deletion docs/contributor/weight-generation.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
To generate weights for a runtime.
Weights generation is using self-hosted runner which is provided by Parity CI, the rest commands are using standard
GitHub runners on `ubuntu-latest` or `ubuntu-20.04`.
Self-hosted runner for benchmarks (arc-runners-Polkadot-sdk-benchmark) is configured to meet requirements of reference
Self-hosted runner for benchmarks (`parity-weights`) is configured to meet requirements of reference
hardware for running validators
https://wiki.polkadot.network/docs/maintain-guides-how-to-validate-polkadot#reference-hardware

Expand Down

0 comments on commit ee0c460

Please sign in to comment.