Skip to content

Docker image or standalone script to block/queue jobs to ensure max concurrency limits

License

Notifications You must be signed in to change notification settings

microbit-matt-hillsdon/circleci-queue

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

86 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CircleCI Concurrency Control Orb

CircleCI Orb to limit workflow concurrency.

Why? Some jobs (typically deployments) need to run sequentially and not parallel, but also run to completion. So CircleCI's native auto-cancel is not quite the right fit. See https://github.com/eddiewebb/circleci-challenge as an example using blue/green cloud foundry deployments.

CircleCI

Basic Usage

This adds concurrency limits by ensuring any jobs with this step will only continue once no previous builds are running. It supports a single argument of how many minutes to wait before aborting itself and it requires a single Environment Variable CIRCLECI_API_KEY - which can be created in account settings.

Screenshots / Examples

Suppose we have a workflow take takes a little while to run. Normally the build (#18) will run immediately, with no queuing. no queuing if only active build

Someone else on the team makes another commit, since the first build (#18) is still running, it will queue build #19. no queuing if only active build

It's late afternoon, everyone is pushing their commits in to ensure they are good before they leave for the day. Build #20 also queues. no queuing if only active build

Meanwhile, build #19 is now allowed to move forward since build #18 finished.

no queuing if only active build

Oh No! Since 1 minute is abnormally long for things to be queued, build #20 aborts itself, letting build #19 finish uninterrupted.

no queuing if only active build

Setup

version: 2.1
  orbs:
    queue: eddiewebb/queue@volatile

jobs:
  some-job:
    docker:
      - image: eddiewebb/circleci-queue:latest
    steps:
      - queue/until_front_of_line:
          time: 10                # max wait, in minutes (default 10)
          consider-job: true      # only block for this job or any running builds in this project?
          consider-branch: true   # only block of running job is on same branch (default true)
          dont-quit: true         # If max-time is exceeded, this option will allow the build to proceed.
          only-on-branch: master  # restrict queueing to a specific branch (default *)

      - checkout
      - ...   #your commands

Note

Queueing is not supported on forked repos. If a queue from a fork happens the queue will immediately exit and the next step of the job will begin.

About

Docker image or standalone script to block/queue jobs to ensure max concurrency limits

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Shell 100.0%