-
Notifications
You must be signed in to change notification settings - Fork 168
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Dummy PR to trigger CI #2938
Dummy PR to trigger CI #2938
Commits on Jun 12, 2024
-
Update ufs-weather-model (NOAA-EMC#2663)
Updates ufs-weather-model, this updates RDHPCS to the newer spack-stack allowing some temporary fixes to be reverted. * removes upp submodule * uses upp from the ufs-weather-model * restores the build and link that were hacked during the Hera Rocky 8 transition to allow for UPP submodule * Removes forecast directories in clean-up Resolves NOAA-EMC#2617 Resolves NOAA-EMC#2437 --------- Co-authored-by: Rahul Mahajan <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 61de004 - Browse repository at this point
Copy the full SHA 61de004View commit details -
Link both global-nest fix files and non-nest ones at the same time (N…
…OAA-EMC#2632) This PR enables linking both global-nest fix files and non-nest ones at the same time and users can run both nesting and non-nesting experiments at the same time without worries about what fix files to be linked. Resolves NOAA-EMC#2631
Configuration menu - View commit details
-
Copy full SHA for 2e6f1fc - Browse repository at this point
Copy the full SHA 2e6f1fcView commit details -
Add COM template for JEDI obs (NOAA-EMC#2678)
Adds a COM template to define a path to store obs processed for JEDI. This will allow UFSDA to stop writing to COM_OBS, which should be read-only as it belongs to obsproc in operations. No functional change yet.
Configuration menu - View commit details
-
Copy full SHA for 5b2a3d4 - Browse repository at this point
Copy the full SHA 5b2a3d4View commit details
Commits on Jun 13, 2024
-
Replace
sleep
withwait_for_file
(NOAA-EMC#2586)This PR addresses issue NOAA-EMC#2444. The following is accomplished: - All `sleep` statements are replaced with `wait_for_file` for the relevant scripts beneath `scripts` and `ush`; - Indentation and shell-norms are updated where applicable. Note: The WAFS scripts are not updated as per @aerorahul direction. Resolves NOAA-EMC#2444 --------- Co-authored-by: henrywinterbottom-wxdev <[email protected]> Co-authored-by: Walter Kolczynski - NOAA <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 6c19a0e - Browse repository at this point
Copy the full SHA 6c19a0eView commit details -
Add ability to use GEFS replay ICs (NOAA-EMC#2559)
The PR allows the use of ICs from PSL's replay analysis. These replay ICs will be used for GEFS reforecasting and SFS. Two main changes are associated with these updates: (1) replay ICs being valid at 3Z, and (2) the use of warm starts. Resolves NOAA-EMC#1838 --------- Co-authored-by: Jessica Meixner <[email protected]> Co-authored-by: Walter Kolczynski - NOAA <[email protected]> Co-authored-by: Rahul Mahajan <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 34155fb - Browse repository at this point
Copy the full SHA 34155fbView commit details -
Update gdas.cd and gsi_utils hashes (NOAA-EMC#2641)
This PR updates the `sorc/gdas.cd` and `sorc/gsi_utils` hashes. The updated hashes bring in bug fixes, new UFS DA functionality, and a Gaea build for gsi_utils. Resolves NOAA-EMC#2640
Configuration menu - View commit details
-
Copy full SHA for ebacebf - Browse repository at this point
Copy the full SHA ebacebfView commit details -
Add Hercules-EMC to the Jenkins configurable parameter list (NOAA-EMC…
…#2685) This quick-fix PR is to update the Jenkins Pipeline's configurable parameter list to include the **Hercules-EMC** node. This allows Jenkins users to restart Jobs in the controller when no updates have been made.
Configuration menu - View commit details
-
Copy full SHA for dc21eac - Browse repository at this point
Copy the full SHA dc21eacView commit details -
Configuration menu - View commit details
-
Copy full SHA for 603a4a8 - Browse repository at this point
Copy the full SHA 603a4a8View commit details
Commits on Jun 14, 2024
-
Remove ocean daily files (NOAA-EMC#2689)
This PR removes the ocn_daily files that are produced by the ocean component. These files can be recreated by averaging data that exists in the 6 hour aveaged files if needed. Fixes NOAA-EMC#2675 Fixes NOAA-EMC#2659 (by removing them and making this obsolete)
Configuration menu - View commit details
-
Copy full SHA for 5a5fc2b - Browse repository at this point
Copy the full SHA 5a5fc2bView commit details -
Add observation preparation job for aerosols DA to workflow (NOAA-EMC…
…#2624) Add a prepaeroobs job to prepare aerosol obs files for DA. This job does quality control of the VIIRS aerosol raw observations and convert them to ioda format. Resolves NOAA-EMC#2623 --------- Co-authored-by: ypwang19 <[email protected]> Co-authored-by: TerrenceMcGuinness-NOAA <[email protected]> Co-authored-by: Cory Martin <[email protected]> Co-authored-by: David Huber <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 6c93b45 - Browse repository at this point
Copy the full SHA 6c93b45View commit details -
Update GDASapp hash to move JCB into GDASapp (NOAA-EMC#2665)
This PR moves JCB into GDASapp. The PR also bumps up the hash of GDASapp to what is in `feature/move_jcb`, which at time of writing is develop plus the absorption of JCB into GDASapp. Note that I also took the changes from NOAA-EMC#2641 to follow the testing @RussTreadon-NOAA has done.
Configuration menu - View commit details
-
Copy full SHA for 5af325a - Browse repository at this point
Copy the full SHA 5af325aView commit details
Commits on Jun 17, 2024
-
Optimize wavepostpnt (NOAA-EMC#2657)
Optimize the gfswavepostpnt, gfswavepostbndpntbll, and gfswavepostbndpnt jobs This is done by 1) reducing the number of calls to `sed`, `awk`, `grep`, and `cat` by - performing operations on all files at once instead of looping over each file - removing piped `cat` calls (e.g. `cat <file> | sed 'something'`) - combining `sed` and `grep` calls when possible - adding logic to `awk` calls instead of handling that logic in bash 2) minimizing as much as possible the amount of data on disk that has to be read in (e.g. limiting sed to read only the line numbers it needs) --------- Co-authored-by: Walter Kolczynski - NOAA <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 38f2df9 - Browse repository at this point
Copy the full SHA 38f2df9View commit details
Commits on Jun 18, 2024
-
Turn on high-frequency output in extended test (NOAA-EMC#2679)
Turns on high-frequency (hourly) output in the extended products test to exercise that aspect of the code. This test only runs on WCOSS. Also adds the hooks to optionally turn on the metplus jobs, but that is deferred as they are not currently working correctly.
Configuration menu - View commit details
-
Copy full SHA for 47b3a58 - Browse repository at this point
Copy the full SHA 47b3a58View commit details -
Update archive job to use COMIN/COMOUT (NOAA-EMC#2668)
NCO has requested that each COM variable specify whether it is an input or an output. This completes that process for the global-workflow archive task. Refs NOAA-EMC#2451 --------- Co-authored-by: Walter Kolczynski - NOAA <[email protected]> Co-authored-by: Rahul Mahajan <[email protected]> Co-authored-by: David Huber <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 35d4d99 - Browse repository at this point
Copy the full SHA 35d4d99View commit details -
Hotfix for bug in template names. (NOAA-EMC#2697)
This PR is a hotfix for an incorrectly named (e.g., non-existent) `COM/` template. Resolves NOAA-EMC#2696 Refs NOAA-EMC#2451
Configuration menu - View commit details
-
Copy full SHA for 3270ac3 - Browse repository at this point
Copy the full SHA 3270ac3View commit details
Commits on Jun 19, 2024
-
Removes misleading "No such file or directory" syntax errors from out…
…put files (NOAA-EMC#2688) This PR addresses issue NOAA-EMC#1252. The following is accomplished: - Prior to removing files, the existence of a file is checked prior to attempting to remove; this is performed as noted [here](NOAA-EMC#1252 (comment)); this PR only addresses the the `chgrp` issue. Refs NOAA-EMC#1252 --------- Co-authored-by: David Huber <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 0b810c8 - Browse repository at this point
Copy the full SHA 0b810c8View commit details
Commits on Jun 20, 2024
-
Eliminate post groups (NOAA-EMC#2667)
Eliminates the post groups used for upp and products jobs so that each task only processes one forecast hour. This is more efficient and greatly simplifies downstream dependencies that depend on a specific forecast hour. Resolves NOAA-EMC#2666 Refs NOAA-EMC#2642
Configuration menu - View commit details
-
Copy full SHA for 8993b42 - Browse repository at this point
Copy the full SHA 8993b42View commit details
Commits on Jun 21, 2024
-
Fix and simplify online archiving and reenable METplus jobs (NOAA-EMC…
…#2687) This fixes the online archiving portion of the `*arch` and `*earc00` jobs, a prerequisite for running METplus. This also reenables METplus by default. The approach previously taken created `FileHandler` dictionaries at varying levels within the resulting yaml, which was not properly parsed by `exglobal_archive.py`. This approach creates a single `FileHandler` dictionary and is much less complicated overall. Resolves NOAA-EMC#2673 NOAA-EMC#2647
Configuration menu - View commit details
-
Copy full SHA for f43a862 - Browse repository at this point
Copy the full SHA f43a862View commit details
Commits on Jun 24, 2024
-
Add minimum software requirements (NOAA-EMC#2712)
Adds a table to HPC documentation stating the minimum support versions
Configuration menu - View commit details
-
Copy full SHA for 4e1b937 - Browse repository at this point
Copy the full SHA 4e1b937View commit details
Commits on Jun 25, 2024
-
Assign machine- and RUN-specific resources (NOAA-EMC#2672)
Redefine resource variables based explicitly on RUN or CDUMP Additionally, machine-specific resources are moved out of config.resources and placed in respective config.resources.{machine} files. Resolves NOAA-EMC#177 NOAA-EMC#2672
Configuration menu - View commit details
-
Copy full SHA for b902c0b - Browse repository at this point
Copy the full SHA b902c0bView commit details
Commits on Jun 26, 2024
-
Update wave jobs to use COMIN/COMOUT (NOAA-EMC#2643)
NCO has requested that each COM variable specify whether it is an input or an output. This completes that process for the global-workflow wave model and products tasks. Refs NOAA-EMC#2451
Configuration menu - View commit details
-
Copy full SHA for 12431f7 - Browse repository at this point
Copy the full SHA 12431f7View commit details -
Update logic for MOM6 number of layers/exception values (NOAA-EMC#2681)
Updates the logic to be by run instead of for DO_JEDIOCNVAR to determine how many layers and sets the exception value for MOM6 to be 1e-34 for all scenarios. Note, we will no longer have zeros in the ocean grib output and the DA will also run without issues. Fixes NOAA-EMC#2615
Configuration menu - View commit details
-
Copy full SHA for 8962991 - Browse repository at this point
Copy the full SHA 8962991View commit details -
Cleanup of stale RUNDIRS from an experiment (NOAA-EMC#2719)
This PR: - removes stale temporary scratch run directories from `$DATAROOT/` every 3 days. - should help to scrub failed attempts. - removes an unused variable `RUNDIR` defined in `config.base`
Configuration menu - View commit details
-
Copy full SHA for 7706760 - Browse repository at this point
Copy the full SHA 7706760View commit details -
Activate snow DA test on WCOSS (NOAA-EMC#2720)
Activate the snow DA test on WCOSS.
Configuration menu - View commit details
-
Copy full SHA for 968568f - Browse repository at this point
Copy the full SHA 968568fView commit details -
updated Finalize in Jenkinsfile and added try block around scm checko…
…ut (NOAA-EMC#2692) We are updating the Jenkins Pipeline with a try block around checkout to capture errors for the user. Also cleaned up Finalize and added section to clean out workspace on success.
Configuration menu - View commit details
-
Copy full SHA for 9476c12 - Browse repository at this point
Copy the full SHA 9476c12View commit details
Commits on Jun 28, 2024
-
Revert PR 2681 (NOAA-EMC#2739)
This PR: - reverts NOAA-EMC#2681 in part - keeps some changes for `RUN`. - is a hotfix - should be merged ASAP after consensus w/ @guillaumevernieres @CatherineThomas-NOAA @WalterKolczynski-NOAA
Configuration menu - View commit details
-
Copy full SHA for c49e4ee - Browse repository at this point
Copy the full SHA c49e4eeView commit details
Commits on Jul 1, 2024
-
Update for JCB policies and stage DA job files with Jinja2-templates (N…
…OAA-EMC#2700) This PR updates the `gdas.cd` hash to bring in new JCB conventions. Resolves NOAA-EMC#2699 From NOAA-EMC#2654 This PR will move much of the staging code that take place in the python initialization subroutines of the variational and ensemble DA jobs into Jinja2-templated YAML files to be passed into the wxflow file handler. Much of the staging has already been done this way, but this PR simply expands that strategy. The old Python routines that were doing this staging are now removed. This is part of a broader refactoring of the pygfs tasking. wxflow PR [NOAA-EMC#30](NOAA-EMC/wxflow#30) is a companion to this PR. Co-authored-by: danholdaway <[email protected]> Co-authored-by: DavidNew-NOAA <[email protected]> Co-authored-by: DavidNew-NOAA <[email protected]> Co-authored-by: Dan Holdaway <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for de87067 - Browse repository at this point
Copy the full SHA de87067View commit details
Commits on Jul 2, 2024
-
Fix xml file setup and complete C48 ATM and S2SW runs for CI on Gaea (N…
…OAA-EMC#2701) This PR sets up the ability on Gaea for auto generation of a clean xml file, i.e., an xml file that does not need any alterations before running rocoto. Refs NOAA-EMC#2572 Refs NOAA-EMC#2664
Configuration menu - View commit details
-
Copy full SHA for 11943e3 - Browse repository at this point
Copy the full SHA 11943e3View commit details -
Hotfix for clusters from NOAA-EMC#2701 (NOAA-EMC#2747)
Fixes an issue created from NOAA-EMC#2701 that added `CLUSTERS` to the `gaea.yaml`.
Configuration menu - View commit details
-
Copy full SHA for 8215ae6 - Browse repository at this point
Copy the full SHA 8215ae6View commit details
Commits on Jul 3, 2024
-
Update gempak job to run one fcst hour per task (NOAA-EMC#2671)
This PR updates gempak jobs (gfs, gdas, and goes) from processing all forecast hours at once to one forecast hour at a time. This will reduce the job runtime to less than 5 min, so restart capability is not needed. Resolves NOAA-EMC#1250 Ref NOAA-EMC#2666 NOAA-EMC#2667 --------- Co-authored-by: Walter.Kolczynski <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 7dc6651 - Browse repository at this point
Copy the full SHA 7dc6651View commit details -
Hotfix for undefined CLUSTERS (NOAA-EMC#2748)
Defines `CLUSTERS` as an empty string for all hosts except Gaea and uses the native `dict` `get` method to prevent grabbing an unset entry.
Configuration menu - View commit details
-
Copy full SHA for 2bd106a - Browse repository at this point
Copy the full SHA 2bd106aView commit details
Commits on Jul 4, 2024
-
Update ufs model hash to 20240625 (NOAA-EMC#2729)
Updates UFS weather model hash to hash from 2024-06-24 which has orion porting updates + a few namelist updates.
Configuration menu - View commit details
-
Copy full SHA for d65d3d2 - Browse repository at this point
Copy the full SHA d65d3d2View commit details
Commits on Jul 5, 2024
-
Update (partially) global-workflow for orion+rocky9 (NOAA-EMC#2741)
This PR: - updates a few submodules (GSI, GSI-utils, GSI-monitor, UFS_utils, GFS-utils) to include recent update to their modulefiles for Orion+Rocky9 upgrade - updates the modulefiles in global-workflow to load modules from Orion+Rocky9 paths - updates modulefiles for `gwsetup` and `gwci` as well. - removes NCL and GEMPAK from Orion. NCL is not used and GEMPAK is not installed. - adds `parm/config.gfs/config.resources.ORION` to address GSI performance degradation after Rocky 9 upgrade. This PR: - does not update the build for UPP. Standalone UPP is not available via ufs-weather-model as of NOAA-EMC#2729 - will need a follow-up update for `prepobs` and `fit2obs` updated locations when they are installed in `glopara` space on Orion. # Type of change - Maintenance (code refactor, clean-up, new CI test, etc.) # Change characteristics - Is this a breaking change (a change in existing functionality)? NO - Does this change require a documentation update? NO # How has this been tested? This PR is not sufficient for Orion. This PR must be tested on other platforms (Hera, WCOSS2) as this PR updates submodules. # Checklist - [ ] Any dependent changes have been merged and published - [ ] My code follows the style guidelines of this project - [ ] I have performed a self-review of my own code - [ ] I have commented my code, particularly in hard-to-understand areas - [ ] My changes generate no new warnings - [ ] New and existing tests pass with my changes - [ ] I have made corresponding changes to the documentation if necessary --------- Co-authored-by: Kate Friedman <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 58fca16 - Browse repository at this point
Copy the full SHA 58fca16View commit details
Commits on Jul 9, 2024
-
Add fcst dependency to ocnanalprep (NOAA-EMC#2728)
Add previous cycle's `fcst` as a dependency to `ocnanalprep` This ensures that the availability of restart files to the latter. This addresses a seldomly-encountered race condition where `ocnanalprep` fails due to the lack of the files.
Configuration menu - View commit details
-
Copy full SHA for 3ca7477 - Browse repository at this point
Copy the full SHA 3ca7477View commit details -
Fix GDAS group B restart archiving (NOAA-EMC#2735)
Archives the GDAS restartb dataset at a 6-hour offset from restarta This allows cycled experiments to restart from the archives. The tabbing for the master archive templates was also added to improve readability. Resolves NOAA-EMC#2722
Configuration menu - View commit details
-
Copy full SHA for 8998ec7 - Browse repository at this point
Copy the full SHA 8998ec7View commit details
Commits on Jul 11, 2024
-
Adds contents of constructor and initialize methods to marine LETKF c…
…lass (NOAA-EMC#2635) Adds contents of constructor and initialize methods to marine LETKF class Partially addresses NOAA-EMC/GDASApp#1091 --------- Co-authored-by: Rahul Mahajan <[email protected]> Co-authored-by: Cory Martin <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 5ef4db7 - Browse repository at this point
Copy the full SHA 5ef4db7View commit details -
CI maintenance updates and adding CI Unit Tests (NOAA-EMC#2740)
This PR has a few maintenance updates to the CI pipeline and adds a test directory with Unit Tests **Major Maintenance updates:** - Added try blocks with appropriate messaging to GitHub PR of failure for: - - **scm** checkout - - build fail (with error logs sent as gists) - - create experiment fails with `stderr` sent to GitHub PR messaging - Pre-stage FAILS from the above are now captured these fails allow FINALIZE to update the label to FAIL (i.e. no more "hanging" CI state labels in GitHub - see image below) **Minor Maintenance updates:** - Fix for STALLED cases reviled from PR 2700 (just needed a lambda specifier) - Fixed path to experiment directory in PR message (had dropped EXPDIR in path) - Needed `latin-1` decoder in reading log files for publishing **Added python Unit Tests for CI functionality:** - Installed **Rocoto** and **wxfow** in GitHub Runner for testing key CI utility codes - Cashed the install of Rocoto in the GitHub Runners to greatly reduce stetup time for running the unit tests - Unit Tests Python scripts added - `test_rocostat.py`: rocoto_statcount() rocoto_summary() rocoto_stalled() - `test_setup.py`: setup_expt() test_setup_xml() - `test_create_experment`: test_create_experiment() - - Runs all PR cases that do not have ICs in the GItHub Runner - Reporting mechanism in the Actions tab for Python Unit Testing results - Test case data for STALLED and RUNNING stored on S3 and pulled using wget during runtime of tests
Configuration menu - View commit details
-
Copy full SHA for 4968f3a - Browse repository at this point
Copy the full SHA 4968f3aView commit details
Commits on Jul 15, 2024
-
Updated prepobs and fit2obs versions for Orion Rocky9 (NOAA-EMC#2758)
Update prepobs to v1.0.2 and fit2obs to v1.1.2 These versions now support Orion Rocky9. Updates are included for new install locations on WCOSS2, Hera, Orion/Hercules, and Jet.
Configuration menu - View commit details
-
Copy full SHA for e0878db - Browse repository at this point
Copy the full SHA e0878dbView commit details
Commits on Jul 16, 2024
-
Address issues in creating XML for GFS forecast-only with app S2SWA (N…
…OAA-EMC#2757) This bugfix PR: - fixes an issue where a user is unable to generate the XML for a GFS forecast-only experiment with APP=S2SWA Specifically, the changes are related to defining `aero_fcst_cdumps`. Following `setup_expt.py`, the user will have to set `AERO_FCST_CDUMPS="gdas|gfs|both" depending on their use case in `config.base`.
Configuration menu - View commit details
-
Copy full SHA for fc668aa - Browse repository at this point
Copy the full SHA fc668aaView commit details
Commits on Jul 22, 2024
-
Hotfix: Update jcb to avoid git-lfs files (NOAA-EMC#2782)
Removes git-lfs files from the `GDASApp` `jcb` submodule, allowing it to be cloned on Hera. This hotfix points to a non-authoritative branch of the GDASApp (https://github.com/DavidHuber-NOAA/GDASApp/tree/hotfix/update_jcb) and should be updated ASAP back to the authoritative repository.
Configuration menu - View commit details
-
Copy full SHA for 56df67a - Browse repository at this point
Copy the full SHA 56df67aView commit details -
Set METplus process count in config.metp; add verif-global support fo…
…r Rocky 9 (NOAA-EMC#2774) Fix metp* resources and check that they completed properly; add support for Orion Rocky 9
Configuration menu - View commit details
-
Copy full SHA for 71dc33c - Browse repository at this point
Copy the full SHA 71dc33cView commit details
Commits on Jul 23, 2024
-
Add task to process reforecast variables to save on WCOSS2 (NOAA-EMC#…
…2680) # Description This PR adds an optional task to the global-workflow to process a subset of ocean, ice, wave and atmosphere products to be saved on WCOSS2 for the GEFSv13 reforecast. This task is designed to process GEFS variables so that specific reforecast product requirements are met. A new variable in `config.base` called `DO_EXTRACTVARS` enables this task, which is currently called `extractvars`. `DO_EXTRACTVARS` is set to `NO` by default and is specifically a task designed to be executed for the GEFSv13 reforecast. Refs NOAA-EMC#1878 # Type of change - New feature (adds functionality) # Change characteristics - Is this a breaking change (a change in existing functionality)? NO - Does this change require a documentation update? NO # How has this been tested? This has been cloned and tested on WCOSS2. This will need to be tested on Hera and other platforms on which the reforecast may be running. # Checklist - [ ] Any dependent changes have been merged and published - [x] My code follows the style guidelines of this project - [x] I have performed a self-review of my own code - [ ] I have commented my code, particularly in hard-to-understand areas - [x] My changes generate no new warnings - [x] New and existing tests pass with my changes - [ ] I have made corresponding changes to the documentation if necessary --------- Co-authored-by: Rahul Mahajan <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for c45b961 - Browse repository at this point
Copy the full SHA c45b961View commit details -
Replace Jinja namespaces with replace_tmpl filter and disable ACCOUNT…
…_SERVICE option (NOAA-EMC#2775) Removes the namespace-based construction of EnKF member COM directories in the enkf archive template.
Configuration menu - View commit details
-
Copy full SHA for 65a7ab7 - Browse repository at this point
Copy the full SHA 65a7ab7View commit details
Commits on Jul 24, 2024
-
Refactoring of the marine B-matrix job (NOAA-EMC#2749)
Refactor the functionality of B-matrix generation from the GDASApp Resolves NOAA-EMC#2743
Configuration menu - View commit details
-
Copy full SHA for 8486596 - Browse repository at this point
Copy the full SHA 8486596View commit details
Commits on Jul 25, 2024
-
Configuration menu - View commit details
-
Copy full SHA for a7f6b32 - Browse repository at this point
Copy the full SHA a7f6b32View commit details
Commits on Jul 26, 2024
-
HR4 GWD update (NOAA-EMC#2732)
This update is a combination of the gravity wave drag (GWD) versions from the NOAA/GSL and NOAA/PSL
Configuration menu - View commit details
-
Copy full SHA for f156a78 - Browse repository at this point
Copy the full SHA f156a78View commit details
Commits on Jul 29, 2024
-
Remove f000 from atmos rocoto tasks for replay cases (NOAA-EMC#2778)
The main purpose of this PR is to remove the f000 from atmosphere-related rocoto tasks when `REPLAY_ICS` is set to `YES`. In cases where `REPLAY_ICS` is `YES` and `OFFSET_START_HOUR `is greater than `0`, it becomes necessary to have the first lead hour set to `OFFSET_START_HOUR ` for the atmosphere-related rocoto tasks. For example, when `OFFSET_START_HOUR ` is set to `3`, then the minimum lead time for the atmos_prod and atmos_ensstat rocoto tasks needs to be 3 and the minimum lead time for the ocean_prod rocoto task needs to be 6 (assuming `FHOUT_OCN` is 6). This PR makes this rocoto workflow set up possible by removing 0 from fhrs for atmosphere-related tasks in `gefs_tasks.py` when replaying. This PR also moves where f000 is being removed for the ocean_prod and ice_prod tasks. The if-block that performs this f000 removal has been moved from `tasks.py` to `gefs_tasks.py` and `gfs_tasks.py`. --------- Co-authored-by: Rahul Mahajan <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 61875f2 - Browse repository at this point
Copy the full SHA 61875f2View commit details
Commits on Jul 30, 2024
-
Simplify resource-related variables, remove CDUMP where unneeded (NOA…
…A-EMC#2727) This overhauls resource-related variables to use a common set of variables for each job. In the process, this also removed the use of CDUMP in most cases. Resolves NOAA-EMC#1299 NOAA-EMC#2693
Configuration menu - View commit details
-
Copy full SHA for 1cf8b44 - Browse repository at this point
Copy the full SHA 1cf8b44View commit details
Commits on Aug 1, 2024
-
Add fixes for metplus jobs when gfs_cyc=2 or 4 (NOAA-EMC#2791)
Changes how METplus jobs run so that they run on the last GFS cycle for a given `PDY`. This is a departure from operations where the METplus jobs run on the 00Z cycle for the previous 3 cycles and 00Z (i.e. `${PDYm1}06` through `${PDY}00`). With this PR, for gfs_cyc=4, METplus jobs will run on `${PDY}18` for cycles 00-18. See NOAA-EMC/EMC_verif-global#131 for more details.
Configuration menu - View commit details
-
Copy full SHA for d3d85f0 - Browse repository at this point
Copy the full SHA d3d85f0View commit details -
Update the gfs_utils repository hash (NOAA-EMC#2801)
# Description Point to the latest hash of the gfs-utils repository, which contains the bug fix to gaussian_sfcanl. Resolves NOAA-EMC#2669. Refs: NOAA-EMC/gfs-utils#73
Configuration menu - View commit details
-
Copy full SHA for aa2af1c - Browse repository at this point
Copy the full SHA aa2af1cView commit details
Commits on Aug 2, 2024
-
Update ocean post-processing triggers (NOAA-EMC#2784)
This PR: - replaces `check_netcdf.sh` checker for ocean post-processing with with ocean output at the next forecast hour or finishing of the forecast job for ocean prod - removes no longer needed `ush/check_netcdf.sh`
Configuration menu - View commit details
-
Copy full SHA for 4987704 - Browse repository at this point
Copy the full SHA 4987704View commit details -
Configuration menu - View commit details
-
Copy full SHA for b73b1fd - Browse repository at this point
Copy the full SHA b73b1fdView commit details -
Update Java Agent launching script for Jenkins connections (NOAA-EMC#…
…2762) Made updates to the Jenkins Launching Script for robustness and less ambiguous documentation: - Clearer distinction between required user token for the remote api and the systems token for launching - Added pre-checks: `gh` is authenticating, named compliant token and secret file exists - More robust Jason based parser of the remote api response for checking the state of the Node connection - For `cron` use a 5 minute pause and recheck was added before re-launching of the java agent - Added concise header documentation of requirements and purpose --------- Co-authored-by: David Huber <[email protected]> Co-authored-by: Walter Kolczynski - NOAA <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 0706c59 - Browse repository at this point
Copy the full SHA 0706c59View commit details -
Run METplus serially and correct the name of prod tasks (NOAA-EMC#2804)
Adds 2 hot fixes: - METplus v9.1.3 has a bug in it that sometimes attempts to create multiple copies of the same directory when running in parallel, causing a Python error and downstream problems. This PR makes METplus run in serial mode, preventing such issues. - Corrects the name of the atmos_prod, ocean_prod, and ice_prod tasks in workflow/rocoto/tasks.py (was accidentally changed to e.g. atmosprod)
Configuration menu - View commit details
-
Copy full SHA for 6d7f7e8 - Browse repository at this point
Copy the full SHA 6d7f7e8View commit details
Commits on Aug 5, 2024
-
Change land surface for HR4 (NOAA-EMC#2787)
Resets the default value of opt_diag to 2 corresponding to the land surface upgrades in ufs-weather-model for HR4. Resolves NOAA-EMC#2786
Configuration menu - View commit details
-
Copy full SHA for d599fff - Browse repository at this point
Copy the full SHA d599fffView commit details
Commits on Aug 6, 2024
-
Clean-up temporary rundirs - take 2. (NOAA-EMC#2753)
This PR: - is a follow-up to a previous PR that aggressively pruned run directories. - removes run directories for the current cycle in the clean-up if the cycle is successful. If the cycle is not successful, cleanup is not called and all run directories for the cycle are safe from being purged. - also updates the PR template to list/query for any updates to submodules. --------- Co-authored-by: David Huber <[email protected]> Co-authored-by: David Huber <[email protected]> Co-authored-by: Walter Kolczynski - NOAA <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 8fee36f - Browse repository at this point
Copy the full SHA 8fee36fView commit details -
Bugfix for updating label states in Jenkins (NOAA-EMC#2808)
Quick bug fix for updating state labels in CI during finalize. (did not reference GitHub CLI executable correctly in the pipeline script)
Configuration menu - View commit details
-
Copy full SHA for 876dfee - Browse repository at this point
Copy the full SHA 876dfeeView commit details
Commits on Aug 7, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 37c53ac - Browse repository at this point
Copy the full SHA 37c53acView commit details -
Marine DA updates (NOAA-EMC#2802)
Companion PR to GDASApp#1226 Addresses a few issues described in: - GDASApp#1219 - GDASApp#1217 - GDASApp#1232
Configuration menu - View commit details
-
Copy full SHA for 7a79146 - Browse repository at this point
Copy the full SHA 7a79146View commit details -
Feature/get arch adds an empty archive job to GEFS system (NOAA-EMC#2772
) - This feature added an archive task for GEFS system. This task will run in the service queue with a single processor. The task executes with success. - Only xml is generated. Refs NOAA-EMC#832 Refs NOAA-EMC#2698
Configuration menu - View commit details
-
Copy full SHA for 5c2e9b1 - Browse repository at this point
Copy the full SHA 5c2e9b1View commit details -
Check that a PR driver is still running before trying to kill it (NOA…
…A-EMC#2799) Adds a check to the SSH command used to kill child PIDs of a defunct driver instance on a different head node to prevent invalid kill commands, preventing CI failures. Resolves NOAA-EMC#2798
Configuration menu - View commit details
-
Copy full SHA for ad8d3e9 - Browse repository at this point
Copy the full SHA ad8d3e9View commit details
Commits on Aug 8, 2024
-
Stage atmospheric backgrounds and UFS cubed-sphere history files (NOA…
…A-EMC#2792) This PR changes the G-W so that backgrounds for the atmospheric analyses are staged as UFS cubed-sphere history files rather than FMS restarts. The motivation being that FMS restarts include many data we don't need for the analyses and thus take up too much disk space/bandwidth. This is a companion PR to: GDASApp#1236 JCB-GDAS#19 --------- Co-authored-by: danholdaway <[email protected]> Co-authored-by: Dan Holdaway <[email protected]> Co-authored-by: Walter Kolczynski - NOAA <[email protected]> Co-authored-by: RussTreadon-NOAA <[email protected]> Co-authored-by: RussTreadon-NOAA <[email protected]> Co-authored-by: Rahul Mahajan <[email protected]> Co-authored-by: David Huber <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for e2c0f06 - Browse repository at this point
Copy the full SHA e2c0f06View commit details
Commits on Aug 12, 2024
-
Add capability to run forecast in segments (NOAA-EMC#2795)
Adds the ability to run a forecast in segments instead of all at once. To accomplish this, a new local `checkpnts` variable is introduced to `config.base` to contain a comma-separated list of intermediate stopping points for the forecast. This is combined with `FHMIN_GFS` and `FHMAX_GFS` to create a comma-separated string `FCST_SEGMENTS` with all the start/end points that is used by `config.fcst` and rocoto workflow. Capability to parse these into python lists was added to wxflow in an accompanying PR. If `checkpnts` is an empty string, this will result in a single-segment forecast. To accommodate the new segment metatasks that must be run serially, the capability of `create_task()` was expanded to allow a dictionary key of `is_serial`, which controls whether a metatask is parallel or serial using pre-existing capability in rocoto. The default when not given is parallel (i.e. most metatasks). Resolves NOAA-EMC#2274 Refs NOAA-EMC/wxflow#39 Refs NOAA-EMC/wxflow#40
Configuration menu - View commit details
-
Copy full SHA for 1d53953 - Browse repository at this point
Copy the full SHA 1d53953View commit details
Commits on Aug 13, 2024
-
Add fixes to products for when REPLAY IC's are used (NOAA-EMC#2755)
This PR fixes a couple issues that arise when replay initial conditions are used. These issues only occur when `REPLAY_ICS` is set to `YES` and `OFFSET_START_HOUR` is greater than `0`. The following items are addressed in this PR. 1. Fix issue that causes ocean_prod tasks not to be triggered (issue [NOAA-EMC#2725](NOAA-EMC#2725)). A new diag_table was added (called `diag_table_replay`) that is used only when `REPLAY_ICS` is set to `YES`. This diag_table accounts for the offset that occurs when using replay IC's. 2. Fix issue that causes atmos_prod tasks not to be triggered for the first lead time (e.g. f003) (issue [NOAA-EMC#2754](NOAA-EMC#2754)). When `OFFSET_START_HOUR` is greater than `0`, the first `fhr` is `${OFFSET_START_HOUR}+(${DELTIM}/3600)`, which is defined in `forecast_predet.sh` and will allow data for the first lead time to be generated. The filename with this lead time will still be labelled with `OFFSET_START_HOUR`. 3. Minor modifications were made to the extractvars task so that atmos data from replay cases can be processed. This PR was split from PR NOAA-EMC#2680. Refs NOAA-EMC#2725, NOAA-EMC#2754 --------- Co-authored-by: Walter Kolczynski - NOAA <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 5699167 - Browse repository at this point
Copy the full SHA 5699167View commit details -
Add support for forecast-only runs on AWS (NOAA-EMC#2711)
The purpose of this PR it to merge code that allowing global-workflow run on AWS, first focus on ATM forecast only. Resolves: NOAA-EMC#2709 --------- Co-authored-by: David Huber <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for eba813f - Browse repository at this point
Copy the full SHA eba813fView commit details -
Add Gaea C5 to CI (NOAA-EMC#2814)
CI Testing and Jenkinsfile for Gaea C5
Configuration menu - View commit details
-
Copy full SHA for f2aee0a - Browse repository at this point
Copy the full SHA f2aee0aView commit details -
Jenkins Pipeline Updates (NOAA-EMC#2815)
Pipeline updates: - get `gh` location on remote machine and define global bash env variable `$GH` for GitHub CLI - Failed cases are now displayed accordingly in the Jenkins dashboard (see NOTE below) - Added the Build # in messaging for clarity when running from re-runs. - Replaced Matrix construct for concurrency with the parallel method that can use dynamic case lists - With removing of the hard coded list of cases we now get list of cases dynamically from the PR case directory - See new look of dashboard below (has more annotations and displays only used cases) NOTE: **failFast** (quitting all cases on failing of one) still does not work because it isn't quitting the running remote shells. We can make this a configurable capability in feature request with some custom code. The current behavior has the remaining cases continuing to run after a FAIL label has been issued and it is incumbent of the code manager to kill the CI job in the controller before resetting another Ready label. --------- Co-authored-by: David Huber <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for d994642 - Browse repository at this point
Copy the full SHA d994642View commit details -
Hotfix: Handle UNAVAILABLE and UNKNOWN rocoto status in Bash CI (NOAA…
…-EMC#2820) # Description From time to time, PBS pro cannot return a `qstat` response within a given time limit set by `rocoto` (default is 45 seconds). If that happens, then an `UNAVAILABLE` status will be returned for the given job. This PR adds checking for this status to allow CI processing to continue.
Configuration menu - View commit details
-
Copy full SHA for 336b78a - Browse repository at this point
Copy the full SHA 336b78aView commit details
Commits on Aug 20, 2024
-
Fixed test on UNAVAILBLE in python Rocoto check (NOAA-EMC#2842)
Update the test for UNAVAILABLE from inclusion to count: `if ['UNAVAILABLE'] > 0` in `rocotocheck.py `script.
Configuration menu - View commit details
-
Copy full SHA for 8772e61 - Browse repository at this point
Copy the full SHA 8772e61View commit details -
Convert staging job to python and yaml (NOAA-EMC#2651)
This PR converts the staging job from shell to python and introduces the use of yaml. Changes in this PR: 1. Rename `scripts/exglobal_stage_ic.sh` to `scripts/exglobal_stage_ic.py`. 2. Update `jobs/JGLOBAL_STAGE_IC` to use `.py` script extension. Move `COM*` variable declarations and member loop down into yaml and python respectively. Move `GDATE/gPDY/gcyc` settings up to JJOB from ex-script and replace with newer cycle variables (as done in forecast job). 3. Create `parm/stage` folder to hold newly created `stage.yaml.j2`, which both mimics forecast-only functionality in existing `scripts/exglobal_stage_ic.sh` and adds functionality for cycled mode. 4. Create `ush/python/pygfs/task/stage.py` to house staging job python functions for call from `scripts/exglobal_stage_ic.py`. 5. Remove `stage_ic` job rocoto dependencies from xml. Do not need and removes area of duplicate maintenance. 6. Add cycled staging jobs for gdas and enkf suites. 7. Rename `model_data` to `model` for issue NOAA-EMC#2686 There will now be distinct `stage_ic` jobs for each `RUN`: `gdasstage_ic`, `gfsstage_ic`, `enkfgdasstage_ic`, `stage_ic` (for gefs). Related work was done to set up new symlink folder structure under supported platform `ICSDIR` folder for use by updated staging job. Resolves NOAA-EMC#2475 Resolves NOAA-EMC#2650 Resolves NOAA-EMC#2686 --------- Co-authored-by: Rahul Mahajan <[email protected]> Co-authored-by: Walter Kolczynski - NOAA <[email protected]> Co-authored-by: David Huber <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 659bcbe - Browse repository at this point
Copy the full SHA 659bcbeView commit details -
support ATM forecast only on Azure (NOAA-EMC#2827)
This PR will support ATM forecast only run on Azure
Configuration menu - View commit details
-
Copy full SHA for 1b18f2f - Browse repository at this point
Copy the full SHA 1b18f2fView commit details
Commits on Aug 23, 2024
-
Add snow DA update and recentering for the EnKF forecasts (NOAA-EMC#2690
) This PR adds the capability to update the ensemble of snow states by recentering the ensemble mean to the deterministic snow analysis and applying increments as appropriate. Resolves NOAA-EMC#2585 --------- Co-authored-by: David Huber <[email protected]> Co-authored-by: Rahul Mahajan <[email protected]> Co-authored-by: Guillaume Vernieres <[email protected]> Co-authored-by: AntonMFernando-NOAA <[email protected]> Co-authored-by: Anil Kumar <[email protected]> Co-authored-by: TerrenceMcGuinness-NOAA <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 2ce2116 - Browse repository at this point
Copy the full SHA 2ce2116View commit details -
Update omega calculation (NOAA-EMC#2751)
Add a parameter "pass_full_omega_to_physics_in_non_hydrostatic_mode" in FV3 namelist. It was set to "true" to use a new method to diagnose omega. This PR is based on the /ufs-community/ufs-weather-model#2327) Corresponding parameter changed in GFSv17 related regression tests ufs-community/ufs-weather-model#2373))
Configuration menu - View commit details
-
Copy full SHA for ea22a73 - Browse repository at this point
Copy the full SHA ea22a73View commit details
Commits on Aug 26, 2024
-
Add GEFS C48 support on AWS (NOAA-EMC#2818)
Changes to make GEFS C48 case run on AWS. After C48 ATM forecast only runs on AWs, the next step is to make GEFS C48 run on AWS. Changes to AWS env, and yaml files. Resolves NOAA-EMC#2817 Refs NOAA-EMC#2711
Configuration menu - View commit details
-
Copy full SHA for 1231c9a - Browse repository at this point
Copy the full SHA 1231c9aView commit details -
Support ATM forecast only on Google (NOAA-EMC#2832)
Support global-workflow ATM forecast only runs on Google. Add/Modify env, yaml, and python scripts changes to make global-workflow ATM forecast only runs on GSP. Resolves NOAA-EMC#2831 Refs NOAA-EMC#2826 Refs NOAA-EMC#2711
Configuration menu - View commit details
-
Copy full SHA for 7a724e0 - Browse repository at this point
Copy the full SHA 7a724e0View commit details
Commits on Aug 27, 2024
-
Fix gdas build on Gaea and add Gaea to available CI list (NOAA-EMC#2857)
Module git-lfs is required to run CI test on gaea machine and added gaea in the Jenkinsfile - Module (git-lfs) added in the modulefiles/module_gwsetup.gaea.lua - Gaea added (Jenkinsfile)
Configuration menu - View commit details
-
Copy full SHA for 935ac64 - Browse repository at this point
Copy the full SHA 935ac64View commit details
Commits on Aug 28, 2024
-
Add JEDI ATM lgetkf observer and solver jobs (NOAA-EMC#2833)
This PR adds JEDI ATM lgetkf observer and solver jobs to global-workflow. This is approach is akin GSI-based eobs and eupd. Splitting the single JEDI ATM lgetkf job into separate observer and solver jobs improves memory and computational efficiency. Resolves NOAA-EMC#2415
Configuration menu - View commit details
-
Copy full SHA for 9ad7d3e - Browse repository at this point
Copy the full SHA 9ad7d3eView commit details -
Support coupling on AWS (NOAA-EMC#2859)
Make ATM-OCN-ICE coupling model run on AWS. This adds capability to run UFS atm-ocn-ice coupling on AWS. Resolves NOAA-EMC#2858
Configuration menu - View commit details
-
Copy full SHA for 85c7659 - Browse repository at this point
Copy the full SHA 85c7659View commit details
Commits on Aug 29, 2024
-
Correct ocean
MOM.res_#
stage copy (NOAA-EMC#2868)This PR corrects a bug in the staging job for ocean `MOM.res_#` IC files. The `OCNRES` value was coming in as an integer (e.g. `25`) but the `ocean.yaml.j2` file was checking for `"025"`. Correct to now set OCNRES to be three digits in staging script and also correct the for loop range to include third file. Resolves NOAA-EMC#2864
Configuration menu - View commit details
-
Copy full SHA for 5ccdd8b - Browse repository at this point
Copy the full SHA 5ccdd8bView commit details -
Add diffusion/diag B for aerosol DA and some other needed changes (NO…
…AA-EMC#2738) This PR adds in support for computing files needed for the aerosol analysis **B**. This includes a new task, `aeroanlgenb`. This work was performed by both me and @andytangborn Resolves NOAA-EMC#2501 Resolves NOAA-EMC#2737 --------- Co-authored-by: Andrew.Tangborn <[email protected]> Co-authored-by: Walter Kolczynski - NOAA <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 7f160f6 - Browse repository at this point
Copy the full SHA 7f160f6View commit details
Commits on Aug 30, 2024
-
Add 3 and 9 hr increment files to IC staging (NOAA-EMC#2876)
Adds files `atmi009.nc`, `atmi003.nc`, `ratmi009.nc`, and `ratmi003.nc` to list of files to be staged for ICs, if available. These are necessary for starting an IAU run, and are currently missing. Resolves NOAA-EMC#2874
Configuration menu - View commit details
-
Copy full SHA for 66fc89c - Browse repository at this point
Copy the full SHA 66fc89cView commit details
Commits on Sep 4, 2024
-
Support global-workflow GEFS C48 on Google Cloud (NOAA-EMC#2861)
# Description Support global-worflow GEFS C48 on Google Cloud. Make env. var. and yaml file changes, so global-workflow GEFS C48 case can run properly on Google Cloud. Resolves NOAA-EMC#2860
Configuration menu - View commit details
-
Copy full SHA for 5c304b5 - Browse repository at this point
Copy the full SHA 5c304b5View commit details -
Add ability to run CI test C96_atm3DVar.yaml to Gaea-C5 (NOAA-EMC#2885)
Add the ability to run CI test C96_atm3DVar on Gaea-C5 Resolves NOAA-EMC#2766 Refs NOAA-EMC/prepobs#32 Refs NOAA-EMC/Fit2Obs#28
Configuration menu - View commit details
-
Copy full SHA for 2e4f4b7 - Browse repository at this point
Copy the full SHA 2e4f4b7View commit details
Commits on Sep 6, 2024
-
Update aerosol climatology to 2013-2024 mean (NOAA-EMC#2888)
Use the updated 2013 to 2024 mean MERRA2 climatology instead of 2003 to 2014 mean Depends on NOAA-EMC#2887 Refs: ufs-community/ufs-weather-model#2272 Refs: ufs-community/ufs-weather-model#2273
Configuration menu - View commit details
-
Copy full SHA for d3ea8e2 - Browse repository at this point
Copy the full SHA d3ea8e2View commit details -
Eliminate race conditions and remove DATAROOT last in cleanup (NOAA-E…
…MC#2893) This changes the order of the cleanup job so that the working directory is deleted at the end. It also adds the `-ignore_readdir_race` flag to `find` to prevent errors if a file was deleted after the list of files was collected. This can happen if two consecutive cycles run the cleanup job at the same time.
Configuration menu - View commit details
-
Copy full SHA for 6519211 - Browse repository at this point
Copy the full SHA 6519211View commit details
Commits on Sep 7, 2024
-
Reenable Orion Cycling Support (NOAA-EMC#2877)
This updates the model hash to include the UPP update needed to be able to run the post processor on Orion, thus reenabling support on that system. A note on the UPP: it is using a newer version of g2tmpl that requires a separate spack-stack 1.6.0 installation. This version of g2tmpl will be standard in spack-stack 1.8.0, but for now requires loading separate modules for the UPP. A note on running analyses on Orion: due to a yet-unknown issue causing the BUFR library to run much slower on Orion when compared with Rocky 8, the GSI and GDASApp are expected to run significantly slower than on any other platform (on the order of an hour longer). Lastly, I made adjustments to the build_all.sh script to send more cores to compiling the UFS and GDASApp. Under this configuration, the GSI, UPP, UFS_Utils, and WW3 pre/post executables finish compiling before the UFS when run with 20 cores. Resolves NOAA-EMC#2694 Resolves NOAA-EMC#2851 --------- Co-authored-by: Rahul Mahajan <[email protected]> Co-authored-by: Walter.Kolczynski <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for ac93a9b - Browse repository at this point
Copy the full SHA ac93a9bView commit details -
Add an archive task to GEFS system to archive files locally (NOAA-EMC…
…#2816) - This task is an extension of the empty arch job previously merged. - This feature adds an archive task to GEFS system to archive files locally. - This feature archives files in ensstat directory. Resolves NOAA-EMC#2698 Refs NOAA-EMC#832 NOAA-EMC#2772
Configuration menu - View commit details
-
Copy full SHA for 2816c3b - Browse repository at this point
Copy the full SHA 2816c3bView commit details -
Restructure the bufr sounding job (NOAA-EMC#2853)
The current operational BUFR job begins concurrently with the GFS model run. This PR updates the script and ush to process all forecast hour data simultaneously, then combines the temporary outputs to create BUFR sounding products for each station. The updated job will now start processing data only after the GFS model completes its 180-hour run, handling all forecast files from 000hr to 180hr at a time. The new version job running will need 7 nodes instead of the current operational 4 nodes. This PR depends on the GFS bufr code update NOAA-EMC/gfs-utils#75 With the updates of bufr codes and scripts, there is no need to add restart capability to GFS post-process job JGFS_ATMOS_POSTSND. This PR includes the other changes: Rename the following table files: parm/product/bufr_ij13km.txt to parm/product/bufr_ij_gfs_C768.txt parm/product/bufr_ij9km.txt to parm/product/bufr_ij_gfs_C1152.txt Add a new table file: parm/product/bufr_ij_gfs_C96.txt for GFSv17 C96 testing. Added a new capability to the BUFR package. The job priority is to read bufr_ij_gfs_${CASE}.txt. If the table file is not available, the code will automatically find the nearest neighbor grid point (i, j). Refs NOAA-EMC#1257 Refs NOAA-EMC/gfs-utils#75
Configuration menu - View commit details
-
Copy full SHA for b8080cd - Browse repository at this point
Copy the full SHA b8080cdView commit details -
Create JEDI class (NOAA-EMC#2805)
This PR creates a PyGFS class called JEDI, which is to be instantiated everytime a JEDI application is run. The AtmAnalysis and AtmEnsAnalysis classes are no longer children of the Analysis class, but rather direct children of the Task class. They each have a JEDI object as an attribute, which is used to run either the variational/ensemble DA JEDI applications or the FV3 increment converter JEDI application, depending on which job they are created for (e.g. atmanlvar vs. atmanlfv3inc). The intention is that a later PR will apply this framework to all analysis task, and the PyGFS Analysis class will be removed.
Configuration menu - View commit details
-
Copy full SHA for 49f697a - Browse repository at this point
Copy the full SHA 49f697aView commit details
Commits on Sep 9, 2024
-
Add FAQ page and a caution with using reserved variables (NOAA-EMC#2898)
This PR: - Creates a standalone page for FAQ and Common issues - Adds a block of caution on using variables in a users' `bashrc` Fixes: NOAA-EMC#2850
Configuration menu - View commit details
-
Copy full SHA for 0953c0f - Browse repository at this point
Copy the full SHA 0953c0fView commit details
Commits on Sep 10, 2024
-
Consolidate python configuration dictionaries (NOAA-EMC#2839)
This modifies the way the `config` dictionary is constructed and referenced. Rather than updating a single configuration dictionary with each `RUN`, a `RUN`-based dictionary of `config` dictionaries is created and referenced by the appropriate `RUN` when calculating resources. This also makes the methods that were hidden before NOAA-EMC#2727 hidden again. Resolves NOAA-EMC#2783
Configuration menu - View commit details
-
Copy full SHA for b443915 - Browse repository at this point
Copy the full SHA b443915View commit details
Commits on Sep 11, 2024
-
Replace APRUN with APRUN_default (NOAA-EMC#2871)
This replaces `APRUN` with `APRUN_default` in all of the `.env` files. Resolves NOAA-EMC#2870
Configuration menu - View commit details
-
Copy full SHA for 6ea681b - Browse repository at this point
Copy the full SHA 6ea681bView commit details
Commits on Sep 12, 2024
-
Add new UPP links to .gitignore (NOAA-EMC#2904)
This adds 3 missing links from the UPP into parm/ufs to .gitignore. Resolves NOAA-EMC#2901
Configuration menu - View commit details
-
Copy full SHA for 108db4d - Browse repository at this point
Copy the full SHA 108db4dView commit details
Commits on Sep 13, 2024
-
Disable native grid writes for non-JEDI experiments; update C384 comp…
…ression options (NOAA-EMC#2914) - enables writing native grid model output when doing JEDI-atm DA - updates compression settings for C384 model output Fixes NOAA-EMC#2891
Configuration menu - View commit details
-
Copy full SHA for 4ad9695 - Browse repository at this point
Copy the full SHA 4ad9695View commit details -
Support gefs C48 on Azure (NOAA-EMC#2881)
Support global-worflow GEFS C48 on Azure Make env. var. and yaml file changes, so global-workflow GEFS C48 case can run properly on Google Cloud. Resolves NOAA-EMC#2882
Configuration menu - View commit details
-
Copy full SHA for d866982 - Browse repository at this point
Copy the full SHA d866982View commit details
Commits on Sep 14, 2024
-
add 1 deg ocean/ice info to parm/config/gfs/config.resources (NOAA-EM…
…C#2922) Adds 1 deg ocean, ice information to config.resources so 1 deg ocean jobs can run
Configuration menu - View commit details
-
Copy full SHA for 19455ba - Browse repository at this point
Copy the full SHA 19455baView commit details -
Build GDASApp and unset memory in Gaea-C5 xml files (NOAA-EMC#2912)
In preparation for GDASApp CI tests, add GDASApp build capability to global-workflow and remove memory specifications for Gaea-C5 xml setup (in Ref to NOAA-EMC#2727) Resolves NOAA-EMC#2535 Resolves NOAA-EMC#2910 Resolves NOAA-EMC#2911
Configuration menu - View commit details
-
Copy full SHA for a13bbef - Browse repository at this point
Copy the full SHA a13bbefView commit details -
Cleanup job for GEFS (NOAA-EMC#2919)
As forecast ensemble jobs are added to the global workflow, this PR ensures the output is being cleaned up properly once it is no longer needed. Resolves NOAA-EMC#833
Configuration menu - View commit details
-
Copy full SHA for b7f71e0 - Browse repository at this point
Copy the full SHA b7f71e0View commit details
Commits on Sep 16, 2024
-
Update config.resources for bufr sounding job postsnd (NOAA-EMC#2917)
This PR updates the parm/config/gfs/config.resources and env/WCOSS2.env files for the BUFR sounding job "postsnd." It includes adjustments to resource settings such as tasks per node and memory allocations for various GFS resolutions, including C768, C1152, and others. Here are the proposed changes: C768: 7 nodes, 21 tasks per node C1152: 16 nodes, 9 tasks per node
Configuration menu - View commit details
-
Copy full SHA for 03ee9f8 - Browse repository at this point
Copy the full SHA 03ee9f8View commit details -
Update global atmos upp job to use COMIN/COMOUT (NOAA-EMC#2867)
NCO has requested that each COM variable specify whether it is an input or an output. This completes that process for the global-workflow Unified Post Processor (UPP) task. Refs: NOAA-EMC#2451
Configuration menu - View commit details
-
Copy full SHA for 2602eac - Browse repository at this point
Copy the full SHA 2602eacView commit details
Commits on Sep 18, 2024
-
Update to obsproc/v1.2.0 and prepobs/v1.1.0 (NOAA-EMC#2903)
This PR updates the `develop` branch to use the newer operational `obsproc/v1.2.0` and `prepobs/v1.1.0`. The obsproc/prepobs installs in glopara space on supported platforms use tags cut from the `dev/gfsv17` branches in the respective repos. The installation of `prepobs/v1.1.0` on WCOSS2 is called "gfsv17_v1.1.0" to help avoid GFSv16 users using it instead of the operational module. Also, the `HOMEobsproc` path is updated to set an empty default for `obsproc_run_ver`. This both removes the need to set a default (and constantly update it, which is duplication) and avoid the unset variable error when the fcst jobs use their own load module script that does not know `obsproc_run_ver`: ``` export HOMEobsproc="${BASE_GIT:-}/obsproc/v${obsproc_run_ver:-}" ``` This PR also reverts the prepobs and fit2obs installs on MSU back to the glopara space from the temporary `/work/noaa/global/kfriedma/glopara` space installs. Lastly, this PR also includes updates to complete issue NOAA-EMC#2844 (merge `build.spack.ver` and `run.spack.ver`). Resolves NOAA-EMC#2291 Resolves NOAA-EMC#2840 Resolves NOAA-EMC#2844
Configuration menu - View commit details
-
Copy full SHA for 7588d2b - Browse repository at this point
Copy the full SHA 7588d2bView commit details