Skip to content

Commit

Permalink
Update according to new repo name
Browse files Browse the repository at this point in the history
- I used the latest version of the workflow present in
  DETECT_EUR-11_ECMWF-ERA5_evaluation_r1i1p1_FZJ-COSMO5-01-CLM3-5-0-ParFlow3-12-0_vBaseline
  to setup thie WorkflowGettingStarted repo.
  According to the renaming I had to update some names and links
  hard-coded within the documentation and README.
Update documentation and links according to the new repo name.
  • Loading branch information
niklaswr committed Aug 29, 2023
1 parent 3f6e969 commit 271cf6f
Show file tree
Hide file tree
Showing 6 changed files with 39 additions and 36 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# TSMP_WorkflowStarter

[![GitHub Workflow Status](https://img.shields.io/github/actions/workflow/status/niklaswr/TSMP_WorkflowStarter/RenderMainSphinxDocumentation.yml?label=documentation)](https://niklaswr.github.io/TSMP_WorkflowStarter/index.html)
[![Latest release](https://img.shields.io/github/v/tag/niklaswr/TSMP_WorkflowSTarter.svg?color=brightgreen&label=latest%20release&sort=semver)](https://github.com/niklaswr/TSMP_WorkflowStarter/tags)
[![GitHub last commit](https://img.shields.io/github/last-commit/niklaswr/TSMP_WorkflowStarter)](https://github.com/niklaswr/TSMP_WorkflowStarter/commits/master)
[![GitHub Workflow Status](https://img.shields.io/github/actions/workflow/status/HPSCTerrSys/TSMP_WorkflowGettingStarted/RenderMainSphinxDocumentation.yml?label=documentation)](https://hpscterrsys.github.io/TSMP_WorkflowGettingStarted/content/introduction.html)
[![Latest release](https://img.shields.io/github/v/tag/HPSCTerrSys/TSMP_WorkflowGettingStarted.svg?color=brightgreen&label=latest%20release&sort=semver)](https://github.com/HPSCTerrSys/TSMP_WorkflowGettingStarted/tags)
[![GitHub last commit](https://img.shields.io/github/last-commit/HPSCTerrSys/TSMP_WorkflowGettingStarted)](https://github.com/HPSCTerrSys/TSMP_WorkflowGettingStarted/commits/main)

2 changes: 1 addition & 1 deletion doc/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
# -- Project information -----------------------------------------------------
# https://www.sphinx-doc.org/en/master/usage/configuration.html#project-information

project = 'TSMP_WorkflowStarter'
project = 'TSMP_WorkflowGettingStarted'
copyright = '2023, Niklas WAGNER'
author = 'Niklas WAGNER'
version = '1.1.0'
Expand Down
54 changes: 26 additions & 28 deletions doc/content/gettingstarted.md
Original file line number Diff line number Diff line change
@@ -1,19 +1,19 @@
# Getting Started

## Set up the TSMP_WorkflowStarter
## Set up the TSMP_WorkflowGettingStarted

**First**, clone this repository into your project-directory with its
dependencies marked with Git submodules,

``` bash
cd $PROJECT_DIR
git clone --recurse-submodules https://github.com/niklaswr/TSMP_WorkflowStarter.git
git clone --recurse-submodules https://github.com/HPSCTerrSys/TSMP_WorkflowGettingStarted.git
```

and export the following path to an environment variable for later use.

``` bash
cd $PROJECT_DIR/TSMP_WorkflowStarter
cd $PROJECT_DIR/TSMP_WorkflowGettingStarted
export BASE_ROOT=$(pwd)
```

Expand All @@ -24,7 +24,7 @@ CLM, and Oasis) into `src/TSMP/`,
cd ${BASE_ROOT}/src/TSMP
export TSMP_DIR=$(pwd)
git clone https://icg4geo.icg.kfa-juelich.de/ModelSystems/tsmp_src/cosmo5.01_fresh.git cosmo5_1
git clone -b v3.12.0 https://github.com/parflow/parflow.git parflow
git clone -b UseMaskNc https://github.com/HPSCTerrSys/parflow.git parflow
git clone https://icg4geo.icg.kfa-juelich.de/ModelSystems/tsmp_src/clm3.5_fresh.git clm3_5
git clone https://icg4geo.icg.kfa-juelich.de/ModelSystems/tsmp_src/oasis3-mct.git oasis3-mct
```
Expand All @@ -33,7 +33,6 @@ and build the binaries.

``` bash
cd $TSMP_DIR/bldsva
git apply ${BASE_ROOT}/ctrl/externals/TSMP_Patch/ClmSendZero.patch
./build_tsmp.ksh --readclm=true -v 3.1.0MCT -c clm-cos-pfl -m JURECA -O Intel
```

Expand All @@ -46,7 +45,7 @@ vi export_paths.sh
```

Within this file change the line
`rootdir="/p/scratch/cesmtst/wagner6/${expid}"`
`rootdir="/PATH/TO/YOUR/EXPDIR/${expid}"`
according to you `$PROJECT_DIR` from above. To verify `rootdir` is set properly
do
`source $BASE_ROOT/ctrl/export_paths.sh && echo "$rootdir" && ls -l $rootdir`.
Expand Down Expand Up @@ -94,10 +93,10 @@ cold-start, while CLM and ParFlow always expect restart-files. So the user
only needs to provide restart-files for ParFlow and CLM only.

In this example, we do run a simulation over the EUR-11 domain for the year
1970, for which restart files could be taken from:
1979, for which restart files could be taken from:

```
/p/project/cslts/wagner6/TempForcAndRestFileFor_TSMP_WorkflowStarter/restarts
/p/largedata2/detectdata/projects/Z04/SPINUP_TSMP_EUR-11/restarts
```

If needed, do request access to the related data project via [JuDoor](https://judoor.fz-juelich.de/login).
Expand All @@ -108,9 +107,9 @@ restart files there:
``` bash
cd $BASE_ROOT/rundir/MainRun/restarts
# copy CLM restart file
cp -r /p/project/cslts/wagner6/TempForcAndRestFileFor_TSMP_WorkflowStarter/restarts/clm ./
cp -r /p/largedata2/detectdata/projects/Z04/SPINUP_TSMP_EUR-11/restarts/clm ./
# copy ParFlow restart file
cp -r /p/project/cslts/wagner6/TempForcAndRestFileFor_TSMP_WorkflowStarter/restarts/parflow ./
cp -r /p/largedata2/detectdata/projects/Z04/SPINUP_TSMP_EUR-11/restarts/parflow ./
```
**NOTE**:
ParFlow needs the previous model-outpt as a restart-file, whereas CLM needs a
Expand All @@ -135,26 +134,25 @@ are expected by the workflow under:
$BASE_ROOT/forcing/laf_lbfd/all
```

In this example, we do run a simulation over the EUR-11 domain for the year
1970, for which forcing files could be taken from:

In the pre-processing step of this workflow the `laf_lbfd` files are generated
by `INT2LM` automatically wherefore on has to provide the raw meterological data
only, which are provided under:
```
/p/project/cslts/wagner6/TempForcAndRestFileFor_TSMP_WorkflowStarter/forcing/laf_lbfd/1970
```

/p/largedata2/detectdata/CentralDB/era5/
```
and have to be linked to
```
${BASE_ROOT}/forcing
```
to be found by the workflow.
If needed, do request access to the data project via [JuDoor](https://judoor.fz-juelich.de/login).

To properly provide these files, do copy the directory from above to your
workflow and link all files to `$BASE_ROOT/forcing/laf_lbfd/all`
To properly provide these files, do link the directory from above to your
workflow under `forcing/`
``` bash
# move to forcing dir and copy forcing files
cd $BASE_ROOT/forcing/laf_lbfd/
cp -rv /p/project/cslts/wagner6/TempForcAndRestFileFor_TSMP_WorkflowStarter/forcing/laf_lbfd/1970 ./
# link boundary files to all/
cd $BASE_ROOT/forcing/laf_lbfd/
mkdir all
cd all
ln -sf ../1970/l* ./
# move to forcing dir and link forcing files
${BASE_ROOT}/forcing
ln -sf /p/largedata2/detectdata/CentralDB/era5/ ./cafFilesIn
```

## Start a simulation
Expand All @@ -175,8 +173,8 @@ vi ./starter.sh
## Exercice
To become a little bit famillar with this workflow, work on the following tasks:

1) Do simulate the compleat year of 2020.
2) Plot a time serie of the spatial averaged 2m temperature for 2020.
1) Do simulate the compleat year of 1979.
2) Plot a time serie of the spatial averaged 2m temperature for 1979.
3) Write down which information / data / files you might think are needed to
repoduce the simulation.
4) Think about how you could check the simulation is running fine during
Expand Down
5 changes: 5 additions & 0 deletions doc/content/inDetail/maintenance.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,4 +28,9 @@ Than use links like:

## How to CI/CD

Enable pages in GitHub:
Settings -->
Source: deply from a branch
Branch: gh-pages (auto generated)

[TBE]
2 changes: 1 addition & 1 deletion doc/content/introduction.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Introdction

[TSMP_WorkflowStarter]() provides an example of how to run bigger simulations.
[TSMP_WorkflowGettingStarted](https://github.com/HPSCTerrSys/TSMP_WorkflowGettingStarted) provides an example of how to run bigger simulations.
Bigger simulations, such as long lasting climate simulations, require a bit more
effort to run than the TSMP included test-cases.
This extra effort ranges from a proper directory structure, to some helper
Expand Down
6 changes: 3 additions & 3 deletions doc/index.rst
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
.. TSMP_WorkflowStarter documentation master file, created by
.. TSMP_WorkflowGettingStarted documentation master file, created by
sphinx-quickstart on Thu Mar 9 07:28:18 2023.
You can adapt this file completely to your liking, but it should at least
contain the root `toctree` directive.
TSMP_WorkflowStarter
====================
TSMP_WorkflowGettingStarted
===========================

.. toctree::
:maxdepth: 3
Expand Down

0 comments on commit 271cf6f

Please sign in to comment.