ERA5 dataset for climwip recipe

[DoMatte]

Hi, I am new with esmval and I am trying to use climwip on my own server. So, if I understood well, since downloading era5 data from ESMval is not possible, I should download it myself, which I can do using era5cli as suggested on the webpage. Both from there, I am a bit lost...from what I understood, I should CMORize first the downloaded dataset and then use it with climwip..right?

For now I downloaded some monthly mean dataset (t2m for now) form some year and then I tried to cmorize them using esmvaltool data format --config_file config-userera5.yml "path to rawera5" where I have indicate in my
rootpath:
RAWOBS: "path to rawera5"
in my config_user.yml

I kept having this error message:
Exception: Format failed for datasets "path to dataset"

I have tried a few combinations with no sucess.
Any help would be very appreciated!

p.s I am able to use other recipe that does not need era5 but need dataset from esgf, so I know that some of the esmvaltool recipe works

[valeriupredoi]

hi @DoMatte and welcome to the ESMValRool discussions! RAWOBS: "path to rawera5" is not a valid key-value parameter, instead of "path to rawera5" you need to specify the actual POSIX path object e.g. /home/user/domatte/data/ERA5 or whatever the actual path is on your computer 👍 Also, make sure that the path root eg ERA5 in that example contains a dir called Tier3 where the netCDF data is located

[valeriupredoi]

@remi-kazeroni or myself can assist further, should need be 🍺

[DoMatte]

Excellent, thank you to both of you (@remi-kazeroni and @valeriupredoi), I did manage to download data using era5cli and then passing them to native6 project! It works like a charm (for now;)). I am currently working of using some recipes for my work, mainly climwip. I will most likely contact you again ;)

[remi-kazeroni]

@DoMatte, great news! 👍
Could you please click on the "Mark as answer" button in one our our responses? This helps us to manage questions from the users. Feel free to open new discussions if you encounter other issues while working with the climwip recipes.

[remi-kazeroni]

Hi @DoMatte, thanks for your interest in ESMValTool and opening this discussions. It is actually not recommended to CMORize ERA5 data beforehand but rather rely on the "on-the-fly" CMORization during recipe run. This is used for datasets with the native6 project in recipes, like in climwip recipes. For this to work it is necessary to put the data downloaded with era5cli into the right directory structure (see doc for native6 data). In your case, that should be: ~/RAWOBS/Tier3/ERA5/v1/mon/tas/t2m*.nc (I forgot what's the exact file name returned by era5cli...). Please let me know if that enables you to run the recipe directly.