Error running an existing recipe, recipe_validation_CMIP6.yml

[AnushaNTNU]

Hi All and @rswamina
I am having trouble running an existing recipe , ESMValTool/esmvaltool/recipes/recipe_validation_CMIP6.yml. The recipe is exactly the same here, https://github.com/ESMValGroup/ESMValTool/blob/main/esmvaltool/recipes/recipe_validation_CMIP6.yml. It gives error while using the recipe as it is. The error says RuntimeError: NetCDF: Not a valid ID

I am attaching the files run/recipe_*.yml and run/main_log_debug.txt from the output directory. Can anyone help me to know what is the error

recipe_validation_CMIP6.txt
main_log_debug.txt

[rswamina]

Hi @AnushaNTNU - Sorry my email notification went to a different folder and I did not see this. Please can you share the file /projects/NS9576K/www/diagnostics/esmvaltool/a2021/tmp/recipe_validation_CMIP6_20221011_093909/run/validation_with_ERA-Interim/zonal_mean/log.txt? That's where the source of error is likely to be.

[AnushaNTNU]

Hi
I am uploading the log.txt here
log.txt

[valeriupredoi]

hi @AnushaNTNU could you please send me the output of this command - conda list netCDF4

[AnushaNTNU]

packages in environment at /conda/esmvaltool/2.6.0:

Name Version Build Channel

netcdf4 1.6.1 nompi_py310h55e1e36_100 conda-forge
(/conda/esmvaltool/2.6.0)

[valeriupredoi]

@AnushaNTNU thanks! netCDF4=1.6.1 is throwing a lot of issues due to iris using the threaded dask, this is a known behaviour, and that's why we pinned the netCDF4 in our environment not to pick up 1.6.1. Seems the sys admins at your institute are updating the environment on a rolling basis, w/o updating it from the ESMValTool environment file, so I'll send an email to alert them to pin netCDF4 👍