RRFS UPP log files are HUGE

[MatthewPyle-NOAA]

It has been reported to me that the UPP log files from the RRFS are huge (400+ MB for each hour) Making a note of it here so if we open a PR to remove/reduce some of the diagnostic prints, at least in our release branch, we have a record of the problem.

[WenMeng-NOAA]

@MatthewPyle-NOAA I believe many of the printouts are generated by the CRTM code during the creation of simulated satellite products.

[MatthewPyle-NOAA]

Some GTG related prints:

 searching upward for pflmax
 i,j,pfl,hgt,pblht=        2900        2927   44674.71      0.0000000E+00
   1500.000    
 kk,z,p=           1   8.517233       100136.4
 kk,z,p=           2   26.68519       99909.55
 kk,z,p=           3   47.24525       99653.61
 kk,z,p=           4   70.50052       99365.02
 kk,z,p=           5   96.79388       99039.85        
 kk,z,p=           6   126.5007       98673.77    
 kk,z,p=           7   160.0393       98261.98
 kk,z,p=           8   197.8846       97799.25
 kk,z,p=           9   240.5578       97279.86

Also:

 iregion,istab,idQ,ipickindx,ipickgtgx=   1   1    400   1   0  Brown1                  
 iregion,istab,idQ,ipickindx,ipickgtgx=   1   1    401   1   0  Brown2                  
 iregion,istab,idQ,ipickindx,ipickgtgx=   1   1    402   1   0  CP                      
 iregion,istab,idQ,ipickindx,ipickgtgx=   1   1    403   1   0  Ellrod1                 
 iregion,istab,idQ,ipickindx,ipickgtgx=   1   1    404   1   1  Ellrod2                 
 iregion,istab,idQ,ipickindx,ipickgtgx=   1   1    405   1   0  1/Ri                    
 iregion,istab,idQ,ipickindx,ipickgtgx=   1   1    406   1   0  Ellrod3     

Also:

undefined landflag at i,j=        4749        1260 (about 2.2 million lines like this for an RRFS UPP log)
 undefined hgt at i,j=        4701         666 (about 2.2 million lines like this for an RRFS UPP log)
These two "undefined"  prints create about 50% of the bulk of the RRFS UPP log files.  

And:

 epsLL^2/3/Ri: MYPE,ic,jc=          96        2900        2237
  0.2064001      0.2206336      2.2779291E-03  2.8573314E-04  1.2934202E-04
  1.0897306E-04  1.1283725E-04  1.2817985E-04  1.7706011E-04  2.8891885E-04
  4.6689590E-04  6.2759069E-04  6.1237998E-04  4.4433383E-04  2.7882162E-04
  1.4478718E-04  7.2878363E-05  3.6610025E-05  1.6349746E-05  3.3166309E-06
  7.1051034E-07  2.1037594E-07  1.4297186E-06  3.1896534E-06  3.0438853E-06
  7.8726862E-06  7.9196388E-06  1.4662127E-05  1.2420185E-05  4.9190598E-06
  4.0925916E-06  8.6895989E-06  8.0396430E-06  5.2349155E-06  9.4648531E-06
  1.9693216E-05  8.1548942E-06  7.1124423E-06  7.9318679E-06  3.0793246E-06
  9.0758067E-06  3.3767512E-05  1.7288061E-05  4.4448730E-06  3.0400954E-06
  6.7063320E-07  1.0927408E-06  5.3610797E-06  1.4955051E-05  1.2826954E-04
  1.2843188E-05  1.2653037E-05  3.9006145E-06  1.2318623E-06  1.0127090E-04
  9.9900001E+20  9.9900001E+20  9.9900001E+20  9.9900001E+20  9.9900001E+20
  9.9900001E+20  9.9900001E+20  9.9900001E+20  9.9900001E+20  9.9900001E+20
 idx,TImin,i,j,k=         483  0.0000000E+00        1652         961           1
 idx,TImax,i,j,k=         483  0.4600878            2621         970           8
 CLDEDR: MYPE,ic,jc=          41        2900         972
  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00
  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00
  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00
  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00
  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00
  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00
  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00
  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00
  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00
  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00
  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00  9.9900001E+20
  9.9900001E+20  9.9900001E+20  9.9900001E+20  9.9900001E+20  9.9900001E+20
  9.9900001E+20  9.9900001E+20  9.9900001E+20  9.9900001E+20  9.9900001E+20
 idx,TImin,i,j,k=         455  6.4611356E-09        3040        2141          52
 idx,TImax,i,j,k=         455   252.4682            2305        2139           2
 MWT10: MYPE,ic,jc,mws=          92        2900        2145  0.0000000E+00
  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00
  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00
  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00  0.0000000E+00

[WenMeng-NOAA]

@YaliMao-NOAA Could you address the issue of printouts from gtg code?

[HuiyaChuang-NOAA]

@YaliMao-NOAA Could you address the issue of printouts from gtg code?

perhaps @hsinmulin-NOAA can look too.

[WenMeng-NOAA]

@HuiyaChuang-NOAA Would you like this issue assigned to @hsinmulin-NOAA?

[YaliMao-NOAA]

GTG code separated printouts to the general UPP output and individual files for each CPU. More details will be updated.

[WenMeng-NOAA]

@YaliMao-NOAA @hsinmulin-NOAA When you submit the PR, please target the branch "release/rrfs_v1". I will sync the changes in the UPP develop branch later.

[YaliMao-NOAA]

@MatthewPyle-NOAA May I know where your RRFS code is on Cactus? After I fixed some control file issues, I did a test run on the most recent version of GTG and didn't see additional printout files. So I am wondering which version of UPP and its correpsonding version of GTG you are using.
Thank you!

[MatthewPyle-NOAA]

@YaliMao-NOAA The GTG code being used with RRFS is here: /lfs/h2/emc/lam/noscrub/emc.lam/rrfs/v0.9.1/rrfs-workflow/sorc/UPP/sorc/ncep_post.fd/post_gtg.fd

[YaliMao-NOAA]

@MatthewPyle-NOAA I got 'Permission denied'. May you please change the permission of the folder? Thank you.

[MatthewPyle-NOAA]

@YaliMao-NOAA If you just need to look at the code, I opened some permissions on it copied to /lfs/h2/emc/lam/noscrub/emc.lam/tmp/post_gtg.fd. I didn't want to mess with the permissions with the workflow on disk.

[YaliMao-NOAA]

@MatthewPyle-NOAA Thank you! I checked the code. It is the second to the most recent updated version. @hsinmulin-NOAA has reached out to NCAR GTG to address this issue. It's going to get resolved.

[HuiyaChuang-NOAA]

@hsinmulin-NOAA tested one line change from NCAR and confirmed the printouts were greatly reduced.
@YaliMao-NOAA just merged this update to GTG repo. Please see https://github.com/NCAR/UPP_GTG/pull/35