Baseline 4.0 Offset Issue

[julianblue]

@matthewhanson ,

is there an update on this https://github.com/cirrus-geo/cirrus-earth-search/issues/26 ?

I am facing issues when processing sentinel data as there are cases when the scale supposedly was not applied (according to metadata) but actually seems to have been applied. --> causing negative values in some instances

[matthewhanson]

@julianblue are you looking at the earthsearch:boa_offset_applied property? Or at the raster:bands.offset property? It looks like the offset property may be incorrectly set to -0.1 even when it has been applied but I think the boa_offset_applied is the truth.

This has been fixed in our new pipeline which we will be switching to soon for new scenes and will be processing the new ESA produced scenes as they are made available.

[gcaria]

When reading the TIFs directly from the S3 bucket, is there a way to know whether the offset has been applied?

e.g. reading the data with rioxarray, would it be possible to rely on the add_offset attribute (see example below)?

[jkeifer]

@gcaria Unfortunately, the current COG files do not have the scale/offset written to them, so this is an unreliable indicator. This has also been fixed in the new pipeline.