Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Ensemble Data Assimilation at 2021-05-17 00:00

iasi
METOP-B IASI RADIANCES CHANNEL 566 : out of range
1 times in the last 10 days for at least one item
Severe: stdev_fgdepar=0.4358, expected range: 0.3092 0.3732
METOP-A IASI RADIANCES CHANNEL 193 : out of range
Considerable: obs_number=1446.0000, expected range: 1657.7657 2130.2343
METOP-A IASI RADIANCES CHANNEL 197 : out of range
Considerable: obs_number=1489.0000, expected range: 1701.1536 2127.8464
METOP-A IASI RADIANCES CHANNEL 199 : out of range
Considerable: obs_number=1344.0000, expected range: 1530.0704 2148.9296
METOP-A IASI RADIANCES CHANNEL 203 : out of range
Considerable: obs_number=1548.0000, expected range: 1697.4488 2174.5512
METOP-A IASI RADIANCES CHANNEL 207 : out of range
Considerable: obs_number=1414.0000, expected range: 1643.6192 2127.5058
METOP-A IASI RADIANCES CHANNEL 210 : out of range
Considerable: obs_number=1302.0000, expected range: 1484.9398 2143.4352
METOP-A IASI RADIANCES CHANNEL 214 : out of range
Considerable: obs_number=1391.0000, expected range: 1604.6239 2139.3761
METOP-A IASI RADIANCES CHANNEL 222 : out of range
Considerable: obs_number=1328.0000, expected range: 1563.2522 2138.1228
METOP-A IASI RADIANCES CHANNEL 228 : out of range
Considerable: obs_number=1279.0000, expected range: 1479.8507 2126.3993
METOP-B IASI RADIANCES CHANNEL 571 : out of range
1 times in the last 10 days for at least one item
Considerable: stdev_fgdepar=0.4302, expected range: 0.2956 0.3832
METOP-C IASI RADIANCES CHANNEL 271 : out of range
Considerable: obs_number=1012.0000, expected range: 341.9872 833.8878
METOP-C IASI RADIANCES CHANNEL 272 : out of range
Considerable: obs_number=961.0000, expected range: 301.4063 800.7187
METOP-C IASI RADIANCES CHANNEL 323 : out of range
Considerable: obs_number=943.0000, expected range: 300.1990 782.4260
METOP-C IASI RADIANCES CHANNEL 329 : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=1114.0000, expected range: 463.3918 905.1082
METOP-C IASI RADIANCES CHANNEL 347 : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=1093.0000, expected range: 405.6546 934.4704
METOP-C IASI RADIANCES CHANNEL 354 : out of range
Considerable: obs_number=1279.0000, expected range: 566.5185 1119.2315
METOP-C IASI RADIANCES CHANNEL 360 : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=1217.0000, expected range: 513.4614 1073.0386
METOP-C IASI RADIANCES CHANNEL 366 : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=1150.0000, expected range: 490.9535 956.9215
METOP-B IASI RADIANCES CHANNEL 573 : out of range
Slight: stdev_fgdepar=0.3680, expected range: 0.3004 0.3540
mwhs2
FY-3D MWHS2 ALLSKY RADIANCES (11 channels affected) : out of range
Severe: obs_number=40719.0000, expected range: 52766.0975 57451.6525
mwri
FY-3D MWRI RADIANCES (6 channels affected) : out of range
Severe: stdev_norm_fgdepar=0.7961, expected range: 0.6595 0.7372