Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Ensemble Data Assimilation at 2021-05-11 00:00

iasi
METOP-B IASI RADIANCES CHANNEL 377 : out of range
1 times in the last 10 days for at least one item
Considerable: avg_biascorr=-1.0107, expected range: -0.9419 -0.8402
METOP-C IASI RADIANCES CHANNEL 377 : out of range
2 times in the last 10 days for at least one item
Considerable: avg_biascorr=-1.0450, expected range: -0.9795 -0.8776
cris
NPP CRIS RADIANCES (103 channels affected) : out of range
Slight: avg_fgdepar=0.0143, expected range: -0.0087 -0.0087
NPP CRIS RADIANCES (12 channels affected) : out of range
Slight: stdev_fgdepar=0.1214, expected range: 0.1136 0.1136
NOAA20 CRIS RADIANCES (142 channels affected) : out of range
Slight: avg_fgdepar=0.0164, expected range: -0.0048 -0.0048
NOAA20 CRIS RADIANCES CHANNEL 33 : out of range
Slight: stdev_fgdepar=0.1607, expected range: 0.1446 0.1446
NOAA20 CRIS RADIANCES CHANNEL 63 : out of range
Slight: stdev_fgdepar=0.1081, expected range: 0.1003 0.1003
NOAA20 CRIS RADIANCES CHANNEL 64 : out of range
Slight: stdev_fgdepar=0.1062, expected range: 0.0990 0.0990
NOAA20 CRIS RADIANCES CHANNEL 111 : out of range
Slight: stdev_fgdepar=0.0953, expected range: 0.0896 0.0896
NOAA20 CRIS RADIANCES CHANNEL 113 : out of range
Slight: stdev_fgdepar=0.1252, expected range: 0.1130 0.1130
NOAA20 CRIS RADIANCES CHANNEL 114 : out of range
Slight: stdev_fgdepar=0.1233, expected range: 0.1059 0.1059
NOAA20 CRIS RADIANCES CHANNEL 115 : out of range
Slight: stdev_fgdepar=0.0939, expected range: 0.0883 0.0883
NOAA20 CRIS RADIANCES CHANNEL 649 : out of range
Slight: stdev_fgdepar=0.4008, expected range: 0.3760 0.3760
airs
AQUA AIRS RADIANCES CHANNEL 232 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.1268, expected range: 0.0131 0.0723
AQUA AIRS RADIANCES CHANNEL 1869 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.2363, expected range: -0.1964 -0.1825
AQUA AIRS RADIANCES CHANNEL 1865 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=0.1575, expected range: 0.0878 0.0885
AQUA AIRS RADIANCES CHANNEL 1079 : out of range
Severe: stdev_fgdepar=0.3792, expected range: 0.3327 0.3375
AQUA AIRS RADIANCES CHANNEL 1090 : out of range
Severe: stdev_fgdepar=0.4320, expected range: 0.3450 0.3646
AQUA AIRS RADIANCES CHANNEL 1329 : out of range
Severe: stdev_fgdepar=0.3117, expected range: 0.2702 0.2709
AQUA AIRS RADIANCES (39 channels affected) : out of range
Considerable: obs_number=852.0000, expected range: 939.8161 987.3858
AQUA AIRS RADIANCES CHANNEL 1115 : out of range
Considerable: stdev_fgdepar=0.4642, expected range: 0.3624 0.4231
mhs
NOAA-19 MHS ALLSKY RADIANCES CHANNEL 4 : out of range
Slight: avg_norm_fgdepar=-0.0292, expected range: -0.0428 -0.0428
NOAA-19 MHS ALLSKY RADIANCES CHANNEL 5 : out of range
1 times in the last 10 days for at least one item
Slight: avg_norm_fgdepar=0.0112, expected range: -0.0054 -0.0054
METOP-A MHS ALLSKY RADIANCES CHANNEL 4 : out of range
Slight: avg_norm_fgdepar=-0.0851, expected range: -0.0997 -0.0997
METOP-A MHS ALLSKY RADIANCES CHANNEL 5 : out of range
Slight: avg_norm_fgdepar=-0.0382, expected range: -0.0610 -0.0610
mwhs2
FY-3C MWHS2 ALLSKY RADIANCES (10 channels affected) : out of range
Considerable: obs_number=7744.0000, expected range: 8781.0000 8781.0000
FY-3D MWHS2 ALLSKY RADIANCES CHANNEL 11 : out of range
Considerable: obs_number=4739.0000, expected range: 3942.6142 4218.3858
FY-3D MWHS2 ALLSKY RADIANCES CHANNEL 12 : out of range
Considerable: obs_number=4745.0000, expected range: 3942.6142 4218.3858
atms
NOAA20 ATMS RADIANCES (5 channels affected) : out of range
Considerable: obs_number=4785.0000, expected range: 4345.0000 4345.0000
ssmis
DMSP-17 SSMIS RADIANCES (9 channels affected) : out of range
Considerable: obs_number=15425.0000, expected range: 25807.4268 25807.4268
DMSP-18 SSMIS RADIANCES CHANNEL 9 : out of range
Considerable: obs_number=17459.0000, expected range: 25216.0685 25216.0685
DMSP-18 SSMIS RADIANCES CHANNEL 10 : out of range
Considerable: obs_number=21770.0000, expected range: 32453.3423 32453.3423
DMSP-18 SSMIS RADIANCES CHANNEL 11 : out of range
Considerable: obs_number=21708.0000, expected range: 32463.1690 32463.1690
gpsro
METOP-A GRAS SETTING (23 impact heights affected) : out of range
Slight: avg_norm_fgdepar=0.5441, expected range: 0.4950 0.4950
METOP-A GRAS SETTING (17 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=1.0438, expected range: 1.1281 1.1281
METOP-A GRAS RISING (22 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.3307, expected range: -0.4108 -0.4108
METOP-A GRAS RISING (14 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=1.0731, expected range: 1.2171 1.2171
TERRASAR-X GPSRO SETTING (23 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.0120, expected range: 0.0501 0.0501
TERRASAR-X GPSRO SETTING (21 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=0.6602, expected range: 0.6118 0.6118
METOP-B GRAS SETTING (10 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=1.1558, expected range: 1.0427 1.0427
METOP-B GRAS SETTING (22 impact heights affected) : out of range
Slight: avg_norm_fgdepar=0.2793, expected range: 0.3151 0.3151
METOP-B GRAS RISING (22 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.1502, expected range: -0.0422 -0.0422
METOP-B GRAS RISING (8 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=0.8549, expected range: 0.7469 0.7469
METOP-C GRAS SETTING (22 impact heights affected) : out of range
Slight: avg_norm_fgdepar=0.4954, expected range: 0.5347 0.5347
METOP-C GRAS SETTING (8 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=1.2750, expected range: 1.1520 1.1520
METOP-C GRAS RISING (23 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.0233, expected range: 0.0389 0.0389
METOP-C GRAS RISING (13 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=0.8357, expected range: 0.7795 0.7795
COSMIC2-E1 GPSRO SETTING (25 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.1947, expected range: -0.1587 -0.1587
COSMIC2-E1 GPSRO SETTING (13 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=0.8905, expected range: 0.8370 0.8370
COSMIC2-E1 GPSRO RISING (23 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.1160, expected range: -0.2430 -0.2430
COSMIC2-E1 GPSRO RISING HEIGHT 22-24 KM : out of range
Slight: stdev_norm_fgdepar=1.1364, expected range: 1.0683 1.0683
COSMIC2-E1 GPSRO RISING HEIGHT 26-28 KM : out of range
Slight: stdev_norm_fgdepar=0.9974, expected range: 1.0632 1.0632
COSMIC2-E1 GPSRO RISING HEIGHT 42-44 KM : out of range
Slight: stdev_norm_fgdepar=0.6155, expected range: 0.6885 0.6885
COSMIC2-E2 GPSRO SETTING (22 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.1542, expected range: -0.2811 -0.2811
COSMIC2-E2 GPSRO SETTING (7 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=1.0886, expected range: 1.0050 1.0050
COSMIC2-E2 GPSRO RISING (23 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.1792, expected range: -0.2988 -0.2988
COSMIC2-E2 GPSRO RISING (13 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=0.8624, expected range: 0.8093 0.8093
COSMIC2-E3 GPSRO SETTING (25 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.1655, expected range: -0.2440 -0.2440
COSMIC2-E3 GPSRO SETTING (10 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=1.1244, expected range: 1.0532 1.0532
COSMIC2-E3 GPSRO RISING (23 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.1823, expected range: -0.1653 -0.1653
COSMIC2-E3 GPSRO RISING (8 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=0.9024, expected range: 0.8351 0.8351
COSMIC2-E4 GPSRO SETTING (24 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.2189, expected range: -0.1037 -0.1037
COSMIC2-E4 GPSRO SETTING (9 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=1.0744, expected range: 0.9255 0.9255
COSMIC2-E4 GPSRO RISING (24 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.1583, expected range: -0.0951 -0.0951
COSMIC2-E4 GPSRO RISING (5 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=1.1321, expected range: 1.0652 1.0652
COSMIC2-E5 GPSRO SETTING (24 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.1934, expected range: -0.2184 -0.2184
COSMIC2-E5 GPSRO SETTING (5 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=0.9226, expected range: 0.8632 0.8632
COSMIC2-E5 GPSRO RISING (24 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.1513, expected range: -0.2462 -0.2462
COSMIC2-E5 GPSRO RISING (10 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=0.9425, expected range: 1.0249 1.0249
COSMIC2-E6 GPSRO SETTING (22 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.0329, expected range: -0.0723 -0.0723
COSMIC2-E6 GPSRO SETTING (8 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=0.8321, expected range: 0.9066 0.9066
COSMIC2-E6 GPSRO RISING (23 impact heights affected) : out of range
Slight: avg_norm_fgdepar=-0.0843, expected range: -0.1724 -0.1724
COSMIC2-E6 GPSRO RISING (6 impact heights affected) : out of range
Slight: stdev_norm_fgdepar=0.8998, expected range: 0.9805 0.9805
Geostationary CSR
METEOSAT-8 SEVIRI RADIANCES CHANNEL 3 : out of range
Severe: avg_biascorr=-0.0974, expected range: -0.0080 0.0674
METEOSAT-8 SEVIRI RADIANCES CHANNEL 8 : out of range
Severe: avg_fgdepar=-0.1748, expected range: 0.0016 0.0894
HIMAWARI-8 AHI RADIANCES CHANNEL 2 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=0.2156, expected range: -0.0937 0.0151
HIMAWARI-8 AHI RADIANCES CHANNEL 3 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=0.1689, expected range: -0.1038 0.0145
GOES-16 ABI RADIANCES CHANNEL 2 : out of range
Considerable: obs_number=19791.0000, expected range: 21818.8424 24039.1576
GOES-16 ABI RADIANCES CHANNEL 3 : out of range
Considerable: obs_number=19778.0000, expected range: 21827.9490 24027.0510
GOES-16 ABI RADIANCES CHANNEL 4 : out of range
Considerable: obs_number=19844.0000, expected range: 21858.0556 24035.9444
mwri
FY-3D MWRI RADIANCES (11 channels affected) : out of range
Considerable: obs_number=5945.0000, expected range: 5226.6497 5495.3503
scatt
METOP-A ASCAT WIND VECTOR DIFF (M/S) : out of range
Slight: avg_fgdepar=-0.0500, expected range: -0.0230 -0.0230
METOP-B ASCAT WIND VECTOR DIFF (M/S) : out of range
Slight: avg_fgdepar=-0.0404, expected range: -0.0261 -0.0261
METOP-C ASCAT WIND VECTOR DIFF (M/S) : out of range
Slight: avg_fgdepar=-0.0453, expected range: -0.0100 -0.0100