Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-09-15 12:00

iasi
METOP-C IASI RADIANCES (220 channels affected) : out of range
Severe: obs_number=6790.0000, expected range: 21799.6992 23914.7452
METOP-C IASI RADIANCES CHANNEL 109 : out of range
Severe: avg_fgdepar=-0.0251, expected range: -0.0047 0.0130
METOP-C IASI RADIANCES CHANNEL 116 : out of range
Severe: avg_fgdepar=-0.0354, expected range: -0.0095 0.0140
METOP-C IASI RADIANCES CHANNEL 122 : out of range
Severe: avg_fgdepar=-0.0399, expected range: -0.0113 0.0170
METOP-C IASI RADIANCES CHANNEL 161 : out of range
Severe: avg_fgdepar=-0.0292, expected range: -0.0077 0.0144
METOP-C IASI RADIANCES CHANNEL 167 : out of range
Severe: avg_fgdepar=-0.0255, expected range: -0.0086 0.0136
METOP-C IASI RADIANCES CHANNEL 2991 : out of range
Severe: avg_fgdepar=0.0956, expected range: -0.0708 0.0237
METOP-C IASI RADIANCES CHANNEL 354 : out of range
Severe: stdev_fgdepar=0.2038, expected range: 0.2215 0.2329
METOP-C IASI RADIANCES CHANNEL 282 : out of range
Severe: stdev_fgdepar=0.1975, expected range: 0.2138 0.2324
METOP-C IASI RADIANCES CHANNEL 299 : out of range
Severe: stdev_fgdepar=0.2133, expected range: 0.2379 0.2499
METOP-C IASI RADIANCES CHANNEL 366 : out of range
Severe: stdev_fgdepar=0.1929, expected range: 0.2089 0.2287
METOP-C IASI RADIANCES CHANNEL 386 : out of range
Severe: stdev_fgdepar=0.2132, expected range: 0.2281 0.2463
METOP-C IASI RADIANCES CHANNEL 389 : out of range
Severe: stdev_fgdepar=0.2079, expected range: 0.2264 0.2504
METOP-C IASI RADIANCES CHANNEL 63 : out of range
Considerable: avg_fgdepar=-0.0243, expected range: -0.0108 0.0151
METOP-C IASI RADIANCES CHANNEL 135 : out of range
Considerable: avg_fgdepar=-0.0295, expected range: -0.0133 0.0159
METOP-C IASI RADIANCES CHANNEL 148 : out of range
Considerable: avg_fgdepar=-0.0289, expected range: -0.0111 0.0175
METOP-C IASI RADIANCES CHANNEL 165 : out of range
Considerable: avg_fgdepar=-0.0232, expected range: -0.0085 0.0202
METOP-C IASI RADIANCES CHANNEL 416 : out of range
Considerable: avg_fgdepar=0.0535, expected range: -0.0020 0.0342
METOP-C IASI RADIANCES CHANNEL 2907 : out of range
Considerable: avg_fgdepar=0.1121, expected range: -0.0672 0.0513
METOP-C IASI RADIANCES CHANNEL 3029 : out of range
Considerable: avg_fgdepar=0.0951, expected range: -0.0674 0.0324
METOP-C IASI RADIANCES CHANNEL 3049 : out of range
Considerable: avg_fgdepar=0.0937, expected range: -0.0632 0.0328
airs
AQUA AIRS RADIANCES CHANNEL 93 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.0973, expected range: -0.0662 -0.0452
AQUA AIRS RADIANCES CHANNEL 99 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=0.0289, expected range: 0.0522 0.0635
AQUA AIRS RADIANCES CHANNEL 104 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=0.0307, expected range: 0.0632 0.0814
AQUA AIRS RADIANCES CHANNEL 105 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=0.1135, expected range: 0.1413 0.1684
AQUA AIRS RADIANCES CHANNEL 110 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=0.0150, expected range: 0.0380 0.0660
AQUA AIRS RADIANCES CHANNEL 111 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.0644, expected range: -0.0406 -0.0232
AQUA AIRS RADIANCES CHANNEL 116 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=0.0118, expected range: 0.0552 0.0694
AQUA AIRS RADIANCES CHANNEL 117 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=0.0139, expected range: 0.0319 0.0417
AQUA AIRS RADIANCES CHANNEL 123 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.1022, expected range: -0.0765 -0.0609
AQUA AIRS RADIANCES CHANNEL 128 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=0.0430, expected range: 0.0691 0.0949
ssmis
DMSP-18 SSMIS RADIANCES CHANNEL 7 : out of range
4 times in the last 10 days for at least one item
Severe: avg_biascorr=4.8301, expected range: 3.6498 4.2196
gpsro
COSMIC2-E2 GPSRO SETTING HEIGHT 12-14 KM : out of range
Slight: stdev_norm_fgdepar=1.0684, expected range: 0.7512 0.9962
SPIRE LEMUR 3U GPSRO SETTING (24 impact heights affected) : out of range
Slight: obs_number=3405.0000, expected range: 4006.6661 5180.6281
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1010-1011 (HPA) : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-3.9736, expected range: -3.3301 -3.2556
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 10-11 (HPA) : out of range
19 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=0.0087, expected range: 0.0066 0.0068
Severely_persistent: avg_fgdepar=-0.0252, expected range: -0.0338 -0.0324
METOP-B GOME-2 OZONE, TOP PRESSURE LAYER 12-13 (HPA) : out of range
11 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=4.6561, expected range: 5.0442 5.3625
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1600-1601 (HPA) : out of range
8 times in the last 10 days for at least one item
Slight: stdev_fgdepar=3.4760, expected range: 2.7254 3.3217
Radiosondes
LAND TEMP TEMPERATURE (K) 17064 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.2514, expected range: 0.0000 3.4546
HIGH RESO LAND TEMP TEMPERATURE (K) 56492 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.4746, expected range: 0.3486 1.8326
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
Considerable: obs_number=93.0000, expected range: 167.2406 184.5094
amdar
TAMDAR WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : missing
2 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 252.9005
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU5745 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.1801, expected range: 0.0000 8.5298
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU4538 (2 pressure layers affected) : out of range
Severe: avg_fgdepar=24.6791, expected range: -1.5395 7.3368
Severe: rms_fgdepar=24.6791, expected range: 0.0000 7.3162
Severe: avg_pge=0.8944, expected range: -0.4130 0.5807
WIGOS AMDAR TEMPERATURE (K) GXSXPBBA PRESSURE LAYER 0-300 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=8.5242, expected range: 0.0000 2.1532
Severe: avg_pge=0.8718, expected range: 0.0000 0.0000
ADS-C WIND VECTOR DIFF (M/S) J4RYCOJA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=17.3309, expected range: 0.0000 9.3110
ADS-C WIND VECTOR DIFF (M/S) 2CGXUXJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=25.0216, expected range: 0.0000 8.6048
ADS-C WIND VECTOR DIFF (M/S) JXFEIFRA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=21.2131, expected range: 0.0000 8.3151
ADS-C WIND VECTOR DIFF (M/S) C03XONRA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=23.5113, expected range: 0.0000 10.0073
airep
AIREP WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : out of range
Slight: obs_number=428.0000, expected range: 35.9772 219.1660
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 10169 PRESSURE LAYER 900-1200 : out of range
Severe: rms_fgdepar=21.8710, expected range: 0.0000 17.1480
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 78807 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.0291, expected range: 3.1400 7.8344
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 17880 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8056, expected range: -1.7038 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 17060 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8030, expected range: -1.5161 0.7500
BUFR LAND SYNOP RH2M (%) 04162 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-52.9401, expected range: -171.4618 158.2889
Severely_persistent: rms_fgdepar=52.9843, expected range: 0.0000 92.5898
Severely_persistent: avg_pge=0.9703, expected range: -1.9129 0.7500
MANUAL LAND SYNOP RH2M (%) 62120 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.9999, expected range: -0.8547 0.7500
MANUAL LAND SYNOP RH2M (%) 43324 : out of range
Severe: avg_pge=0.9259, expected range: -0.3908 0.4876
BUFR LAND SYNOP SURFACE PRESSURE (PA) 60210 : out of range
Severe: rms_fgdepar=329.6870, expected range: 0.0000 134.7817
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33961 : out of range
Severe: rms_fgdepar=302.9447, expected range: 0.0000 295.1044
Severe: avg_pge=0.8389, expected range: -0.7709 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33391 : out of range
Severe: rms_fgdepar=575.5186, expected range: 0.0000 219.6408
BUFR LAND SYNOP SURFACE PRESSURE (PA) 14542 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=530.3608, expected range: 0.0000 181.5871
BUFR LAND SYNOP SURFACE PRESSURE (PA) 81833 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8055, expected range: 0.7670 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 13278 : out of range
Severe: rms_fgdepar=533.0348, expected range: 0.0000 157.5759
BUFR LAND SYNOP RH2M (%) 44210 : out of range
Severe: rms_fgdepar=32.0439, expected range: 0.0000 12.8225
BUFR LAND SYNOP RH2M (%) 16261 : out of range
Severe: rms_fgdepar=34.3752, expected range: 0.0000 19.2595
BUFR LAND SYNOP RH2M (%) 44216 : out of range
Severe: rms_fgdepar=35.8050, expected range: 0.0000 5.6813
BUFR LAND SYNOP RH2M (%) 72578 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=33.8497, expected range: 0.0000 19.2633
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) TBWUK61 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=835.8005, expected range: -1822.6323 1610.6820
Severely_persistent: rms_fgdepar=835.8005, expected range: -1269.9498 1705.1196
Severely_persistent: avg_pge=0.8813, expected range: -1.7012 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OYGR2 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-534.8830, expected range: -829.7990 -447.7389
Severely_persistent: rms_fgdepar=535.1763, expected range: 447.8360 829.7401
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRLJ4 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1306.4928, expected range: 307.4717 2004.7715
Severely_persistent: rms_fgdepar=1306.4928, expected range: 323.6732 1995.7928
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VDBY : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1336.6255, expected range: -1647.8608 2563.4584
Severely_persistent: rms_fgdepar=1337.1111, expected range: 0.0000 2538.5051
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OWSC2 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=504.2829, expected range: -71.8592 1117.9298
Severe: rms_fgdepar=504.2829, expected range: 0.0000 1117.9298
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRG03 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=1060.5054, expected range: 494.7756 1349.9562
Severe: rms_fgdepar=1060.5054, expected range: 494.7756 1349.9562
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6RN3 : out of range
Severe: rms_fgdepar=303.2983, expected range: 0.0000 169.2942
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6DL4 : out of range
Severe: rms_fgdepar=441.9601, expected range: 0.0000 171.5640
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7A5205 : out of range
Severe: avg_fgdepar=574.2833, expected range: 110.0455 594.6183
Severe: rms_fgdepar=574.2833, expected range: 109.8556 594.9760
Severe: avg_pge=0.8261, expected range: 0.6147 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) LAOL5 : out of range
Severe: avg_fgdepar=952.1646, expected range: -393.1970 468.4233
Severe: rms_fgdepar=952.1646, expected range: 0.0000 271.8587
Severe: avg_pge=0.8869, expected range: -0.4088 0.5063
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7ZZ6 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-537.1661, expected range: -734.5721 678.1647
Severe: rms_fgdepar=537.1661, expected range: -795.5022 1117.9907
Severe: avg_pge=0.8278, expected range: -1.2204 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRNI7 : out of range
Severe: avg_fgdepar=-924.6732, expected range: -331.8890 305.7799
Severe: rms_fgdepar=924.6732, expected range: 0.0000 394.3769
Severe: avg_pge=0.9051, expected range: -0.7749 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WTED : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-602.5640, expected range: -109.7393 44.9784
Severe: rms_fgdepar=605.8445, expected range: 0.0000 115.1212
Severe: avg_pge=0.8518, expected range: -0.0494 0.0572
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WACW : out of range
Severe: avg_fgdepar=759.0047, expected range: 552.6679 833.3854
Severe: rms_fgdepar=759.0047, expected range: 552.7280 833.5478
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 9V7382 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8894, expected range: -0.7252 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) C6DL4 : out of range
Severe: avg_fgdepar=30.3423, expected range: 0.1442 9.9518
Severe: rms_fgdepar=30.3423, expected range: 0.8477 9.9609
Severe: avg_pge=0.9452, expected range: -0.3300 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) LAMG7 : out of range
Severe: avg_fgdepar=38.1872, expected range: -3.5370 8.2410
Severe: rms_fgdepar=38.1872, expected range: 0.0000 8.8767
Severe: avg_pge=0.9580, expected range: -0.8068 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 2101882 : out of range
Severe: rms_fgdepar=316.4789, expected range: 0.0000 93.4543
DRIFTING BUOYS SURFACE PRESSURE (PA) 2101834 : out of range
Severe: rms_fgdepar=300.6382, expected range: 0.0000 82.3579
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-773.9083, expected range: -774.6556 -771.7741
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=773.9087, expected range: 771.7742 774.6556
BUFR LAND SYNOP SNOW (CM) _MI1F9AC : out of range
29 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=51.5000, expected range: 44.7018 57.3500
BUFR LAND SYNOP SNOW (CM) _MI1F9AC : out of range
29 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=52.2563, expected range: 45.5747 57.8861
t2m
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.4320, expected range: -20.8685 -11.2249
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=17.4338, expected range: 11.2516 20.8656
MANUAL LAND SYNOP 2M TEMPERATURE (K) 63671 : out of range
Severe: rms_fgdepar=11.5363, expected range: 0.4411 1.6428
MANUAL LAND SYNOP 2M TEMPERATURE (K) 38337 : out of range
Severe: rms_fgdepar=10.6328, expected range: 0.0000 5.8144