Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-10-04 12:00

mwhs2
FY-3C MWHS2 ALLSKY RADIANCES CHANNEL 3 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.7890, expected range: -0.7218 -0.6340
FY-3C MWHS2 ALLSKY RADIANCES CHANNEL 6 : out of range
Slight: stdev_norm_fgdepar=0.8516, expected range: 0.7345 0.8135
atms
NPP ATMS RADIANCES CHANNEL 13 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.3168, expected range: -0.2972 -0.2766
NPP ATMS RADIANCES CHANNEL 12 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.3006, expected range: -0.2750 -0.2491
Severely_persistent: avg_biascorr=-0.2758, expected range: -0.2092 -0.1749
NOAA20 ATMS RADIANCES CHANNEL 12 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.3815, expected range: -0.3168 -0.2936
gpsro
All TERRASAR-X GPSRO SETTING ALL HEIGHTS Global : all data missing
Severe: obs_number=0, expected range: 107.82 877.30
Atmospheric Motion Vector
NOAA20 VIIRS-AMV IR WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=231.0000, expected range: 0.0000 109.9311
METEOSAT-11 AMV CLOUDY WV2 WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-6 : out of range
Slight: avg_press=449.4346, expected range: 401.6934 432.1831
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1-2 (HPA) : out of range
31 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.0153, expected range: -0.0078 -0.0031
Severely_persistent: avg_fgdepar=-0.0799, expected range: -0.0238 0.0126
Severely_persistent: stdev_fgdepar=0.0188, expected range: 0.0013 0.0090
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 10-11 (HPA) : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.0519, expected range: -0.0468 -0.0464
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 63940-63941 (HPA) : out of range
14 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=1.7511, expected range: 1.0425 1.4235
METOP-B GOME-2 OZONE, TOP PRESSURE LAYER 12-13 (HPA) : out of range
19 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=4.6254, expected range: 5.0442 5.5953
Severely_persistent: avg_biascorr=-0.7802, expected range: -0.9801 -0.9301
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1010-1011 (HPA) : out of range
18 times in the last 10 days for at least one item
Slight: avg_fgdepar=-4.0562, expected range: -3.3301 -3.3301
Radiosondes
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA : missing
7 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 94.9354 99.5646
LAND TEMP WIND VECTOR DIFF (M/S) 30054 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=22.9717, expected range: 0.6651 4.1766
Severe: rms_fgdepar=23.0150, expected range: 0.8368 5.0218
Severe: avg_pge=0.8695, expected range: -0.6163 0.7500
LAND TEMP WIND VECTOR DIFF (M/S) 76679 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=15.1061, expected range: 0.6175 3.7588
LAND TEMP WIND VECTOR DIFF (M/S) 32540 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=16.4086, expected range: 0.0000 8.6114
Severe: avg_pge=0.8461, expected range: -0.5332 0.7500
LAND TEMP Q (G/KG) 40417 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=-6.0048, expected range: -7.6995 8.6390
Severe: rms_fgdepar=6.9069, expected range: 0.0000 6.6783
All LAND TEMP ALL LAYERS WMO BLOCK 82 : all data missing
Severe: obs_number=0, expected range: 227.40 381.85
All LAND TEMP ALL LAYERS WMO BLOCK 83 : all data missing
Severe: obs_number=0, expected range: 256.57 430.18
HIGH RESO LAND TEMP Q (G/KG) 07510 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.3733, expected range: 0.0000 1.1631
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=1.5687, expected range: 0.2946 1.0029
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU1722 PRESSURE LAYER 0-300 (HPA) : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8640, expected range: -0.2242 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU1722 (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=25.4246, expected range: -25.4444 59.7894
Severe: rms_fgdepar=27.2340, expected range: 0.0000 64.8201
MODE-S WIND VECTOR DIFF (M/S) M0020B0 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.3863, expected range: 0.0000 7.8813
ADS-C WIND VECTOR DIFF (M/S) TKNCSWZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.9134, expected range: 0.0000 9.2838
pilot
LAND PILOT WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=11.6351, expected range: 3.3981 6.5795
LAND PILOT WIND VECTOR DIFF (M/S) 48407 PRESSURE LAYER 600-900 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=19.9423, expected range: 0.0000 16.7536
LAND PILOT WIND VECTOR DIFF (M/S) 48407 (2 pressure layers affected) : out of range
Severe: avg_pge=0.8436, expected range: -0.9752 0.7500
synop
MANUAL LAND SYNOP RH2M (%) 66285 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9715, expected range: -0.7321 0.7500
MANUAL LAND SYNOP RH2M (%) 67229 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=51.5923, expected range: -6.2827 96.9519
Severely_persistent: rms_fgdepar=51.6150, expected range: 0.0000 97.0564
Severely_persistent: avg_pge=0.9999, expected range: -1.1713 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 36736 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8361, expected range: -0.3763 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71588 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=500.6968, expected range: 415.1015 571.7332
AUTOMATIC LAND SYNOP RH2M (%) 89011 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=61.7671, expected range: -42.3224 62.6153
Severe: rms_fgdepar=61.7743, expected range: 0.0000 61.6392
AUTOMATIC LAND SYNOP RH2M (%) 68471 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=32.6131, expected range: 0.0000 17.0770
MANUAL LAND SYNOP RH2M (%) 42661 : out of range
Severe: avg_pge=0.9672, expected range: -0.4136 0.5402
MANUAL LAND SYNOP RH2M (%) 67877 : out of range
Severe: rms_fgdepar=33.4283, expected range: 0.7785 12.2100
MANUAL LAND SYNOP RH2M (%) 41697 : out of range
Severe: avg_pge=1.0000, expected range: -1.3750 0.7500
MANUAL LAND SYNOP RH2M (%) 82879 : out of range
Severe: avg_pge=0.9058, expected range: -0.9505 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42740 : out of range
Severe: rms_fgdepar=333.3736, expected range: 0.0000 305.3408
Severe: avg_pge=0.8440, expected range: -1.0887 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 61811 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=425.4255, expected range: 0.0000 336.3899
Severe: avg_pge=0.8637, expected range: -0.1058 0.1293
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42704 : out of range
Severe: rms_fgdepar=466.4444, expected range: 0.0000 175.3918
Severe: avg_pge=0.8728, expected range: -0.5001 0.6420
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42577 : out of range
Severe: avg_pge=0.8427, expected range: -1.3099 0.7500
BUFR LAND SYNOP RH2M (%) 76040 : out of range
Severe: rms_fgdepar=37.2630, expected range: 0.0000 36.9347
Severe: avg_pge=0.8727, expected range: -0.1267 0.1702
BUFR LAND SYNOP RH2M (%) 72360 : out of range
Severe: rms_fgdepar=37.0747, expected range: 0.0000 7.6207
BUFR LAND SYNOP RH2M (%) 72271 : out of range
Severe: rms_fgdepar=35.7737, expected range: 0.0000 7.3533
BUFR LAND SYNOP RH2M (%) 34473 : out of range
Severe: rms_fgdepar=38.5778, expected range: 0.0000 18.7261
BUFR LAND SYNOP RH2M (%) 72556 : out of range
Severe: rms_fgdepar=36.9693, expected range: 0.0000 14.4507
BUFR LAND SYNOP RH2M (%) 38229 : out of range
Severe: rms_fgdepar=49.7450, expected range: 0.0000 21.4911
BUFR LAND SYNOP RH2M (%) 16459 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9740, expected range: -1.3098 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 63820 : out of range
Severe: rms_fgdepar=425.4289, expected range: 0.0000 129.3597
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48033 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=476.4160, expected range: 0.0000 460.4734
Severe: avg_pge=0.8665, expected range: -1.1442 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33376 : out of range
Severe: rms_fgdepar=561.3432, expected range: 0.0000 121.3458
ship
AUTOMATIC SHIP SURFACE PRESSURE (PA) 63059 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8348, expected range: -1.5656 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) YBBQ2 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=740.7761, expected range: 398.5659 1108.4692
Severely_persistent: rms_fgdepar=742.7034, expected range: 357.0595 1163.7846
BUFR SHIP SYNOP SURFACE PRESSURE (PA) KIAB : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=636.6580, expected range: 345.4991 1066.1598
Severely_persistent: rms_fgdepar=636.6580, expected range: 344.3809 1067.6353
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6NZ3 : out of range
Severe: rms_fgdepar=581.5404, expected range: 0.0000 163.2940
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V9725 : out of range
Severe: rms_fgdepar=610.2513, expected range: 0.0000 181.4573
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VROO6 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=490.1276, expected range: 0.0000 268.8794
Severe: avg_pge=0.8185, expected range: -0.8848 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6ZS6 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=539.3591, expected range: -608.7764 680.9506
Severe: rms_fgdepar=539.3591, expected range: 0.0000 497.9828
Severe: avg_pge=0.8016, expected range: -1.0976 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WGEB : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=674.0187, expected range: -1175.2027 1157.4070
Severe: rms_fgdepar=674.0187, expected range: -966.5922 1407.5219
Severe: avg_pge=0.8424, expected range: -0.8047 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WDJK : out of range
Severe: avg_fgdepar=549.4903, expected range: -393.4037 262.8601
Severe: rms_fgdepar=752.4425, expected range: 0.0000 335.3644
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) DJBF2 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=20.0032, expected range: -6.5381 15.0022
Severe: rms_fgdepar=20.0032, expected range: 0.0000 15.0010
Severe: avg_pge=0.8856, expected range: -1.0400 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) YBBQ2 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8520, expected range: 0.4828 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRUC4 : out of range
Severe: avg_fgdepar=21.5732, expected range: -2.7530 10.3472
Severe: rms_fgdepar=21.5732, expected range: 0.0000 10.7454
Severe: avg_pge=0.9148, expected range: -0.3623 0.7500
metar
METAR SURFACE PRESSURE (PA) EGYE : out of range
Severe: rms_fgdepar=469.3817, expected range: 0.0000 80.3346
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-777.5983, expected range: -799.5437 -760.8384
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=777.7938, expected range: 761.0449 799.4087
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71052 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.0207, expected range: -19.3285 -4.3242
Severely_persistent: rms_fgdepar=15.1815, expected range: 4.2885 19.6208
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1D122 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=16.1461, expected range: -16.1018 20.0663
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1D122 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=16.4097, expected range: -11.1701 19.9706
BUFR LAND SYNOP 2M TEMPERATURE (K) 71052 : out of range
22 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.5954, expected range: -19.5814 -4.3913
Severely_persistent: rms_fgdepar=15.7352, expected range: 4.3593 19.8579
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.7033, expected range: -19.9022 -6.5945
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=17.7198, expected range: 6.5767 19.9839
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.2203, expected range: -17.5655 -5.4808
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=14.4667, expected range: 5.4130 17.7200
MANUAL LAND SYNOP 2M TEMPERATURE (K) 43291 : out of range
Severe: avg_fgdepar=-17.3781, expected range: -0.8486 4.9791
Severe: rms_fgdepar=17.3781, expected range: 0.0000 4.7927
MANUAL LAND SYNOP 2M TEMPERATURE (K) 68267 : out of range
Severe: rms_fgdepar=10.2580, expected range: 0.0000 3.1287
MANUAL LAND SYNOP 2M TEMPERATURE (K) 67877 : out of range
Severe: avg_fgdepar=-17.5251, expected range: -4.4167 3.2626
Severe: rms_fgdepar=17.5251, expected range: 0.0000 4.5056
METAR 2M TEMPERATURE (K) KRIV : out of range
Severe: rms_fgdepar=13.6644, expected range: 1.0778 4.6782
LAND TEMP 2M TEMPERATURE (K) 61052 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.7835, expected range: 0.0000 13.8296
BUFR LAND SYNOP 2M TEMPERATURE (K) 68380 : out of range
Severe: avg_fgdepar=-12.0531, expected range: -4.2794 1.2516
Severe: rms_fgdepar=12.0531, expected range: 0.0000 4.0445
BUFR LAND SYNOP 2M TEMPERATURE (K) 43291 : out of range
Severe: avg_fgdepar=-17.4281, expected range: -0.8986 4.9291
Severe: rms_fgdepar=17.4281, expected range: 0.0000 4.6835