Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-04-08 12:00

amsua
NOAA-19 AMSUA RADIANCES CHANNEL 12 : out of range
Severe: stdev_fgdepar=0.3622, expected range: 0.3052 0.3375
iasi
METOP-C IASI RADIANCES CHANNEL 241 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0084, expected range: 0.0202 0.0218
cris
NOAA20 CRIS RADIANCES CHANNEL 134 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1239, expected range: -0.1142 -0.1107
NOAA20 CRIS RADIANCES CHANNEL 83 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0024, expected range: 0.0110 0.0197
NOAA20 CRIS RADIANCES CHANNEL 124 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0498, expected range: -0.0411 -0.0318
NOAA20 CRIS RADIANCES CHANNEL 125 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0983, expected range: -0.0901 -0.0829
NOAA20 CRIS RADIANCES CHANNEL 143 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1041, expected range: -0.0925 -0.0912
NOAA20 CRIS RADIANCES CHANNEL 110 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0726, expected range: 0.0808 0.0832
NPP CRIS RADIANCES CHANNEL 71 : out of range
Considerable: stdev_fgdepar=0.1048, expected range: 0.0876 0.0975
NPP CRIS RADIANCES CHANNEL 73 : out of range
Considerable: stdev_fgdepar=0.1084, expected range: 0.0852 0.0994
NOAA20 CRIS RADIANCES CHANNEL 138 : out of range
3 times in the last 10 days for at least one item
Considerable: avg_biascorr=-0.1119, expected range: -0.1037 -0.0922
ssmis
DMSP-17 SSMIS RADIANCES CHANNEL 16 : out of range
Considerable: stdev_norm_fgdepar=1.1665, expected range: 0.8734 1.0530
Atmospheric Motion Vector
METEOSAT-8 AMV CLOUDY WV1 WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 : out of range
2 times in the last 10 days for at least one item
Considerable: avg_fgdepar=3.1965, expected range: 4.0410 5.1025
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 6390-6391 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: stdev_fgdepar=5.5398, expected range: 3.5306 4.4850
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 10130-10131 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: stdev_fgdepar=6.4916, expected range: 4.7822 5.3656
Radiosondes
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 54135 PRESSURE LAYER 300-60 : out of range
Severe: rms_fgdepar=15.4960, expected range: 0.0000 6.2067
BUFR TEMP DESCENT Q (G/KG) PRESSURE LAYER 900-1200 (HPA) : missing
4 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 496.1125
amdar
AMDAR WIND VECTOR DIFF (M/S) ETH507 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=25.0843, expected range: -20.5973 33.1430
Severe: rms_fgdepar=25.0897, expected range: 0.0000 33.8052
Severe: avg_pge=0.8737, expected range: -1.2882 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) E3DYR4BA PRESSURE LAYER 300-600 (HP : out of range
Severe: rms_fgdepar=18.5761, expected range: 0.0000 8.1873
WIGOS AMDAR Q (G/KG) F33GUWRA PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.6710, expected range: 0.0000 1.9018
synop
MANUAL LAND SYNOP RH2M (%) 41560 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=50.5734, expected range: -82.0446 138.5657
Severely_persistent: rms_fgdepar=50.5734, expected range: 0.0000 138.5657
Severely_persistent: avg_pge=0.9674, expected range: -1.7202 0.7500
MANUAL LAND SYNOP RH2M (%) 42674 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9706, expected range: 0.3900 0.7500
MANUAL LAND SYNOP RH2M (%) 42387 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=1.0000, expected range: -1.3917 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 51818 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-646.8454, expected range: -497.6654 416.6661
Severely_persistent: rms_fgdepar=647.5347, expected range: 0.0000 470.4409
Severely_persistent: avg_pge=0.9226, expected range: -1.2893 0.7500
BUFR LAND SYNOP RH2M (%) 86850 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-54.8811, expected range: -75.4806 -36.2259
Severely_persistent: rms_fgdepar=55.0885, expected range: 37.4572 74.8370
AUTOMATIC LAND SYNOP RH2M (%) 35391 : out of range
Severe: rms_fgdepar=33.6631, expected range: 0.0000 16.6511
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83700 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-593.2395, expected range: -966.5898 822.0615
Severe: rms_fgdepar=768.3813, expected range: 0.0000 1030.2359
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 60690 : out of range
Severe: rms_fgdepar=332.3552, expected range: 0.0000 140.7796
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 48803 : out of range
Severe: rms_fgdepar=380.7079, expected range: 0.0000 177.8994
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 13583 : out of range
Severe: avg_pge=0.8394, expected range: -0.5372 0.6470
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 38886 : out of range
Severe: avg_pge=0.8095, expected range: -0.5372 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62008 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=380.7615, expected range: 0.0000 278.3641
Severe: avg_pge=0.8295, expected range: -1.1262 0.7500
MANUAL LAND SYNOP RH2M (%) 64650 : out of range
Severe: avg_fgdepar=56.3807, expected range: -8.3304 23.3330
Severe: rms_fgdepar=56.3807, expected range: 0.0000 23.3330
MANUAL LAND SYNOP RH2M (%) 38750 : out of range
Severe: avg_pge=0.9999, expected range: -0.0232 0.0365
MANUAL LAND SYNOP RH2M (%) 42393 : out of range
Severe: avg_pge=0.9823, expected range: -0.0431 0.0748
MANUAL LAND SYNOP RH2M (%) 43324 : out of range
Severe: avg_pge=0.9774, expected range: -1.6253 0.7500
MANUAL LAND SYNOP RH2M (%) 42915 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.9978, expected range: -2.0125 0.7500
MANUAL LAND SYNOP RH2M (%) 42027 : out of range
Severe: avg_pge=0.9228, expected range: -0.1289 0.1618
MANUAL LAND SYNOP RH2M (%) 42488 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=62.4304, expected range: -2.8258 18.4573
Severe: rms_fgdepar=62.4304, expected range: 0.0000 18.4573
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33187 : out of range
Severe: rms_fgdepar=309.0989, expected range: 0.0000 113.5590
BUFR LAND SYNOP RH2M (%) 86691 : out of range
Severe: avg_pge=0.9950, expected range: -0.3275 0.6510
BUFR LAND SYNOP RH2M (%) 33593 : out of range
Severe: rms_fgdepar=30.7781, expected range: 0.0000 17.1080
BUFR LAND SYNOP RH2M (%) 71855 : out of range
Severe: avg_fgdepar=53.4389, expected range: -48.7363 55.6757
Severe: rms_fgdepar=53.9514, expected range: 0.0000 37.6080
Severe: avg_pge=0.8994, expected range: -0.0277 0.0399
BUFR LAND SYNOP RH2M (%) _3489A17 : out of range
Severe: rms_fgdepar=31.8422, expected range: 0.0000 17.9397
BUFR LAND SYNOP RH2M (%) 23358 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-54.9514, expected range: -32.4044 20.2350
Severe: rms_fgdepar=54.9514, expected range: 0.0000 28.3659
Severe: avg_pge=0.9809, expected range: -0.0006 0.0068
BUFR LAND SYNOP RH2M (%) 33268 : out of range
Severe: rms_fgdepar=35.5813, expected range: 0.0000 19.4693
BUFR LAND SYNOP RH2M (%) 23678 : out of range
Severe: avg_fgdepar=-58.2249, expected range: -77.6414 44.9851
Severe: rms_fgdepar=58.2249, expected range: 0.0000 59.9923
Severe: avg_pge=0.9968, expected range: -0.0142 0.0282
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) : out of range
Considerable: obs_number=3589.0000, expected range: 3838.0837 4291.1663
Considerable: obs_number=567.0000, expected range: 678.3355 881.4145
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) CKR759 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8610, expected range: -0.3358 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V3071 : out of range
Severe: avg_fgdepar=682.7269, expected range: 61.8752 318.3528
Severe: rms_fgdepar=682.7269, expected range: 61.8752 318.3528
Severe: avg_pge=0.8493, expected range: -0.6952 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ZCDF4 : out of range
Severe: avg_fgdepar=-1037.6056, expected range: -655.2777 760.6702
Severe: rms_fgdepar=1037.6056, expected range: 0.0000 462.3724
Severe: avg_pge=0.9161, expected range: -0.6448 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7EQ4 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-735.1039, expected range: -534.5589 792.8029
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7EQ4 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=735.1039, expected range: 0.0000 723.5554
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7EQ4 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8809, expected range: -1.2488 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9VFV5 : out of range
Severe: rms_fgdepar=319.4165, expected range: 0.0000 140.6025
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRCC8 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=894.2862, expected range: 0.0000 657.8399
Severe: avg_pge=0.8879, expected range: -1.0534 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WCAJ : out of range
Severe: rms_fgdepar=337.5516, expected range: 0.0000 140.7134
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 7KDT : out of range
Severe: avg_fgdepar=1184.2134, expected range: -1665.7777 2164.3075
Severe: rms_fgdepar=1184.2134, expected range: 0.0000 1978.4122
Severe: avg_pge=0.9101, expected range: -1.3956 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) MJKZ4 : out of range
Severe: avg_fgdepar=26.1273, expected range: -13.6777 27.7166
Severe: rms_fgdepar=26.1273, expected range: 0.0000 27.9896
Severe: avg_pge=0.9317, expected range: -0.7747 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 5601522 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=447.4652, expected range: 0.0000 67.5628
DRIFTING BUOYS SURFACE PRESSURE (PA) 5401694 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8092, expected range: -0.9104 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1701568 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8399, expected range: -0.8889 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5501668 : out of range
Severe: rms_fgdepar=437.0680, expected range: 0.0000 137.7387
DRIFTING BUOYS SURFACE PRESSURE (PA) 5401698 : out of range
Severe: rms_fgdepar=423.2417, expected range: 0.0000 243.3941
Severe: avg_pge=0.8729, expected range: -0.7157 0.7500
metar
METAR SURFACE PRESSURE (PA) OPMJ : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-539.3208, expected range: -1022.0185 783.5423
Severely_persistent: rms_fgdepar=540.6950, expected range: 0.0000 979.4601
Severely_persistent: avg_pge=0.8190, expected range: -0.8334 0.7500
METAR SURFACE PRESSURE (PA) OEDR : out of range
Severe: rms_fgdepar=324.9466, expected range: 0.0000 86.6976
AUTOMATIC METAR SURFACE PRESSURE (PA) EGPB : out of range
Severe: rms_fgdepar=369.7232, expected range: 0.0000 131.1933
snow
AUTOMATIC LAND SYNOP SNOW (CM) 71743 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-71.7436, expected range: -82.2835 -70.1110
Severely_persistent: rms_fgdepar=71.7436, expected range: 70.1110 82.2835
AUTOMATIC LAND SYNOP SNOW (CM) 71576 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-51.6697, expected range: -59.5638 -55.8608
Severely_persistent: rms_fgdepar=51.6697, expected range: 55.8608 59.5638
MANUAL LAND SYNOP SNOW (CM) 16021 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=54.6940, expected range: 48.3819 61.9034
Severely_persistent: rms_fgdepar=54.6940, expected range: 48.3819 61.9034
MANUAL LAND SYNOP SNOW (CM) 71816 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-71.9861, expected range: -87.5313 -43.2641
Severely_persistent: rms_fgdepar=71.9861, expected range: 43.2769 87.5334
BUFR LAND SYNOP SNOW (CM) 01435 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=52.4964, expected range: 46.1166 54.8019
Severely_persistent: rms_fgdepar=52.4965, expected range: 46.2268 54.7266
BUFR LAND SYNOP SNOW (CM) 71816 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-71.8972, expected range: -87.4135 -43.2305
Severely_persistent: rms_fgdepar=71.8972, expected range: 43.2451 87.4164
AUTOMATIC LAND SYNOP SNOW (CM) 71134 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-52.6216, expected range: -53.4174 -38.6115
Severe: rms_fgdepar=52.6216, expected range: 38.6115 53.4174
BUFR LAND SYNOP SNOW (CM) 17095 : out of range
Severe: avg_fgdepar=66.0000, expected range: -4.1144 1.9417
BUFR LAND SYNOP SNOW (CM) 17095 : out of range
Severe: rms_fgdepar=66.0000, expected range: 0.0000 4.1144
BUFR LAND SYNOP SNOW (CM) 10836 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=28.1157, expected range: -4.4170 5.4758
t2m
MANUAL LAND SYNOP 2M TEMPERATURE (K) 25248 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.5611, expected range: -19.1289 11.9371
Severely_persistent: rms_fgdepar=15.5611, expected range: 0.0000 17.3124
BUFR LAND SYNOP 2M TEMPERATURE (K) 25248 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.6381, expected range: -19.1581 11.8671
Severely_persistent: rms_fgdepar=15.6381, expected range: 0.0000 17.3658
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24371 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.1961, expected range: -11.7684 7.3698
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24371 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.5281, expected range: 0.0000 11.4162
MANUAL LAND SYNOP 2M TEMPERATURE (K) 31102 : out of range
Severe: avg_fgdepar=-12.6023, expected range: -3.2629 4.4733
Severe: rms_fgdepar=12.6765, expected range: 0.0000 4.8741
METAR 2M TEMPERATURE (K) YAMB : out of range
Severe: avg_fgdepar=13.9808, expected range: -2.4667 2.8415
Severe: rms_fgdepar=13.9808, expected range: 0.0000 4.0867
METAR 2M TEMPERATURE (K) UGMS : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=14.3311, expected range: 1.9431 16.2746
Severe: rms_fgdepar=14.3360, expected range: 2.2527 16.4888
METAR 2M TEMPERATURE (K) FEFT : out of range
Severe: avg_fgdepar=-12.1671, expected range: -5.4308 3.4044
Severe: rms_fgdepar=12.1671, expected range: 0.8772 4.0322
BUFR LAND SYNOP 2M TEMPERATURE (K) 24371 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.2085, expected range: -11.8258 7.3279
Severe: rms_fgdepar=12.5420, expected range: 0.0000 11.4765
BUFR LAND SYNOP 2M TEMPERATURE (K) 31102 : out of range
Severe: avg_fgdepar=-12.6599, expected range: -3.3190 4.4183
Severe: rms_fgdepar=12.7337, expected range: 0.0000 4.8228
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=652.0000, expected range: 732.0504 859.6163