Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-02-21 12:00

mhs
All METOP-A MHS ALLSKY ALL CHANNELS Global : all data missing
Severe: obs_number=0, expected range: 2642.24 28141.64
mwhs2
FY-3D MWHS2 ALLSKY RADIANCES (6 channels affected) : out of range
Slight: obs_number=51805.0000, expected range: 56121.9980 58192.3550
ssmis
All DMSP-17 SSMIS ALL CHANNELS Global : all data missing
Severe: obs_number=0, expected range: 6275.41 18851.49
All DMSP-18 SSMIS ALL CHANNELS Global : all data missing
Severe: obs_number=0, expected range: 6132.60 18299.30
Atmospheric Motion Vector
GOES-16 AMV IR1 WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: obs_number=3536.0000, expected range: 2083.6011 3046.1489
mwri
FY-3D MWRI RADIANCES (6 channels affected) : out of range
Considerable: obs_number=12724.0000, expected range: 14365.3621 16445.2262
Radiosondes
LAND TEMP TEMPERATURE (K) 24266 PRESSURE LAYER 900-1200 (HPA) : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8840, expected range: -1.0343 0.7500
LAND TEMP TEMPERATURE (K) 44373 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=9.1923, expected range: 0.0000 5.7306
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 26 : all data missing
Severe: obs_number=0, expected range: 0.00 441.15
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
Severe: obs_number=182.0000, expected range: 264.5311 276.2689
amdar
ADS-C TEMPERATURE (K) PRESSURE LAYER 300-600 (HPA) : missing
5 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 0.0000 271.7560
All AMDAR ALL LAYERS South Atlantic : all data missing
Severe: obs_number=0, expected range: 2.53 378.78
AMDAR WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : missing
1 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 601.7333
AMDAR TEMPERATURE (K) AU0125 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=7.4614, expected range: 0.0000 1.5806
WIGOS AMDAR TEMPERATURE (K) AU0125 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=7.5244, expected range: 0.1798 1.4004
ADS-C WIND VECTOR DIFF (M/S) 3YQUDQRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=32.8263, expected range: 0.0000 16.2663
Severe: avg_fgdepar=32.8263, expected range: -2.4331 10.2574
airep
AIREP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: rms_fgdepar=17.2210, expected range: 0.0281 11.3439
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 01206 PRESSURE LAYER 600-900 : out of range
Severe: avg_pge=0.8723, expected range: -1.1029 0.7500
Severe: rms_fgdepar=22.1533, expected range: 0.0000 12.1657
Severe: avg_fgdepar=22.0924, expected range: -2.5131 9.3101
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 01405 PRESSURE LAYER 600-900 : out of range
Severe: avg_pge=0.8760, expected range: -0.4460 0.7500
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 43466 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=24.7970, expected range: 0.0000 5.3444
LAND PILOT WIND VECTOR DIFF (M/S) 96011 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_pge=0.8927, expected range: -0.8179 0.7500
Severe: rms_fgdepar=18.7328, expected range: 0.0000 9.6642
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 18138 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8255, expected range: 0.4012 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 18162 : out of range
30 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=779.5725, expected range: 441.2808 934.5922
Severely_persistent: avg_fgdepar=779.1162, expected range: 440.0082 934.7168
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 17841 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8153, expected range: 0.7548 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 18210 : out of range
25 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8843, expected range: -1.1621 0.7500
MANUAL LAND SYNOP RH2M (%) 42776 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=54.9718, expected range: 0.0000 147.3791
Severely_persistent: avg_fgdepar=54.9718, expected range: -57.7473 147.3791
MANUAL LAND SYNOP RH2M (%) 42915 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=1.0000, expected range: -0.2834 0.7500
Severely_persistent: rms_fgdepar=51.3053, expected range: 7.7117 74.0207
Severely_persistent: avg_fgdepar=51.3053, expected range: 7.7117 74.0207
BUFR LAND SYNOP SURFACE PRESSURE (PA) 17015 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8620, expected range: -1.2720 0.7500
MANUAL LAND SYNOP RH2M (%) 40713 : out of range
Severe: avg_pge=0.9886, expected range: -0.0031 0.0106
Severe: rms_fgdepar=54.4349, expected range: 0.0000 27.3915
Severe: avg_fgdepar=54.4349, expected range: -45.4577 39.8909
MANUAL LAND SYNOP RH2M (%) 42792 : out of range
Severe: avg_pge=0.9451, expected range: -0.0679 0.1022
MANUAL LAND SYNOP RH2M (%) 40841 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8178, expected range: -0.0056 0.0118
MANUAL LAND SYNOP RH2M (%) 43441 : out of range
Severe: rms_fgdepar=37.6982, expected range: 0.0000 17.4608
MANUAL LAND SYNOP RH2M (%) 42921 : out of range
Severe: rms_fgdepar=30.6345, expected range: 0.0000 11.3240
MANUAL LAND SYNOP RH2M (%) 62011 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8963, expected range: -0.4045 0.5196
MANUAL LAND SYNOP RH2M (%) 76040 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.9993, expected range: -0.2702 0.7500
Severe: rms_fgdepar=61.9175, expected range: 17.3438 70.4929
Severe: avg_fgdepar=61.8038, expected range: 12.6358 74.1107
MANUAL LAND SYNOP RH2M (%) 62120 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9997, expected range: -0.3527 0.4716
Severe: rms_fgdepar=52.0090, expected range: 1.3794 43.3388
Severe: avg_fgdepar=52.0090, expected range: 1.3496 43.0646
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83288 : out of range
Severe: avg_pge=0.8643, expected range: -0.4277 0.7206
Severe: rms_fgdepar=446.4879, expected range: 0.0000 196.0369
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62458 : out of range
Severe: rms_fgdepar=315.9777, expected range: 0.0000 116.3801
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42177 : out of range
Severe: avg_pge=0.8360, expected range: -0.8587 0.7500
Severe: rms_fgdepar=334.4971, expected range: 0.0000 226.6628
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 91317 : out of range
Severe: avg_pge=0.8397, expected range: -1.4009 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 76743 : out of range
Severe: rms_fgdepar=303.8537, expected range: 0.0000 121.5861
BUFR LAND SYNOP Z (M) 44517 : out of range
Severe: avg_pge=0.9888, expected range: -0.5880 0.7071
BUFR LAND SYNOP RH2M (%) 94549 : out of range
Severe: rms_fgdepar=38.5060, expected range: 0.0000 20.8059
BUFR LAND SYNOP RH2M (%) 95529 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=30.5297, expected range: 0.0000 10.7648
BUFR LAND SYNOP RH2M (%) 94387 : out of range
Severe: rms_fgdepar=41.7623, expected range: 0.0000 16.9744
BUFR LAND SYNOP RH2M (%) 61627 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9991, expected range: -1.2695 0.7500
BUFR LAND SYNOP RH2M (%) 72425 : out of range
Severe: avg_pge=0.9297, expected range: -0.7012 0.7500
Severe: rms_fgdepar=60.7276, expected range: 0.0000 85.7242
Severe: avg_fgdepar=60.5850, expected range: -22.8698 85.8954
BUFR LAND SYNOP SURFACE PRESSURE (PA) 60177 : out of range
Severe: rms_fgdepar=605.0339, expected range: 0.0000 141.2806
BUFR LAND SYNOP SURFACE PRESSURE (PA) 40435 : out of range
Severe: avg_pge=0.8116, expected range: -0.9048 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48802 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8464, expected range: -0.0397 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=51.0000, expected range: 66.5385 92.5726
MANUAL LAND SYNOP SURFACE PRESSURE (PA) : out of range
4 times in the last 10 days for at least one item
Considerable: obs_number=99.0000, expected range: 65.3180 74.1820
Considerable: obs_number=63.0000, expected range: 73.3973 93.3527
ship
AUTOMATIC SHIP WIND VECTOR DIFF (M/S) 44150 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8498, expected range: 0.2639 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HJC9 : out of range
Severe: avg_pge=0.8935, expected range: -0.7626 0.7500
Severe: rms_fgdepar=814.2930, expected range: 0.0000 335.4981
Severe: avg_fgdepar=-814.2930, expected range: -356.4311 248.8235
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRLI8 : out of range
Severe: rms_fgdepar=501.2593, expected range: 0.0000 1726.4356
Severe: avg_fgdepar=501.0245, expected range: -526.8837 1536.9653
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V8208 : out of range
Severe: avg_pge=0.8061, expected range: -0.7024 0.7500
Severe: rms_fgdepar=542.7592, expected range: 0.0000 452.7217
Severe: avg_fgdepar=542.7592, expected range: -608.6135 673.8932
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ZCEF6 : out of range
Severe: avg_pge=0.8794, expected range: -0.6785 0.7500
Severe: rms_fgdepar=720.4160, expected range: 0.0000 275.6997
Severe: avg_fgdepar=-720.4160, expected range: -286.9193 169.4784
BUFR SHIP SYNOP SURFACE PRESSURE (PA) AMOUK36 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8042, expected range: -0.5264 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 2IYH4 : out of range
Severe: rms_fgdepar=349.3025, expected range: 0.0000 138.3978
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRDJ3 : out of range
Severe: rms_fgdepar=887.6416, expected range: 0.0000 521.6481
Severe: avg_fgdepar=-715.6278, expected range: -684.7883 357.8150
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OUUY2 : out of range
Severe: rms_fgdepar=432.7654, expected range: 0.0000 145.4943
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 9HJC9 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8901, expected range: -1.1216 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) C6AX3 : out of range
Severe: avg_pge=0.9441, expected range: -0.7242 0.7500
Severe: rms_fgdepar=29.8526, expected range: 0.0000 7.5744
Severe: avg_fgdepar=29.8526, expected range: -1.8779 7.5505
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 4601840 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8945, expected range: -0.8449 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 7201510 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8903, expected range: -0.9601 0.7500
Severely_persistent: rms_fgdepar=634.3191, expected range: 0.0000 649.0366
Severely_persistent: avg_fgdepar=590.9523, expected range: -685.0357 495.0577
DRIFTING BUOYS SURFACE PRESSURE (PA) 1501749 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8703, expected range: -0.0417 0.0515
Severe: rms_fgdepar=451.3506, expected range: 0.0000 97.3678
DRIFTING BUOYS SURFACE PRESSURE (PA) 4401577 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8796, expected range: -0.3085 0.3396
Severe: rms_fgdepar=667.7120, expected range: 0.0000 217.2746
Severe: avg_fgdepar=645.2201, expected range: -115.7166 149.4791
DRIFTING BUOYS SURFACE PRESSURE (PA) 5401625 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8738, expected range: -1.2993 0.7500
metar
METAR SURFACE PRESSURE (PA) KFMH : out of range
Severe: rms_fgdepar=305.2820, expected range: 0.0000 129.8483
METAR SURFACE PRESSURE (PA) SBNF : out of range
Severe: rms_fgdepar=317.9013, expected range: 0.0000 155.2095
snow
AUTOMATIC LAND SYNOP SNOW (CM) 71029 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=56.0558, expected range: 52.9212 54.2217
Severely_persistent: avg_fgdepar=-56.0558, expected range: -54.2217 -52.9212
AUTOMATIC LAND SYNOP SNOW (CM) 71576 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=52.9235, expected range: 50.4811 53.6589
Severely_persistent: avg_fgdepar=-52.9235, expected range: -53.6589 -50.4811
AUTOMATIC LAND SYNOP SNOW (CM) 71743 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=70.3987, expected range: 61.5225 76.1584
Severely_persistent: avg_fgdepar=-70.3987, expected range: -76.1584 -61.5225
AUTOMATIC LAND SYNOP SNOW (CM) 71742 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=57.5615, expected range: 27.2990 63.4606
Severely_persistent: avg_fgdepar=-57.5615, expected range: -63.4606 -27.2990
MANUAL LAND SYNOP SNOW (CM) 71816 : out of range
28 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=64.5045, expected range: 60.5967 77.5975
Severely_persistent: avg_fgdepar=-64.5045, expected range: -77.5886 -60.6022
BUFR LAND SYNOP SNOW (CM) 01036 : out of range
30 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=117.3767, expected range: 49.6498 125.7151
Severely_persistent: avg_fgdepar=-117.3533, expected range: -125.6375 -49.6517
BUFR LAND SYNOP SNOW (CM) 71816 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=64.4904, expected range: 60.3182 77.9515
Severely_persistent: avg_fgdepar=-64.4904, expected range: -77.9455 -60.3213
BUFR LAND SYNOP SNOW (CM) 01091 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=99.8984, expected range: 69.8586 97.1115
Severely_persistent: avg_fgdepar=-99.8970, expected range: -97.0774 -69.8591
BUFR LAND SYNOP SNOW (CM) 01480 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=68.0270, expected range: 54.1019 67.1425
Severely_persistent: avg_fgdepar=-68.0252, expected range: -67.1485 -54.0918
BUFR LAND SYNOP SNOW (CM) 01429 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=26.2772, expected range: -5.2567 9.3560
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 72552 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.0922, expected range: 0.0000 4.0970
MANUAL LAND SYNOP 2M TEMPERATURE (K) 25627 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=13.0257, expected range: 0.0000 10.2784
Severe: avg_fgdepar=-12.9007, expected range: -13.0016 8.7848
METAR 2M TEMPERATURE (K) VYNT : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=13.7038, expected range: 8.5577 13.0745
Severe: avg_fgdepar=13.5489, expected range: 8.4569 12.8569
METAR 2M TEMPERATURE (K) FEFT : out of range
Severe: rms_fgdepar=14.2966, expected range: 0.0000 4.1851
Severe: avg_fgdepar=-14.2966, expected range: -3.8946 3.1514
METAR 2M TEMPERATURE (K) KSBN : out of range
Severe: rms_fgdepar=10.3067, expected range: 0.0000 4.3607
BUFR LAND SYNOP 2M TEMPERATURE (K) 25627 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=13.0804, expected range: 0.0000 10.2485
Severe: avg_fgdepar=-12.9662, expected range: -12.8891 8.7352
rh2m
METAR RH2M (%) EPTM : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=33.1533, expected range: 0.0000 12.7333
AUTOMATIC LAND SYNOP RH2M (%) : out of range
Considerable: obs_number=67.0000, expected range: 74.7068 83.1879