Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-07-31 00:00

amsua
METOP-B AMSUA ALL SKY RADIANCES CHANNEL 14 : out of range
Slight: stdev_norm_fgdepar=0.6611, expected range: 0.5938 0.6457
atms
All NPP ATMS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 11689.70 14156.47
ssmis
DMSP-17 SSMIS RADIANCES CHANNEL 9 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.0911, expected range: 0.5093 0.5519
DMSP-17 SSMIS RADIANCES CHANNEL 8 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.1323, expected range: 0.3672 0.3702
Slight: stdev_norm_fgdepar=0.1257, expected range: 0.4890 0.4890
DMSP-17 SSMIS RADIANCES CHANNEL 11 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.0268, expected range: 0.1564 0.2072
Slight: stdev_norm_fgdepar=0.0355, expected range: 0.6108 0.6108
DMSP-17 SSMIS RADIANCES CHANNEL 10 : out of range
15 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.0523, expected range: 0.5579 0.5579
DMSP-17 SSMIS RADIANCES CHANNEL 17 : out of range
13 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.0827, expected range: 0.7707 0.7707
DMSP-18 SSMIS RADIANCES CHANNEL 9 : out of range
15 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.0794, expected range: 0.5113 0.5113
DMSP-18 SSMIS RADIANCES CHANNEL 10 : out of range
15 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.0481, expected range: 0.5874 0.5874
DMSP-18 SSMIS RADIANCES CHANNEL 11 : out of range
11 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.0327, expected range: 0.6393 0.6393
Atmospheric Motion Vector
All AQUA MODIS CLEAR WV ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 176.19 2324.41
All NPP VIIRS AMV IR ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 292.66 1787.75
Radiosondes
LAND TEMP Q (G/KG) 35700 PRESSURE LAYER 900-1200 (HPA) : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=6.2957, expected range: -4.4345 11.9216
Severely_persistent: rms_fgdepar=6.4979, expected range: 0.0000 11.8835
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=6.5191, expected range: 1.1870 9.6302
Severely_persistent: rms_fgdepar=6.5294, expected range: 1.2019 9.6316
LAND TEMP WIND VECTOR DIFF (M/S) 17240 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=27.0303, expected range: 0.0000 4.9960
LAND TEMP WIND VECTOR DIFF (M/S) 67197 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=15.6733, expected range: 0.4973 5.9238
LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=10.7920, expected range: 1.7863 6.8243
LAND TEMP TEMPERATURE (K) 16754 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.8463, expected range: 0.0000 2.7192
LAND TEMP TEMPERATURE (K) 40766 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=7.5182, expected range: 0.0000 2.9795
HIGH RESO LAND TEMP Q (G/KG) 59431 PRESSURE LAYER 900-1200 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=6.5747, expected range: 0.0000 12.8069
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 15420 PRESSURE LAYER 900-12 : out of range
Severe: rms_fgdepar=17.1786, expected range: 0.0000 9.1017
HIGH RESO LAND TEMP TEMPERATURE (K) 17281 PRESSURE LAYER 900-1200 (HPA : out of range
Severe: rms_fgdepar=8.0713, expected range: 0.0000 4.3915
Severe: avg_pge=0.9093, expected range: -1.0099 0.7500
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 42 : all data missing
Severe: obs_number=0, expected range: 18.73 263.39
All HIGH RESO SEA TEMP ALL LAYERS North West Pacific : all data missing
Severe: obs_number=0, expected range: 102.42 127.25
All BUFR TEMP DESCENT ALL LAYERS North Atlantic : all data missing
Severe: obs_number=0, expected range: 20.82 237.33
amdar
WIGOS AMDAR TEMPERATURE (K) EU0133 PRESSURE LAYER 0-300 (HPA) : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8689, expected range: -1.1888 0.7500
WIGOS AMDAR TEMPERATURE (K) ZLK1T1ZA PRESSURE LAYER 900-1200 (HPA) : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8444, expected range: -1.3161 0.7500
AMDAR WIND VECTOR DIFF (M/S) AU0180 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=17.8132, expected range: 0.0000 6.9537
WIGOS AMDAR TEMPERATURE (K) EU0785 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.1046, expected range: 0.0000 3.6699
Severe: avg_pge=0.8757, expected range: -0.6380 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) 1XJICMZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.4861, expected range: 0.0000 8.3159
WIGOS AMDAR WIND VECTOR DIFF (M/S) AU0180 PRESSURE LAYER 900-1200 (HPA : out of range
Severe: avg_fgdepar=32.3039, expected range: -2.2075 6.1497
Severe: rms_fgdepar=32.3039, expected range: 0.0000 6.5102
Severe: avg_pge=0.9276, expected range: -0.1416 0.1927
MODE-S WIND VECTOR DIFF (M/S) M4FA10D PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=16.9343, expected range: 0.0000 7.9425
airep
AIREP WIND VECTOR DIFF (M/S) THY7LK PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.2906, expected range: 0.0000 11.6997
synop
AUTOMATIC LAND SYNOP RH2M (%) 17956 : out of range
Severe: rms_fgdepar=32.1581, expected range: 0.0000 17.2974
Severe: rms_fgdepar=33.6154, expected range: 0.0000 15.6184
MANUAL LAND SYNOP RH2M (%) 60492 : out of range
Severe: rms_fgdepar=47.7883, expected range: 0.0000 29.3235
Severe: avg_pge=0.9471, expected range: -0.0015 0.0082
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40740 : out of range
Severe: rms_fgdepar=664.6381, expected range: 0.0000 112.6581
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 89642 : out of range
Severe: avg_fgdepar=-540.4570, expected range: -363.0889 409.1373
Severe: rms_fgdepar=554.7601, expected range: 0.0000 309.5663
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 89053 : out of range
Severe: rms_fgdepar=330.9362, expected range: 0.0000 176.7898
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 82353 : out of range
Severe: avg_fgdepar=-542.2530, expected range: -605.2179 -74.2262
Severe: rms_fgdepar=542.2530, expected range: 74.2262 605.2179
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 89574 : out of range
Severe: rms_fgdepar=459.0566, expected range: 0.0000 211.4729
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83967 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-711.3820, expected range: -220.4131 124.6513
Severe: rms_fgdepar=711.3820, expected range: 0.0000 208.0501
Severe: avg_pge=0.9209, expected range: -0.5396 0.7500
BUFR LAND SYNOP RH2M (%) 60253 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.9994, expected range: -1.4258 0.7500
BUFR LAND SYNOP RH2M (%) 08545 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=34.8481, expected range: 0.0000 10.5643
BUFR LAND SYNOP RH2M (%) 40439 : out of range
Severe: avg_pge=0.9998, expected range: -1.2883 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 15302 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=375.6388, expected range: 0.0000 75.8166
BUFR LAND SYNOP SURFACE PRESSURE (PA) 94444 : out of range
Severe: avg_fgdepar=-951.7585, expected range: -442.8848 628.2834
Severe: rms_fgdepar=951.7585, expected range: -398.8764 597.2170
Severe: avg_pge=0.9414, expected range: -1.5101 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 28275 : out of range
Severe: rms_fgdepar=384.7810, expected range: 0.0000 114.8508
BUFR LAND SYNOP SURFACE PRESSURE (PA) 36307 : out of range
Severe: rms_fgdepar=339.9336, expected range: 0.0000 134.9639
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71588 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=530.6209, expected range: 441.2801 524.0808
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V8585 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=710.5134, expected range: 512.1465 880.7423
Severely_persistent: rms_fgdepar=710.5134, expected range: 512.1465 880.7423
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V9268 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8005, expected range: -1.3817 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) PJWM : out of range
21 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=687.5267, expected range: 182.6582 1129.3426
Severely_persistent: rms_fgdepar=687.5267, expected range: 182.6582 1129.3426
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRCF6 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8669, expected range: 0.0839 0.7500
SHIP SURFACE PRESSURE (PA) WTEK : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8619, expected range: -1.2484 0.7500
ABBREVIATED SHIP SURFACE PRESSURE (PA) WTEK : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8328, expected range: -0.6296 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) HEWXGHC : out of range
Severe: rms_fgdepar=15.6094, expected range: 0.0000 7.7467
Severe: avg_pge=0.8732, expected range: -0.9360 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) ZMMC : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8923, expected range: -0.5623 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) RCMSZ4L : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8945, expected range: -0.2822 0.7500
All BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) WMO BLOCK 5 : all data missing
Severe: obs_number=0, expected range: 25.21 153.72
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 6102804 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-677.3536, expected range: -1575.7695 1242.6161
Severely_persistent: rms_fgdepar=678.4718, expected range: -1231.5846 1570.6614
Severely_persistent: avg_pge=0.9249, expected range: -1.8589 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6204570 : out of range
Severe: avg_pge=0.8557, expected range: -0.4138 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4401851 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=450.2715, expected range: 0.0000 232.9747
Severe: avg_pge=0.8824, expected range: -0.4393 0.7132
DRIFTING BUOYS SURFACE PRESSURE (PA) 3401545 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=351.4235, expected range: 0.0000 104.9234
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-773.5287, expected range: -773.4478 -772.1329
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=773.5288, expected range: 772.1330 773.4478
t2m
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13681 : out of range
Severe: rms_fgdepar=10.5147, expected range: 0.2799 4.9673
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1BC83 : out of range
Severe: rms_fgdepar=11.4695, expected range: 2.6695 6.4387
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI12FF4 : out of range
Severe: rms_fgdepar=10.5017, expected range: 1.5412 6.2310
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI167E7 : out of range
Severe: rms_fgdepar=10.6908, expected range: 1.6481 4.7245
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1FA4A : out of range
Severe: rms_fgdepar=10.8432, expected range: 2.9409 6.1638
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI10FCC : out of range
Severe: rms_fgdepar=10.1645, expected range: 1.6614 4.5294
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1AC2D : out of range
Severe: rms_fgdepar=10.1835, expected range: 1.7273 4.4433
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1FC1E : out of range
Severe: rms_fgdepar=10.8528, expected range: 2.6600 5.0628
rh2m
MANUAL LAND SYNOP RH2M (%) 82184 : out of range
Severe: rms_fgdepar=38.9116, expected range: 0.0000 22.1435
MANUAL LAND SYNOP RH2M (%) 94716 : out of range
Severe: rms_fgdepar=38.1815, expected range: 0.0000 21.5715
METAR RH2M (%) KTKI : out of range
Severe: rms_fgdepar=30.8150, expected range: 0.0000 16.6269
BUFR LAND SYNOP RH2M (%) _MI155C2 : out of range
Severe: rms_fgdepar=38.9994, expected range: 1.8922 19.0795
BUFR LAND SYNOP RH2M (%) _MI1AFF6 : out of range
Severe: rms_fgdepar=37.3745, expected range: 1.5469 19.5111
BUFR LAND SYNOP RH2M (%) _MI1CE98 : out of range
Severe: rms_fgdepar=32.3749, expected range: 5.5120 18.8258
BUFR LAND SYNOP RH2M (%) _MI19BCB : out of range
Severe: rms_fgdepar=35.1229, expected range: 1.5140 19.8305
BUFR LAND SYNOP RH2M (%) _MI1812F : out of range
Severe: rms_fgdepar=33.3741, expected range: 5.2619 21.2486