Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-11-18 00:00

amsua
METOP-B AMSUA ALL SKY RADIANCES CHANNEL 7 : out of range
1 times in the last 10 days for at least one item
Considerable: avg_biascorr=-0.5580, expected range: -0.6627 -0.5972
AMSUA Pacific RARS
All NOAA-18 AMSUA ALL SKY CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 359.87 1681.12
All NOAA-19 AMSUA ALL SKY CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 114.61 1466.89
cris
NPP CRIS RADIANCES CHANNEL 20 : out of range
Slight: avg_fgdepar=-0.0304, expected range: -0.0223 0.0078
gpsro
All KOMPSAT-5 GPSRO SETTING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 258.23 830.27
Atmospheric Motion Vector
All HIMAWARI-8 AMV CLOUDY WV3 ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 256.69 867.14
Radiosondes
LAND TEMP Q (G/KG) 41891 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.4501, expected range: 0.0000 1.3965
LAND TEMP TEMPERATURE (K) 43285 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.9619, expected range: 0.4278 2.3768
LAND TEMP TEMPERATURE (K) 24688 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_fgdepar=9.1004, expected range: -0.4179 1.9255
Severe: rms_fgdepar=9.2424, expected range: 0.0407 2.2574
Severe: avg_pge=0.9076, expected range: -0.2893 0.6487
HIGH RESO LAND TEMP Q (G/KG) 57516 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=2.5263, expected range: 0.0417 0.4584
HIGH RESO LAND TEMP Q (G/KG) 43371 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=5.1501, expected range: 0.0000 2.2650
HIGH RESO LAND TEMP TEMPERATURE (K) 17196 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=8.5624, expected range: 0.1743 1.4338
HIGH RESO LAND TEMP TEMPERATURE (K) 54102 PRESSURE LAYER 900-1200 (HPA : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8572, expected range: -0.0718 0.7500
airep
AIREP WIND VECTOR DIFF (M/S) LOT4N PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=22.6582, expected range: -4.5517 12.4100
Severe: rms_fgdepar=47.5534, expected range: 0.0000 16.4270
AIREP WIND VECTOR DIFF (M/S) UAL140 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.8032, expected range: 0.0000 9.1343
AIREP WIND VECTOR DIFF (M/S) UAL760 PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=19.7504, expected range: 0.0000 7.3661
AIREP WIND VECTOR DIFF (M/S) UAL90 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.7243, expected range: 0.0000 7.0631
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 01405 PRESSURE LAYER 600-900 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=21.9549, expected range: -29.2556 43.9820
Severely_persistent: rms_fgdepar=21.9549, expected range: 0.0000 43.5386
synop
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 63450 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8120, expected range: -1.4175 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 63533 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8349, expected range: -0.5547 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 81797 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=608.5678, expected range: 493.1026 705.4450
Severely_persistent: rms_fgdepar=608.6421, expected range: 493.3048 705.8955
BUFR LAND SYNOP SURFACE PRESSURE (PA) 84825 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-509.5563, expected range: -689.5402 -363.1654
Severely_persistent: rms_fgdepar=510.4488, expected range: 366.3893 688.9429
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43192 : out of range
Severe: rms_fgdepar=401.9720, expected range: 0.0000 100.5163
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 80214 : out of range
Severe: avg_pge=0.8682, expected range: 0.0864 0.7500
MANUAL LAND SYNOP Z (M) 38957 : out of range
Severe: avg_pge=0.9975, expected range: -0.1759 0.2078
MANUAL LAND SYNOP RH2M (%) 42026 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=56.6191, expected range: -76.9312 120.3019
Severe: rms_fgdepar=56.6191, expected range: 0.0000 120.0497
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33917 : out of range
Severe: rms_fgdepar=462.1476, expected range: 0.0000 116.4267
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48921 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8399, expected range: -1.5462 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 67217 : out of range
Severe: rms_fgdepar=310.4220, expected range: 0.0000 133.7552
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72243 : out of range
Severe: avg_fgdepar=-700.9152, expected range: -240.8522 157.9187
Severe: rms_fgdepar=700.9152, expected range: 0.0000 187.6263
Severe: avg_pge=0.9282, expected range: -0.4089 0.5748
BUFR LAND SYNOP RH2M (%) 33421 : out of range
Severe: rms_fgdepar=30.7462, expected range: 0.0000 16.7626
BUFR LAND SYNOP RH2M (%) 40435 : out of range
Severe: rms_fgdepar=35.9127, expected range: 0.0000 18.1349
BUFR LAND SYNOP RH2M (%) 41055 : out of range
Severe: avg_pge=0.8910, expected range: -0.0777 0.1098
BUFR LAND SYNOP RH2M (%) 71892 : out of range
Severe: rms_fgdepar=42.1623, expected range: 0.0000 15.4790
BUFR LAND SYNOP RH2M (%) 86704 : out of range
Severe: avg_pge=0.9298, expected range: -0.0074 0.0157
BUFR LAND SYNOP RH2M (%) 86896 : out of range
Severe: rms_fgdepar=41.5325, expected range: 0.0000 23.0906
ship
AUTOMATIC SHIP WIND VECTOR DIFF (M/S) 62153 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=22.1455, expected range: -10.3865 23.7648
Severely_persistent: rms_fgdepar=22.1779, expected range: 0.0000 23.9299
Severely_persistent: avg_pge=0.9183, expected range: -0.5387 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) WDM2180 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8763, expected range: -0.6564 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 7JWH : out of range
26 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=565.3102, expected range: 365.3537 659.6700
Severely_persistent: rms_fgdepar=565.7310, expected range: 364.3353 661.7058
Severely_persistent: avg_pge=0.8210, expected range: 0.6934 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ONKK : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=510.4726, expected range: 21.1262 840.7426
Severely_persistent: rms_fgdepar=510.4726, expected range: 21.1262 840.7426
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7QT7 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=662.9926, expected range: 0.0000 1756.5610
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WYQ4356 : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-689.1219, expected range: -1702.6890 2553.8827
Severely_persistent: rms_fgdepar=718.5738, expected range: 0.0000 2348.3003
Severely_persistent: avg_pge=0.8623, expected range: -1.2393 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) WSAF : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8673, expected range: 0.2822 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 7KJS : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=517.6000, expected range: -544.0664 619.9447
Severe: rms_fgdepar=517.6000, expected range: 0.0000 645.6580
Severe: avg_pge=0.8018, expected range: -1.0672 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6RM7 : out of range
Severe: avg_fgdepar=-1101.9017, expected range: -388.3414 215.2052
Severe: rms_fgdepar=1101.9017, expected range: 0.0000 412.5492
Severe: avg_pge=0.9178, expected range: -0.8601 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) SKEC : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=312.5325, expected range: 0.0000 127.3234
Severe: avg_pge=0.8366, expected range: -0.6887 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7A5139 : out of range
Severe: rms_fgdepar=379.8928, expected range: 0.0000 181.4851
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7XV6 : out of range
Severe: avg_fgdepar=-750.9104, expected range: -404.1055 325.1174
Severe: rms_fgdepar=750.9104, expected range: 0.0000 432.7283
Severe: avg_pge=0.8834, expected range: -0.7821 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ZCEF6 : out of range
Severe: rms_fgdepar=683.5537, expected range: 0.0000 729.9271
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 1401832 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=411.3347, expected range: 0.0000 223.3999
Severely_persistent: avg_pge=0.8631, expected range: -0.5317 0.6304
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101718 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=528.7039, expected range: -720.4928 854.5273
Severely_persistent: rms_fgdepar=541.0846, expected range: -818.9222 1175.8386
Severely_persistent: avg_pge=0.8810, expected range: -1.6466 0.7500
MOORED BUOYS SURFACE PRESSURE (PA) 4400063 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-536.4644, expected range: -137.7588 231.8488
Severe: rms_fgdepar=539.2234, expected range: 0.0000 337.9233
Severe: avg_pge=0.9077, expected range: -0.4288 0.7437
DRIFTING BUOYS SURFACE PRESSURE (PA) 2101836 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8219, expected range: -0.9263 0.7500
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-781.7031, expected range: -794.6904 -782.1467
Severely_persistent: rms_fgdepar=781.7895, expected range: 782.3204 794.5862
BUFR LAND SYNOP SNOW (CM) _MI17AC6 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-73.6502, expected range: -83.8750 -37.3229
Severely_persistent: rms_fgdepar=73.6896, expected range: 37.3492 83.8858
BUFR LAND SYNOP SNOW (CM) _MF19B7F : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=15.5083, expected range: 5.8430 11.2037
BUFR LAND SYNOP SNOW (CM) : out of range
7 times in the last 10 days for at least one item
Slight: avg_fgdepar=-22.2076, expected range: -53.4419 -30.0937
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02031 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.9382, expected range: -14.1466 9.2175
Severely_persistent: rms_fgdepar=13.9835, expected range: -7.9033 14.4529
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02036 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.2753, expected range: -17.0152 13.2895
Severely_persistent: rms_fgdepar=15.2756, expected range: -8.4671 15.7561
METAR 2M TEMPERATURE (K) LTCB : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=15.8293, expected range: 0.4921 19.2713
Severely_persistent: rms_fgdepar=15.9924, expected range: 2.3904 18.4511
BUFR LAND SYNOP 2M TEMPERATURE (K) 02031 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.9827, expected range: -18.9040 11.9845
Severely_persistent: rms_fgdepar=14.0606, expected range: -10.2611 18.7273
BUFR LAND SYNOP 2M TEMPERATURE (K) 02036 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.3779, expected range: -20.4108 15.1939
Severely_persistent: rms_fgdepar=15.3813, expected range: -10.1235 18.9877
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13804 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.2580, expected range: -57.6741 39.7744
Severely_persistent: rms_fgdepar=12.3404, expected range: 12.5202 22.7088
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1D581 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.7128, expected range: -20.0851 -10.1854
Severely_persistent: rms_fgdepar=17.7128, expected range: 10.1554 20.1715
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02055 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-13.5504, expected range: -10.7556 7.6906
Severe: rms_fgdepar=13.6391, expected range: -5.6731 10.6949
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02101 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=11.6022, expected range: 0.0000 5.9074
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02254 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.1037, expected range: -4.9653 2.8936
Severe: rms_fgdepar=12.1038, expected range: 0.0000 4.9085
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02282 : out of range
Severe: rms_fgdepar=10.3563, expected range: 0.0000 3.9660
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71001 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.4095, expected range: -17.0856 13.0756
Severe: rms_fgdepar=15.1282, expected range: 0.0000 14.4438
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71195 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.2370, expected range: -17.3804 12.9925
Severe: rms_fgdepar=14.9406, expected range: 0.0000 14.7858
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71229 : out of range
Severe: avg_fgdepar=-12.3647, expected range: -11.4098 3.2103
Severe: rms_fgdepar=12.6872, expected range: 0.0000 11.0075
MANUAL LAND SYNOP 2M TEMPERATURE (K) 23921 : out of range
Severe: avg_fgdepar=-12.0952, expected range: -8.3845 6.2821
Severe: rms_fgdepar=12.4404, expected range: 0.0000 7.3840
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24076 : out of range
Severe: avg_fgdepar=-13.4320, expected range: -23.4970 16.6729
Severe: rms_fgdepar=13.4399, expected range: 0.0000 16.3165
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24843 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.7685, expected range: -18.1936 4.0722
Severe: rms_fgdepar=12.8261, expected range: 0.0000 17.9266
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24951 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=11.3663, expected range: 0.0000 4.5723
MANUAL LAND SYNOP 2M TEMPERATURE (K) 42915 : out of range
Severe: rms_fgdepar=10.1942, expected range: 0.0000 4.7526
MANUAL LAND SYNOP 2M TEMPERATURE (K) 42948 : out of range
Severe: avg_fgdepar=12.3127, expected range: 1.9207 6.7450
Severe: rms_fgdepar=12.3127, expected range: 1.9207 6.7450
MANUAL LAND SYNOP 2M TEMPERATURE (K) 71043 : out of range
Severe: avg_fgdepar=-12.4373, expected range: -11.5261 4.2042
Severe: rms_fgdepar=12.4832, expected range: 0.0000 12.0033
METAR 2M TEMPERATURE (K) USDA : out of range
Severe: avg_fgdepar=12.7514, expected range: -5.9043 5.2484
Severe: rms_fgdepar=14.7762, expected range: 0.0000 5.5678
LAND TEMP 2M TEMPERATURE (K) 23921 : out of range
Severe: avg_fgdepar=-14.3978, expected range: -6.9408 6.1710
Severe: rms_fgdepar=14.3978, expected range: 0.0000 5.9150
BUFR LAND SYNOP 2M TEMPERATURE (K) 01042 : out of range
Severe: rms_fgdepar=11.6932, expected range: 0.0000 4.3583
BUFR LAND SYNOP 2M TEMPERATURE (K) 02055 : out of range
Severe: avg_fgdepar=-13.2305, expected range: -11.9875 7.9935
Severe: rms_fgdepar=13.4503, expected range: 0.0000 11.5810
BUFR LAND SYNOP 2M TEMPERATURE (K) 02101 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=11.6696, expected range: 0.0000 6.1755
BUFR LAND SYNOP 2M TEMPERATURE (K) 02254 : out of range
Severe: avg_fgdepar=-12.2581, expected range: -7.0707 4.0573
Severe: rms_fgdepar=12.2648, expected range: 0.0000 6.9514
BUFR LAND SYNOP 2M TEMPERATURE (K) 02282 : out of range
Severe: rms_fgdepar=10.2482, expected range: 0.0000 4.8615
BUFR LAND SYNOP 2M TEMPERATURE (K) 23921 : out of range
Severe: avg_fgdepar=-12.2719, expected range: -8.4243 6.2269
Severe: rms_fgdepar=12.6120, expected range: 0.0000 7.4429
BUFR LAND SYNOP 2M TEMPERATURE (K) 24076 : out of range
Severe: avg_fgdepar=-13.6044, expected range: -23.4169 16.5301
Severe: rms_fgdepar=13.6105, expected range: 0.0000 16.3322
BUFR LAND SYNOP 2M TEMPERATURE (K) 24843 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.8620, expected range: -18.2878 4.0271
Severe: rms_fgdepar=12.9200, expected range: 0.0000 18.0293
BUFR LAND SYNOP 2M TEMPERATURE (K) 42948 : out of range
Severe: avg_fgdepar=12.2627, expected range: 1.8707 6.6950
Severe: rms_fgdepar=12.2627, expected range: 1.8707 6.6950
BUFR LAND SYNOP 2M TEMPERATURE (K) 71001 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.3289, expected range: -16.4522 12.8501
Severe: rms_fgdepar=15.0961, expected range: 0.0000 14.0293
BUFR LAND SYNOP 2M TEMPERATURE (K) 71195 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.1902, expected range: -16.7315 12.8340
Severe: rms_fgdepar=14.9940, expected range: 0.0000 14.4120
rh2m
MANUAL LAND SYNOP RH2M (%) 40435 : out of range
Severe: rms_fgdepar=30.1033, expected range: 0.0000 10.2009
METAR RH2M (%) MNCH : out of range
Severe: rms_fgdepar=36.0947, expected range: 0.0000 20.0463
METAR RH2M (%) OEDM : out of range
Severe: rms_fgdepar=35.1112, expected range: 0.0000 12.6065
BUFR LAND SYNOP RH2M (%) 01146 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=32.1303, expected range: 0.0000 17.4418
BUFR LAND SYNOP RH2M (%) 01347 : out of range
Severe: rms_fgdepar=33.5248, expected range: 0.2942 18.2956