Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-11-19 00:00

amsua
METOP-B AMSUA ALL SKY RADIANCES CHANNEL 14 : out of range
Severe: stdev_norm_fgdepar=0.6728, expected range: 0.5697 0.6249
AMSUA Pacific RARS
All NOAA-18 AMSUA ALL SKY CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 359.87 1681.12
All NOAA-19 AMSUA ALL SKY CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 114.61 1466.89
cris
NOAA20 CRIS RADIANCES CHANNEL 653 : out of range
3 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.0568, expected range: 0.0731 0.1014
Atmospheric Motion Vector
All HIMAWARI-8 AMV CLOUDY WV3 ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 256.69 867.14
Radiosondes
LAND TEMP WIND VECTOR DIFF (M/S) 34882 PRESSURE LAYER 300-600 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=23.4052, expected range: 0.0000 6.9142
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU1702 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=24.9092, expected range: -0.3848 5.4628
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU1702 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=30.7747, expected range: 0.0000 5.9658
ADS-C WIND VECTOR DIFF (M/S) A2PYCKZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=23.3529, expected range: -16.1678 24.4039
Severe: rms_fgdepar=23.3529, expected range: 0.0000 24.2880
airep
AIREP WIND VECTOR DIFF (M/S) BAW171 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.9054, expected range: 0.0000 7.7508
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 17952 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8140, expected range: -0.7277 0.7500
MANUAL LAND SYNOP RH2M (%) 42915 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9671, expected range: -0.5160 0.7204
MANUAL LAND SYNOP RH2M (%) 65125 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=50.2584, expected range: -43.3212 110.0010
Severely_persistent: rms_fgdepar=50.2584, expected range: 0.0000 110.0010
Severely_persistent: avg_pge=0.9973, expected range: -1.4057 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 81797 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=597.0287, expected range: 490.5068 706.8670
Severely_persistent: rms_fgdepar=597.1901, expected range: 491.0028 707.1060
BUFR LAND SYNOP SURFACE PRESSURE (PA) 84825 : out of range
24 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-506.2139, expected range: -681.4138 -367.3008
Severely_persistent: rms_fgdepar=506.7562, expected range: 370.0277 681.1495
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 38915 : out of range
Severe: rms_fgdepar=538.8834, expected range: 0.0000 280.5139
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 63471 : out of range
Severe: avg_fgdepar=1045.5561, expected range: 963.5900 1231.0045
Severe: rms_fgdepar=1045.6672, expected range: 962.1936 1233.0292
MANUAL LAND SYNOP RH2M (%) 42925 : out of range
Severe: avg_pge=0.8972, expected range: -0.7231 0.7500
MANUAL LAND SYNOP RH2M (%) 95813 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9078, expected range: -1.3347 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 16061 : out of range
Severe: avg_fgdepar=-635.5863, expected range: -317.2444 125.3750
Severe: rms_fgdepar=635.8271, expected range: 0.0000 314.5111
Severe: avg_pge=0.9030, expected range: -0.5156 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33801 : out of range
Severe: rms_fgdepar=306.8711, expected range: 0.0000 99.8456
BUFR LAND SYNOP SURFACE PRESSURE (PA) 76581 : out of range
Severe: avg_pge=0.8028, expected range: -0.8724 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 84515 : out of range
Severe: avg_fgdepar=830.2643, expected range: -497.8678 121.4005
Severe: rms_fgdepar=830.2643, expected range: 0.0000 497.8678
Severe: avg_pge=0.9335, expected range: -0.3370 0.7500
BUFR LAND SYNOP RH2M (%) 26335 : out of range
Severe: rms_fgdepar=33.2955, expected range: 0.0000 15.3258
BUFR LAND SYNOP RH2M (%) 26436 : out of range
Severe: rms_fgdepar=33.4924, expected range: 0.0000 12.3075
BUFR LAND SYNOP RH2M (%) 42441 : out of range
Severe: avg_pge=0.8758, expected range: -0.7884 0.7500
ship
AUTOMATIC SHIP WIND VECTOR DIFF (M/S) 62153 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8479, expected range: -0.4098 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) WSAF : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8597, expected range: 0.1720 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 7JWH : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=771.7660, expected range: 401.1993 633.8200
Severely_persistent: rms_fgdepar=810.1663, expected range: 400.7609 635.3721
Severely_persistent: avg_pge=0.8521, expected range: 0.6974 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WYQ4356 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-814.2984, expected range: -1587.7690 2474.6398
Severely_persistent: rms_fgdepar=816.9954, expected range: 0.0000 2262.4909
Severely_persistent: avg_pge=0.8914, expected range: -1.1230 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 3EFK6 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-1160.5101, expected range: -548.0726 230.1532
Severe: rms_fgdepar=1160.5101, expected range: 0.0000 572.5934
Severe: avg_pge=0.9229, expected range: -0.8548 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9VHE2 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-610.6562, expected range: -603.0506 286.6394
Severe: rms_fgdepar=623.0404, expected range: 0.0000 616.5691
Severe: avg_pge=0.8507, expected range: -1.1131 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) CFK5152 : out of range
Severe: avg_pge=0.8017, expected range: -1.4882 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) DCQN : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8153, expected range: -1.2253 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) MAOR9 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=571.8446, expected range: 0.0000 803.1848
buoy
MOORED BUOYS SURFACE PRESSURE (PA) 4400063 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8926, expected range: -0.8374 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1401832 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8489, expected range: -1.1818 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101718 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=529.3614, expected range: -821.0607 1065.5541
Severely_persistent: rms_fgdepar=533.9334, expected range: 0.0000 1239.7269
Severely_persistent: avg_pge=0.8834, expected range: -1.5871 0.7500
metar
METAR SURFACE PRESSURE (PA) LIMK : out of range
Severe: avg_fgdepar=-632.5007, expected range: -279.9906 95.1770
Severe: rms_fgdepar=632.7221, expected range: 0.0000 272.4794
Severe: avg_pge=0.8189, expected range: -0.4121 0.6335
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-778.2634, expected range: -801.3778 -778.4765
Severely_persistent: rms_fgdepar=778.2636, expected range: 778.6300 801.2939
BUFR LAND SYNOP SNOW (CM) _MI17AC6 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-70.9405, expected range: -83.3026 -41.8576
Severely_persistent: rms_fgdepar=70.9426, expected range: 41.8872 83.3078
BUFR LAND SYNOP SNOW (CM) _MI1EDCD : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=100.0000, expected range: 100.0000 100.0000
Severely_persistent: rms_fgdepar=100.0000, expected range: 100.0000 100.0000
BUFR LAND SYNOP SNOW (CM) _MF18902 : out of range
Severe: rms_fgdepar=16.1891, expected range: 6.7086 10.9965
BUFR LAND SYNOP SNOW (CM) _MI1FB9B : out of range
Severe: rms_fgdepar=33.2194, expected range: 10.0996 22.8701
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02036 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.1122, expected range: -22.1944 15.2879
Severely_persistent: rms_fgdepar=13.1122, expected range: -10.3908 20.4004
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02055 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-18.3350, expected range: -11.8258 7.5296
Severely_persistent: rms_fgdepar=18.3350, expected range: 0.0000 11.4380
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71001 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.0827, expected range: -17.9239 13.6692
Severely_persistent: rms_fgdepar=14.4370, expected range: 0.0000 15.4843
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71195 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.1809, expected range: -17.9238 13.3914
Severely_persistent: rms_fgdepar=14.4371, expected range: 0.0000 15.4936
METAR 2M TEMPERATURE (K) LTCB : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=14.6176, expected range: 0.6163 18.9571
Severely_persistent: rms_fgdepar=14.8712, expected range: 2.4358 18.1336
BUFR LAND SYNOP 2M TEMPERATURE (K) 02031 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.2740, expected range: -22.9523 13.0713
Severely_persistent: rms_fgdepar=12.2843, expected range: -11.4708 22.6277
BUFR LAND SYNOP 2M TEMPERATURE (K) 02036 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.8492, expected range: -24.6271 16.3055
Severely_persistent: rms_fgdepar=12.8602, expected range: 0.0000 22.6732
BUFR LAND SYNOP 2M TEMPERATURE (K) 71001 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.8139, expected range: -17.6712 13.7516
Severely_persistent: rms_fgdepar=14.3085, expected range: 0.0000 15.3650
BUFR LAND SYNOP 2M TEMPERATURE (K) 71195 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.7828, expected range: -17.6895 13.5603
Severely_persistent: rms_fgdepar=14.2552, expected range: 0.0000 15.4363
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1D581 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.1042, expected range: -20.2521 -10.3003
Severely_persistent: rms_fgdepar=17.1134, expected range: 10.2765 20.3353
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02044 : out of range
Severe: avg_fgdepar=-13.2147, expected range: -6.0076 4.0529
Severe: rms_fgdepar=13.2152, expected range: 0.0000 5.7815
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02064 : out of range
Severe: rms_fgdepar=10.1287, expected range: 0.0000 3.5884
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02081 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-13.3943, expected range: -11.8959 4.3766
Severe: rms_fgdepar=13.4892, expected range: 0.0000 11.9551
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02805 : out of range
Severe: avg_fgdepar=-13.3974, expected range: -8.3809 6.7621
Severe: rms_fgdepar=13.4029, expected range: -4.4544 8.7621
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02890 : out of range
Severe: avg_fgdepar=-13.6809, expected range: -9.9002 7.8595
Severe: rms_fgdepar=13.6809, expected range: -5.2750 9.1912
METAR 2M TEMPERATURE (K) KFAR : out of range
Severe: rms_fgdepar=11.1962, expected range: 0.0000 3.4930
METAR 2M TEMPERATURE (K) USDA : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=14.5374, expected range: -6.4246 6.6232
Severe: rms_fgdepar=16.6166, expected range: 0.0000 8.8181
BUFR LAND SYNOP 2M TEMPERATURE (K) 01047 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-16.3545, expected range: -10.4681 6.5019
Severe: rms_fgdepar=16.3573, expected range: 0.0000 10.2117
BUFR LAND SYNOP 2M TEMPERATURE (K) 01057 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-17.2098, expected range: -8.9214 6.5625
Severe: rms_fgdepar=17.2098, expected range: 0.0000 7.8294
BUFR LAND SYNOP 2M TEMPERATURE (K) 01065 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-18.9274, expected range: -9.4076 7.1757
Severe: rms_fgdepar=18.9363, expected range: -4.8189 9.1138
BUFR LAND SYNOP 2M TEMPERATURE (K) 02044 : out of range
Severe: avg_fgdepar=-12.7867, expected range: -7.4246 4.6622
Severe: rms_fgdepar=12.8470, expected range: 0.0000 6.9646
BUFR LAND SYNOP 2M TEMPERATURE (K) 02055 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-18.8558, expected range: -12.7969 7.6768
Severe: rms_fgdepar=18.8661, expected range: 0.0000 12.1852
BUFR LAND SYNOP 2M TEMPERATURE (K) 02081 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-13.4510, expected range: -12.3608 4.5829
Severe: rms_fgdepar=13.5471, expected range: 0.0000 12.4408
BUFR LAND SYNOP 2M TEMPERATURE (K) 02805 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-13.5202, expected range: -8.6611 6.9825
Severe: rms_fgdepar=13.5250, expected range: -4.4599 8.8373
BUFR LAND SYNOP 2M TEMPERATURE (K) 02827 : out of range
Severe: avg_fgdepar=-12.0221, expected range: -9.0986 4.5456
Severe: rms_fgdepar=12.1488, expected range: 0.0000 9.4456
BUFR LAND SYNOP 2M TEMPERATURE (K) 02890 : out of range
Severe: avg_fgdepar=-13.3574, expected range: -8.5268 6.9994
Severe: rms_fgdepar=13.3645, expected range: 0.0000 8.5772
BUFR LAND SYNOP 2M TEMPERATURE (K) 42522 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=12.0351, expected range: 3.4345 16.8398
Severe: rms_fgdepar=12.0351, expected range: 3.4345 16.8398
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI12FF4 : out of range
Severe: avg_fgdepar=12.6933, expected range: -1.7981 9.3141
Severe: rms_fgdepar=12.7749, expected range: 0.0000 9.2714
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI16C34 : out of range
Severe: avg_fgdepar=14.0624, expected range: -2.0072 10.3091
Severe: rms_fgdepar=14.0685, expected range: 0.0000 10.5774
rh2m
AUTOMATIC LAND SYNOP RH2M (%) 26436 : out of range
Severe: rms_fgdepar=32.3012, expected range: 0.0000 14.2184
AUTOMATIC LAND SYNOP RH2M (%) 26447 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=30.0694, expected range: 0.0000 9.6390
AUTOMATIC LAND SYNOP RH2M (%) 71087 : out of range
Severe: rms_fgdepar=31.4992, expected range: 0.0000 9.4830
AUTOMATIC LAND SYNOP RH2M (%) 71353 : out of range
Severe: rms_fgdepar=30.2409, expected range: 0.0000 16.1528
AUTOMATIC LAND SYNOP RH2M (%) 71904 : out of range
Severe: rms_fgdepar=36.9819, expected range: 0.0000 19.4479
METAR RH2M (%) ENEV : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=37.2598, expected range: 0.0000 15.5120
METAR RH2M (%) KNRB : out of range
Severe: rms_fgdepar=31.0906, expected range: 0.0000 14.1390
BUFR LAND SYNOP RH2M (%) _MI11F29 : out of range
Severe: rms_fgdepar=36.8615, expected range: 0.0000 20.8986
BUFR LAND SYNOP RH2M (%) _MI1BAEA : out of range
Severe: rms_fgdepar=31.3616, expected range: 0.0000 16.1847