Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-05-27 12:00

Atmospheric Motion Vector
All AQUA MODIS CLEAR WV ALL LAYERS Global : all data missing
Severe: obs_number=0, expected range: 172.09 1730.02
HIMAWARI-8 AMV CLOUDY WV2 WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-60 : out of range
Considerable: obs_number=5583.0000, expected range: 3309.7442 4859.7558
GOES-17 AMV IR1 WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=1388.0000, expected range: 294.9073 1071.0643
Radiosondes
All LAND TEMP ALL LAYERS WMO BLOCK 43 : all data missing
Severely_persistent: obs_number=0, expected range: 46.26 160.14
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 26 : all data missing
Severely_persistent: obs_number=0, expected range: 81.72 138.28
LAND TEMP WIND VECTOR DIFF (M/S) 29634 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_pge=0.8319, expected range: -0.4200 0.7500
LAND TEMP WIND VECTOR DIFF (M/S) 21432 (2 pressure layers affected) : out of range
Severe: avg_fgdepar=22.1082, expected range: -0.3476 4.2839
Severe: rms_fgdepar=24.0964, expected range: 0.0000 4.7962
LAND TEMP WIND VECTOR DIFF (M/S) 21432 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_pge=0.9258, expected range: -0.2662 0.5105
LAND TEMP Q (G/KG) 28722 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.3755, expected range: 0.0000 1.3485
HIGH RESO LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=3.9351, expected range: 0.7389 1.5650
Severe: avg_fgdepar=3.6302, expected range: -0.2055 0.5167
Severe: rms_fgdepar=6.6389, expected range: 0.1561 3.0035
HIGH RESO LAND TEMP TEMPERATURE (K) 48698 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.6389, expected range: 0.1561 3.0035
HIGH RESO LAND TEMP Q (G/KG) (4 pressure layers affected) : out of range
Severe: obs_number=543.0000, expected range: 176.2956 196.9544
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 0-300 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: obs_number=396.0000, expected range: 522.5856 536.6644
Considerable: obs_number=173.0000, expected range: 193.7978 200.8689
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
Considerable: obs_number=89.0000, expected range: 134.8348 216.4152
Considerable: obs_number=93.0000, expected range: 155.4506 207.5494
prof
All EUROPEAN WIND PROFILER ALL LAYERS South West Pacific : all data missing
Severe: obs_number=0, expected range: 354.76 718.74
All EUROPEAN WIND PROFILER ALL LAYERS West pacific Tropica : all data missing
Severe: obs_number=0, expected range: 354.76 718.74
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) (2 pressure layers affected) : out of range
3 times in the last 10 days for at least one item
Considerable: obs_number=1044.0000, expected range: 1966.9695 2457.5305
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 85432 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8469, expected range: -1.0897 0.7500
MANUAL LAND SYNOP RH2M (%) 43158 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9883, expected range: -1.3000 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 36090 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=383.5331, expected range: 0.0000 154.4375
Severe: avg_pge=0.8776, expected range: -0.5008 0.6381
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42343 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=316.9081, expected range: 0.0000 158.6709
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42045 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8133, expected range: -0.5280 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42779 : out of range
Severe: rms_fgdepar=402.6083, expected range: 0.0000 116.3095
MANUAL LAND SYNOP RH2M (%) 65351 : out of range
Severe: avg_pge=0.8200, expected range: -0.6443 0.7487
MANUAL LAND SYNOP RH2M (%) 61043 : out of range
Severe: rms_fgdepar=34.1584, expected range: 0.0000 9.5587
BUFR LAND SYNOP SURFACE PRESSURE (PA) 81982 : out of range
Severe: avg_fgdepar=-734.9122, expected range: -199.4743 72.3971
Severe: rms_fgdepar=815.7213, expected range: 0.0000 174.6511
Severe: avg_pge=0.8773, expected range: -0.2488 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48074 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8306, expected range: -1.4369 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24726 : out of range
Severe: rms_fgdepar=321.7827, expected range: 0.0000 112.9828
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48048 : out of range
Severe: rms_fgdepar=497.2054, expected range: 0.0000 280.0727
Severe: avg_pge=0.8693, expected range: -1.4114 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48078 : out of range
Severe: rms_fgdepar=727.7436, expected range: 0.0000 191.9404
Severe: avg_pge=0.8513, expected range: -0.6905 0.7500
BUFR LAND SYNOP RH2M (%) 48052 : out of range
Severe: rms_fgdepar=41.3328, expected range: 0.0000 31.7462
Severe: avg_pge=0.9967, expected range: -0.1495 0.1875
BUFR LAND SYNOP RH2M (%) 48053 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=46.3631, expected range: 0.0000 25.1274
BUFR LAND SYNOP RH2M (%) 72256 : out of range
Severe: rms_fgdepar=38.8576, expected range: 0.0000 20.9172
BUFR LAND SYNOP RH2M (%) 48037 : out of range
Severe: avg_pge=0.9997, expected range: -0.0969 0.1413
BUFR LAND SYNOP RH2M (%) 48048 : out of range
Severe: rms_fgdepar=37.4989, expected range: 0.0000 19.3220
Severe: avg_pge=0.9440, expected range: -0.9638 0.7500
BUFR LAND SYNOP RH2M (%) : out of range
Considerable: obs_number=361.0000, expected range: 413.9856 434.5144
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 9VBP8 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9065, expected range: -0.6731 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRDJ3 : out of range
25 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8118, expected range: 0.7310 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRQK3 : out of range
Severe: avg_fgdepar=-566.4708, expected range: -836.4955 -338.9292
Severe: rms_fgdepar=568.5791, expected range: 350.8650 830.7277
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7KD5 : out of range
Severe: avg_fgdepar=1209.4244, expected range: -453.6624 260.7032
Severe: rms_fgdepar=1209.4244, expected range: 0.0000 462.5349
Severe: avg_pge=0.8895, expected range: -1.1798 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRCZ7 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=747.5554, expected range: 0.0000 967.0063
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WBN3008 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=541.0733, expected range: -269.6609 602.1659
Severe: rms_fgdepar=761.0012, expected range: 0.0000 523.0830
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WTOI : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=418.3672, expected range: 0.0000 101.1392
buoy
MOORED BUOYS SURFACE PRESSURE (PA) 2200186 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8185, expected range: 0.7022 0.7500
MOORED BUOYS WIND VECTOR DIFF (M/S) 6100198 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9086, expected range: -1.1486 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5601603 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8125, expected range: -1.2660 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 3301523 : out of range
Severe: rms_fgdepar=344.2309, expected range: 0.0000 159.8001
DRIFTING BUOYS SURFACE PRESSURE (PA) 5601634 : out of range
Severe: rms_fgdepar=355.7681, expected range: 0.0000 91.6520
DRIFTING BUOYS SURFACE PRESSURE (PA) 5300555 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=509.2925, expected range: 0.0000 206.1581
Severe: avg_pge=0.8003, expected range: -0.3990 0.5249
DRIFTING BUOYS SURFACE PRESSURE (PA) 1701617 : out of range
Severe: rms_fgdepar=380.9502, expected range: 0.0000 98.6641
MOORED BUOYS WIND VECTOR DIFF (M/S) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=77.0000, expected range: 82.5734 92.6897
metar
METAR SURFACE PRESSURE (PA) VECX : out of range
22 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-681.9432, expected range: -1017.9636 250.6446
Severely_persistent: rms_fgdepar=698.5016, expected range: 0.0000 1004.2603
Severely_persistent: avg_pge=0.8338, expected range: -0.6187 0.7500
snow
AUTOMATIC LAND SYNOP SNOW (CM) 71356 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-57.1614, expected range: -62.1554 -48.9620
Severely_persistent: rms_fgdepar=57.1614, expected range: 48.9620 62.1554
BUFR LAND SYNOP SNOW (CM) 01132 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=72.1999, expected range: 71.0413 76.1828
Severely_persistent: rms_fgdepar=72.2042, expected range: 71.0402 76.1869
BUFR LAND SYNOP SNOW (CM) 01008 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-70.3324, expected range: -135.9205 -68.8135
Severely_persistent: rms_fgdepar=70.3376, expected range: 68.8147 135.9201
BUFR LAND SYNOP SNOW (CM) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=30.5784, expected range: 2.6450 6.0029
BUFR LAND SYNOP SNOW (CM) 01435 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=109.1924, expected range: 91.7488 119.6227
Severe: rms_fgdepar=109.1936, expected range: 91.7534 119.6253
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
Severe: avg_est_pge=0.8079, expected range: 0.4100 1.0265
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 51777 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.0370, expected range: -18.0589 16.9183
Severe: rms_fgdepar=12.0370, expected range: 0.0000 12.2481
MANUAL LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
Severe: avg_est_pge=0.8101, expected range: 0.3703 1.0343
LAND TEMP 2M TEMPERATURE (K) 65578 : out of range
Severe: avg_fgdepar=-13.3134, expected range: -8.8363 9.8650
Severe: rms_fgdepar=13.3134, expected range: -5.1282 9.3627
BUFR LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
Severe: avg_est_pge=0.8087, expected range: 0.4073 1.0228
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.6882, expected range: -13.5658 -0.8271
Severe: rms_fgdepar=14.9082, expected range: 0.6945 14.1475
BUFR LAND SYNOP 2M TEMPERATURE (K) : out of range
Considerable: obs_number=1324.0000, expected range: 1414.3832 1553.6168