Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-01-10 00:00

mwhs
All FY-3B MWHS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 14401.34 20167.05
Radiosondes
LAND TEMP TEMPERATURE (K) 30758 PRESSURE LAYER 900-1200 (HPA) : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9123, expected range: -0.0629 0.7500
LAND TEMP TEMPERATURE (K) 24688 PRESSURE LAYER 900-1200 (HPA) : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8274, expected range: -1.1468 0.7500
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 85 : all data missing
Severely_persistent: obs_number=0, expected range: 0.00 505.85
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 37 : all data missing
Severely_persistent: obs_number=0, expected range: 86.70 99.01
LAND TEMP WIND VECTOR DIFF (M/S) 41169 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=21.0091, expected range: 0.0000 9.9108
LAND TEMP TEMPERATURE (K) 42361 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=7.7927, expected range: 0.0000 2.3533
Severe: avg_pge=0.8418, expected range: -0.2285 0.4195
LAND TEMP TEMPERATURE (K) 43371 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=10.2608, expected range: 0.0000 4.5843
LAND TEMP TEMPERATURE (K) 42339 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=11.0373, expected range: 0.2728 3.5899
LAND TEMP TEMPERATURE (K) 41169 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=9.8321, expected range: 0.0000 3.8301
LAND TEMP TEMPERATURE (K) 40265 PRESSURE LAYER 900-1200 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8969, expected range: -1.3326 0.7500
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : out of range
2 times in the last 10 days for at least one item
Severe: obs_number=366.0000, expected range: 260.1455 311.2295
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 600-900 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: obs_number=85.0000, expected range: 157.2307 185.1223
Considerable: obs_number=103.0000, expected range: 78.4232 94.0474
LAND TEMP WIND VECTOR DIFF (M/S) (4 pressure layers affected) : out of range
3 times in the last 10 days for at least one item
Considerable: obs_number=1962.0000, expected range: 2463.5777 3675.8668
HIGH RESO LAND TEMP TEMPERATURE (K) (3 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=5082.0000, expected range: 2071.7691 4270.0087
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
Considerable: obs_number=325.0000, expected range: 351.0517 426.0594
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 0-300 (HPA) : out of range
3 times in the last 10 days for at least one item
Considerable: obs_number=266.0000, expected range: 295.5816 353.9478
LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : out of range
1 times in the last 10 days for at least one item
Slight: obs_number=1955.0000, expected range: 2065.9621 2686.0379
amdar
WIGOS AMDAR Q (G/KG) GRBWUUZA PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_pge=0.9101, expected range: -0.9000 0.7500
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) (2 pressure layers affected) : out of range
4 times in the last 10 days for at least one item
Severe: obs_number=2486.0000, expected range: 848.1658 1727.0564
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 41169 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=23.3210, expected range: 0.0000 8.0204
synop
MANUAL LAND SYNOP SURFACE PRESSURE (PA) : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=568.6078, expected range: 0.0000 170.5123
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48112 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8722, expected range: -1.4832 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24585 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8658, expected range: 0.2484 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 56946 : out of range
26 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8548, expected range: -1.1676 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=124.0000, expected range: 269.0193 378.2748
MANUAL LAND SYNOP RH2M (%) 64750 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9999, expected range: -1.4432 0.7500
MANUAL LAND SYNOP RH2M (%) 42459 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8744, expected range: -1.2072 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 94680 : out of range
Severe: rms_fgdepar=946.4443, expected range: 0.0000 224.0811
Severe: avg_pge=0.9333, expected range: -0.7300 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 97284 : out of range
Severe: rms_fgdepar=319.6305, expected range: 0.0000 154.5848
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83916 : out of range
Severe: avg_pge=0.8095, expected range: -0.1708 0.7500
BUFR LAND SYNOP RH2M (%) 48941 : out of range
Severe: rms_fgdepar=35.7242, expected range: 0.0000 19.2593
BUFR LAND SYNOP RH2M (%) 94466 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9977, expected range: -1.2496 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 94680 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=981.5939, expected range: 0.0000 246.8404
Severe: avg_pge=0.9434, expected range: -0.6491 0.7174
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24944 : out of range
Severe: rms_fgdepar=523.9542, expected range: 0.0000 139.8333
BUFR LAND SYNOP SURFACE PRESSURE (PA) 92035 : out of range
Severe: rms_fgdepar=615.6602, expected range: 0.0000 162.2954
BUFR LAND SYNOP SURFACE PRESSURE (PA) 94257 : out of range
Severe: rms_fgdepar=394.8054, expected range: 0.0000 237.2565
Severe: avg_pge=0.8651, expected range: -0.7384 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 04077 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=739.6904, expected range: 0.0000 123.1246
Severe: avg_pge=0.9458, expected range: -0.1598 0.2790
ship
SHIP SURFACE PRESSURE (PA) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: obs_number=18.0000, expected range: 707.6468 1370.8269
Severely_persistent: obs_number=1.0000, expected range: 111.8502 333.9336
Severely_persistent: avg_fgdepar=788.0626, expected range: -82.0322 78.7706
Severely_persistent: rms_fgdepar=788.0626, expected range: 58.7962 270.7525
Severely_persistent: avg_pge=0.9128, expected range: 0.0056 0.4739
Severely_persistent: avg_fgdepar=-359.5561, expected range: -155.2528 182.5802
Severely_persistent: avg_pge=0.8235, expected range: -0.2994 0.7500
Severely_persistent: obs_number=4.0000, expected range: 76.4351 371.7754
Severely_persistent: rms_fgdepar=478.6331, expected range: 102.8430 221.7240
Severely_persistent: avg_pge=0.8016, expected range: 0.1272 0.3358
Severely_persistent: avg_fgdepar=788.0626, expected range: -214.2401 205.1167
Severely_persistent: rms_fgdepar=788.0626, expected range: 0.0000 359.6475
Severely_persistent: avg_pge=0.9128, expected range: -0.0903 0.6329
Severely_persistent: avg_fgdepar=-359.5561, expected range: -186.5124 211.3211
Severely_persistent: rms_fgdepar=359.5561, expected range: 22.3399 287.0511
Severely_persistent: avg_pge=0.8235, expected range: -0.2965 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) LF8A : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8943, expected range: -0.9069 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) : out of range
2 times in the last 10 days for at least one item
Severely_persistent: obs_number=381.0000, expected range: 0.0000 175.5713
Severely_persistent: obs_number=643.0000, expected range: 73.2392 293.6029
Severely_persistent: rms_fgdepar=179.3027, expected range: 9.8674 97.3647
Severe: obs_number=6716.0000, expected range: 1084.9168 1415.4516
Severe: obs_number=2945.0000, expected range: 415.2030 937.9023
Severe: obs_number=2044.0000, expected range: 0.0000 177.0446
Severe: rms_fgdepar=216.9214, expected range: 0.0000 121.2595
Severe: obs_number=4336.0000, expected range: 1052.9337 1383.4874
Considerable: rms_fgdepar=224.3568, expected range: 0.0000 133.2786
AUTOMATIC SHIP SURFACE PRESSURE (PA) : out of range
2 times in the last 10 days for at least one item
Severe: obs_number=778.0000, expected range: 2014.1783 2439.4883
SHIP SURFACE PRESSURE (PA) 9HA4883 : out of range
Severe: rms_fgdepar=354.9385, expected range: 0.0000 193.7887
Severe: avg_pge=0.8137, expected range: -1.0935 0.7500
SHIP SURFACE PRESSURE (PA) A8OR8 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8235, expected range: -1.0601 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 4602501 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=726.5048, expected range: 0.0000 341.6571
Severely_persistent: avg_pge=0.9306, expected range: -0.7941 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4700546 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8961, expected range: -1.2844 0.7500
metar
METAR SURFACE PRESSURE (PA) LGTG : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=301.0258, expected range: 0.0000 112.6116
METAR SURFACE PRESSURE (PA) MDLR : out of range
Severe: rms_fgdepar=317.4744, expected range: 0.0000 119.7563
snow
BUFR LAND SYNOP SNOW (CM) 02801 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=22.7096, expected range: 0.0000 7.3629
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89828 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8084, expected range: 0.3354 1.0432
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24076 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8169, expected range: 0.1178 1.2131
LAND TEMP 2M TEMPERATURE (K) 56046 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8075, expected range: 0.1624 1.2510
LAND TEMP 2M TEMPERATURE (K) 40948 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8058, expected range: -0.4378 1.4546
LAND TEMP 2M TEMPERATURE (K) 56029 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8524, expected range: 0.6374 1.0510
BUFR LAND SYNOP 2M TEMPERATURE (K) 51542 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8617, expected range: 0.4238 1.1528
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 16710 : out of range
Severe: rms_fgdepar=10.1136, expected range: 0.0658 3.4763
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71341 : out of range
Severe: rms_fgdepar=10.0098, expected range: 0.0000 4.4350
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24477 : out of range
3 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8166, expected range: 0.0602 1.2080
METAR 2M TEMPERATURE (K) KHYA : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.9618, expected range: 0.0000 4.2721
LAND TEMP 2M TEMPERATURE (K) 24908 : out of range
1 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8341, expected range: -0.5414 1.2092
rh2m
AUTOMATIC LAND SYNOP RH2M (%) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=147.0000, expected range: 301.2703 458.3963
BUFR LAND SYNOP RH2M (%) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=85.0000, expected range: 154.7694 200.5640