Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-06-02 12:00

amsua
METOP-A AMSUA RADIANCES (8 channels affected) : out of range
Considerable: obs_number=3717.0000, expected range: 4430.3096 5402.7493
mwhs2
FY-3C MWHS2 ALLSKY RADIANCES CHANNEL 4 : out of range
Slight: avg_norm_fgdepar=-0.0927, expected range: -0.0494 0.1084
mwhs
All FY-3B MWHS ALL CHANNELS Global : all data missing
Severe: obs_number=0, expected range: 5546.27 30092.68
gpsro
All FY-3C GNOS RISING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 467.59 2312.99
Atmospheric Motion Vector
NOAA-19 AVHRR IR WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: obs_number=276.0000, expected range: 72.9770 233.7730
METEOSAT-11 AMV IR3 WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA : out of range
Considerable: obs_number=842.0000, expected range: 134.9833 573.4936
AQUA MODIS CLOUDY WV WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HP : out of range
1 times in the last 10 days for at least one item
Slight: stdev_fgdepar=2.1828, expected range: 1.8183 2.0872
Radiosondes
HIGH RESO SEA TEMP Q (G/KG) PRESSURE LAYER 0-300 (HPA) : missing
5 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 0.0000 347.1916
LAND TEMP TEMPERATURE (K) 30935 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=12.8071, expected range: -2.6038 1.9351
Severe: rms_fgdepar=12.8071, expected range: 0.0000 3.5505
Severe: avg_pge=0.8617, expected range: -0.5286 0.7500
LAND TEMP TEMPERATURE (K) 27459 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.5531, expected range: 0.6766 2.3350
LAND TEMP WIND VECTOR DIFF (M/S) 24507 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=15.3589, expected range: 0.0000 8.9358
Severe: avg_pge=0.8751, expected range: -0.9374 0.7500
LAND TEMP Q (G/KG) 40417 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=7.3130, expected range: 0.0000 3.9856
HIGH RESO SEA TEMP Q (G/KG) (4 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=265.0000, expected range: 129.7145 136.7855
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
Considerable: obs_number=393.0000, expected range: 471.5757 495.9243
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (4 pressure layers affected : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=128.0000, expected range: 241.7892 299.9608
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : out of range
Considerable: obs_number=838.0000, expected range: 921.0427 945.2073
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=175.0000, expected range: 222.7695 311.4805
Considerable: obs_number=195.0000, expected range: 262.6320 284.7680
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 48551 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=21.4564, expected range: 0.0000 30.4333
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 85432 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8502, expected range: -1.5897 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 60602 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8068, expected range: 0.1303 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 76683 : out of range
Severe: rms_fgdepar=352.3758, expected range: 0.0000 87.3797
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 36535 : out of range
Severe: rms_fgdepar=316.0203, expected range: 0.0000 147.0496
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40655 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=551.3192, expected range: 0.0000 178.0996
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 60127 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8137, expected range: 0.5961 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 65357 : out of range
Severe: rms_fgdepar=330.1501, expected range: 0.0000 174.9154
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42367 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8354, expected range: -0.7030 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42398 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=546.0546, expected range: 0.0000 119.4548
MANUAL LAND SYNOP RH2M (%) 43021 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9755, expected range: -0.4895 0.6160
MANUAL LAND SYNOP RH2M (%) 42921 : out of range
Severe: rms_fgdepar=30.0361, expected range: 0.0000 12.7887
MANUAL LAND SYNOP RH2M (%) 63671 : out of range
Severe: rms_fgdepar=36.5915, expected range: 0.0000 18.9342
MANUAL LAND SYNOP RH2M (%) 42832 : out of range
Severe: rms_fgdepar=46.1009, expected range: 0.0000 21.7871
Severe: avg_pge=0.9975, expected range: -0.0059 0.0136
MANUAL LAND SYNOP RH2M (%) 41685 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=31.6862, expected range: 0.0000 13.0917
MANUAL LAND SYNOP RH2M (%) 42546 : out of range
Severe: rms_fgdepar=30.2535, expected range: 0.0000 14.8903
Severe: avg_pge=0.9130, expected range: -0.0007 0.0078
MANUAL LAND SYNOP RH2M (%) 38598 : out of range
Severe: avg_pge=0.9238, expected range: -1.3904 0.7500
MANUAL LAND SYNOP RH2M (%) 62259 : out of range
Severe: avg_pge=0.9859, expected range: -0.7091 0.7500
MANUAL LAND SYNOP RH2M (%) 42469 : out of range
Severe: avg_pge=0.9784, expected range: -0.8090 0.7500
MANUAL LAND SYNOP RH2M (%) 42479 : out of range
Severe: rms_fgdepar=33.5508, expected range: 0.0000 17.1235
BUFR LAND SYNOP SURFACE PRESSURE (PA) 86701 : out of range
Severe: rms_fgdepar=324.4823, expected range: 97.2713 161.9230
BUFR LAND SYNOP SURFACE PRESSURE (PA) 23471 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8329, expected range: -0.8162 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 61291 : out of range
Severe: rms_fgdepar=333.3850, expected range: 0.0000 85.1427
BUFR LAND SYNOP RH2M (%) 16261 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9065, expected range: -0.6429 0.7412
BUFR LAND SYNOP RH2M (%) 02243 : out of range
Severe: rms_fgdepar=33.9464, expected range: 0.1562 15.1948
MANUAL LAND SYNOP SURFACE PRESSURE (PA) : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=601.0000, expected range: 494.9324 541.8176
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) PCHF : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8782, expected range: 0.4873 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OXFG2 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=722.1861, expected range: -537.7391 1784.8165
Severely_persistent: rms_fgdepar=746.0419, expected range: 0.0000 1781.9592
Severely_persistent: avg_pge=0.8530, expected range: 0.5532 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OYIK2 : out of range
23 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=578.5365, expected range: 408.0042 790.1814
Severely_persistent: rms_fgdepar=580.8640, expected range: 408.4328 790.4887
Severely_persistent: avg_pge=0.8373, expected range: 0.0354 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRDJ3 : out of range
24 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-559.0901, expected range: -683.9781 -307.6868
Severely_persistent: rms_fgdepar=565.0592, expected range: 306.6005 686.0611
Severely_persistent: avg_pge=0.8312, expected range: 0.7335 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRQK3 : out of range
30 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-531.1110, expected range: -792.6827 -397.1436
Severely_persistent: rms_fgdepar=535.2672, expected range: 399.8072 822.7813
Severely_persistent: avg_pge=0.8341, expected range: 0.7796 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6AX3 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8078, expected range: 0.7194 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRMO4 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-576.5771, expected range: -667.7388 -400.6269
Severely_persistent: rms_fgdepar=576.5771, expected range: 400.6269 667.7388
BUFR SHIP SYNOP SURFACE PRESSURE (PA) UCQX : out of range
23 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1148.1566, expected range: -34.2084 1875.4705
Severely_persistent: rms_fgdepar=1148.9120, expected range: 0.0000 1871.4624
Severely_persistent: avg_pge=0.9100, expected range: 0.6282 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 3EVZ8 : out of range
Severe: rms_fgdepar=16.6078, expected range: 0.0000 12.2375
Severe: avg_pge=0.8977, expected range: -0.7735 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WDH7562 : out of range
Severe: rms_fgdepar=389.4851, expected range: 0.0000 180.2447
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6FN4 : out of range
Severe: avg_fgdepar=571.1106, expected range: -187.5721 255.5317
Severe: rms_fgdepar=571.1106, expected range: 0.0000 233.2152
Severe: avg_pge=0.8171, expected range: -0.4597 0.5906
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA4999 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=635.8176, expected range: -404.8114 298.0618
Severe: rms_fgdepar=635.8176, expected range: -431.4318 631.1228
Severe: avg_pge=0.8545, expected range: -0.5777 0.7291
buoy
MOORED BUOYS SURFACE PRESSURE (PA) 2200186 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8192, expected range: -1.0987 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6203641 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=541.4271, expected range: -632.6936 730.3327
Severely_persistent: rms_fgdepar=541.4575, expected range: -529.1413 777.8574
Severely_persistent: avg_pge=0.8939, expected range: -1.3362 0.7500
MOORED BUOYS SURFACE PRESSURE (PA) : out of range
Considerable: obs_number=69.0000, expected range: 27.4346 55.0917
metar
METAR SURFACE PRESSURE (PA) ROTM : out of range
Severe: rms_fgdepar=312.5748, expected range: 0.0000 111.9775
snow
BUFR LAND SYNOP SNOW (CM) 01361 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=96.0000, expected range: 97.7775 113.0798
Severely_persistent: rms_fgdepar=96.0000, expected range: 97.7798 113.0806
BUFR LAND SYNOP SNOW (CM) 01435 : out of range
26 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=93.2297, expected range: 95.6290 116.8970
Severely_persistent: rms_fgdepar=93.2297, expected range: 95.6319 116.8994
BUFR LAND SYNOP SNOW (CM) 01346 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=87.2583, expected range: 86.3134 93.0951
Severely_persistent: rms_fgdepar=87.2676, expected range: 86.3196 93.0933
t2m
METAR 2M TEMPERATURE (K) SBMG : out of range
Severe: rms_fgdepar=11.3510, expected range: 1.8303 4.6093
METAR 2M TEMPERATURE (K) PHJH : out of range
Severe: avg_fgdepar=-13.1394, expected range: -0.0253 6.2490
Severe: rms_fgdepar=15.4144, expected range: 1.1299 7.2980
METAR 2M TEMPERATURE (K) KSTS : out of range
Severe: rms_fgdepar=14.0822, expected range: 0.0000 8.6889
METAR 2M TEMPERATURE (K) EGPU : out of range
Severe: rms_fgdepar=12.7739, expected range: 0.0000 3.5310
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) : out of range
Considerable: obs_number=1694.0000, expected range: 1964.4313 2050.3922
rh2m
AUTOMATIC LAND SYNOP RH2M (%) : out of range
Considerable: obs_number=1597.0000, expected range: 1805.8656 1961.3109