Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2019-08-15 00:00

amsua
METOP-C/AMSUA RADIANCES CHANNEL 7 : out of range
3 times in the last 10 days for at least one item
Severe: stdev_fgdepar=0.1788, expected range: 0.1443 0.1607
NOAA-19/AMSUA RADIANCES CHANNEL 9 : out of range
2 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.0370, expected range: 0.0606 0.1172
NOAA-19/AMSUA RADIANCES CHANNEL 8 : out of range
Considerable: obs_number=4307.0000, expected range: 4548.7323 5206.1326
iasi
METOP-B/IASI RADIANCES (260 channels affected) : out of range
Severe: obs_number=14579.0000, expected range: 19944.5966 24389.7818
cris
NPP/CRIS RADIANCES (118 channels affected) : out of range
3 times in the last 10 days for at least one item
Severe: avg_biascorr=0.2560, expected range: 0.0726 0.2148
NPP/CRIS RADIANCES (147 channels affected) : out of range
Severe: obs_number=8729.0000, expected range: 4410.4342 6275.4324
NPP/CRIS RADIANCES (17 channels affected) : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=0.2003, expected range: -0.0527 0.0714
NPP/CRIS RADIANCES (22 channels affected) : out of range
1 times in the last 10 days for at least one item
Severe: stdev_fgdepar=3.0632, expected range: 0.1915 0.2784
Atmospheric Motion Vector
METOP-B/AMV IR WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: obs_number=175.0000, expected range: 199.4956 294.5044
Geostationary CSR
GOES-15/IMAGER RADIANCES CHANNEL 3 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=0.7025, expected range: -0.1930 0.2957
GOES-15/IMAGER RADIANCES CHANNEL 2 : out of range
2 times in the last 10 days for at least one item
Slight: avg_fgdepar=1.2328, expected range: -1.0603 0.9782
Radiosondes
LAND TEMP TEMPERATURE (K) 30673 PRESSURE LAYER 900-1200 (HPA) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8304, expected range: -1.4019 0.7500
LAND TEMP TEMPERATURE (K) 44292 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=8.1470, expected range: 0.1882 2.2742
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : out of range
Considerable: obs_number=256.0000, expected range: 296.8771 388.9979
amdar
WIGOS AMDAR Q (G/KG) XWGY0OZA PRESSURE LAYER 900-1200 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8787, expected range: -1.2405 0.7500
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 48887 (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8705, expected range: -0.2182 0.7500
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=4.4800, expected range: -1.3307 1.3971
Considerable: obs_number=2449.0000, expected range: 2622.8366 3059.9412
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42711 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8875, expected range: -1.1370 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42523 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8979, expected range: -0.8822 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42078 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9109, expected range: -0.3485 0.7500
BUFR LAND SYNOP RH2M (%) 71774 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9979, expected range: -0.9232 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: obs_number=204.0000, expected range: 114.9282 160.9541
AUTOMATIC LAND SYNOP RH2M (%) 41301 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9875, expected range: -0.8745 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 35167 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=1.0000, expected range: -0.7095 0.7500
MANUAL LAND SYNOP RH2M (%) 62440 : out of range
Severe: avg_pge=0.8995, expected range: -1.1363 0.7500
MANUAL LAND SYNOP RH2M (%) 76471 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=61.2651, expected range: 0.0000 34.9507
Severe: avg_pge=0.9999, expected range: -0.0144 0.0252
MANUAL LAND SYNOP RH2M (%) 62062 : out of range
Severe: rms_fgdepar=43.9839, expected range: 0.0000 12.0469
Severe: avg_pge=0.9883, expected range: -0.0135 0.0208
MANUAL LAND SYNOP RH2M (%) 68619 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9712, expected range: -1.3713 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 86260 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8234, expected range: -1.2225 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42714 : out of range
Severe: avg_pge=0.8598, expected range: -1.0390 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 91425 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=687.2184, expected range: 0.0000 177.5874
Severe: avg_pge=0.9186, expected range: -0.4067 0.5321
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42176 : out of range
Severe: rms_fgdepar=945.1909, expected range: 0.0000 246.7004
Severe: avg_pge=0.9401, expected range: -0.8625 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43169 : out of range
Severe: rms_fgdepar=412.4434, expected range: 0.0000 303.6714
Severe: avg_pge=0.8337, expected range: -0.9748 0.7500
MANUAL LAND SYNOP Z (M) 38856 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9673, expected range: -1.4863 0.7500
BUFR LAND SYNOP RH2M (%) 71214 : out of range
Severe: avg_pge=0.9687, expected range: -0.0231 0.0352
BUFR LAND SYNOP SURFACE PRESSURE (PA) 29876 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=497.6436, expected range: 0.0000 213.1550
BUFR LAND SYNOP SURFACE PRESSURE (PA) 25428 : out of range
Severe: rms_fgdepar=492.2917, expected range: 0.0000 187.8923
AUTOMATIC LAND SYNOP RH2M (%) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=826.0000, expected range: 910.0853 1043.0259
Severe: obs_number=1221.0000, expected range: 1456.7984 1659.3097
ship
SHIP SURFACE PRESSURE (PA) OXES2 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8013, expected range: -1.5356 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) LF4J : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8482, expected range: 0.0778 0.7500
SHIP SURFACE PRESSURE (PA) ZCBU5 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9085, expected range: -1.1130 0.7500
SHIP SURFACE PRESSURE (PA) ZCDM6 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=1111.8054, expected range: 0.0000 814.8340
Severe: avg_pge=0.9389, expected range: -1.2335 0.7500
SHIP SURFACE PRESSURE (PA) TBWUK77 : out of range
Severe: rms_fgdepar=999.1546, expected range: 0.0000 480.2418
Severe: avg_pge=0.9338, expected range: -1.2118 0.7500
SHIP SURFACE PRESSURE (PA) 9HJB9 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8261, expected range: -1.1958 0.7500
SHIP SURFACE PRESSURE (PA) VRKB9 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8378, expected range: -0.6098 0.7500
SHIP SURFACE PRESSURE (PA) BQHZ : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8965, expected range: -0.9641 0.7500
SHIP WIND VECTOR DIFF (M/S) ZCBU3 : out of range
Severe: avg_pge=0.9117, expected range: -0.8596 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 2101630 : out of range
Severe: rms_fgdepar=430.3225, expected range: 0.0000 225.0694
Severe: avg_pge=0.8345, expected range: -0.6035 0.7500
metar
METAR SURFACE PRESSURE (PA) FNMO : out of range
Severe: rms_fgdepar=605.8362, expected range: 0.0000 430.3639
Severe: avg_pge=0.8361, expected range: -0.7157 0.7500
METAR SURFACE PRESSURE (PA) LIRT : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=600.6487, expected range: 0.0000 148.4099
snow
MANUAL LAND SYNOP SNOW (CM) : out of range
Severe: avg_fgdepar=0.1095, expected range: -0.0233 0.0265
Severe: rms_fgdepar=2.4495, expected range: -0.6516 0.7418
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8088, expected range: 0.6970 0.9019
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) : out of range
5 times in the last 10 days for at least one item
Severely_persistent: obs_number=1222.0000, expected range: 1497.9932 1618.7095
MANUAL LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8252, expected range: 0.6412 0.9784
BUFR LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8082, expected range: 0.7036 0.8995
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 08410 : out of range
Severe: rms_fgdepar=7.8092, expected range: 0.8628 4.5018
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 68403 : out of range
Severe: rms_fgdepar=7.6338, expected range: 0.0000 3.4267
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89625 : out of range
1 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8252, expected range: -0.4245 1.2878
MANUAL LAND SYNOP 2M TEMPERATURE (K) 08410 : out of range
Severe: rms_fgdepar=9.6622, expected range: 0.0000 3.9450
MANUAL LAND SYNOP 2M TEMPERATURE (K) 17092 : out of range
Severe: rms_fgdepar=9.2923, expected range: 0.1651 4.6505
MANUAL LAND SYNOP 2M TEMPERATURE (K) 89009 : out of range
2 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8091, expected range: 0.3001 1.1161
MANUAL LAND SYNOP 2M TEMPERATURE (K) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=104.0000, expected range: 131.6518 140.9038
METAR 2M TEMPERATURE (K) KSGR : out of range
Severe: rms_fgdepar=7.8506, expected range: 0.6988 3.9680
METAR 2M TEMPERATURE (K) LPPR : out of range
Severe: rms_fgdepar=7.4879, expected range: 0.0000 2.8140
METAR 2M TEMPERATURE (K) KTZR : out of range
Severe: rms_fgdepar=9.1351, expected range: 0.0000 4.7920
METAR 2M TEMPERATURE (K) KHUT : out of range
Severe: rms_fgdepar=8.7499, expected range: 0.9518 4.1536
METAR 2M TEMPERATURE (K) UWWW : out of range
Severe: rms_fgdepar=7.7313, expected range: 0.4095 2.7798
LAND TEMP 2M TEMPERATURE (K) 76612 : out of range
1 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8028, expected range: -0.6199 1.3111
LAND TEMP 2M TEMPERATURE (K) 04417 : out of range
3 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8274, expected range: -0.5582 1.1292
rh2m
AUTOMATIC LAND SYNOP RH2M (%) 74740 : out of range
Severe: rms_fgdepar=30.7773, expected range: 0.0000 13.7257
MANUAL LAND SYNOP RH2M (%) 08410 : out of range
Severe: rms_fgdepar=37.2351, expected range: 0.0000 18.8427
MANUAL LAND SYNOP RH2M (%) 40783 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=21.3922, expected range: 0.0000 10.7088
MANUAL LAND SYNOP RH2M (%) : out of range
Severe: obs_number=103.0000, expected range: 126.7255 145.0523