Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-07-30 12:00

iasi
METOP-B IASI RADIANCES CHANNEL 1639 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1244, expected range: -0.0877 -0.0532
METOP-B IASI RADIANCES CHANNEL 1658 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0247, expected range: 0.0701 0.1118
METOP-C IASI RADIANCES CHANNEL 5383 : out of range
3 times in the last 10 days for at least one item
Considerable: avg_biascorr=-0.4588, expected range: -0.4323 -0.3875
cris
NOAA20 CRIS RADIANCES CHANNEL 965 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2733, expected range: -0.2446 -0.2184
NOAA20 CRIS RADIANCES CHANNEL 989 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0415, expected range: 0.0665 0.0850
NOAA20 CRIS RADIANCES CHANNEL 1005 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0820, expected range: 0.1105 0.1191
mwhs2
FY-3C MWHS2 ALLSKY RADIANCES CHANNEL 15 : out of range
Considerable: avg_biascorr=-2.0533, expected range: -1.9215 -1.6581
FY-3C MWHS2 ALLSKY RADIANCES CHANNEL 5 : out of range
Slight: stdev_norm_fgdepar=0.8648, expected range: 0.7821 0.8439
FY-3C MWHS2 ALLSKY RADIANCES CHANNEL 6 : out of range
2 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.9059, expected range: 0.7325 0.8597
FY-3C MWHS2 ALLSKY RADIANCES CHANNEL 7 : out of range
1 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=1.0023, expected range: 0.5999 0.9184
atms
All NPP ATMS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 11690.67 14203.03
NOAA20 ATMS RADIANCES CHANNEL 7 : out of range
Considerable: stdev_fgdepar=0.1547, expected range: 0.0828 0.1264
ssmis
DMSP-17 SSMIS RADIANCES CHANNEL 8 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.1241, expected range: 0.4890 0.5345
DMSP-17 SSMIS RADIANCES CHANNEL 9 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.0954, expected range: 0.5093 0.7171
DMSP-17 SSMIS RADIANCES CHANNEL 10 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.0569, expected range: 0.5579 0.6073
DMSP-17 SSMIS RADIANCES CHANNEL 11 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.0219, expected range: 0.1564 0.2509
Slight: stdev_norm_fgdepar=0.0371, expected range: 0.6108 0.6108
DMSP-18 SSMIS RADIANCES CHANNEL 9 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.0797, expected range: 0.5113 0.5301
DMSP-17 SSMIS RADIANCES CHANNEL 17 : out of range
12 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.0831, expected range: 0.7707 0.7707
DMSP-18 SSMIS RADIANCES CHANNEL 10 : out of range
14 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.0497, expected range: 0.5874 0.5874
DMSP-18 SSMIS RADIANCES CHANNEL 11 : out of range
10 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.0331, expected range: 0.6393 0.6393
Atmospheric Motion Vector
All AQUA MODIS CLEAR WV ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 0.00 1214.26
All NPP VIIRS AMV IR ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 85.39 1478.07
scatt
HY-2B SCATTEROMETER WIND VECTOR DIFF (M/S) : out of range
1 times in the last 10 days for at least one item
Slight: obs_number=60846.0000, expected range: 82364.8703 167027.1297
Radiosondes
LAND TEMP Q (G/KG) 35700 PRESSURE LAYER 900-1200 (HPA) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=6.2915, expected range: 0.3197 7.3871
Severely_persistent: rms_fgdepar=6.5344, expected range: 0.5154 7.5333
LAND TEMP Q (G/KG) 17240 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=6.0101, expected range: 0.0000 4.1695
LAND TEMP Q (G/KG) 40437 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=5.5534, expected range: 0.0000 2.1964
LAND TEMP Q (G/KG) 96253 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.0248, expected range: 0.0000 2.6571
LAND TEMP WIND VECTOR DIFF (M/S) 30965 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.1272, expected range: 0.0000 7.8231
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
Severe: obs_number=638.0000, expected range: 437.4271 465.0729
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
Severe: obs_number=287.0000, expected range: 373.5863 388.1637
All HIGH RESO SEA TEMP ALL LAYERS North West Pacific : all data missing
Severe: obs_number=0, expected range: 56.00 168.33
amdar
AMDAR WIND VECTOR DIFF (M/S) AU0124 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=17.0677, expected range: 0.0000 6.5505
TAMDAR WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : missing
4 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 258.3698
WIGOS AMDAR TEMPERATURE (K) EU0133 (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8727, expected range: -1.4387 0.7500
ADS-C WIND VECTOR DIFF (M/S) D3WAIIBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=21.0110, expected range: -3.2409 10.3045
Severe: rms_fgdepar=21.0110, expected range: 0.0000 9.6548
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 10873 PRESSURE LAYER 300-600 : out of range
Severe: rms_fgdepar=21.1641, expected range: 0.0000 40.0441
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: rms_fgdepar=9.3719, expected range: 0.0000 6.0524
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 43128 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_fgdepar=20.2221, expected range: -1.5133 9.8318
Severe: rms_fgdepar=26.4502, expected range: 0.0000 9.9464
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 17952 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8001, expected range: -1.5122 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 38191 : out of range
Severe: avg_fgdepar=53.4779, expected range: -19.8913 20.3724
Severe: rms_fgdepar=53.4779, expected range: -10.9225 16.1433
Severe: avg_pge=0.9998, expected range: 0.0007 0.0048
MANUAL LAND SYNOP RH2M (%) 62120 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.9994, expected range: -0.5194 0.7500
MANUAL LAND SYNOP RH2M (%) 62011 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=40.0821, expected range: 7.6588 35.4612
Severe: avg_pge=0.9914, expected range: -0.6925 0.7500
MANUAL LAND SYNOP RH2M (%) 76113 : out of range
Severe: avg_pge=0.9997, expected range: -2.1297 0.7500
MANUAL LAND SYNOP RH2M (%) 66285 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9886, expected range: 0.3647 0.7500
MANUAL LAND SYNOP RH2M (%) 84056 : out of range
Severe: rms_fgdepar=39.4245, expected range: 12.1825 19.9699
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40001 : out of range
Severe: rms_fgdepar=629.5827, expected range: 60.0595 230.0104
Severe: avg_pge=0.8388, expected range: 0.2029 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 37985 : out of range
Severe: rms_fgdepar=633.8170, expected range: 0.0000 139.1818
BUFR LAND SYNOP RH2M (%) 10540 : out of range
Severe: rms_fgdepar=31.1584, expected range: 0.0000 16.2222
BUFR LAND SYNOP RH2M (%) 29842 : out of range
Severe: rms_fgdepar=43.6061, expected range: 0.0000 26.5571
Severe: avg_pge=0.9376, expected range: -0.0760 0.0925
BUFR LAND SYNOP RH2M (%) 35582 : out of range
Severe: rms_fgdepar=31.6567, expected range: 0.0000 15.0595
BUFR LAND SYNOP RH2M (%) 08223 : out of range
Severe: rms_fgdepar=33.0147, expected range: 0.0000 12.4750
BUFR LAND SYNOP RH2M (%) 72506 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8710, expected range: -1.5642 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 40405 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=538.3414, expected range: 0.0000 143.8538
BUFR LAND SYNOP SURFACE PRESSURE (PA) 60507 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=320.1285, expected range: 75.9477 193.5312
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V8585 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=766.8296, expected range: 506.4179 871.4768
Severely_persistent: rms_fgdepar=766.8296, expected range: 506.4179 871.4768
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V9268 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=513.7136, expected range: -1448.5414 1505.8554
Severely_persistent: rms_fgdepar=513.7136, expected range: 0.0000 1230.1627
BUFR SHIP SYNOP SURFACE PRESSURE (PA) PJWM : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=708.0710, expected range: 182.6582 1129.3426
Severely_persistent: rms_fgdepar=708.0710, expected range: 182.6582 1129.3426
Severely_persistent: avg_pge=0.8668, expected range: 0.5696 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OWSC2 : out of range
Severe: avg_fgdepar=519.0669, expected range: -71.7858 666.9768
Severe: rms_fgdepar=519.0669, expected range: 0.0000 666.9768
Severe: avg_pge=0.8064, expected range: -0.3127 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ZCBU5 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=515.0596, expected range: -640.1866 1302.2272
Severe: rms_fgdepar=515.0596, expected range: 0.0000 1302.2272
Severe: avg_pge=0.8111, expected range: -1.0986 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6WK7 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-574.3237, expected range: -1215.6084 1301.3124
Severe: rms_fgdepar=574.3237, expected range: 0.0000 1023.6491
Severe: avg_pge=0.8566, expected range: -1.0806 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRSR7 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=539.8576, expected range: -913.4239 1388.2890
Severe: rms_fgdepar=540.0735, expected range: 0.0000 1329.1463
Severe: avg_pge=0.8236, expected range: -1.6959 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WZE4539 : out of range
Severe: avg_fgdepar=1085.3206, expected range: -541.3669 634.6596
Severe: rms_fgdepar=1085.3206, expected range: 0.0000 434.8711
Severe: avg_pge=0.8997, expected range: -0.9282 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 7JQF : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=334.2009, expected range: 0.0000 183.4466
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 6102804 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-678.8896, expected range: -1221.5734 1014.3621
Severely_persistent: rms_fgdepar=679.5305, expected range: -1004.3412 1218.1533
Severely_persistent: avg_pge=0.9215, expected range: -1.7172 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6301679 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-659.0639, expected range: -1015.5151 880.7179
Severely_persistent: rms_fgdepar=664.7535, expected range: 0.0000 1215.6489
Severely_persistent: avg_pge=0.9160, expected range: -1.5192 0.7500
MOORED BUOYS SURFACE PRESSURE (PA) 4200060 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=320.4244, expected range: 0.0000 66.2913
DRIFTING BUOYS SURFACE PRESSURE (PA) 4602500 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8293, expected range: -0.7641 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4401851 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=354.4271, expected range: 0.0000 220.2799
Severe: avg_pge=0.8360, expected range: -0.4064 0.6683
DRIFTING BUOYS SURFACE PRESSURE (PA) 3401545 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=354.9256, expected range: 0.0000 110.4160
Severe: avg_pge=0.8397, expected range: -0.0831 0.0969
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-773.5706, expected range: -773.1695 -772.3176
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=773.5707, expected range: 772.3178 773.1694
t2m
METAR 2M TEMPERATURE (K) UGMS : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=12.7544, expected range: 6.4681 14.8121
Severely_persistent: rms_fgdepar=12.7740, expected range: 6.4733 14.9354
BUFR LAND SYNOP 2M TEMPERATURE (K) 80010 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=12.2219, expected range: 3.3452 14.6968
BUFR LAND SYNOP 2M TEMPERATURE (K) 78896 : out of range
23 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.1932, expected range: -20.7526 -2.4733
Severely_persistent: rms_fgdepar=17.1932, expected range: 2.9839 21.1722