Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-08-08 00:00

cris
All NPP CRIS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 14971.98 15886.47
atms
All NPP ATMS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 11528.30 13974.28
Atmospheric Motion Vector
All AQUA MODIS CLEAR WV ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 113.66 1091.78
All NPP VIIRS AMV IR ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 94.30 1474.05
METEOSAT-11 AMV IR3 WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: stdev_press=32.1094, expected range: 26.8459 28.9220
Radiosondes
LAND TEMP WIND VECTOR DIFF (M/S) 42701 PRESSURE LAYER 0-300 (HPA) : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=24.9052, expected range: -7.6611 48.4559
Severely_persistent: rms_fgdepar=25.4231, expected range: 0.0000 50.4694
LAND TEMP Q (G/KG) 35700 PRESSURE LAYER 900-1200 (HPA) : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=6.1863, expected range: -2.3019 12.2431
Severely_persistent: rms_fgdepar=6.3245, expected range: 0.0000 12.5758
All HIGH RESO LAND TEMP ALL LAYERS South pole : all data missing
Severely_persistent: obs_number=0, expected range: 67.08 436.31
LAND TEMP TEMPERATURE (K) 61052 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=6.4408, expected range: 0.0000 1.8445
LAND TEMP TEMPERATURE (K) 27707 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=9.7392, expected range: 0.0000 1.7112
LAND TEMP WIND VECTOR DIFF (M/S) 36872 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=20.4033, expected range: 0.1370 7.1277
Severe: rms_fgdepar=20.6123, expected range: 0.0000 8.4308
Severe: avg_pge=0.8531, expected range: -0.3298 0.5505
LAND TEMP WIND VECTOR DIFF (M/S) 37259 PRESSURE LAYER 300-600 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=15.2703, expected range: 0.0000 8.5027
LAND TEMP Q (G/KG) 23933 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.6047, expected range: 0.0000 1.4571
LAND TEMP Q (G/KG) 40417 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.6791, expected range: 0.0000 6.8805
LAND TEMP Q (G/KG) 41169 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.5450, expected range: 0.0000 8.5497
All LAND TEMP ALL LAYERS WMO BLOCK 98 : all data missing
Severe: obs_number=0, expected range: 198.55 325.20
HIGH RESO LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=3.0603, expected range: 0.3697 1.0954
HIGH RESO LAND TEMP TEMPERATURE (K) PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=3.3883, expected range: 0.1996 1.3668
amdar
TAMDAR WIND VECTOR DIFF (M/S) 00005178 PRESSURE LAYER 0-300 (HPA) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=21.2226, expected range: -1.0882 33.9737
Severely_persistent: rms_fgdepar=21.2226, expected range: 0.0000 34.0279
WIGOS AMDAR Q (G/KG) BSTXQVBA PRESSURE LAYER 900-1200 (HPA) : out of range
29 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-7.2261, expected range: -12.3549 0.5576
Severely_persistent: rms_fgdepar=7.3190, expected range: 0.0825 12.1129
synop
AUTOMATIC LAND SYNOP RH2M (%) 18156 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-54.4300, expected range: -105.1093 54.9226
Severely_persistent: rms_fgdepar=54.4300, expected range: 0.0000 91.0822
Severely_persistent: avg_pge=0.9998, expected range: -1.6337 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 91682 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-803.9957, expected range: -349.2055 385.7229
Severely_persistent: rms_fgdepar=803.9957, expected range: 0.0000 514.8826
Severely_persistent: avg_pge=0.9502, expected range: -0.2904 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 43097 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-660.0369, expected range: -372.0714 246.6685
Severely_persistent: rms_fgdepar=660.0369, expected range: 0.0000 244.1557
Severely_persistent: avg_pge=0.9116, expected range: -0.8400 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 26258 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=280.6276, expected range: 0.0000 78.5748
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71588 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=523.2547, expected range: 398.2047 583.3798
AUTOMATIC LAND SYNOP RH2M (%) 94644 : out of range
Severe: rms_fgdepar=37.7243, expected range: 0.0000 21.3115
AUTOMATIC LAND SYNOP RH2M (%) 68296 : out of range
Severe: rms_fgdepar=42.6071, expected range: 0.0000 27.4312
Severe: avg_pge=0.8462, expected range: -0.0124 0.0210
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 38613 : out of range
Severe: avg_fgdepar=-698.7677, expected range: -256.8677 40.2053
Severe: rms_fgdepar=698.7677, expected range: 0.0000 256.8677
Severe: avg_pge=0.9355, expected range: -0.8321 0.7500
MANUAL LAND SYNOP RH2M (%) 40831 : out of range
Severe: avg_fgdepar=50.3663, expected range: -18.4817 21.5720
Severe: rms_fgdepar=51.1117, expected range: 0.0000 22.0826
MANUAL LAND SYNOP RH2M (%) 76122 : out of range
Severe: rms_fgdepar=34.2834, expected range: 0.0000 7.6076
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 37735 : out of range
Severe: avg_fgdepar=540.1204, expected range: -24.2336 147.2711
Severe: rms_fgdepar=541.6105, expected range: 1.6387 150.3244
Severe: avg_pge=0.8772, expected range: -0.2037 0.3515
BUFR LAND SYNOP RH2M (%) 12843 : out of range
Severe: rms_fgdepar=31.9729, expected range: 0.0000 16.5823
BUFR LAND SYNOP RH2M (%) 71785 : out of range
Severe: rms_fgdepar=33.9717, expected range: 0.3400 17.9155
BUFR LAND SYNOP RH2M (%) 71607 : out of range
Severe: rms_fgdepar=32.2313, expected range: 0.0000 11.4519
BUFR LAND SYNOP RH2M (%) 07607 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=31.3916, expected range: 0.0000 12.5939
BUFR LAND SYNOP RH2M (%) 11858 : out of range
Severe: rms_fgdepar=32.6955, expected range: 1.0676 12.4425
BUFR LAND SYNOP SURFACE PRESSURE (PA) 37953 : out of range
Severe: rms_fgdepar=672.3231, expected range: 0.0000 204.1455
BUFR LAND SYNOP SURFACE PRESSURE (PA) 30673 : out of range
Severe: avg_fgdepar=-527.7759, expected range: -279.5593 321.9672
Severe: rms_fgdepar=626.5151, expected range: 0.0000 264.0332
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48064 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=525.5251, expected range: 24.9815 246.2849
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48947 : out of range
Severe: rms_fgdepar=570.8090, expected range: 0.0000 345.1271
BUFR LAND SYNOP SURFACE PRESSURE (PA) 42367 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-1003.7620, expected range: -178.4623 34.3646
Severe: rms_fgdepar=1003.7620, expected range: 0.0000 178.4623
Severe: avg_pge=0.9472, expected range: -1.0580 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 16219 : out of range
Severe: avg_pge=0.8114, expected range: -0.7604 0.7500
ship
SHIP SURFACE PRESSURE (PA) WTEK : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8582, expected range: -1.2306 0.7500
ABBREVIATED SHIP SURFACE PRESSURE (PA) WTEK : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8584, expected range: -0.9242 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6NR7 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=804.4299, expected range: -1160.5267 1249.5190
Severely_persistent: rms_fgdepar=804.6002, expected range: -864.9321 1154.7969
Severely_persistent: avg_pge=0.9278, expected range: -1.2530 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9VKU8 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=961.4362, expected range: 704.8903 1223.0159
Severely_persistent: rms_fgdepar=961.4362, expected range: 706.4170 1222.2691
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WZE4539 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-658.4206, expected range: -1204.8992 1775.8656
Severely_persistent: rms_fgdepar=658.4206, expected range: -1488.2603 2139.7535
Severely_persistent: avg_pge=0.8759, expected range: -1.5145 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRNU9 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1185.8543, expected range: 913.2107 1440.3867
Severely_persistent: rms_fgdepar=1188.2262, expected range: 914.0203 1440.0175
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) ELDMMXN : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9096, expected range: -1.0356 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRWW5 : out of range
Severe: avg_fgdepar=997.9279, expected range: -499.6907 361.8950
Severe: rms_fgdepar=997.9279, expected range: 0.0000 539.1269
Severe: avg_pge=0.8867, expected range: -0.9542 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) TBWUK47 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=447.0981, expected range: 0.0000 109.8009
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRSR7 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=603.8412, expected range: -482.3777 492.7271
Severe: rms_fgdepar=609.3115, expected range: 0.0000 419.7483
Severe: avg_pge=0.8243, expected range: -1.1849 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) : out of range
Severe: avg_fgdepar=501.1400, expected range: -975.5807 896.3756
Severe: rms_fgdepar=501.1400, expected range: 0.0000 842.2696
BUFR SHIP SYNOP SURFACE PRESSURE (PA) PHET : out of range
Severe: rms_fgdepar=459.3113, expected range: 0.0000 438.0259
Severe: avg_pge=0.8007, expected range: -0.7179 0.7500
buoy
DRIBU WIND VECTOR DIFF (M/S) 23451 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9084, expected range: 0.1230 0.7500
DRIBU WIND VECTOR DIFF (M/S) 23454 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8544, expected range: -0.6231 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1501741 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-540.7112, expected range: -1665.5241 1624.3670
Severely_persistent: rms_fgdepar=579.8253, expected range: 0.0000 1086.8653
Severely_persistent: avg_pge=0.8536, expected range: 0.1260 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601807 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=525.6036, expected range: -393.8051 570.4228
metar
METAR SURFACE PRESSURE (PA) FZIC : out of range
Severe: rms_fgdepar=592.3625, expected range: 0.0000 200.5048
METAR SURFACE PRESSURE (PA) FQNC : out of range
Severe: rms_fgdepar=616.1885, expected range: 0.0000 234.1596
METAR SURFACE PRESSURE (PA) EGQL : out of range
Severe: rms_fgdepar=322.5630, expected range: 0.3376 74.8461
AUTOMATIC METAR SURFACE PRESSURE (PA) KAIZ : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=537.0776, expected range: 0.0000 130.3194
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-772.5641, expected range: -773.7355 -771.9808
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=772.5642, expected range: 771.9810 773.7354
t2m
METAR 2M TEMPERATURE (K) SVBC : out of range
Severe: avg_fgdepar=-18.7186, expected range: 0.2443 7.6428
Severe: rms_fgdepar=18.7186, expected range: 0.3494 7.8817
METAR 2M TEMPERATURE (K) KNBG : out of range
Severe: avg_fgdepar=-18.5372, expected range: -2.7370 3.1031
Severe: rms_fgdepar=18.5372, expected range: 0.0000 7.0212
METAR 2M TEMPERATURE (K) TISX : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.1658, expected range: 0.0000 16.9906
rh2m
MANUAL LAND SYNOP RH2M (%) 60536 : out of range
Severe: rms_fgdepar=36.0764, expected range: 0.0000 17.5675
All MANUAL LAND SYNOP WMO BLOCK 98 : all data missing
Severe: obs_number=0, expected range: 75.39 191.61
All BUFR LAND SYNOP WMO BLOCK 98 : all data missing
Severe: obs_number=0, expected range: 125.81 134.97