Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-07-03 12:00

iasi
METOP-C IASI RADIANCES CHANNEL 176 : out of range
Considerable: avg_biascorr=0.2020, expected range: 0.1610 0.1868
cris
NOAA20 CRIS RADIANCES CHANNEL 147 : out of range
Considerable: stdev_fgdepar=0.1537, expected range: 0.1196 0.1419
NPP CRIS RADIANCES CHANNEL 147 : out of range
Slight: stdev_fgdepar=0.1302, expected range: 0.1162 0.1268
gpsro
COSMIC2-E2 GPSRO RISING (24 impact heights affected) : out of range
Considerable: obs_number=277.0000, expected range: 979.6600 2799.9564
COSMIC2-E2 GPSRO SETTING HEIGHT 14 : out of range
Slight: avg_norm_fgdepar=-0.1779, expected range: -0.0987 0.2011
Atmospheric Motion Vector
METEOSAT-8 AMV CLOUDY WV2 WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 : out of range
Slight: avg_fgdepar=4.8635, expected range: 4.1006 4.5976
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 10-11 (HPA) : out of range
4 times in the last 10 days for at least one item
Considerable: stdev_fgdepar=0.0000, expected range: 0.0045 0.0131
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 20-21 (HPA) : out of range
8 times in the last 10 days for at least one item
Slight: avg_fgdepar=-0.0439, expected range: -0.0404 -0.0333
Radiosondes
LAND TEMP TEMPERATURE (K) 24507 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=8.7523, expected range: 0.0000 2.4136
LAND TEMP TEMPERATURE (K) 31168 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.2430, expected range: 0.0000 3.0194
LAND TEMP TEMPERATURE (K) 43279 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.0516, expected range: 0.0000 3.1848
LAND TEMP Q (G/KG) 41112 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=3.0953, expected range: 0.0000 1.6453
LAND TEMP Q (G/KG) 31770 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.1326, expected range: 0.0000 1.1894
LAND TEMP Q (G/KG) 36003 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=6.0970, expected range: -2.0036 7.2463
Severe: rms_fgdepar=6.1966, expected range: 0.0000 7.4540
All LAND TEMP ALL LAYERS WMO BLOCK 62 : all data missing
Severe: obs_number=0, expected range: 26.50 145.98
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : missing
1 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 24.3431 577.0545
Severe: obs_number=0.0000, expected range: 57.2960 372.1232
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 72659 PRESSURE LAYER 900-12 : out of range
Severe: rms_fgdepar=16.4843, expected range: 0.0000 8.2721
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA : missing
Severe: obs_number=0.0000, expected range: 0.0000 912.0758
HIGH RESO LAND TEMP Q (G/KG) 72634 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=3.1007, expected range: 0.0000 1.7424
HIGH RESO LAND TEMP Q (G/KG) 72659 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=5.8674, expected range: 0.0000 2.1596
HIGH RESO LAND TEMP Q (G/KG) 72340 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=4.4634, expected range: 0.2939 1.4812
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 26 : all data missing
Severe: obs_number=0, expected range: 99.42 128.58
HIGH RESO SEA TEMP TEMPERATURE (K) PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=3.5175, expected range: 0.0000 1.1921
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 300-600 (HPA) : out of range
2 times in the last 10 days for at least one item
Considerable: rms_fgdepar=1.4027, expected range: 0.0000 0.8379
Considerable: obs_number=280.0000, expected range: 192.7899 243.7101
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) VJ3H1DBA (2 pressure layers affecte : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=19.3922, expected range: 1.1444 4.0268
WIGOS AMDAR Q (G/KG) BPZGUWRA PRESSURE LAYER 900-1200 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-6.1458, expected range: -20.1343 16.0479
Severe: rms_fgdepar=6.2695, expected range: 0.0000 10.7598
airep
AIREP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: avg_fgdepar=9.7271, expected range: 0.4074 6.3165
Considerable: rms_fgdepar=12.0737, expected range: 0.0000 7.9542
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 48500 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.9570, expected range: 0.0000 27.7592
LAND PILOT WIND VECTOR DIFF (M/S) 48407 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=21.8270, expected range: 0.0000 22.3763
LAND PILOT WIND VECTOR DIFF (M/S) 43063 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_fgdepar=22.0787, expected range: 1.1054 6.2838
LAND PILOT WIND VECTOR DIFF (M/S) 43063 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=23.4957, expected range: 1.3412 6.6681
synop
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40674 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=591.8171, expected range: -567.3324 890.5715
Severely_persistent: rms_fgdepar=592.5757, expected range: 0.0000 887.0707
Severely_persistent: avg_pge=0.8950, expected range: -1.0465 0.7500
MANUAL LAND SYNOP RH2M (%) 64600 : out of range
Severe: rms_fgdepar=39.1119, expected range: 0.0000 27.5535
Severe: avg_pge=0.8651, expected range: -0.0091 0.0197
MANUAL LAND SYNOP RH2M (%) 76040 : out of range
Severe: avg_pge=0.8137, expected range: -0.8801 0.7500
MANUAL LAND SYNOP RH2M (%) 42181 : out of range
Severe: rms_fgdepar=43.4505, expected range: 0.0000 15.8560
Severe: avg_pge=0.8997, expected range: -0.0001 0.0063
MANUAL LAND SYNOP RH2M (%) 43324 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8742, expected range: -1.4641 0.7500
MANUAL LAND SYNOP RH2M (%) 42834 : out of range
Severe: rms_fgdepar=36.0628, expected range: 0.0000 24.5296
Severe: avg_pge=0.9399, expected range: -0.0031 0.0103
MANUAL LAND SYNOP RH2M (%) 42654 : out of range
Severe: avg_fgdepar=50.9666, expected range: -40.3582 40.7959
Severe: rms_fgdepar=50.9666, expected range: 0.0000 32.3950
Severe: avg_pge=0.9981, expected range: -1.0580 0.7500
MANUAL LAND SYNOP RH2M (%) 42174 : out of range
Severe: rms_fgdepar=41.6757, expected range: 0.0000 17.3342
Severe: avg_pge=1.0000, expected range: -0.5257 0.6087
MANUAL LAND SYNOP RH2M (%) 42647 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=51.7515, expected range: -17.0088 23.5548
Severe: rms_fgdepar=51.7515, expected range: 0.0000 21.3645
Severe: avg_pge=0.9995, expected range: -0.0017 0.0084
MANUAL LAND SYNOP RH2M (%) 42468 : out of range
Severe: avg_pge=0.9989, expected range: -0.0082 0.0169
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 82400 : out of range
Severe: rms_fgdepar=493.2442, expected range: 0.0000 113.8238
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42452 : out of range
Severe: avg_pge=0.8270, expected range: -1.0312 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43354 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8672, expected range: -1.2235 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62405 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=607.1232, expected range: 0.0000 111.8668
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 87596 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8068, expected range: -1.4245 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 33679 : out of range
Severe: avg_pge=0.8216, expected range: -0.8560 0.7500
BUFR LAND SYNOP RH2M (%) 12910 : out of range
Severe: rms_fgdepar=32.3038, expected range: 0.0000 16.7425
BUFR LAND SYNOP RH2M (%) 53231 : out of range
Severe: rms_fgdepar=30.7366, expected range: 0.0000 11.2400
BUFR LAND SYNOP RH2M (%) 81786 : out of range
Severe: rms_fgdepar=30.6449, expected range: 0.0000 11.4740
BUFR LAND SYNOP SURFACE PRESSURE (PA) 11880 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=408.6435, expected range: 0.0000 165.9358
Severe: avg_pge=0.8408, expected range: -0.4633 0.6358
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48921 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=463.1965, expected range: 0.0000 142.1406
Severe: avg_pge=0.8505, expected range: -1.0298 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 12215 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=338.6647, expected range: 0.0000 229.5291
Severe: avg_pge=0.8868, expected range: -0.9645 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24668 : out of range
Severe: rms_fgdepar=572.4751, expected range: 0.0000 174.1930
BUFR LAND SYNOP SURFACE PRESSURE (PA) 30439 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=857.1400, expected range: -198.1220 72.0935
Severe: rms_fgdepar=857.1400, expected range: 0.0000 179.3096
Severe: avg_pge=0.9319, expected range: -0.2436 0.3315
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7FF3 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=932.7012, expected range: 575.7905 1304.2217
Severely_persistent: rms_fgdepar=932.7012, expected range: 575.7905 1304.2217
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) OXCR2 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8212, expected range: -1.5402 0.7500
SHIP SURFACE PRESSURE (PA) OZBY2 : out of range
Severe: avg_fgdepar=659.2132, expected range: -729.8544 1265.6264
Severe: rms_fgdepar=659.2136, expected range: 0.0000 1281.5339
SHIP SURFACE PRESSURE (PA) V7FF3 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=932.7012, expected range: 592.5449 1283.3926
Severe: rms_fgdepar=932.7012, expected range: 592.5449 1283.3926
SHIP SURFACE PRESSURE (PA) A8SI8 : out of range
Severe: avg_fgdepar=-855.1050, expected range: -590.8412 930.8378
Severe: rms_fgdepar=855.1050, expected range: 0.0000 969.3430
SHIP SURFACE PRESSURE (PA) VRKB9 : out of range
Severe: avg_fgdepar=623.0428, expected range: -786.0411 1194.2587
Severe: rms_fgdepar=623.0428, expected range: 0.0000 803.0035
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRJV2 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=633.8290, expected range: -394.6626 421.8421
Severe: rms_fgdepar=633.8290, expected range: 0.0000 329.5761
Severe: avg_pge=0.8260, expected range: -1.0406 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OZBY2 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=659.2132, expected range: -726.6349 1379.0419
Severe: rms_fgdepar=659.2136, expected range: 0.0000 1353.5563
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7JD6 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-700.0871, expected range: -2020.6082 1591.2314
Severe: rms_fgdepar=700.0871, expected range: 0.0000 881.8113
Severe: avg_pge=0.8773, expected range: -0.4940 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) D5QV7 : out of range
Severe: avg_fgdepar=-505.6196, expected range: -1155.1130 246.4999
Severe: rms_fgdepar=505.6196, expected range: 0.0000 1033.7298
BUFR SHIP SYNOP SURFACE PRESSURE (PA) A8SI8 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-855.1050, expected range: -569.9702 601.3264
Severe: rms_fgdepar=855.1050, expected range: 0.0000 548.2984
Severe: avg_pge=0.8897, expected range: -0.9841 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) OZDQ2 : out of range
Severe: avg_fgdepar=30.3528, expected range: -23.1339 39.4635
Severe: rms_fgdepar=30.3528, expected range: 0.0000 39.4635
Severe: avg_pge=0.9403, expected range: -0.8737 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 2IYG9 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8136, expected range: -1.0737 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRBH9 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=19.0639, expected range: 0.0000 14.2727
Severe: avg_pge=0.9033, expected range: -0.9917 0.7500
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 5300041 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8601, expected range: 0.3704 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101769 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8187, expected range: 0.3172 0.7500
MOORED BUOYS SURFACE PRESSURE (PA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=70.0000, expected range: 86.0631 108.1474
Considerable: obs_number=70.0000, expected range: 86.0631 108.1474
metar
METAR SURFACE PRESSURE (PA) RKTH : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=319.1771, expected range: 0.0000 140.8195
METAR SURFACE PRESSURE (PA) LTCR : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-503.0279, expected range: -657.7944 -147.4065
Severe: rms_fgdepar=503.5251, expected range: 148.5705 659.3153
snow
BUFR LAND SYNOP SNOW (CM) 01035 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=106.8933, expected range: 102.8495 132.7973
Severely_persistent: rms_fgdepar=106.8951, expected range: 102.6264 133.5417
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89734 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.1057, expected range: -14.8878 0.4973
Severely_persistent: rms_fgdepar=12.1092, expected range: 0.0000 14.7911
Severely_persistent: avg_est_pge=0.8514, expected range: 0.3431 1.0840
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8402, expected range: 0.6208 0.9016
METAR 2M TEMPERATURE (K) KLCK : out of range
27 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.1552, expected range: -18.1157 -9.2267
Severely_persistent: rms_fgdepar=12.1552, expected range: 9.5885 18.3527
BUFR LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8401, expected range: 0.6399 0.8908
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 51777 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-15.1322, expected range: -19.4778 15.4968
Severe: rms_fgdepar=15.1322, expected range: 0.0000 15.0404
Severe: avg_est_pge=0.8396, expected range: -0.1242 1.2381
MANUAL LAND SYNOP 2M TEMPERATURE (K) 43324 : out of range
Severe: rms_fgdepar=11.8468, expected range: 0.0000 5.9189
MANUAL LAND SYNOP 2M TEMPERATURE (K) 42654 : out of range
Severe: rms_fgdepar=11.5841, expected range: 0.0000 5.9560
METAR 2M TEMPERATURE (K) KDXR : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.6209, expected range: 0.0000 6.5050
LAND TEMP 2M TEMPERATURE (K) 71926 : out of range
Severe: avg_fgdepar=13.1580, expected range: -4.4762 9.2700
Severe: rms_fgdepar=13.1580, expected range: 0.0000 8.3036
rh2m
All BUFR LAND SYNOP WMO BLOCK 98 : all data missing
Severely_persistent: obs_number=0, expected range: 123.58 134.05
BUFR LAND SYNOP RH2M (%) : out of range
Considerable: obs_number=76.0000, expected range: 88.7809 98.6928