Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-09-14 12:00

iasi
All METOP-C IASI ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 21901.42 23832.22
METOP-B IASI RADIANCES (210 channels affected) : out of range
Severe: obs_number=13139.0000, expected range: 22508.2846 23275.7154
METOP-B IASI RADIANCES CHANNEL 434 : out of range
Severe: stdev_fgdepar=0.3066, expected range: 0.2671 0.2878
METOP-B IASI RADIANCES CHANNEL 5403 : out of range
Considerable: stdev_fgdepar=0.5107, expected range: 0.4274 0.4829
METOP-B IASI RADIANCES CHANNEL 404 : out of range
Slight: stdev_fgdepar=0.2645, expected range: 0.2337 0.2580
METOP-B IASI RADIANCES CHANNEL 445 : out of range
Slight: stdev_fgdepar=0.3171, expected range: 0.2810 0.3038
METOP-B IASI RADIANCES CHANNEL 3093 : out of range
Slight: stdev_fgdepar=1.4198, expected range: 1.1944 1.3717
METOP-B IASI RADIANCES CHANNEL 5399 : out of range
Slight: stdev_fgdepar=0.6760, expected range: 0.5646 0.6432
METOP-B IASI RADIANCES CHANNEL 5480 : out of range
Slight: stdev_fgdepar=0.5266, expected range: 0.4421 0.5044
airs
AQUA AIRS RADIANCES (11 channels affected) : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.0925, expected range: -0.0662 -0.0523
mhs
METOP-B MHS ALLSKY RADIANCES CHANNEL 3 : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=29997.0000, expected range: 45978.7213 50343.9846
METOP-B MHS ALLSKY RADIANCES CHANNEL 4 : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=28431.0000, expected range: 44080.2700 48112.0829
METOP-B MHS ALLSKY RADIANCES CHANNEL 5 : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=17600.0000, expected range: 27519.7919 30915.1493
gpsro
METOP-B GRAS RISING HEIGHT 20-22 KM : out of range
Slight: stdev_norm_fgdepar=1.1267, expected range: 0.8764 1.0760
COSMIC2-E2 GPSRO SETTING HEIGHT 24-26 KM : out of range
Slight: obs_number=1188.0000, expected range: 1387.3380 2183.4855
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1010-1011 (HPA) : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-3.9649, expected range: -3.3301 -3.2013
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 10-11 (HPA) : out of range
38 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=0.0085, expected range: 0.0067 0.0068
METOP-B GOME-2 OZONE, TOP PRESSURE LAYER 12-13 (HPA) : out of range
10 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=4.5063, expected range: 5.0442 5.4726
Radiosondes
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=6.6023, expected range: -6.3532 19.7641
Severely_persistent: rms_fgdepar=6.6023, expected range: 0.0000 19.8354
LAND TEMP TEMPERATURE (K) 47122 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=8.2378, expected range: 0.0000 4.0224
HIGH RESO LAND TEMP TEMPERATURE (K) 35121 PRESSURE LAYER 900-1200 (HPA : out of range
Severe: avg_pge=0.8315, expected range: -0.0384 0.0484
BUFR TEMP DESCENT WIND VECTOR DIFF (M/S) (2 pressure layers affected) : out of range
Severe: avg_fgdepar=9.2565, expected range: 0.1851 3.9946
Severe: rms_fgdepar=10.6100, expected range: 0.3746 4.3683
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
Considerable: obs_number=956.0000, expected range: 845.5750 871.1750
BUFR TEMP DESCENT Q (G/KG) PRESSURE LAYER 300-600 (HPA) : out of range
Considerable: avg_fgdepar=1.2585, expected range: -0.5285 0.5374
amdar
AMDAR WIND VECTOR DIFF (M/S) (2 pressure layers affected) : missing
2 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 262.7245
TAMDAR WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : missing
1 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 277.5344
MODE-S WIND VECTOR DIFF (M/S) M1062B7 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=16.0899, expected range: 0.0000 5.0253
ADS-C WIND VECTOR DIFF (M/S) CWWWAIBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.5199, expected range: 0.0000 10.0315
ADS-C WIND VECTOR DIFF (M/S) A3SKLBRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.6800, expected range: 0.0000 15.8293
airep
AIREP WIND VECTOR DIFF (M/S) UAL1110 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.2493, expected range: 0.0000 7.8781
AIREP WIND VECTOR DIFF (M/S) QFA7 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=20.6754, expected range: 0.0000 11.4592
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 43333 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=21.3903, expected range: 0.0000 15.6563
LAND PILOT WIND VECTOR DIFF (M/S) 98433 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=21.9065, expected range: 0.0381 16.5635
Severe: rms_fgdepar=21.9065, expected range: 0.6856 16.8496
Severe: avg_pge=0.8031, expected range: -0.9559 0.7500
synop
BUFR LAND SYNOP SURFACE PRESSURE (PA) 68939 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=627.7666, expected range: -689.1870 704.2739
Severely_persistent: rms_fgdepar=644.8697, expected range: 0.0000 1056.5123
Severely_persistent: avg_pge=0.9277, expected range: -0.6544 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 34498 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=58.6020, expected range: -6.1679 15.1245
Severe: rms_fgdepar=58.6020, expected range: 0.0000 15.1245
Severe: avg_pge=0.9995, expected range: -0.0014 0.0077
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 78672 : out of range
Severe: avg_fgdepar=-576.0158, expected range: -201.5893 19.9614
Severe: rms_fgdepar=717.2091, expected range: 0.0000 240.1096
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 76225 : out of range
Severe: avg_fgdepar=719.0759, expected range: -1822.4539 2561.4796
Severe: rms_fgdepar=719.0759, expected range: -1759.1968 2516.9344
Severe: avg_pge=0.8968, expected range: -2.1533 0.7500
MANUAL LAND SYNOP RH2M (%) 67583 : out of range
Severe: rms_fgdepar=37.6226, expected range: 0.0000 10.7963
MANUAL LAND SYNOP RH2M (%) 66285 : out of range
Severe: avg_fgdepar=55.0181, expected range: 35.5606 51.7139
Severe: rms_fgdepar=55.0415, expected range: 35.4832 51.8904
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48563 : out of range
Severe: rms_fgdepar=397.8736, expected range: 0.0000 222.1726
BUFR LAND SYNOP RH2M (%) 63820 : out of range
Severe: rms_fgdepar=32.6074, expected range: 0.0000 13.9926
BUFR LAND SYNOP RH2M (%) 86701 : out of range
Severe: rms_fgdepar=42.2816, expected range: 0.0000 15.9915
BUFR LAND SYNOP RH2M (%) 16084 : out of range
Severe: rms_fgdepar=39.4333, expected range: 6.5189 29.6679
Severe: avg_pge=0.8881, expected range: -1.0189 0.7500
BUFR LAND SYNOP RH2M (%) 68408 : out of range
Severe: rms_fgdepar=37.1461, expected range: 0.0000 14.2175
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OXFU2 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=509.6335, expected range: 340.0829 658.5483
Severely_persistent: rms_fgdepar=512.1484, expected range: 339.9054 659.0038
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V3735 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=873.5334, expected range: 514.4244 1346.9478
Severely_persistent: rms_fgdepar=873.5334, expected range: 514.4244 1346.9478
BUFR SHIP SYNOP SURFACE PRESSURE (PA) TBWUK49 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=570.5159, expected range: -634.8694 979.3614
Severely_persistent: rms_fgdepar=570.5159, expected range: 0.0000 930.3813
Severely_persistent: avg_pge=0.8417, expected range: -1.1402 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VABC : out of range
23 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=832.3234, expected range: 32.9366 1590.8500
Severely_persistent: rms_fgdepar=833.8498, expected range: 39.3687 1590.7701
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VDBY : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1336.8448, expected range: -1997.6837 2739.6042
Severely_persistent: rms_fgdepar=1336.8448, expected range: 0.0000 2420.9219
Severely_persistent: avg_pge=0.9216, expected range: -0.4454 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OWSC2 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=554.1243, expected range: 45.6709 1086.2300
Severe: rms_fgdepar=554.1243, expected range: 45.6709 1086.2300
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OYGR2 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-576.9104, expected range: -907.6338 -407.7540
Severe: rms_fgdepar=578.5204, expected range: 401.8667 914.8192
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WYQ4356 : out of range
Severe: rms_fgdepar=449.7944, expected range: 0.0000 236.7207
Severe: avg_pge=0.8174, expected range: -0.2439 0.3144
BUFR SHIP SYNOP SURFACE PRESSURE (PA) D5BF7 : out of range
Severe: avg_pge=0.8155, expected range: -1.3139 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA5028 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-549.9448, expected range: -507.9409 559.3457
Severe: rms_fgdepar=667.7769, expected range: 0.0000 368.0014
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 7KKU : out of range
Severe: rms_fgdepar=654.9946, expected range: 0.0000 687.1207
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 6501670 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8445, expected range: -0.8967 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6402654 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8448, expected range: -0.1645 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1701666 : out of range
Severe: rms_fgdepar=386.5111, expected range: 0.0000 299.3024
Severe: avg_pge=0.8263, expected range: -0.8385 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5501667 : out of range
Severe: rms_fgdepar=359.4107, expected range: 0.0000 172.3466
metar
METAR SURFACE PRESSURE (PA) LPOV : out of range
Severe: rms_fgdepar=305.6169, expected range: 0.0000 161.4779
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-772.9536, expected range: -774.7449 -771.6732
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=772.9536, expected range: 771.6732 774.7450
BUFR LAND SYNOP SNOW (CM) _MI1F9AC : out of range
25 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=52.5000, expected range: 42.5226 58.5312
BUFR LAND SYNOP SNOW (CM) _MI1F9AC : out of range
25 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=52.8857, expected range: 43.4769 59.0194
BUFR LAND SYNOP SNOW (CM) : out of range
2 times in the last 10 days for at least one item
Considerable: avg_fgdepar=-32.6400, expected range: -51.0630 -39.0769
Considerable: rms_fgdepar=323.3350, expected range: 363.3847 422.7342
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.7819, expected range: -18.5297 1.3064
Severely_persistent: rms_fgdepar=12.7857, expected range: 0.0000 18.6474
METAR 2M TEMPERATURE (K) KTLH : out of range
9 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=12.2133, expected range: 0.0000 20.3617
BUFR LAND SYNOP 2M TEMPERATURE (K) 80010 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=12.1354, expected range: 0.4416 21.4461
BUFR LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.8467, expected range: -18.6299 1.4099
Severely_persistent: rms_fgdepar=12.8502, expected range: 0.0000 18.7259
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-18.7195, expected range: -20.9965 -10.6926
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=18.7195, expected range: 10.7156 20.9969
LAND TEMP 2M TEMPERATURE (K) 61052 : out of range
Severe: rms_fgdepar=12.4693, expected range: 0.0000 14.9490
BUFR LAND SYNOP 2M TEMPERATURE (K) 86804 : out of range
Severe: rms_fgdepar=11.7028, expected range: 0.0000 5.1558
BUFR LAND SYNOP 2M TEMPERATURE (K) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=99667.0000, expected range: 143489.9729 149310.3801
rh2m
MANUAL LAND SYNOP RH2M (%) 41255 : out of range
Severe: rms_fgdepar=39.2943, expected range: 0.0000 19.0591
BUFR LAND SYNOP RH2M (%) : out of range
1 times in the last 10 days for at least one item
Slight: obs_number=72661.0000, expected range: 96651.6652 107561.1583