Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-06-29 12:00

amsua
METOP-B AMSUA ALL SKY RADIANCES CHANNEL 13 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1154, expected range: 0.1615 0.1861
iasi
METOP-B IASI RADIANCES CHANNEL 5480 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.3930, expected range: -0.3632 -0.3408
METOP-B IASI RADIANCES CHANNEL 170 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1904, expected range: 0.2102 0.2319
METOP-C IASI RADIANCES CHANNEL 89 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2544, expected range: -0.2125 -0.2051
METOP-C IASI RADIANCES CHANNEL 144 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1726, expected range: 0.1943 0.1991
METOP-C IASI RADIANCES CHANNEL 183 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1707, expected range: 0.1896 0.2088
METOP-C IASI RADIANCES CHANNEL 189 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1411, expected range: 0.1601 0.1753
METOP-C IASI RADIANCES CHANNEL 195 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1062, expected range: 0.1249 0.1302
METOP-C IASI RADIANCES (12 channels affected) : out of range
Considerable: obs_number=461.0000, expected range: 17.6005 173.7813
ssmis
DMSP-17 SSMIS RADIANCES CHANNEL 7 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.0050, expected range: 0.0043 0.0047
Geostationary CSR
GOES-16 ABI RADIANCES CHANNEL 3 : out of range
4 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.3442, expected range: 0.2544 0.3126
resat
All AURA OMI ALL LAYERS Global : all data missing
Severe: obs_number=0, expected range: 17507.74 24226.61
Radiosondes
LAND TEMP Q (G/KG) 36872 PRESSURE LAYER 900-1200 (HPA) : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=6.1338, expected range: -1.5761 11.8824
Severely_persistent: rms_fgdepar=6.1338, expected range: 0.0000 11.4965
All HIGH RESO SEA TEMP ALL LAYERS North East Pacific : all data missing
Severely_persistent: obs_number=0, expected range: 0.00 509.33
LAND TEMP TEMPERATURE (K) 32150 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=7.3001, expected range: 0.0000 2.9175
Severe: avg_pge=0.8831, expected range: -1.3407 0.7500
LAND TEMP TEMPERATURE (K) 65503 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=8.4389, expected range: 0.0000 3.7965
LAND TEMP WIND VECTOR DIFF (M/S) 47122 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=16.2272, expected range: 0.0000 8.2886
LAND TEMP Q (G/KG) 30635 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=3.8447, expected range: 0.0000 1.7016
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=72.0000, expected range: 155.8413 168.6587
Severe: obs_number=54.0000, expected range: 88.8274 94.1726
Severe: obs_number=5960.0000, expected range: 5344.8103 5440.6897
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 68512 PRESSURE LAYER 300-60 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=28.4902, expected range: -7.1253 13.7949
Severe: rms_fgdepar=31.4265, expected range: 0.0000 16.6691
HIGH RESO LAND TEMP Q (G/KG) 68512 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.0311, expected range: 0.1949 0.9922
HIGH RESO LAND TEMP Q (G/KG) 30557 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_fgdepar=-6.0224, expected range: -2.6853 2.0477
Severe: rms_fgdepar=6.0498, expected range: 0.0000 2.0336
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
Severe: obs_number=383.0000, expected range: 277.4276 293.2390
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 600-900 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=4.7449, expected range: 0.0000 2.1678
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 83 : all data missing
Severe: obs_number=0, expected range: 50.64 122.36
All HIGH RESO SEA TEMP ALL LAYERS Tropics : all data missing
Severe: obs_number=0, expected range: 86.60 109.40
All HIGH RESO SEA TEMP ALL LAYERS Alantic Tropical are : all data missing
Severe: obs_number=0, expected range: 86.60 109.40
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (3 pressure layers affected : out of range
Considerable: obs_number=449.0000, expected range: 597.9836 635.0164
Considerable: obs_number=287.0000, expected range: 372.1673 391.3882
amdar
WIGOS AMDAR TEMPERATURE (K) EU4058 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=7.8771, expected range: 0.0000 2.1065
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU4058 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=19.1972, expected range: 0.0000 7.8231
Severe: avg_pge=0.8267, expected range: -0.6584 0.7500
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 06234 PRESSURE LAYER 300-600 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8656, expected range: -1.1882 0.7500
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 41718 PRESSURE LAYER 300-600 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8212, expected range: -1.0875 0.7500
BUFR LAND PILOT WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=94.0000, expected range: 31.8056 46.8611
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 68918 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8059, expected range: -1.0144 0.7500
MANUAL LAND SYNOP RH2M (%) 62120 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9602, expected range: -0.8048 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 41573 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=784.8316, expected range: 641.7410 1088.4835
Severely_persistent: rms_fgdepar=786.1506, expected range: 647.7874 1084.9175
AUTOMATIC LAND SYNOP RH2M (%) 71073 : out of range
Severe: avg_fgdepar=50.6034, expected range: -12.9160 37.0408
Severe: rms_fgdepar=50.6034, expected range: 0.0000 37.0408
AUTOMATIC LAND SYNOP RH2M (%) 72666 : out of range
Severe: avg_pge=0.9871, expected range: -0.0278 0.0419
MANUAL LAND SYNOP RH2M (%) 42177 : out of range
Severe: rms_fgdepar=48.2452, expected range: 0.0000 19.2346
Severe: avg_pge=0.9998, expected range: -0.0025 0.0090
MANUAL LAND SYNOP RH2M (%) 42577 : out of range
Severe: rms_fgdepar=43.1519, expected range: 0.0000 36.8514
Severe: avg_pge=0.9892, expected range: -0.0061 0.0145
MANUAL LAND SYNOP RH2M (%) 62018 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9987, expected range: -0.5072 0.7135
MANUAL LAND SYNOP RH2M (%) 43338 : out of range
Severe: avg_pge=0.9945, expected range: -0.0676 0.0849
MANUAL LAND SYNOP RH2M (%) 38598 : out of range
Severe: avg_fgdepar=51.5926, expected range: -42.7241 62.8011
Severe: rms_fgdepar=51.5926, expected range: 0.0000 76.1083
Severe: avg_pge=1.0000, expected range: -1.6475 0.7500
MANUAL LAND SYNOP RH2M (%) 61099 : out of range
Severe: rms_fgdepar=42.7677, expected range: 0.0000 23.0064
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40080 : out of range
Severe: rms_fgdepar=334.5008, expected range: 0.0000 259.0021
Severe: avg_pge=0.8026, expected range: -0.8814 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40633 : out of range
Severe: avg_fgdepar=-959.9352, expected range: -62.7968 182.9785
Severe: rms_fgdepar=959.9352, expected range: 0.0000 182.9785
Severe: avg_pge=0.9398, expected range: 0.0000 0.0000
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 87643 : out of range
Severe: rms_fgdepar=387.9615, expected range: 0.0000 131.4722
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 78073 : out of range
Severe: rms_fgdepar=570.2611, expected range: 0.0000 198.6910
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 67037 : out of range
Severe: avg_fgdepar=-555.5627, expected range: -125.1497 1.5060
Severe: rms_fgdepar=770.9268, expected range: 0.0000 127.2909
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 78458 : out of range
Severe: rms_fgdepar=442.3919, expected range: 0.0000 112.9340
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 82989 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-561.1332, expected range: -208.3582 38.9392
Severe: rms_fgdepar=561.1332, expected range: 0.0000 225.0904
Severe: avg_pge=0.8863, expected range: -0.6648 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=154.2292, expected range: 37.4593 71.4141
BUFR LAND SYNOP RH2M (%) 42970 : out of range
Severe: rms_fgdepar=36.6385, expected range: 0.0000 27.4590
Severe: avg_pge=0.8943, expected range: -0.0134 0.0223
BUFR LAND SYNOP RH2M (%) 43021 : out of range
Severe: avg_pge=0.9997, expected range: -0.7495 0.7500
BUFR LAND SYNOP RH2M (%) 48053 : out of range
Severe: rms_fgdepar=37.4673, expected range: 0.0000 35.1074
Severe: avg_pge=0.9945, expected range: -0.0075 0.0158
BUFR LAND SYNOP RH2M (%) 67315 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8479, expected range: -0.0437 0.0576
BUFR LAND SYNOP RH2M (%) 36666 : out of range
Severe: avg_pge=0.9993, expected range: -0.7618 0.7500
BUFR LAND SYNOP RH2M (%) 29937 : out of range
Severe: rms_fgdepar=35.1791, expected range: 0.0000 15.5530
BUFR LAND SYNOP RH2M (%) 71457 : out of range
Severe: rms_fgdepar=33.4077, expected range: 2.8252 12.6643
BUFR LAND SYNOP RH2M (%) 11078 : out of range
Severe: rms_fgdepar=30.8511, expected range: 0.0000 17.2079
BUFR LAND SYNOP SURFACE PRESSURE (PA) : out of range
2 times in the last 10 days for at least one item
Severe: obs_number=5141.0000, expected range: 4144.2065 4281.2935
Severe: obs_number=6948.0000, expected range: 5457.7517 5627.9983
BUFR LAND SYNOP SURFACE PRESSURE (PA) 98433 : out of range
Severe: rms_fgdepar=377.9824, expected range: 0.0000 134.6472
BUFR LAND SYNOP SURFACE PRESSURE (PA) 30493 : out of range
Severe: rms_fgdepar=518.4481, expected range: 0.0000 106.5937
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33484 : out of range
Severe: rms_fgdepar=301.7487, expected range: 0.0000 120.9958
BUFR LAND SYNOP SURFACE PRESSURE (PA) 23345 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=404.3968, expected range: 0.0000 213.0785
Severe: avg_pge=0.8285, expected range: -1.2113 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 36736 : out of range
Severe: rms_fgdepar=384.4970, expected range: 0.0000 316.4744
Severe: avg_pge=0.8291, expected range: -1.0281 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 13376 : out of range
Severe: rms_fgdepar=327.9986, expected range: 0.0000 147.9366
ship
All BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) WMO BLOCK 8 : all data missing
Severely_persistent: obs_number=0, expected range: 102.60 208.25
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9VPY4 : out of range
26 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=650.6414, expected range: 101.8457 1463.8127
Severely_persistent: rms_fgdepar=650.6414, expected range: 99.9040 1467.5473
Severely_persistent: avg_pge=0.8415, expected range: 0.6583 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) D5UO7 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=974.3565, expected range: 692.1029 1323.8708
Severely_persistent: rms_fgdepar=974.3565, expected range: 692.1029 1323.8708
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 3FSA9 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-548.5521, expected range: -743.4179 -239.6732
Severely_persistent: rms_fgdepar=548.5521, expected range: 240.0254 760.7896
Severely_persistent: avg_pge=0.8195, expected range: 0.6831 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7UX2 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=585.3407, expected range: 0.0000 462.7186
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6VG7 : out of range
Severe: avg_fgdepar=593.7533, expected range: -592.5677 604.6071
Severe: rms_fgdepar=593.7533, expected range: 0.0000 532.4549
Severe: avg_pge=0.8180, expected range: -0.8243 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V6408 : out of range
Severe: rms_fgdepar=513.9500, expected range: 0.0000 761.0047
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 2200192 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9282, expected range: 0.4736 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5102722 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8459, expected range: -1.6298 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101655 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=611.7739, expected range: -313.4914 499.0732
Severe: rms_fgdepar=612.3146, expected range: 0.0000 461.9264
Severe: avg_pge=0.9081, expected range: -0.9671 0.7500
metar
AUTOMATIC METAR SURFACE PRESSURE (PA) HTKB : out of range
Severe: avg_fgdepar=-855.4458, expected range: -418.3498 371.4556
Severe: rms_fgdepar=856.8308, expected range: 0.0000 226.8489
Severe: avg_pge=0.8653, expected range: -0.3790 0.4528
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-773.1132, expected range: -773.9598 -771.9423
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=773.1133, expected range: 771.9423 773.9598
BUFR LAND SYNOP SNOW (CM) _MI11588 : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=59.6250, expected range: 48.3416 69.6964
BUFR LAND SYNOP SNOW (CM) _MI11588 : out of range
32 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=60.3221, expected range: 48.7019 69.9047
BUFR LAND SYNOP SNOW (CM) _MI1067E : out of range
34 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=58.9189, expected range: 51.5265 65.6886
BUFR LAND SYNOP SNOW (CM) _MI1067E : out of range
34 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=59.7232, expected range: 53.1301 65.3520
t2m
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
26 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-18.5949, expected range: -20.0687 -16.2879
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
26 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=18.5982, expected range: 16.2983 20.0809
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 60734 : out of range
Severe: rms_fgdepar=10.3501, expected range: 0.9399 3.3919
MANUAL LAND SYNOP 2M TEMPERATURE (K) 41560 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-13.4546, expected range: -19.5613 14.6755
Severe: rms_fgdepar=13.7925, expected range: 0.0000 15.0663
MANUAL LAND SYNOP 2M TEMPERATURE (K) 65306 : out of range
Severe: rms_fgdepar=10.4693, expected range: 0.0000 4.2708
MANUAL LAND SYNOP 2M TEMPERATURE (K) 89009 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.1457, expected range: -16.8138 1.6712
Severe: rms_fgdepar=14.1457, expected range: 0.0000 16.9130
MANUAL LAND SYNOP 2M TEMPERATURE (K) 63729 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=13.4665, expected range: -5.1202 9.6110
METAR 2M TEMPERATURE (K) NZSP : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.0457, expected range: -16.7912 1.8663
Severe: rms_fgdepar=14.0457, expected range: 0.0000 16.8827
METAR 2M TEMPERATURE (K) MMLT : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.0708, expected range: 0.0000 3.5776
LAND TEMP 2M TEMPERATURE (K) 89009 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.1457, expected range: -16.9756 2.1818
Severe: rms_fgdepar=14.1457, expected range: 0.0000 16.9756
BUFR LAND SYNOP 2M TEMPERATURE (K) 41560 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-13.5146, expected range: -20.0258 15.3469
Severe: rms_fgdepar=13.8511, expected range: 0.0000 15.3589
BUFR LAND SYNOP 2M TEMPERATURE (K) 89009 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.1957, expected range: -16.8638 1.6212
Severe: rms_fgdepar=14.1957, expected range: 0.0000 16.9636
rh2m
MANUAL LAND SYNOP RH2M (%) 65306 : out of range
Severe: rms_fgdepar=39.9901, expected range: 0.0000 22.1996