Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-08-02 12:00

cris
NPP CRIS RADIANCES CHANNEL 107 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1862, expected range: 0.1188 0.1561
NOAA20 CRIS RADIANCES CHANNEL 107 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2177, expected range: 0.1498 0.1852
gpsro
All COSMIC2-E5 GPSRO SETTING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 1203.72 2100.57
COSMIC2-E6 GPSRO SETTING (24 impact heights affected) : out of range
3 times in the last 10 days for at least one item
Considerable: obs_number=499.0000, expected range: 1376.6695 3028.7055
COSMIC2-E6 GPSRO SETTING HEIGHT 46-48 KM : out of range
Slight: stdev_norm_fgdepar=0.3779, expected range: 0.4334 0.6476
Radiosondes
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=8.4570, expected range: -1.5759 12.4970
Severely_persistent: rms_fgdepar=8.4570, expected range: 0.0000 12.3990
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : missing
5 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 13.0943 461.8033
Severely_persistent: obs_number=0.0000, expected range: 21.2910 757.0558
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 84 : all data missing
Severely_persistent: obs_number=0, expected range: 15.81 215.39
LAND TEMP TEMPERATURE (K) 24688 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=8.6345, expected range: 0.0000 5.5403
Severe: avg_pge=0.9112, expected range: -0.5698 0.7500
LAND TEMP Q (G/KG) 62414 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=8.1743, expected range: -6.5822 6.3849
Severe: rms_fgdepar=8.3885, expected range: 0.0000 4.9792
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA : missing
Severe: obs_number=0.0000, expected range: 18.3234 289.6419
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : missing
4 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 157.5023 219.0691
Severe: obs_number=0.0000, expected range: 20.5937 637.5761
Severe: obs_number=0.0000, expected range: 174.0000 194.0000
Severe: obs_number=0.0000, expected range: 0.0000 323.7904
HIGH RESO LAND TEMP Q (G/KG) 57245 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.3039, expected range: 0.0000 1.5869
HIGH RESO LAND TEMP Q (G/KG) 51656 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=7.7060, expected range: -2.3267 7.5124
Severe: rms_fgdepar=7.7060, expected range: 0.0000 7.5124
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 82 : all data missing
Severe: obs_number=0, expected range: 77.70 153.97
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
Considerable: obs_number=60.0000, expected range: 94.3585 147.3915
amdar
AMDAR WIND VECTOR DIFF (M/S) BR151888 PRESSURE LAYER 300-600 (HPA) : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8398, expected range: -0.7556 0.7500
AMDAR TEMPERATURE (K) CNFKQP PRESSURE LAYER 600-900 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=9.6458, expected range: 0.0000 18.6405
AMDAR WIND VECTOR DIFF (M/S) BR712393 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8071, expected range: -0.5476 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) OESEIEBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.8126, expected range: 0.0000 8.7555
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 06234 PRESSURE LAYER 300-600 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=18.0194, expected range: 0.0000 7.1959
Severe: avg_pge=0.8672, expected range: -0.1035 0.1840
synop
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42295 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1555.4023, expected range: 1343.3523 1757.9088
Severely_persistent: rms_fgdepar=1555.4023, expected range: 1343.3523 1757.9088
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 60127 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=406.5100, expected range: 0.0000 179.3961
Severely_persistent: avg_pge=0.8357, expected range: -1.1079 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 55664 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8265, expected range: -1.4025 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 47918 : out of range
Severe: rms_fgdepar=322.0102, expected range: 11.1928 67.6684
MANUAL LAND SYNOP RH2M (%) 40853 : out of range
Severe: rms_fgdepar=40.0561, expected range: 0.0000 14.0602
Severe: avg_pge=0.9124, expected range: -0.0015 0.0074
MANUAL LAND SYNOP RH2M (%) 83363 : out of range
Severe: avg_pge=0.9317, expected range: -0.6853 0.7500
MANUAL LAND SYNOP RH2M (%) 60714 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9965, expected range: -0.5877 0.7500
MANUAL LAND SYNOP RH2M (%) 36864 : out of range
Severe: rms_fgdepar=41.2041, expected range: 0.0000 12.4856
MANUAL LAND SYNOP RH2M (%) 42935 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8776, expected range: -0.9514 0.7500
MANUAL LAND SYNOP RH2M (%) 35996 : out of range
Severe: rms_fgdepar=46.5977, expected range: 0.0000 34.3318
Severe: avg_pge=0.9998, expected range: -0.3078 0.3986
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42262 : out of range
Severe: rms_fgdepar=317.8353, expected range: 0.0000 201.3163
Severe: avg_pge=0.8335, expected range: -0.8892 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 67095 : out of range
Severe: rms_fgdepar=571.9064, expected range: 0.0000 70.5228
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83916 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8019, expected range: -1.3907 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42577 : out of range
Severe: avg_pge=0.8404, expected range: -0.9625 0.7500
BUFR LAND SYNOP RH2M (%) 12210 : out of range
Severe: rms_fgdepar=34.7987, expected range: 0.0000 18.9875
BUFR LAND SYNOP RH2M (%) 34691 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=38.3123, expected range: 0.0000 9.9984
Severe: avg_pge=0.9043, expected range: 0.0008 0.0048
BUFR LAND SYNOP RH2M (%) 61489 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9968, expected range: -1.3373 0.7500
BUFR LAND SYNOP Z (M) 06615 : out of range
Severe: avg_pge=0.9710, expected range: -0.5195 0.7468
BUFR LAND SYNOP SURFACE PRESSURE (PA) 61461 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=566.8737, expected range: -205.2138 889.4730
Severe: rms_fgdepar=566.8737, expected range: 0.0000 895.0136
Severe: avg_pge=0.8344, expected range: 0.3555 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48381 : out of range
Severe: rms_fgdepar=465.3402, expected range: 0.0000 158.8354
AUTOMATIC LAND SYNOP RH2M (%) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=51.0000, expected range: 60.9802 68.7976
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OVXO2 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-967.6283, expected range: -1510.0287 -294.1213
Severely_persistent: rms_fgdepar=967.6283, expected range: 574.0798 1277.7446
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) ELDMMXN : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8799, expected range: 0.4264 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) H3DP : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8425, expected range: -0.2381 0.7500
SHIP SURFACE PRESSURE (PA) OVXO2 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-967.6283, expected range: -1567.0880 -235.3573
Severe: rms_fgdepar=967.6283, expected range: 546.2816 1311.7837
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VREM6 : out of range
Severe: avg_fgdepar=-755.3731, expected range: -232.1678 193.1107
Severe: rms_fgdepar=755.3731, expected range: 0.0000 190.9760
Severe: avg_pge=0.8877, expected range: -0.4387 0.5048
BUFR SHIP SYNOP SURFACE PRESSURE (PA) EUCDE07 : out of range
Severe: rms_fgdepar=324.1724, expected range: 0.0000 151.8114
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 9V9926 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9060, expected range: -0.8742 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRLT9 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8921, expected range: -0.7539 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 1501748 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=584.4868, expected range: -1377.7441 1134.6501
Severely_persistent: rms_fgdepar=638.4898, expected range: 0.0000 912.5566
Severely_persistent: avg_pge=0.8095, expected range: 0.1425 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6301543 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=603.6390, expected range: -160.1295 354.8879
Severe: rms_fgdepar=603.6390, expected range: 0.0000 365.0159
Severe: avg_pge=0.9091, expected range: -0.7882 0.7500
gbrad
All GROUND-BASED RADAR Global : all data missing
Severely_persistent: obs_number=0, expected range: 0.00 7420.71
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.1674, expected range: -11.6582 -2.5184
Severely_persistent: rms_fgdepar=13.1876, expected range: 2.4833 11.7911
Severely_persistent: avg_est_pge=0.8627, expected range: 0.5390 0.9314
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-16.3524, expected range: -20.7942 -10.7098
Severely_persistent: rms_fgdepar=16.4643, expected range: 11.1181 21.1820
BUFR LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.1225, expected range: -11.9586 -2.4285
Severely_persistent: rms_fgdepar=13.1444, expected range: 2.3739 12.1074
Severely_persistent: avg_est_pge=0.8624, expected range: 0.5413 0.9346
MANUAL LAND SYNOP 2M TEMPERATURE (K) 68032 : out of range
Severe: avg_fgdepar=-17.8552, expected range: -16.3860 15.3176
Severe: rms_fgdepar=17.8552, expected range: 0.0000 11.1516
Severe: avg_est_pge=0.8780, expected range: 0.1892 0.8312
METAR 2M TEMPERATURE (K) KSKA : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-16.9830, expected range: -7.3012 3.9972
Severe: rms_fgdepar=16.9830, expected range: 0.0000 12.8473
Severe: avg_est_pge=0.8030, expected range: -0.2420 0.5308
LAND TEMP 2M TEMPERATURE (K) 04360 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-19.3637, expected range: -28.4521 26.9113
Severe: rms_fgdepar=19.3637, expected range: 0.0000 23.9266
LAND TEMP 2M TEMPERATURE (K) 56137 : out of range
2 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8780, expected range: 0.0247 1.1213
rh2m
AUTOMATIC LAND SYNOP RH2M (%) 11867 : out of range
Severe: rms_fgdepar=32.4640, expected range: 0.0000 17.3379