Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-08-02 00:00

amsua
NOAA-19 AMSUA RADIANCES CHANNEL 5 : out of range
Considerable: avg_biascorr=-0.0587, expected range: -0.0397 -0.0135
gpsro
All COSMIC2-E5 GPSRO RISING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 268.24 3255.42
METOP-B GRAS RISING HEIGHT 44-46 KM : out of range
Considerable: obs_number=966.0000, expected range: 763.0720 925.1780
COSMIC2-E1 GPSRO SETTING (24 impact heights affected) : out of range
Considerable: obs_number=502.0000, expected range: 1864.0359 2900.0891
COSMIC2-E1 GPSRO SETTING HEIGHT 46-48 KM : out of range
Slight: avg_norm_fgdepar=-0.1120, expected range: -0.0631 0.0936
Radiosondes
LAND TEMP TEMPERATURE (K) 61660 PRESSURE LAYER 0-300 (HPA) : out of range
34 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=14.1687, expected range: 8.9913 32.4888
HIGH RESO LAND TEMP TEMPERATURE (K) (3 pressure layers affected) : missing
2 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 175.9257 195.0743
Severe: obs_number=0.0000, expected range: 175.3228 186.2772
Severe: obs_number=0.0000, expected range: 175.3228 186.2772
HIGH RESO SEA TEMP TEMPERATURE (K) (3 pressure layers affected) : missing
10 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 57.2680 476.7320
LAND TEMP Q (G/KG) PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=2.3297, expected range: 0.9374 1.7310
Considerable: rms_fgdepar=2.9575, expected range: 0.6919 2.0381
LAND TEMP Q (G/KG) 41891 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.9277, expected range: 0.0000 1.4597
LAND TEMP Q (G/KG) 30758 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=3.2540, expected range: 0.4836 1.2556
LAND TEMP Q (G/KG) PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=1.2160, expected range: 0.6049 0.8772
LAND TEMP WIND VECTOR DIFF (M/S) 48407 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=18.0011, expected range: 0.4942 4.6127
HIGH RESO LAND TEMP Q (G/KG) 16080 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-6.5478, expected range: -4.3120 5.5137
Severe: rms_fgdepar=6.6113, expected range: 0.0000 3.9776
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 0-300 (HPA) : missing
2 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 47.9083 75.6472
Considerable: obs_number=264.0000, expected range: 113.1683 146.0317
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : missing
Severe: obs_number=0.0000, expected range: 0.0000 430.5818
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : missing
1 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 8.6160 674.4462
Severe: obs_number=0.0000, expected range: 167.9683 200.8317
Severe: obs_number=0.0000, expected range: 0.0000 640.9850
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 63 : all data missing
Severe: obs_number=0, expected range: 0.00 284.10
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 88 : all data missing
Severe: obs_number=0, expected range: 0.00 398.56
All HIGH RESO LAND TEMP ALL LAYERS South Atlantic : all data missing
Severe: obs_number=0, expected range: 0.00 398.56
HIGH RESO SEA TEMP Q (G/KG) (2 pressure layers affected) : missing
Severe: obs_number=0.0000, expected range: 0.0000 718.1727
Severe: obs_number=0.0000, expected range: 0.0000 718.1727
LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=91.0000, expected range: 38.5132 57.4868
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=373.0000, expected range: 242.5437 314.4563
Considerable: obs_number=689.0000, expected range: 20.8650 434.8850
amdar
AMDAR TEMPERATURE (K) CNFKQP PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_fgdepar=-11.0056, expected range: -14.4965 3.3938
Severe: rms_fgdepar=11.5557, expected range: 0.0000 19.2252
Severe: avg_pge=0.8713, expected range: -0.4451 0.7500
AMDAR WIND VECTOR DIFF (M/S) THT2 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.3738, expected range: 0.0000 7.1134
AMDAR WIND VECTOR DIFF (M/S) (2 pressure layers affected) : missing
Severe: obs_number=0.0000, expected range: 0.0000 537.6581
WIGOS AMDAR TEMPERATURE (K) MTEGUURA PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=6.0676, expected range: 0.0000 1.6255
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU0534 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.1367, expected range: 0.0000 6.4289
WIGOS AMDAR WIND VECTOR DIFF (M/S) PRESSURE LAYER 900-1200 (HPA) : missing
1 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 592.5212
WIGOS AMDAR Q (G/KG) FMLEOHBA PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=6.3950, expected range: -1.8836 3.3558
Severe: rms_fgdepar=6.3950, expected range: 0.0000 3.2512
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 97260 PRESSURE LAYER 900-1200 (HPA) : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8485, expected range: 0.5679 0.7500
LAND PILOT WIND VECTOR DIFF (M/S) 48870 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=16.8535, expected range: 0.9313 7.4250
LAND PILOT WIND VECTOR DIFF (M/S) 48870 (2 pressure layers affected) : out of range
Severe: avg_pge=0.8479, expected range: -0.5663 0.7500
synop
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72494 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8069, expected range: 0.7821 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72327 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8677, expected range: 0.8516 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 68843 : out of range
Severe: avg_fgdepar=61.4430, expected range: -58.3907 85.2341
Severe: rms_fgdepar=61.4430, expected range: -58.3907 85.2341
AUTOMATIC LAND SYNOP RH2M (%) 68837 : out of range
Severe: avg_fgdepar=54.8595, expected range: -57.6224 66.9725
Severe: rms_fgdepar=54.8595, expected range: 0.0000 53.5310
Severe: avg_pge=0.9953, expected range: -0.0903 0.1153
MANUAL LAND SYNOP RH2M (%) 65351 : out of range
Severe: rms_fgdepar=38.4752, expected range: -14.8958 21.1470
Severe: avg_pge=0.9711, expected range: 0.0011 0.0046
MANUAL LAND SYNOP RH2M (%) 40794 : out of range
Severe: avg_pge=0.9546, expected range: -0.7043 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 38715 : out of range
Severe: rms_fgdepar=437.6198, expected range: 0.0000 186.3570
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40676 : out of range
Severe: rms_fgdepar=609.4125, expected range: 0.0000 310.4795
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 60127 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=324.9813, expected range: 0.0000 124.4398
Severe: avg_pge=0.8020, expected range: -1.1891 0.7500
MANUAL LAND SYNOP Z (M) 38856 : out of range
Severe: avg_pge=0.9747, expected range: -0.4383 0.5953
BUFR LAND SYNOP RH2M (%) 94311 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9774, expected range: -1.4798 0.7500
BUFR LAND SYNOP RH2M (%) 34691 : out of range
Severe: rms_fgdepar=39.5936, expected range: 0.0000 20.0372
Severe: avg_pge=0.9266, expected range: -0.0785 0.0955
BUFR LAND SYNOP RH2M (%) 94696 : out of range
Severe: rms_fgdepar=36.6704, expected range: 0.0000 19.1466
BUFR LAND SYNOP RH2M (%) 72658 : out of range
Severe: rms_fgdepar=31.0111, expected range: 0.0000 13.9813
BUFR LAND SYNOP RH2M (%) 10469 : out of range
Severe: rms_fgdepar=30.1221, expected range: 0.0000 15.2961
Severe: rms_fgdepar=32.8061, expected range: 0.0000 17.2158
BUFR LAND SYNOP SURFACE PRESSURE (PA) 25400 : out of range
Severe: rms_fgdepar=551.4420, expected range: 0.0000 165.9166
BUFR LAND SYNOP SURFACE PRESSURE (PA) 17530 : out of range
Severe: rms_fgdepar=304.5610, expected range: 15.7002 144.0461
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71660 : out of range
Severe: rms_fgdepar=317.1752, expected range: 10.9977 87.1724
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71880 : out of range
Severe: rms_fgdepar=300.4149, expected range: 0.0000 114.9236
BUFR LAND SYNOP SURFACE PRESSURE (PA) 88881 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=509.6680, expected range: -278.9840 414.5863
Severe: avg_pge=0.8806, expected range: -1.1242 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 08544 : out of range
Severe: rms_fgdepar=390.1496, expected range: 0.0000 177.1343
Severe: avg_pge=0.8344, expected range: -0.0556 0.0631
BUFR LAND SYNOP SURFACE PRESSURE (PA) 89057 : out of range
Severe: avg_fgdepar=613.2642, expected range: -651.3640 534.7547
Severe: rms_fgdepar=613.2642, expected range: 0.0000 385.8639
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48957 : out of range
Severe: rms_fgdepar=574.3514, expected range: 0.0000 149.5208
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48477 : out of range
Severe: rms_fgdepar=499.9468, expected range: 0.0000 176.4423
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48378 : out of range
Severe: rms_fgdepar=346.7651, expected range: 0.0000 114.6808
BUFR LAND SYNOP RH2M (%) : out of range
Considerable: obs_number=101.0000, expected range: 111.0180 116.1820
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) ELDMMXN : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8618, expected range: 0.4062 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) H3DP : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8603, expected range: -0.2044 0.7500
SHIP SURFACE PRESSURE (PA) OVXO2 : out of range
Severe: avg_fgdepar=-1008.2197, expected range: -1567.0880 -235.3573
Severe: rms_fgdepar=1008.2197, expected range: 546.2816 1311.7837
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OVXO2 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-1008.2197, expected range: -1510.0287 -294.1213
Severe: rms_fgdepar=1008.2197, expected range: 574.0798 1277.7446
Severe: avg_pge=0.9140, expected range: 0.2911 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRDJ3 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=570.5292, expected range: 0.0000 279.9899
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRHQ9 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=440.8309, expected range: 0.0000 241.2506
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) ONGI : out of range
Severe: rms_fgdepar=16.4028, expected range: 0.0000 8.7207
Severe: avg_pge=0.9003, expected range: -0.9855 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601531 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8312, expected range: -0.7210 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 7401533 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=585.0236, expected range: -1392.7489 1581.3029
Severely_persistent: rms_fgdepar=595.0507, expected range: 0.0000 939.8014
Severely_persistent: avg_pge=0.8884, expected range: -0.3637 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 7101533 : out of range
Severe: avg_fgdepar=-742.2737, expected range: -159.0595 177.8184
Severe: rms_fgdepar=743.0532, expected range: 0.0000 176.8527
Severe: avg_pge=0.9264, expected range: -0.5954 0.7500
metar
METAR SURFACE PRESSURE (PA) CYGE : out of range
Severe: rms_fgdepar=433.7634, expected range: 0.0000 206.6808
gbrad
All GROUND-BASED RADAR Global : all data missing
Severely_persistent: obs_number=0, expected range: 0.00 7420.71
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=13.7584, expected range: 2.6458 13.8798
Severely_persistent: rms_fgdepar=13.7722, expected range: 2.8919 13.8558
Severely_persistent: avg_est_pge=0.8469, expected range: 0.5210 0.9387
MANUAL LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=15.1593, expected range: 1.9428 14.1989
Severely_persistent: rms_fgdepar=15.1593, expected range: 1.9643 14.2279
Severely_persistent: avg_est_pge=0.8610, expected range: 0.5021 0.9532
BUFR LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=14.0007, expected range: 2.9071 13.6181
Severely_persistent: rms_fgdepar=14.0199, expected range: 3.1531 13.5911
Severely_persistent: avg_est_pge=0.8494, expected range: 0.5345 0.9286
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.9099, expected range: -20.9149 -10.7951
Severely_persistent: rms_fgdepar=13.9238, expected range: 11.2838 21.2582
BUFR LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.7357, expected range: -12.0714 -2.2572
Severely_persistent: rms_fgdepar=15.4248, expected range: 2.1989 12.2211
Severely_persistent: avg_est_pge=0.8132, expected range: 0.5343 0.9387
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.1848, expected range: -11.7308 -2.3580
Severe: rms_fgdepar=15.0941, expected range: 2.3201 11.8644
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
1 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8426, expected range: -0.2416 1.2963
MANUAL LAND SYNOP 2M TEMPERATURE (K) 63791 : out of range
Severe: rms_fgdepar=11.8770, expected range: 0.0000 2.9971
BUFR LAND SYNOP 2M TEMPERATURE (K) 60037 : out of range
Severe: rms_fgdepar=13.1372, expected range: 0.0000 3.5704
BUFR LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
1 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8432, expected range: -0.2699 1.3127
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) : out of range
1 times in the last 10 days for at least one item
Considerable: rms_fgdepar=6.3454, expected range: 3.8769 5.2987
rh2m
MANUAL LAND SYNOP RH2M (%) 34691 : out of range
Severe: rms_fgdepar=34.6476, expected range: 0.0000 19.0126
MANUAL LAND SYNOP RH2M (%) 94789 : out of range
Severe: rms_fgdepar=32.1732, expected range: 0.0000 11.9734
LAND TEMP RH2M (%) 96011 : out of range
Severe: rms_fgdepar=32.6821, expected range: 0.0000 9.8816