Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-05-10 00:00

iasi
METOP-B IASI RADIANCES CHANNEL 546 : out of range
Considerable: avg_fgdepar=0.0625, expected range: 0.0944 0.1552
METOP-B IASI RADIANCES CHANNEL 552 : out of range
Considerable: avg_fgdepar=0.0618, expected range: 0.0925 0.1517
Atmospheric Motion Vector
METEOSAT-11 AMV IR3 WIND VECTOR DIFF (M/S) PRESSURE LAYER 900-1200 (HP : out of range
Considerable: stdev_press=18.5819, expected range: 21.8390 25.3753
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 25430-25431 (HPA) : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=9.3303, expected range: 5.8117 7.3540
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 10130-10131 (HPA) : out of range
16 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=5.9928, expected range: 4.6748 5.3656
Radiosondes
LAND TEMP WIND VECTOR DIFF (M/S) 36096 PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=23.8392, expected range: -10.0370 19.1369
LAND TEMP WIND VECTOR DIFF (M/S) 36096 PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=23.8392, expected range: 0.0000 25.2209
LAND TEMP WIND VECTOR DIFF (M/S) 36096 PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8692, expected range: -1.2965 0.7500
LAND TEMP Q (G/KG) 96749 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=3.9135, expected range: 0.2274 2.2486
HIGH RESO LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=3.5677, expected range: 0.1412 1.8079
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 72235 PRESSURE LAYER 0-300 : out of range
Severe: rms_fgdepar=15.8998, expected range: 0.1581 7.5000
HIGH RESO LAND TEMP Q (G/KG) 72520 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.8079, expected range: 0.0000 1.4498
HIGH RESO LAND TEMP Q (G/KG) 53915 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=3.0100, expected range: 0.0000 1.5879
HIGH RESO LAND TEMP Q (G/KG) 57083 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.7247, expected range: 0.0000 1.9488
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 48 : all data missing
Severe: obs_number=0, expected range: 125.64 179.61
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=77.0000, expected range: 108.3869 142.6131
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=550.0000, expected range: 303.1340 462.8660
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) DDMGXZBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.2666, expected range: 0.0000 9.0471
WIGOS AMDAR WIND VECTOR DIFF (M/S) PWGENVJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.5004, expected range: 0.0000 7.2440
WIGOS AMDAR WIND VECTOR DIFF (M/S) JQPEIRZA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=15.7384, expected range: 0.0000 8.4073
WIGOS AMDAR WIND VECTOR DIFF (M/S) 3CBKB4ZA PRESSURE LAYER 300-600 (HP : out of range
Severe: avg_fgdepar=22.9667, expected range: -1.3275 7.3159
WIGOS AMDAR WIND VECTOR DIFF (M/S) 3CBKB4ZA PRESSURE LAYER 300-600 (HP : out of range
Severe: rms_fgdepar=22.9667, expected range: 0.0000 7.6354
WIGOS AMDAR WIND VECTOR DIFF (M/S) 3CBKB4ZA PRESSURE LAYER 300-600 (HP : out of range
Severe: avg_pge=0.8378, expected range: -0.7922 0.7500
MODE-S WIND VECTOR DIFF (M/S) M77C23A PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.7158, expected range: 0.0000 6.3103
airep
AIREP WIND VECTOR DIFF (M/S) KLM194 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.1385, expected range: 0.3359 6.5579
AIREP WIND VECTOR DIFF (M/S) ETD47N PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.1200, expected range: 0.0000 9.7128
synop
MANUAL LAND SYNOP RH2M (%) 62054 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9935, expected range: -1.7178 0.7500
MANUAL LAND SYNOP RH2M (%) 42101 : out of range
Severe: rms_fgdepar=37.8364, expected range: 6.2819 19.4558
MANUAL LAND SYNOP RH2M (%) 42874 : out of range
Severe: rms_fgdepar=41.5831, expected range: 0.0000 18.2466
MANUAL LAND SYNOP RH2M (%) 47146 : out of range
Severe: rms_fgdepar=48.8178, expected range: 0.0000 19.1206
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 91631 : out of range
Severe: rms_fgdepar=332.1592, expected range: 0.0000 147.6755
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 91631 : out of range
Severe: avg_pge=0.8245, expected range: -0.5635 0.6687
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42383 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=1194.3586, expected range: -198.9651 667.6024
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42383 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=1194.3586, expected range: 0.0000 667.6024
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42383 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9462, expected range: -0.7570 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 38974 : out of range
Severe: rms_fgdepar=587.9283, expected range: 0.0000 264.5997
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40025 : out of range
Severe: rms_fgdepar=541.8017, expected range: 0.0000 117.4878
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43025 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=605.6479, expected range: -251.4861 306.2568
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43025 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=605.6479, expected range: 0.0000 235.4797
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43025 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8804, expected range: -0.4917 0.5937
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 35739 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=310.0340, expected range: 0.0000 86.1649
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 35739 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8103, expected range: -1.1879 0.7500
MANUAL LAND SYNOP Z (M) 38734 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8337, expected range: -1.4814 0.7500
BUFR LAND SYNOP RH2M (%) 71007 : out of range
Severe: rms_fgdepar=31.2047, expected range: 0.0000 16.1520
BUFR LAND SYNOP SURFACE PRESSURE (PA) 86613 : out of range
Severe: rms_fgdepar=319.1414, expected range: 0.0000 102.6470
BUFR LAND SYNOP SURFACE PRESSURE (PA) 86613 : out of range
Severe: avg_pge=0.8673, expected range: -0.9345 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 40373 : out of range
Severe: rms_fgdepar=490.3244, expected range: 0.0000 63.8186
BUFR LAND SYNOP SURFACE PRESSURE (PA) 34373 : out of range
Severe: rms_fgdepar=569.1698, expected range: 0.0000 86.0892
BUFR LAND SYNOP SURFACE PRESSURE (PA) 17547 : out of range
Severe: avg_fgdepar=-832.7207, expected range: -84.2708 96.5779
BUFR LAND SYNOP SURFACE PRESSURE (PA) 17547 : out of range
Severe: rms_fgdepar=832.8181, expected range: 0.0000 85.3448
BUFR LAND SYNOP SURFACE PRESSURE (PA) 17547 : out of range
Severe: avg_pge=0.9320, expected range: -0.2662 0.3348
MANUAL LAND SYNOP SURFACE PRESSURE (PA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=671.0000, expected range: 716.9836 786.7664
BUFR LAND SYNOP SURFACE PRESSURE (PA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=611.0000, expected range: 489.4319 544.3181
ship
AUTOMATIC SHIP WIND VECTOR DIFF (M/S) 44137 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8421, expected range: -0.4503 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6PT7 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=644.9197, expected range: 123.8981 804.2091
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6PT7 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=644.9197, expected range: 123.2894 804.9445
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6PT7 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8345, expected range: 0.5114 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) JMJRCES : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-584.2110, expected range: -741.6459 675.1909
BUFR SHIP SYNOP SURFACE PRESSURE (PA) JMJRCES : out of range
9 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=586.1374, expected range: -597.1042 729.3568
BUFR SHIP SYNOP SURFACE PRESSURE (PA) JMJRCES : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9133, expected range: -0.9565 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ZCDY2 : out of range
Severe: rms_fgdepar=419.8972, expected range: 0.0000 283.2920
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ZCDY2 : out of range
Severe: avg_pge=0.8029, expected range: -0.5070 0.6507
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRTM7 : out of range
Severe: rms_fgdepar=565.5379, expected range: 0.0000 225.1670
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9VPQ7 : out of range
Severe: rms_fgdepar=556.0874, expected range: 0.0000 303.1722
BUFR SHIP SYNOP SURFACE PRESSURE (PA) KRIJ : out of range
Severe: rms_fgdepar=460.4677, expected range: 0.0000 153.6182
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 6200200 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8848, expected range: 0.4670 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601701 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-536.9318, expected range: -664.3488 480.3147
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601701 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=568.7982, expected range: 0.0000 995.4369
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601701 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8735, expected range: -1.3550 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1401721 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8454, expected range: -1.1731 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5401534 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=633.5160, expected range: -595.0625 453.8109
DRIFTING BUOYS SURFACE PRESSURE (PA) 5401534 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=633.7760, expected range: 0.0000 1053.9085
DRIFTING BUOYS SURFACE PRESSURE (PA) 5401534 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9093, expected range: -1.5833 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4601834 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8321, expected range: -1.5506 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101768 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=541.5435, expected range: 120.5007 752.4984
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101768 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8114, expected range: 0.2286 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5401763 : out of range
Severe: rms_fgdepar=526.1374, expected range: 0.0000 626.5474
DRIFTING BUOYS SURFACE PRESSURE (PA) 1701576 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8286, expected range: -0.3514 0.7500
metar
METAR SURFACE PRESSURE (PA) LIPA : out of range
Severe: rms_fgdepar=409.6907, expected range: 0.0000 186.7569
snow
MANUAL LAND SYNOP SNOW (CM) 30815 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=113.6422, expected range: 82.2930 134.1447
MANUAL LAND SYNOP SNOW (CM) 30815 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=113.6422, expected range: 82.2930 134.1447
ROCOB TEMP SNOW (CM) 63300006 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-55.6824, expected range: -62.0398 -37.3245
ROCOB TEMP SNOW (CM) 63300006 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=55.6824, expected range: 37.3245 62.0398
BUFR LAND SYNOP SNOW (CM) 30815 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=113.6636, expected range: 82.3057 134.1028
BUFR LAND SYNOP SNOW (CM) 30815 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=113.6636, expected range: 82.3057 134.1028
BUFR LAND SYNOP SNOW (CM) 01435 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=60.8094, expected range: 55.2013 59.7479
BUFR LAND SYNOP SNOW (CM) 01435 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=60.8100, expected range: 55.2033 59.7497
BUFR LAND SYNOP SNOW (CM) 01429 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=75.3864, expected range: 74.6642 80.9906
BUFR LAND SYNOP SNOW (CM) 01429 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=75.3864, expected range: 74.6682 80.9905
MANUAL LAND SYNOP SNOW (CM) 31004 : out of range
Severe: rms_fgdepar=36.7455, expected range: 0.0000 15.5106
BUFR LAND SYNOP SNOW (CM) 01025 : out of range
Severe: avg_fgdepar=-63.3229, expected range: -76.6831 -57.5580
BUFR LAND SYNOP SNOW (CM) 01025 : out of range
Severe: rms_fgdepar=63.3229, expected range: 57.5580 76.6831
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 04351 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.1659, expected range: -11.2992 7.2225
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 04351 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=15.3152, expected range: 0.0000 11.0285
BUFR LAND SYNOP 2M TEMPERATURE (K) 04351 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.9352, expected range: -11.5535 7.3390
BUFR LAND SYNOP 2M TEMPERATURE (K) 04351 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=15.9781, expected range: 0.0000 11.4586
BUFR LAND SYNOP 2M TEMPERATURE (K) 38318 : out of range
30 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.1867, expected range: -23.6336 -11.1040
BUFR LAND SYNOP 2M TEMPERATURE (K) 38318 : out of range
30 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=15.1867, expected range: 11.1040 23.6336
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 54308 : out of range
Severe: avg_fgdepar=12.6658, expected range: 1.1445 14.7485
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 54308 : out of range
Severe: rms_fgdepar=12.6658, expected range: 1.1445 14.7485
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=16.0021, expected range: 1.2250 14.5495
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=16.0102, expected range: 1.2615 14.5597
MANUAL LAND SYNOP 2M TEMPERATURE (K) 31754 : out of range
Severe: rms_fgdepar=11.0726, expected range: 0.7256 4.2241
LAND TEMP 2M TEMPERATURE (K) 61024 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-13.9121, expected range: -15.6254 10.2902
LAND TEMP 2M TEMPERATURE (K) 61024 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=13.9121, expected range: -9.5484 15.3784
BUFR LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=12.8626, expected range: 0.8062 13.0852
BUFR LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.9107, expected range: 0.9261 13.2805
BUFR LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=15.9606, expected range: 1.1724 14.4876
BUFR LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=15.9680, expected range: 1.2068 14.4990
rh2m
BUFR LAND SYNOP RH2M (%) 60725 : out of range
Severe: rms_fgdepar=36.9792, expected range: 0.0000 20.0033