Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-09-16 00:00

iasi
METOP-B IASI RADIANCES CHANNEL 131 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.3353, expected range: 0.3647 0.3908
METOP-C IASI RADIANCES CHANNEL 16 : out of range
Severe: avg_biascorr=0.0175, expected range: -0.0055 0.0046
METOP-C IASI RADIANCES CHANNEL 38 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-0.0266, expected range: -0.0081 0.0139
METOP-C IASI RADIANCES CHANNEL 386 : out of range
Severe: stdev_fgdepar=0.2260, expected range: 0.2447 0.2582
METOP-C IASI RADIANCES CHANNEL 49 : out of range
1 times in the last 10 days for at least one item
Considerable: avg_fgdepar=-0.0213, expected range: -0.0070 0.0129
METOP-C IASI RADIANCES CHANNEL 109 : out of range
1 times in the last 10 days for at least one item
Considerable: avg_fgdepar=-0.0181, expected range: -0.0059 0.0142
METOP-C IASI RADIANCES CHANNEL 116 : out of range
1 times in the last 10 days for at least one item
Considerable: avg_fgdepar=-0.0203, expected range: -0.0068 0.0127
METOP-C IASI RADIANCES CHANNEL 161 : out of range
1 times in the last 10 days for at least one item
Considerable: avg_fgdepar=-0.0213, expected range: -0.0081 0.0146
METOP-C IASI RADIANCES CHANNEL 66 : out of range
Slight: avg_fgdepar=-0.0171, expected range: -0.0051 0.0224
METOP-C IASI RADIANCES CHANNEL 70 : out of range
1 times in the last 10 days for at least one item
Slight: avg_fgdepar=-0.0234, expected range: -0.0116 0.0206
METOP-C IASI RADIANCES CHANNEL 79 : out of range
Slight: avg_fgdepar=-0.0238, expected range: -0.0093 0.0252
METOP-C IASI RADIANCES CHANNEL 122 : out of range
1 times in the last 10 days for at least one item
Slight: avg_fgdepar=-0.0217, expected range: -0.0117 0.0180
METOP-C IASI RADIANCES CHANNEL 148 : out of range
1 times in the last 10 days for at least one item
Slight: avg_fgdepar=-0.0242, expected range: -0.0112 0.0183
METOP-C IASI RADIANCES CHANNEL 165 : out of range
1 times in the last 10 days for at least one item
Slight: avg_fgdepar=-0.0160, expected range: -0.0079 0.0179
METOP-C IASI RADIANCES CHANNEL 187 : out of range
Slight: avg_fgdepar=-0.0070, expected range: -0.0012 0.0151
METOP-C IASI RADIANCES CHANNEL 201 : out of range
Slight: avg_fgdepar=-0.0132, expected range: -0.0041 0.0206
METOP-C IASI RADIANCES CHANNEL 222 : out of range
Slight: avg_fgdepar=-0.0040, expected range: 0.0015 0.0196
METOP-C IASI RADIANCES CHANNEL 301 : out of range
Slight: avg_fgdepar=-0.0227, expected range: -0.0081 0.0232
airs
AQUA AIRS RADIANCES CHANNEL 93 : out of range
2 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.0844, expected range: -0.0662 -0.0512
AQUA AIRS RADIANCES CHANNEL 99 : out of range
2 times in the last 10 days for at least one item
Severe: avg_biascorr=0.0395, expected range: 0.0522 0.0601
AQUA AIRS RADIANCES CHANNEL 111 : out of range
2 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.0527, expected range: -0.0406 -0.0252
AQUA AIRS RADIANCES CHANNEL 116 : out of range
2 times in the last 10 days for at least one item
Severe: avg_biascorr=0.0236, expected range: 0.0552 0.0668
AQUA AIRS RADIANCES CHANNEL 117 : out of range
2 times in the last 10 days for at least one item
Severe: avg_biascorr=0.0258, expected range: 0.0319 0.0392
AQUA AIRS RADIANCES CHANNEL 123 : out of range
2 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.0915, expected range: -0.0765 -0.0599
ssmis
DMSP-18 SSMIS RADIANCES CHANNEL 7 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=5.0684, expected range: 3.6995 4.2196
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 10-11 (HPA) : out of range
19 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=0.0091, expected range: 0.0065 0.0068
Severely_persistent: avg_fgdepar=-0.0250, expected range: -0.0348 -0.0324
METOP-B GOME-2 OZONE, TOP PRESSURE LAYER 12-13 (HPA) : out of range
18 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=4.6102, expected range: 5.0442 5.2715
Severely_persistent: avg_biascorr=-3.2691, expected range: -2.9720 -2.9305
Radiosondes
LAND TEMP Q (G/KG) 78486 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.5876, expected range: 0.3210 1.5073
LAND TEMP TEMPERATURE (K) 24641 PRESSURE LAYER 300-600 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=13.7553, expected range: -4.8675 6.9299
Severe: rms_fgdepar=13.7553, expected range: 0.0000 6.8274
Severe: avg_pge=0.9438, expected range: -1.3404 0.7500
HIGH RESO LAND TEMP Q (G/KG) 06610 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.6371, expected range: 0.0808 1.4139
HIGH RESO LAND TEMP Q (G/KG) 72206 PRESSURE LAYER 600-900 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=3.4073, expected range: 0.3273 1.1527
HIGH RESO LAND TEMP TEMPERATURE (K) 30673 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.2134, expected range: 0.0552 2.1756
Severe: avg_pge=0.8506, expected range: -0.6666 0.7500
HIGH RESO LAND TEMP TEMPERATURE (K) 17281 PRESSURE LAYER 900-1200 (HPA : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8973, expected range: -1.9001 0.7500
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 30673 PRESSURE LAYER 0-300 : out of range
Severe: rms_fgdepar=15.3477, expected range: 1.1185 4.7115
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : out of range
2 times in the last 10 days for at least one item
Severe: obs_number=466.0000, expected range: 553.1409 571.6091
Severe: obs_number=192.0000, expected range: 270.8363 285.4137
Severe: obs_number=0.0000, expected range: 32.9440 214.3385
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 22 : all data missing
Severe: obs_number=0, expected range: 75.01 189.57
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 46 : all data missing
Severe: obs_number=0, expected range: 25.23 322.70
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 85 : all data missing
Severe: obs_number=0, expected range: 130.64 154.02
BUFR TEMP DESCENT Q (G/KG) PRESSURE LAYER 900-1200 (HPA) : missing
Severe: obs_number=0.0000, expected range: 0.0000 321.2448
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (3 pressure layers affected : out of range
Considerable: obs_number=116.0000, expected range: 193.8397 213.6603
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) W2QEIEZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.1952, expected range: 0.0000 6.5225
ADS-C WIND VECTOR DIFF (M/S) VHXTWMFQ PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.6203, expected range: 0.5923 7.1282
airep
AIREP WIND VECTOR DIFF (M/S) UAL712 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.6747, expected range: 0.0000 8.4029
AIREP WIND VECTOR DIFF (M/S) LOT3E PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=26.0698, expected range: -3.5983 10.3262
Severe: rms_fgdepar=26.0698, expected range: 0.0000 18.4250
Severe: avg_pge=0.8632, expected range: -0.2413 0.3758
AIREP WIND VECTOR DIFF (M/S) VIR41R PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.2357, expected range: 0.0000 8.7425
synop
BUFR LAND SYNOP SURFACE PRESSURE (PA) 81833 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8072, expected range: 0.6156 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 89011 : out of range
Severe: avg_fgdepar=50.7148, expected range: -47.0258 77.1755
Severe: rms_fgdepar=50.7148, expected range: 0.0000 77.1755
MANUAL LAND SYNOP RH2M (%) 67774 : out of range
Severe: avg_pge=0.9186, expected range: -0.0137 0.0221
MANUAL LAND SYNOP RH2M (%) 87909 : out of range
Severe: rms_fgdepar=38.2283, expected range: 0.0000 15.4651
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40340 : out of range
Severe: rms_fgdepar=532.5957, expected range: 0.0000 120.3564
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 60355 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8364, expected range: 0.6169 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43196 : out of range
Severe: rms_fgdepar=362.0356, expected range: 0.0000 134.7406
BUFR LAND SYNOP RH2M (%) 71230 : out of range
Severe: rms_fgdepar=34.4496, expected range: 0.0000 12.7023
BUFR LAND SYNOP RH2M (%) 71660 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=31.2919, expected range: 0.0000 11.8639
BUFR LAND SYNOP RH2M (%) 71880 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=30.5609, expected range: 0.0000 12.0040
BUFR LAND SYNOP RH2M (%) 72552 : out of range
Severe: rms_fgdepar=39.6874, expected range: 0.0000 18.4415
BUFR LAND SYNOP RH2M (%) 71543 : out of range
Severe: rms_fgdepar=40.5171, expected range: 0.0000 12.1577
BUFR LAND SYNOP RH2M (%) 34247 : out of range
Severe: rms_fgdepar=46.9416, expected range: 0.0000 37.3220
Severe: avg_pge=0.9822, expected range: -0.0093 0.0182
BUFR LAND SYNOP RH2M (%) 71168 : out of range
Severe: rms_fgdepar=30.0293, expected range: 0.0000 11.3983
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48921 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8215, expected range: -1.4949 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 54751 : out of range
Severe: rms_fgdepar=362.3730, expected range: 0.0000 112.8538
BUFR LAND SYNOP SURFACE PRESSURE (PA) 20471 : out of range
Severe: rms_fgdepar=478.0572, expected range: 0.0000 101.1392
BUFR LAND SYNOP SURFACE PRESSURE (PA) 42591 : out of range
Severe: rms_fgdepar=581.1199, expected range: 0.0000 111.5983
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48952 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8590, expected range: -0.8563 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48062 : out of range
Severe: avg_fgdepar=615.0984, expected range: -101.3534 107.3870
Severe: rms_fgdepar=621.1592, expected range: 25.4066 143.4508
Severe: avg_pge=0.9025, expected range: -0.2702 0.4657
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OYGR2 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-612.5698, expected range: -832.0954 -434.2826
Severely_persistent: rms_fgdepar=612.5698, expected range: 435.9418 830.8279
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OXFU2 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=503.1608, expected range: 361.2608 642.6660
Severely_persistent: rms_fgdepar=503.9108, expected range: 360.7237 644.0215
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRG03 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1024.1567, expected range: 483.7071 1356.3948
Severely_persistent: rms_fgdepar=1024.1567, expected range: 483.7071 1356.3948
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRLJ4 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1279.9720, expected range: 307.4717 2004.7715
Severely_persistent: rms_fgdepar=1281.7432, expected range: 323.6732 1995.7928
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V3735 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=953.7262, expected range: 662.4038 1233.3253
Severely_persistent: rms_fgdepar=953.7262, expected range: 662.4038 1233.3253
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VABC : out of range
25 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=660.4548, expected range: 225.8949 1441.9930
Severely_persistent: avg_pge=0.8480, expected range: 0.5901 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 9HJC9 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=29.0348, expected range: -2.1075 8.7219
Severe: rms_fgdepar=29.0348, expected range: 0.0000 9.1814
Severe: avg_pge=0.9432, expected range: -1.0582 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 7JNQ : out of range
Severe: rms_fgdepar=19.2824, expected range: 0.0000 10.3422
Severe: avg_pge=0.9116, expected range: -0.7151 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6YA5 : out of range
Severe: rms_fgdepar=577.8863, expected range: 0.0000 262.9155
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 3ETR7 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=703.0564, expected range: 223.5781 1100.4099
Severe: rms_fgdepar=703.0564, expected range: 223.5895 1100.4024
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WTED : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-721.9721, expected range: -171.8256 96.3815
Severe: rms_fgdepar=723.7945, expected range: 0.0000 173.0910
Severe: avg_pge=0.8749, expected range: -0.2710 0.3048
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 6501670 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8225, expected range: -1.1843 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 2101882 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=334.9946, expected range: 0.5232 87.8521
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101654 : out of range
Severe: avg_pge=0.8299, expected range: -1.1092 0.7500
metar
METAR SURFACE PRESSURE (PA) SGME : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-713.4439, expected range: -279.8196 169.8196
Severe: rms_fgdepar=713.4439, expected range: 0.0000 280.4058
Severe: avg_pge=0.8471, expected range: -0.4368 0.5172
METAR SURFACE PRESSURE (PA) ZYTL : out of range
Severe: rms_fgdepar=303.8305, expected range: 0.0000 92.7805
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-777.3965, expected range: -774.6621 -771.8522
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=777.3967, expected range: 771.8522 774.6621
BUFR LAND SYNOP SNOW (CM) _MF12FF7 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=31.6802, expected range: 44.6358 53.2459
BUFR LAND SYNOP SNOW (CM) 08117 : out of range
Severe: rms_fgdepar=16.0000, expected range: -3.5250 6.0964
t2m
METAR 2M TEMPERATURE (K) KTLH : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.5788, expected range: -21.9301 11.2969
Severely_persistent: rms_fgdepar=14.5788, expected range: 0.0000 21.7843
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
22 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.3122, expected range: -21.9307 -12.2382
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
22 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=17.3673, expected range: 12.2880 21.9191
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.9242, expected range: -21.1277 -11.2298
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=15.9487, expected range: 11.2605 21.1217
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 68624 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.4941, expected range: -3.1427 2.2989
Severe: rms_fgdepar=12.4941, expected range: 0.0000 3.9849
MANUAL LAND SYNOP 2M TEMPERATURE (K) 68618 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.0008, expected range: 0.0000 5.6838
METAR 2M TEMPERATURE (K) RKSG : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.8149, expected range: 0.0000 6.9624
METAR 2M TEMPERATURE (K) KNQI : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.3434, expected range: 0.0000 16.1214
BUFR LAND SYNOP 2M TEMPERATURE (K) 68624 : out of range
Severe: avg_fgdepar=-12.5613, expected range: -3.1900 2.2098
Severe: rms_fgdepar=12.5613, expected range: 0.0000 4.0027
rh2m
BUFR LAND SYNOP RH2M (%) _MI13C3A : out of range
Severe: rms_fgdepar=35.0317, expected range: 2.6882 19.9675
BUFR LAND SYNOP RH2M (%) _MI10E9C : out of range
Severe: rms_fgdepar=32.0895, expected range: 0.7177 17.7111