Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-10-22 12:00

iasi
METOP-B IASI RADIANCES CHANNEL 1521 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0739, expected range: -0.0970 -0.0921
METOP-B IASI RADIANCES CHANNEL 1658 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1145, expected range: 0.0419 0.0810
METOP-C IASI RADIANCES CHANNEL 1521 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0794, expected range: -0.1035 -0.0905
METOP-C IASI RADIANCES CHANNEL 1639 : out of range
2 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.0837, expected range: 0.0549 0.0714
cris
NOAA20 CRIS RADIANCES CHANNEL 598 : out of range
1 times in the last 10 days for at least one item
Considerable: avg_biascorr=-0.0832, expected range: -0.0994 -0.0890
Atmospheric Motion Vector
AQUA MODIS CLEAR WV WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA : out of range
1 times in the last 10 days for at least one item
Slight: stdev_fgdepar=2.5812, expected range: 1.5312 2.1831
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1-2 (HPA) : out of range
4 times in the last 10 days for at least one item
Severe: stdev_fgdepar=0.0206, expected range: 0.0021 0.0113
Slight: avg_fgdepar=-0.0088, expected range: -0.0055 0.0020
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 20-21 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: stdev_fgdepar=0.0097, expected range: 0.0083 0.0120
Radiosondes
LAND TEMP TEMPERATURE (K) 30935 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_pge=0.9073, expected range: -1.1033 0.7500
LAND TEMP WIND VECTOR DIFF (M/S) 29612 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_fgdepar=22.1828, expected range: -1.1048 4.3381
Severe: avg_pge=0.8661, expected range: -0.0775 0.0886
LAND TEMP WIND VECTOR DIFF (M/S) 29612 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=22.2030, expected range: 0.0000 4.4052
LAND TEMP WIND VECTOR DIFF (M/S) 34172 PRESSURE LAYER 900-1200 (HPA) : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8876, expected range: -0.7806 0.7500
HIGH RESO LAND TEMP Q (G/KG) 94120 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.0200, expected range: 0.3374 4.8915
HIGH RESO LAND TEMP Q (G/KG) 71603 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.0648, expected range: 0.0000 0.9632
HIGH RESO LAND TEMP Q (G/KG) 57245 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.8590, expected range: 0.0000 1.3826
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 29 : all data missing
Severe: obs_number=0, expected range: 102.27 146.39
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 83 : all data missing
Severe: obs_number=0, expected range: 54.36 123.64
LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=120.0000, expected range: 182.4894 283.2248
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 300-600 (HPA) : out of range
Considerable: obs_number=220.0000, expected range: 134.6689 185.3311
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=381.0000, expected range: 266.5222 302.9064
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA : out of range
Considerable: obs_number=197.0000, expected range: 163.2204 183.9224
amdar
AMDAR WIND VECTOR DIFF (M/S) 00040369 PRESSURE LAYER 900-1200 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=20.4964, expected range: 0.0000 41.8831
WIGOS AMDAR WIND VECTOR DIFF (M/S) IPPCSWJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=29.2058, expected range: -2.6707 9.0946
Severe: rms_fgdepar=29.2058, expected range: 0.0000 10.3007
WIGOS AMDAR WIND VECTOR DIFF (M/S) MZAGU1ZA (3 pressure layers affecte : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=21.6942, expected range: 0.0000 15.8726
WIGOS AMDAR WIND VECTOR DIFF (M/S) HHUHOEJA PRESSURE LAYER 300-600 (HP : out of range
Severe: rms_fgdepar=16.8370, expected range: 0.6565 5.1222
WIGOS AMDAR WIND VECTOR DIFF (M/S) MZAGU1ZA PRESSURE LAYER 300-600 (HP : out of range
Severe: avg_fgdepar=20.5031, expected range: -10.0312 17.2256
WIGOS AMDAR WIND VECTOR DIFF (M/S) MZAGU1ZA (2 pressure layers affecte : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8528, expected range: -1.2099 0.7500
ADS-C WIND VECTOR DIFF (M/S) NKEICOJA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=31.7642, expected range: 0.0000 19.0540
ADS-C WIND VECTOR DIFF (M/S) X4TBZDRA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=17.9070, expected range: 0.8306 7.5143
ADS-C WIND VECTOR DIFF (M/S) YUEIMERA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=21.0260, expected range: -26.4873 38.5267
airep
AIREP WIND VECTOR DIFF (M/S) KLM31 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=19.4044, expected range: 0.0000 8.9382
AIREP WIND VECTOR DIFF (M/S) UAL181 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.6315, expected range: 0.0000 13.6820
AIREP WIND VECTOR DIFF (M/S) UAL1295 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.7639, expected range: 0.0000 6.8472
AIREP WIND VECTOR DIFF (M/S) AFR378 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.7071, expected range: 0.0000 16.0998
AIREP WIND VECTOR DIFF (M/S) BAW21G PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=24.3970, expected range: 0.2003 7.9704
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : missing
Severe: obs_number=0.0000, expected range: 0.0000 1424.4545
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) (2 pressure layers affected) : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=1340.0000, expected range: 2038.3806 2708.4765
synop
MANUAL LAND SYNOP RH2M (%) 42935 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9827, expected range: -1.9601 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43009 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8135, expected range: 0.3437 0.7500
MANUAL LAND SYNOP RH2M (%) 42851 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8464, expected range: -0.0976 0.1379
MANUAL LAND SYNOP RH2M (%) 42961 : out of range
Severe: avg_pge=0.9990, expected range: -0.3763 0.4472
MANUAL LAND SYNOP RH2M (%) 63702 : out of range
Severe: avg_pge=0.9550, expected range: -0.4588 0.5555
MANUAL LAND SYNOP RH2M (%) 42963 : out of range
Severe: avg_pge=0.9999, expected range: -0.3084 0.3750
MANUAL LAND SYNOP RH2M (%) 67273 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=39.1540, expected range: 0.0000 12.8310
Severe: avg_pge=0.9257, expected range: -0.0329 0.0442
MANUAL LAND SYNOP RH2M (%) 42473 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9869, expected range: -0.8506 0.7500
MANUAL LAND SYNOP RH2M (%) 42925 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9298, expected range: -1.3418 0.7500
MANUAL LAND SYNOP RH2M (%) 87637 : out of range
Severe: rms_fgdepar=30.7876, expected range: 0.0000 12.7019
MANUAL LAND SYNOP RH2M (%) 87679 : out of range
Severe: rms_fgdepar=37.0485, expected range: 0.0000 17.8118
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62120 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=369.9784, expected range: 0.0000 261.5437
Severe: avg_pge=0.8288, expected range: -0.7701 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 44462 : out of range
Severe: avg_pge=0.8058, expected range: 0.2369 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 85114 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-557.2037, expected range: -730.1085 392.0812
Severe: rms_fgdepar=557.2037, expected range: 0.0000 631.9681
Severe: avg_pge=0.8888, expected range: -1.3552 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43309 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8275, expected range: -1.3737 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 38799 : out of range
Severe: avg_fgdepar=-597.4629, expected range: -55.4532 44.1376
Severe: rms_fgdepar=752.3909, expected range: 0.0000 68.1461
BUFR LAND SYNOP RH2M (%) 37463 : out of range
Severe: rms_fgdepar=45.9131, expected range: 0.0000 31.5918
Severe: avg_pge=0.9854, expected range: -0.0241 0.0375
BUFR LAND SYNOP RH2M (%) 10704 : out of range
Severe: rms_fgdepar=35.3294, expected range: 0.0000 14.2019
BUFR LAND SYNOP SURFACE PRESSURE (PA) 27752 : out of range
Severe: rms_fgdepar=488.4631, expected range: 0.0000 100.5947
Severe: avg_pge=0.8866, expected range: -0.0662 0.0875
BUFR LAND SYNOP SURFACE PRESSURE (PA) 70316 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=314.6802, expected range: 0.0000 120.4171
BUFR LAND SYNOP SURFACE PRESSURE (PA) 29068 : out of range
Severe: rms_fgdepar=343.6534, expected range: 0.0000 180.7891
BUFR LAND SYNOP SURFACE PRESSURE (PA) _MI1425D : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8559, expected range: 0.2915 0.7500
BUFR LAND SYNOP Z (M) 56374 : out of range
Severe: avg_pge=0.9682, expected range: -0.9301 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) : out of range
3 times in the last 10 days for at least one item
Considerable: obs_number=52.0000, expected range: 61.3631 71.0813
Considerable: obs_number=103.0000, expected range: 124.0444 133.2056
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) LDRG : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8478, expected range: 0.4310 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRNE6 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8917, expected range: -1.0212 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 3FTJ : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8791, expected range: -1.1580 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V6081 : out of range
Severe: avg_fgdepar=-1032.8534, expected range: -303.1931 101.4478
Severe: rms_fgdepar=1032.8534, expected range: 0.0000 285.3522
Severe: avg_pge=0.9179, expected range: -0.7524 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRWQ2 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=1228.2583, expected range: -655.9000 719.6871
Severe: rms_fgdepar=1228.2583, expected range: -777.0922 1022.9850
Severe: avg_pge=0.9181, expected range: -0.6854 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V9924 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=518.8697, expected range: 0.0000 2977.0477
BUFR SHIP SYNOP SURFACE PRESSURE (PA) D5HF4 : out of range
Severe: avg_fgdepar=636.1469, expected range: -474.4796 241.0102
Severe: rms_fgdepar=666.9502, expected range: 0.0000 349.9418
Severe: avg_pge=0.8190, expected range: -0.6401 0.7500
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 4600001 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8691, expected range: 0.2436 0.7500
MOORED BUOYS WIND VECTOR DIFF (M/S) 2200107 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8734, expected range: 0.1448 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4801636 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8480, expected range: 0.2964 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6203719 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-528.1486, expected range: -1280.3877 1221.6447
Severely_persistent: rms_fgdepar=535.1518, expected range: -996.5464 1295.1056
Severely_persistent: avg_pge=0.8999, expected range: -1.6704 0.7500
MOORED BUOYS WIND VECTOR DIFF (M/S) 4600073 : out of range
Severe: avg_fgdepar=28.3788, expected range: -0.8525 9.5179
Severe: rms_fgdepar=28.3788, expected range: 0.0000 9.6263
Severe: avg_pge=0.9554, expected range: -0.2656 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4701740 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8537, expected range: -0.3887 0.4780
DRIFTING BUOYS SURFACE PRESSURE (PA) 7301551 : out of range
Severe: rms_fgdepar=351.1093, expected range: 0.0000 153.1327
DRIFTING BUOYS SURFACE PRESSURE (PA) 6204577 : out of range
Severe: rms_fgdepar=514.7909, expected range: 0.0000 200.3304
Severe: avg_pge=0.8177, expected range: -0.3538 0.5504
metar
AUTOMATIC METAR SURFACE PRESSURE (PA) KQFW : out of range
23 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8204, expected range: -0.2201 0.7500
METAR SURFACE PRESSURE (PA) PACD : out of range
Severe: rms_fgdepar=344.4074, expected range: 0.0000 182.7059
snow
BUFR LAND SYNOP SNOW (CM) _MI1B25E : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=64.0000, expected range: 17.4602 74.9778
BUFR LAND SYNOP SNOW (CM) _MI1B25E : out of range
7 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=64.0000, expected range: 17.6943 75.7246
BUFR LAND SYNOP SNOW (CM) 15341 : out of range
Severe: avg_fgdepar=66.0000, expected range: 0.0000 0.0000
Severe: rms_fgdepar=66.0000, expected range: 0.0000 0.0000
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.1816, expected range: -19.1277 -0.3141
Severely_persistent: rms_fgdepar=15.2675, expected range: 0.9095 18.8294
BUFR LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.3319, expected range: -19.3650 -0.1503
Severely_persistent: rms_fgdepar=15.4160, expected range: 0.7169 19.0866
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.9184, expected range: -16.7523 -4.5044
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=14.9316, expected range: 4.5505 16.9523
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.4769, expected range: -11.6060 -2.0726
Severe: rms_fgdepar=14.5528, expected range: 2.5037 11.7103
MANUAL LAND SYNOP 2M TEMPERATURE (K) 25715 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=11.0874, expected range: 0.0346 3.9124
BUFR LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.3877, expected range: -11.8278 -2.0790
Severe: rms_fgdepar=14.4619, expected range: 2.4744 11.9235
rh2m
MANUAL LAND SYNOP RH2M (%) 42705 : out of range
Severe: rms_fgdepar=32.3752, expected range: 0.0000 16.9531
BUFR LAND SYNOP RH2M (%) 08430 : out of range
Severe: rms_fgdepar=30.9922, expected range: 2.1579 18.1510