Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-10-23 12:00

iasi
METOP-B IASI RADIANCES CHANNEL 1521 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0764, expected range: -0.1001 -0.0921
METOP-C IASI RADIANCES CHANNEL 1513 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0058, expected range: -0.0225 -0.0146
METOP-C IASI RADIANCES CHANNEL 1521 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0779, expected range: -0.0989 -0.0905
METOP-C IASI RADIANCES CHANNEL 369 : out of range
4 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.1250, expected range: -0.1165 -0.1079
METOP-B IASI RADIANCES (15 channels affected) : out of range
Considerable: avg_biascorr=0.1327, expected range: 0.1435 0.1635
cris
NOAA20 CRIS RADIANCES CHANNEL 610 : out of range
2 times in the last 10 days for at least one item
Considerable: avg_biascorr=-0.0118, expected range: -0.0272 -0.0175
airs
AQUA AIRS RADIANCES CHANNEL 1104 : out of range
Considerable: avg_biascorr=0.5684, expected range: 0.4377 0.5187
mwhs2
FY-3D MWHS2 ALLSKY RADIANCES CHANNEL 2 : out of range
Slight: obs_number=52334.0000, expected range: 54573.2009 57345.0344
FY-3D MWHS2 ALLSKY RADIANCES CHANNEL 3 : out of range
Slight: obs_number=52335.0000, expected range: 54575.0001 57345.4705
FY-3D MWHS2 ALLSKY RADIANCES CHANNEL 4 : out of range
Slight: obs_number=52335.0000, expected range: 54575.1286 57345.4597
atms
NPP ATMS RADIANCES (7 channels affected) : out of range
Considerable: obs_number=3596.0000, expected range: 2930.2779 3419.9574
NOAA20 ATMS RADIANCES CHANNEL 13 : out of range
Considerable: obs_number=3773.0000, expected range: 3134.7915 3644.8556
NOAA20 ATMS RADIANCES CHANNEL 14 : out of range
Considerable: obs_number=3773.0000, expected range: 3135.3117 3645.1589
NOAA20 ATMS RADIANCES CHANNEL 15 : out of range
Considerable: obs_number=3773.0000, expected range: 3135.3117 3645.1589
Radiosondes
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 29 : all data missing
Severely_persistent: obs_number=0, expected range: 102.27 146.39
LAND TEMP TEMPERATURE (K) 36003 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_fgdepar=-10.7307, expected range: -4.1418 2.9041
Severe: rms_fgdepar=10.7771, expected range: 0.0000 3.6011
Severe: avg_pge=0.9206, expected range: -0.5745 0.7500
LAND TEMP TEMPERATURE (K) 98747 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=6.0183, expected range: 0.0000 1.5593
LAND TEMP WIND VECTOR DIFF (M/S) 28695 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=26.2296, expected range: 0.0694 4.1755
Severe: rms_fgdepar=26.2296, expected range: 0.0000 4.9587
Severe: avg_pge=0.8750, expected range: -0.2114 0.2818
LAND TEMP WIND VECTOR DIFF (M/S) 28445 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=20.5573, expected range: 0.0000 5.9772
HIGH RESO LAND TEMP Q (G/KG) 72250 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=5.1671, expected range: 0.0000 2.7854
HIGH RESO LAND TEMP Q (G/KG) 93844 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=2.5617, expected range: 0.0000 1.2113
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
Severe: obs_number=280.0000, expected range: 360.8453 375.9047
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 40186 PRESSURE LAYER 0-300 : out of range
Severe: rms_fgdepar=17.8059, expected range: 0.0000 8.8104
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=14.4810, expected range: -0.2202 6.2735
Severe: rms_fgdepar=17.8059, expected range: 0.0000 7.4002
Considerable: obs_number=360.0000, expected range: 385.4550 432.7950
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=390.0000, expected range: 465.8292 553.1708
amdar
AMDAR TEMPERATURE (K) 00000374 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=7.3067, expected range: 0.0000 2.1649
Severe: avg_pge=0.8692, expected range: -0.3883 0.5699
WIGOS AMDAR TEMPERATURE (K) WVTUIEZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=8.8142, expected range: 0.0000 1.6584
WIGOS AMDAR WIND VECTOR DIFF (M/S) G3ZGIVBA PRESSURE LAYER 300-600 (HP : out of range
Severe: rms_fgdepar=15.7266, expected range: 0.0000 8.1396
WIGOS AMDAR WIND VECTOR DIFF (M/S) (2 pressure layers affected) : missing
Severe: obs_number=0.0000, expected range: 0.0000 460.6716
WIGOS AMDAR Q (G/KG) DVPUOFZA PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_pge=0.9322, expected range: -0.8277 0.7500
ADS-C WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : missing
3 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 250.7854
airep
AIREP WIND VECTOR DIFF (M/S) ACA861 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=21.8339, expected range: 0.5662 7.3433
AIREP WIND VECTOR DIFF (M/S) AFR334 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.6712, expected range: 0.0000 8.9924
AIREP WIND VECTOR DIFF (M/S) UAL4 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=21.5651, expected range: 0.0000 24.7165
AIREP WIND VECTOR DIFF (M/S) UAL47 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=21.7577, expected range: 0.0000 35.6941
AIREP WIND VECTOR DIFF (M/S) KLM757 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=24.5871, expected range: -30.3622 44.9179
AIREP WIND VECTOR DIFF (M/S) THT67 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=31.7087, expected range: 0.8985 6.1566
Severe: rms_fgdepar=45.0267, expected range: 0.8397 7.2266
AIREP WIND VECTOR DIFF (M/S) KLM749 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=26.8707, expected range: 0.0000 15.3441
AIREP WIND VECTOR DIFF (M/S) AAL49 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.8298, expected range: 0.0000 28.0290
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) (2 pressure layers affected) : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=104.0000, expected range: 758.3056 1362.6944
Considerable: obs_number=1420.0000, expected range: 2048.4467 2687.5533
Considerable: obs_number=104.0000, expected range: 758.3056 1362.6944
synop
AUTOMATIC LAND SYNOP RH2M (%) 68593 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9966, expected range: -1.5937 0.7500
MANUAL LAND SYNOP RH2M (%) 42935 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9676, expected range: -1.6271 0.7500
MANUAL LAND SYNOP RH2M (%) 42855 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9768, expected range: -1.7207 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83919 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8808, expected range: -1.7322 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 83825 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=605.8789, expected range: 0.0000 739.7304
Severely_persistent: avg_pge=0.8150, expected range: -0.6483 0.7500
MANUAL LAND SYNOP RH2M (%) 42961 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9891, expected range: -0.3803 0.4478
MANUAL LAND SYNOP RH2M (%) 86128 : out of range
Severe: rms_fgdepar=39.1285, expected range: 0.0000 13.1837
MANUAL LAND SYNOP RH2M (%) 42969 : out of range
Severe: avg_pge=0.9852, expected range: -0.4500 0.5223
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42174 : out of range
Severe: avg_fgdepar=-808.1575, expected range: -265.3230 112.6353
Severe: rms_fgdepar=808.1575, expected range: 0.0000 166.6236
Severe: avg_pge=0.9284, expected range: -0.9785 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 38584 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=381.2734, expected range: 0.0000 127.8804
Severe: avg_pge=0.8071, expected range: -0.7286 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 84018 : out of range
Severe: avg_fgdepar=-536.3759, expected range: -31.6924 154.7267
Severe: rms_fgdepar=804.8596, expected range: 0.0000 174.1098
BUFR LAND SYNOP RH2M (%) 95529 : out of range
Severe: avg_pge=0.9640, expected range: -0.0430 0.0599
BUFR LAND SYNOP RH2M (%) 94549 : out of range
Severe: avg_pge=0.9990, expected range: -0.0754 0.0950
BUFR LAND SYNOP SURFACE PRESSURE (PA) 37085 : out of range
Severe: rms_fgdepar=336.6393, expected range: 0.0000 170.5601
BUFR LAND SYNOP SURFACE PRESSURE (PA) 41929 : out of range
Severe: rms_fgdepar=603.2597, expected range: 0.0000 231.7711
BUFR LAND SYNOP SURFACE PRESSURE (PA) _MI1425D : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8595, expected range: 0.3027 0.7500
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) LDRG : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8014, expected range: 0.4254 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRWQ2 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=1035.5884, expected range: -425.0355 399.4822
Severe: rms_fgdepar=1035.5884, expected range: 0.0000 315.8904
Severe: avg_pge=0.8980, expected range: -0.6410 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6YZ5 : out of range
Severe: avg_pge=0.8058, expected range: 0.5730 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V8838 : out of range
Severe: rms_fgdepar=365.4017, expected range: 0.0000 186.4486
BUFR SHIP SYNOP SURFACE PRESSURE (PA) AVQU : out of range
Severe: avg_fgdepar=-1008.0066, expected range: -586.7441 610.8104
Severe: rms_fgdepar=1011.2513, expected range: 0.0000 558.5456
Severe: avg_pge=0.9122, expected range: -1.0161 0.7500
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 4600066 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=15.0154, expected range: 0.0000 3.8524
Severe: avg_pge=0.9165, expected range: -0.3882 0.7282
DRIFTING BUOYS SURFACE PRESSURE (PA) 5501667 : out of range
Severe: rms_fgdepar=346.8529, expected range: 0.0000 171.4649
DRIFTING BUOYS SURFACE PRESSURE (PA) 6204577 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=419.1369, expected range: 0.0000 317.3306
Severe: avg_pge=0.8572, expected range: -0.4027 0.6404
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101777 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-562.1841, expected range: -1076.7502 1327.1474
Severe: rms_fgdepar=574.7701, expected range: 0.0000 1288.0980
Severe: avg_pge=0.9045, expected range: -1.1849 0.7500
metar
AUTOMATIC METAR SURFACE PRESSURE (PA) KQFW : out of range
26 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-520.5857, expected range: -1163.0960 174.1356
Severely_persistent: rms_fgdepar=521.6098, expected range: 0.0000 1125.5150
Severely_persistent: avg_pge=0.8198, expected range: -0.5432 0.7500
METAR SURFACE PRESSURE (PA) HEMA : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=588.0738, expected range: 0.0000 345.4479
METAR SURFACE PRESSURE (PA) GQPA : out of range
Severe: rms_fgdepar=328.0032, expected range: 0.0000 138.4503
METAR SURFACE PRESSURE (PA) SFAL : out of range
Severe: rms_fgdepar=462.3969, expected range: 0.0000 240.2451
snow
BUFR LAND SYNOP SNOW (CM) _MI1B25E : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=55.0000, expected range: 18.6994 75.8579
BUFR LAND SYNOP SNOW (CM) _MI1B25E : out of range
9 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=55.0000, expected range: 18.6897 76.7575
AUTOMATIC LAND SYNOP SNOW (CM) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=162.9959, expected range: 430.2284 526.0197
Considerable: avg_fgdepar=-21.1639, expected range: -103.0812 -50.4488
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.1276, expected range: -18.8025 -2.2504
Severely_persistent: rms_fgdepar=14.3201, expected range: 2.7647 18.6038
METAR 2M TEMPERATURE (K) UGMS : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=12.2715, expected range: 5.8066 16.4588
Severely_persistent: rms_fgdepar=12.2987, expected range: 5.9296 16.4719
BUFR LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.1517, expected range: -18.9518 -2.2311
Severely_persistent: rms_fgdepar=14.3453, expected range: 2.7335 18.7529
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.6738, expected range: -16.4244 -5.3030
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=12.7805, expected range: 5.3034 16.6541
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89767 : out of range
Severe: avg_fgdepar=-19.4489, expected range: -6.0826 0.9295
Severe: rms_fgdepar=19.4489, expected range: 0.0000 7.1894
Severe: avg_est_pge=0.8049, expected range: -0.1212 0.4111
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02019 : out of range
Severe: rms_fgdepar=11.7017, expected range: 0.9263 2.6557
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24691 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.5638, expected range: -13.4108 5.2223
Severe: rms_fgdepar=14.5904, expected range: 0.0000 13.1078
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24588 : out of range
Severe: rms_fgdepar=10.4599, expected range: 0.1553 3.9473
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24688 : out of range
Severe: avg_fgdepar=-12.5978, expected range: -10.3017 4.3935
Severe: rms_fgdepar=12.6699, expected range: 0.0000 10.0599
METAR 2M TEMPERATURE (K) KOPF : out of range
Severe: avg_fgdepar=-18.5773, expected range: 0.4109 3.9029
Severe: rms_fgdepar=18.5773, expected range: 1.0580 4.3452
BUFR LAND SYNOP 2M TEMPERATURE (K) 24691 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.5988, expected range: -13.4643 5.1504
Severe: rms_fgdepar=14.6244, expected range: 0.0000 13.1966
BUFR LAND SYNOP 2M TEMPERATURE (K) 89767 : out of range
Severe: avg_fgdepar=-19.3018, expected range: -6.1324 0.9037
Severe: rms_fgdepar=19.3035, expected range: 0.0000 7.2315
BUFR LAND SYNOP 2M TEMPERATURE (K) 24688 : out of range
Severe: avg_fgdepar=-12.6478, expected range: -10.3517 4.3435
Severe: rms_fgdepar=12.7196, expected range: 0.0000 10.1354