Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-09-23 00:00

cris
NOAA20 CRIS RADIANCES (15 channels affected) : out of range
Considerable: avg_biascorr=0.2483, expected range: -0.0167 0.1393
airs
All AQUA AIRS ALL CHANNELS Global : all data missing
Severe: obs_number=0, expected range: 11156.18 12054.20
atms
NPP ATMS RADIANCES CHANNEL 9 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.5955, expected range: -0.4580 -0.4370
ssmis
DMSP-17 SSMIS RADIANCES CHANNEL 17 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-2.5555, expected range: -2.9471 -2.8491
Atmospheric Motion Vector
METEOSAT-11 AMV CLOUDY WV2 WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 : out of range
Considerable: stdev_fgdepar=3.1222, expected range: 2.1386 2.6149
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 10-11 (HPA) : out of range
19 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=0.0024, expected range: 0.0040 0.0058
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1600-1601 (HPA) : out of range
10 times in the last 10 days for at least one item
Slight: stdev_fgdepar=3.3340, expected range: 2.7745 3.3217
Radiosondes
LAND TEMP TEMPERATURE (K) 36096 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.9594, expected range: 0.0000 5.9696
Severe: avg_pge=0.8600, expected range: -1.0990 0.7500
LAND TEMP Q (G/KG) 96685 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=-6.3652, expected range: -8.9816 6.9170
Severe: rms_fgdepar=6.4446, expected range: 0.0000 8.2728
All LAND TEMP ALL LAYERS WMO BLOCK 62 : all data missing
Severe: obs_number=0, expected range: 0.00 292.87
HIGH RESO LAND TEMP TEMPERATURE (K) 29698 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_pge=0.8484, expected range: -0.9677 0.7500
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 04220 PRESSURE LAYER 300-60 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=18.4449, expected range: 0.0000 6.0134
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=578.0000, expected range: 658.7862 676.4638
Considerable: obs_number=368.0000, expected range: 444.0477 467.9523
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=284.0000, expected range: 372.0717 382.6783
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 600-900 (HPA) : missing
Severe: obs_number=0.0000, expected range: 0.0000 378.9432
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 76 : all data missing
Severe: obs_number=0, expected range: 145.00 635.34
LAND TEMP WIND VECTOR DIFF (M/S) (4 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=717.0000, expected range: 18.6593 169.0569
amdar
AMDAR WIND VECTOR DIFF (M/S) LAN801 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=26.5252, expected range: -1.6465 7.5800
Severe: rms_fgdepar=26.5252, expected range: 0.0000 10.8653
Severe: avg_pge=0.8731, expected range: -0.2611 0.3792
AMDAR WIND VECTOR DIFF (M/S) ANZ141 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=24.6648, expected range: -0.3229 6.8659
Severe: rms_fgdepar=24.7180, expected range: 0.0000 8.7423
Severe: avg_pge=0.8689, expected range: -0.1850 0.2752
AMDAR WIND VECTOR DIFF (M/S) ANZ103 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.0911, expected range: 0.0000 6.7956
AMDAR WIND VECTOR DIFF (M/S) ANZ104 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.0731, expected range: 0.4912 5.0778
WIGOS AMDAR WIND VECTOR DIFF (M/S) K2IHLDRA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=17.9318, expected range: 0.0000 15.0312
Severe: avg_pge=0.8767, expected range: -0.1474 0.7500
WIGOS AMDAR TEMPERATURE (K) WURUITRA (3 pressure layers affected) : out of range
Severe: rms_fgdepar=6.3240, expected range: 0.0000 1.7928
WIGOS AMDAR TEMPERATURE (K) WURUITRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_pge=0.8197, expected range: -0.1119 0.1596
ADS-C WIND VECTOR DIFF (M/S) E3JGN1JA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=28.2017, expected range: 0.0000 13.2416
ADS-C WIND VECTOR DIFF (M/S) A0W01LJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=29.8132, expected range: 0.0000 10.5773
ADS-C WIND VECTOR DIFF (M/S) 1H5ZJBRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=33.2887, expected range: 0.0000 9.5636
ADS-C WIND VECTOR DIFF (M/S) 5YSSATRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.5245, expected range: 0.0000 20.5038
ADS-C WIND VECTOR DIFF (M/S) FTRH1JZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.7060, expected range: 0.0000 9.3970
airep
AIREP WIND VECTOR DIFF (M/S) UAL907 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=26.9007, expected range: 0.0000 9.8715
AIREP WIND VECTOR DIFF (M/S) BAW89P PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=59.7797, expected range: -1.1209 6.8449
Severe: rms_fgdepar=60.1325, expected range: 0.0000 7.9358
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 61291 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=15.5410, expected range: 0.0000 10.6882
Severe: avg_pge=0.8856, expected range: -0.5447 0.7500
synop
MANUAL LAND SYNOP Z (M) 38734 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8718, expected range: -2.1917 0.7500
MANUAL LAND SYNOP RH2M (%) 67531 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=47.7437, expected range: 3.1972 23.6187
MANUAL LAND SYNOP RH2M (%) 67551 : out of range
Severe: avg_pge=0.9475, expected range: -0.5216 0.6236
MANUAL LAND SYNOP RH2M (%) 36177 : out of range
Severe: rms_fgdepar=46.0718, expected range: 0.0000 25.1276
BUFR LAND SYNOP RH2M (%) 94221 : out of range
Severe: rms_fgdepar=31.6206, expected range: 0.0000 11.6864
BUFR LAND SYNOP RH2M (%) _17040E1 : out of range
Severe: avg_fgdepar=-68.6787, expected range: -76.3010 14.6256
BUFR LAND SYNOP RH2M (%) _17040E1 : out of range
Severe: rms_fgdepar=68.6787, expected range: 0.0000 79.1783
BUFR LAND SYNOP RH2M (%) _17040E1 : out of range
Severe: avg_pge=1.0000, expected range: -1.4519 0.7500
BUFR LAND SYNOP RH2M (%) 94202 : out of range
Severe: rms_fgdepar=46.9300, expected range: 0.0000 14.4752
Severe: avg_pge=0.9973, expected range: 0.0006 0.0053
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48830 : out of range
Severe: rms_fgdepar=333.4043, expected range: 0.0000 187.4146
BUFR LAND SYNOP SURFACE PRESSURE (PA) 42715 : out of range
Severe: avg_fgdepar=517.5669, expected range: -140.9135 191.1388
Severe: rms_fgdepar=517.5669, expected range: 0.0000 134.5982
Severe: avg_pge=0.8816, expected range: -0.3852 0.4539
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OWSC2 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1169.3414, expected range: -676.5123 1357.9773
Severely_persistent: rms_fgdepar=1169.3414, expected range: 0.0000 1151.8849
Severely_persistent: avg_pge=0.9114, expected range: -0.5415 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OWLD2 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8058, expected range: 0.3748 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRRD7 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=869.8992, expected range: 290.8726 1018.2064
Severely_persistent: rms_fgdepar=869.8992, expected range: 284.0340 1030.6253
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA4048 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=920.7926, expected range: 399.1856 1451.3314
Severely_persistent: rms_fgdepar=921.5045, expected range: 400.5154 1451.7659
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VABC : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=929.0053, expected range: -1647.8657 2372.9052
Severely_persistent: rms_fgdepar=939.5315, expected range: 0.0000 2039.1327
Severely_persistent: avg_pge=0.8857, expected range: -0.8609 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ZCDE3 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=523.9665, expected range: -780.6104 1267.9143
Severe: rms_fgdepar=523.9665, expected range: 0.0000 948.2534
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6FZ7 : out of range
Severe: rms_fgdepar=302.5338, expected range: 0.0000 166.0507
BUFR SHIP SYNOP SURFACE PRESSURE (PA) KOGC : out of range
Severe: rms_fgdepar=449.0444, expected range: 0.0000 174.1234
BUFR SHIP SYNOP SURFACE PRESSURE (PA) CQNL : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-508.5229, expected range: -654.6045 879.6159
Severe: rms_fgdepar=508.5229, expected range: 0.0000 520.1892
Severe: avg_pge=0.8225, expected range: -0.9605 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) DCQN : out of range
Severe: avg_fgdepar=-536.5125, expected range: -1137.1217 1125.6644
Severe: rms_fgdepar=536.5125, expected range: 0.0000 837.6090
Severe: avg_pge=0.8287, expected range: -1.1520 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) C6SE5 : out of range
Severe: rms_fgdepar=19.2794, expected range: 0.0000 14.1453
Severe: avg_pge=0.9053, expected range: -0.6269 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) V7IU6 : out of range
Severe: rms_fgdepar=17.6662, expected range: 0.0000 16.6904
Severe: avg_pge=0.8927, expected range: -0.9703 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 2302614 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8739, expected range: -1.3252 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101654 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8927, expected range: -0.8371 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6402654 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8314, expected range: -0.0512 0.7500
MOORED BUOYS WIND VECTOR DIFF (M/S) 2200186 : out of range
Severe: rms_fgdepar=15.4308, expected range: 0.0000 14.4126
Severe: avg_pge=0.9030, expected range: -0.8455 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4102632 : out of range
Severe: rms_fgdepar=921.6913, expected range: 0.0000 222.2977
DRIFTING BUOYS SURFACE PRESSURE (PA) 6402557 : out of range
Severe: rms_fgdepar=446.2443, expected range: 0.0000 218.1056
DRIFTING BUOYS SURFACE PRESSURE (PA) 1301619 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=471.2520, expected range: 0.0000 191.3549
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-778.0208, expected range: -793.8734 -761.8082
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=778.0210, expected range: 761.8021 793.9044
BUFR LAND SYNOP SNOW (CM) _MF12FF7 : out of range
26 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=50.2231, expected range: 42.4616 59.0602
BUFR LAND SYNOP SNOW (CM) _MI1F9AC : out of range
28 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=60.9545, expected range: 44.3554 59.5796
BUFR LAND SYNOP SNOW (CM) _MI1F9AC : out of range
28 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=61.3059, expected range: 44.8822 60.5744
t2m
METAR 2M TEMPERATURE (K) KTLH : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-18.6144, expected range: -25.1213 8.3045
Severely_persistent: rms_fgdepar=18.6144, expected range: 0.0000 21.4165
METAR 2M TEMPERATURE (K) OIGK : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.5544, expected range: -16.4267 -4.0321
Severely_persistent: rms_fgdepar=12.9079, expected range: 4.6168 16.2796
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 28976 : out of range
Severe: rms_fgdepar=10.8416, expected range: 0.0000 2.4357
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.4413, expected range: -16.8189 -4.1689
Severe: rms_fgdepar=12.6082, expected range: 4.1551 16.9069
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 68589 : out of range
Severe: rms_fgdepar=10.0676, expected range: 0.0000 4.9963
MANUAL LAND SYNOP 2M TEMPERATURE (K) 38316 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=11.3140, expected range: 0.3380 5.4908
BUFR LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.6602, expected range: -16.9256 -4.2151
Severe: rms_fgdepar=12.8326, expected range: 4.1917 17.0172
BUFR LAND SYNOP 2M TEMPERATURE (K) _1701F9F : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=13.2623, expected range: -9.9777 22.0367
BUFR LAND SYNOP 2M TEMPERATURE (K) _1701F9F : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=13.2623, expected range: 0.0000 20.1323