Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-08-13 12:00

amsua
NOAA-19 AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
2 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.0562, expected range: -0.4920 -0.2586
iasi
METOP-B IASI RADIANCES CHANNEL 284 : out of range
Considerable: avg_biascorr=-0.0099, expected range: -0.0276 -0.0170
cris
All NPP CRIS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 14988.80 15827.20
gmi
All GPM GMI ALSKY ALL CHANNELS Global : all data missing
Severe: obs_number=0, expected range: 10197.59 13185.23
atms
All NPP ATMS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 11479.31 13976.86
gpsro
All KOMPSAT-5 GPSRO SETTING ALL HEIGHTS Global : all data missing
Severe: obs_number=0, expected range: 137.95 638.46
SPIRE LEMUR 3U GPSRO RISING (14 impact heights affected) : out of range
Slight: obs_number=4925.0000, expected range: 2131.0049 4359.9951
Atmospheric Motion Vector
All AQUA MODIS CLEAR WV ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 144.58 1012.83
All NPP VIIRS AMV IR ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 188.57 1443.99
Radiosondes
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=6.6242, expected range: -6.7688 20.7992
Severely_persistent: rms_fgdepar=6.6756, expected range: 0.0000 20.8165
LAND TEMP Q (G/KG) 36872 PRESSURE LAYER 900-1200 (HPA) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=7.8621, expected range: -4.7487 16.0965
Severely_persistent: rms_fgdepar=7.8736, expected range: 0.0000 16.1311
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 83 : all data missing
Severely_persistent: obs_number=0, expected range: 37.54 134.86
All HIGH RESO SEA TEMP ALL LAYERS North East Pacific : all data missing
Severely_persistent: obs_number=0, expected range: 93.41 142.88
LAND TEMP Q (G/KG) 98328 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.4163, expected range: 0.3816 1.1947
LAND TEMP Q (G/KG) 40417 PRESSURE LAYER 900-1200 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=9.7973, expected range: -11.2654 14.1495
Severe: rms_fgdepar=9.9836, expected range: 0.0000 10.3151
LAND TEMP WIND VECTOR DIFF (M/S) 23933 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=15.9653, expected range: 0.4298 4.3287
Severe: avg_pge=0.8559, expected range: -0.4025 0.6267
LAND TEMP WIND VECTOR DIFF (M/S) 96147 (2 pressure layers affected) : out of range
Severe: avg_fgdepar=20.6137, expected range: 0.1086 5.0558
Severe: rms_fgdepar=20.6137, expected range: 0.0930 5.7234
Severe: avg_pge=0.8971, expected range: -0.3767 0.5342
LAND TEMP TEMPERATURE (K) 96147 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.3127, expected range: 0.0000 1.6800
Severe: avg_pge=0.8623, expected range: -0.8010 0.7500
All LAND TEMP ALL LAYERS WMO BLOCK 4 : all data missing
Severe: obs_number=0, expected range: 0.00 271.28
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 300-600 (HPA) : missing
Severe: obs_number=0.0000, expected range: 62.3615 91.6385
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 24 : all data missing
Severe: obs_number=0, expected range: 82.94 171.34
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 46 : all data missing
Severe: obs_number=0, expected range: 209.47 361.10
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 82 : all data missing
Severe: obs_number=0, expected range: 97.34 113.52
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 88 : all data missing
Severe: obs_number=0, expected range: 17.53 343.36
All BUFR TEMP DESCENT ALL LAYERS North pole : all data missing
Severe: obs_number=0, expected range: 19.42 192.85
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : out of range
3 times in the last 10 days for at least one item
Considerable: obs_number=547.0000, expected range: 438.5005 463.7217
amdar
AMDAR WIND VECTOR DIFF (M/S) JP9Z58V9 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=15.7248, expected range: 0.0000 6.1758
AMDAR WIND VECTOR DIFF (M/S) JP9Z46W9 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=20.8772, expected range: 0.0000 6.1015
AMDAR WIND VECTOR DIFF (M/S) JP9Z4X49 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=16.0104, expected range: 0.0000 8.3744
AMDAR WIND VECTOR DIFF (M/S) JP9Z57Y9 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=15.1418, expected range: 0.0000 6.4583
WIGOS AMDAR WIND VECTOR DIFF (M/S) BWP0FXBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.7084, expected range: 0.0000 8.7630
WIGOS AMDAR WIND VECTOR DIFF (M/S) NM4EITBA PRESSURE LAYER 300-600 (HP : out of range
Severe: rms_fgdepar=18.7553, expected range: 0.0000 8.7072
MODE-S WIND VECTOR DIFF (M/S) M9EA652 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=21.4264, expected range: -0.5454 4.4465
Severe: rms_fgdepar=21.5498, expected range: 0.0000 5.2818
MODE-S WIND VECTOR DIFF (M/S) MDFDD46 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=16.4328, expected range: 0.0000 7.4001
MODE-S WIND VECTOR DIFF (M/S) M7156C6 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=18.2350, expected range: 0.0000 7.9527
MODE-S WIND VECTOR DIFF (M/S) M1D4A07 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=15.2038, expected range: 0.0000 5.8668
MODE-S WIND VECTOR DIFF (M/S) M968FAD PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=16.6418, expected range: 0.0000 5.6660
MODE-S WIND VECTOR DIFF (M/S) M2CD96F PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=15.8080, expected range: 0.0000 4.4335
ADS-C WIND VECTOR DIFF (M/S) VHXTWMEA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=25.9379, expected range: 0.0000 14.1427
ADS-C WIND VECTOR DIFF (M/S) VE5EIJZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.1163, expected range: 0.0000 7.8749
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Slight: obs_number=2885.0000, expected range: 1831.1459 2431.3541
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 97372 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=21.0799, expected range: -15.7095 24.6974
Severe: rms_fgdepar=21.2769, expected range: 0.0000 25.3360
Severe: avg_pge=0.8234, expected range: -1.1069 0.7500
synop
BUFR LAND SYNOP SURFACE PRESSURE (PA) 08347 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1165.7127, expected range: -52.0362 119.5181
Severely_persistent: rms_fgdepar=1173.2300, expected range: 0.0000 85.7713
Severely_persistent: avg_pge=0.9465, expected range: -0.4729 0.5982
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 41244 : out of range
Severe: avg_fgdepar=-577.2794, expected range: -936.1048 1354.2514
Severe: rms_fgdepar=635.0591, expected range: 0.0000 1199.5668
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 17928 : out of range
Severe: rms_fgdepar=638.2753, expected range: 0.0000 1278.9342
MANUAL LAND SYNOP RH2M (%) 60101 : out of range
Severe: rms_fgdepar=30.1267, expected range: 0.0000 17.1020
MANUAL LAND SYNOP RH2M (%) 83363 : out of range
Severe: avg_pge=1.0000, expected range: -1.0276 0.7500
MANUAL LAND SYNOP RH2M (%) 44373 : out of range
Severe: rms_fgdepar=33.9040, expected range: 0.0000 9.3144
MANUAL LAND SYNOP RH2M (%) 62124 : out of range
Severe: avg_pge=0.9999, expected range: -1.3975 0.7500
MANUAL LAND SYNOP RH2M (%) 43207 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8209, expected range: -0.7770 0.7500
MANUAL LAND SYNOP RH2M (%) 83319 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8188, expected range: -1.3933 0.7500
MANUAL LAND SYNOP RH2M (%) 67229 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9601, expected range: -1.4649 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40080 : out of range
Severe: rms_fgdepar=377.8826, expected range: 0.0000 192.8662
Severe: avg_pge=0.8047, expected range: -0.4722 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 82690 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=362.9853, expected range: 0.0000 187.7943
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 82990 : out of range
Severe: rms_fgdepar=486.8100, expected range: 0.0000 114.6267
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 35361 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=347.5809, expected range: 0.0000 258.8852
Severe: avg_pge=0.8278, expected range: -1.0174 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 82886 : out of range
Severe: rms_fgdepar=472.8772, expected range: 0.0000 133.0968
Severe: avg_pge=0.8741, expected range: -0.8167 0.7500
BUFR LAND SYNOP RH2M (%) 08392 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=39.2876, expected range: 0.0000 8.4502
BUFR LAND SYNOP RH2M (%) 08273 : out of range
Severe: rms_fgdepar=31.1935, expected range: 0.0000 6.3573
BUFR LAND SYNOP RH2M (%) 08383 : out of range
Severe: rms_fgdepar=37.4069, expected range: 0.0000 11.2614
BUFR LAND SYNOP RH2M (%) 34344 : out of range
Severe: rms_fgdepar=35.4168, expected range: 0.0000 19.5689
BUFR LAND SYNOP RH2M (%) 08275 : out of range
Severe: rms_fgdepar=33.7005, expected range: 3.6315 14.5305
BUFR LAND SYNOP RH2M (%) 08346 : out of range
Severe: rms_fgdepar=33.4545, expected range: 0.0000 10.1693
BUFR LAND SYNOP RH2M (%) 08276 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=32.4828, expected range: 0.0000 13.2019
BUFR LAND SYNOP RH2M (%) 51777 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=46.4813, expected range: 0.0000 39.5146
Severe: avg_pge=0.9971, expected range: -1.5352 0.7500
BUFR LAND SYNOP RH2M (%) 08348 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=32.7502, expected range: 0.0000 8.8327
BUFR LAND SYNOP RH2M (%) 36078 : out of range
Severe: rms_fgdepar=39.7680, expected range: 0.0000 17.0621
BUFR LAND SYNOP RH2M (%) 16789 : out of range
Severe: rms_fgdepar=33.3592, expected range: 0.0000 13.6522
Severe: rms_fgdepar=30.2445, expected range: 0.0000 16.0467
BUFR LAND SYNOP SURFACE PRESSURE (PA) 30493 : out of range
Severe: rms_fgdepar=430.9589, expected range: 0.0000 177.3806
BUFR LAND SYNOP SURFACE PRESSURE (PA) 08276 : out of range
Severe: rms_fgdepar=324.2104, expected range: 0.0000 123.4665
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) ELDMMXN : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8203, expected range: 0.3333 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V3735 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=841.4504, expected range: 73.6704 1947.6787
Severely_persistent: rms_fgdepar=841.4504, expected range: 71.3036 1950.8361
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7OJ5 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1205.6169, expected range: 737.0972 1653.6708
Severely_persistent: rms_fgdepar=1205.7771, expected range: 738.1240 1654.5280
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 9HA3340 : out of range
Severe: rms_fgdepar=15.3983, expected range: 0.0000 6.3028
Severe: avg_pge=0.8400, expected range: -0.8095 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA4612 : out of range
Severe: avg_fgdepar=544.8288, expected range: -492.4217 872.5820
Severe: rms_fgdepar=559.7026, expected range: 0.0000 872.9004
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ZCEF3 : out of range
Severe: rms_fgdepar=454.3638, expected range: 0.0000 205.1267
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRCF6 : out of range
Severe: rms_fgdepar=525.3953, expected range: 0.0000 469.2114
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6XS7 : out of range
Severe: rms_fgdepar=431.7747, expected range: 0.0000 187.9248
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WTDF : out of range
Severe: rms_fgdepar=326.7926, expected range: 0.0000 184.9567
AUTOMATIC SHIP SURFACE PRESSURE (PA) : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=478.0000, expected range: 770.6790 864.9681
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 2301740 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-620.5515, expected range: -755.9916 775.6505
Severe: rms_fgdepar=644.0655, expected range: -592.5003 775.8909
Severe: avg_pge=0.8770, expected range: -1.2172 0.7500
metar
METAR SURFACE PRESSURE (PA) NVSC : out of range
Severe: rms_fgdepar=392.4365, expected range: 0.0000 163.1386
snow
MANUAL LAND SYNOP SNOW (CM) 37552 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=66.0000, expected range: 9.3653 99.9680
Severely_persistent: rms_fgdepar=66.0000, expected range: 11.7702 99.3503
MANUAL LAND SYNOP SNOW (CM) 87803 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-60.5349, expected range: -73.3667 -44.3523
Severely_persistent: rms_fgdepar=60.5349, expected range: 44.3523 73.3667
BUFR LAND SYNOP SNOW (CM) 87803 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-60.5349, expected range: -73.3667 -44.3523
Severely_persistent: rms_fgdepar=60.5349, expected range: 44.3523 73.3667
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-772.7459, expected range: -773.1148 -772.2908
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=772.7460, expected range: 772.2912 773.1146
t2m
METAR 2M TEMPERATURE (K) OIGK : out of range
10 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=12.2406, expected range: 6.3241 14.8012
METAR 2M TEMPERATURE (K) UGMS : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=12.1708, expected range: 8.8808 14.9408
Severely_persistent: rms_fgdepar=12.1799, expected range: 9.1341 14.9131
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.6907, expected range: 1.4649 12.0106
LAND TEMP 2M TEMPERATURE (K) 71907 : out of range
Severe: avg_fgdepar=14.7537, expected range: -3.6485 3.9999
Severe: rms_fgdepar=14.7537, expected range: 0.0000 3.7506
BUFR LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.1376, expected range: -12.0484 -1.3211
Severe: rms_fgdepar=12.9456, expected range: 1.4950 12.1144
BUFR LAND SYNOP 2M TEMPERATURE (K) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=1003.0000, expected range: 836.0112 875.6730
rh2m
MANUAL LAND SYNOP RH2M (%) 65271 : out of range
Severe: rms_fgdepar=33.1899, expected range: 0.0000 17.9102