Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-08-11 00:00

amsua
NOAA-15 AMSUA RADIANCES CHANNEL 13 : out of range
4 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.1660, expected range: 0.2067 0.2617
METOP-C AMSUA RADIANCES (10 channels affected) : out of range
Considerable: obs_number=5790.0000, expected range: 11611.8441 24648.2809
iasi
METOP-B IASI RADIANCES CHANNEL 167 : out of range
Considerable: obs_number=1596.0000, expected range: 1730.8099 2262.8151
METOP-B IASI RADIANCES CHANNEL 173 : out of range
Considerable: obs_number=1463.0000, expected range: 1644.1279 2289.3721
METOP-B IASI RADIANCES CHANNEL 178 : out of range
Considerable: obs_number=1513.0000, expected range: 1693.3795 2274.1205
METOP-B IASI RADIANCES CHANNEL 179 : out of range
Considerable: obs_number=1336.0000, expected range: 1536.9710 2323.5290
METOP-B IASI RADIANCES CHANNEL 180 : out of range
Considerable: obs_number=1340.0000, expected range: 1558.2997 2310.7003
METOP-B IASI RADIANCES CHANNEL 187 : out of range
Considerable: obs_number=1156.0000, expected range: 1393.9490 2320.6760
METOP-B IASI RADIANCES CHANNEL 201 : out of range
Considerable: obs_number=1126.0000, expected range: 1375.4248 2307.3252
METOP-B IASI RADIANCES CHANNEL 301 : out of range
Considerable: obs_number=1042.0000, expected range: 1288.4098 2239.0902
METOP-B IASI RADIANCES CHANNEL 303 : out of range
Considerable: obs_number=1214.0000, expected range: 1475.9908 2274.1342
cris
NPP CRIS RADIANCES CHANNEL 62 : out of range
Considerable: obs_number=1321.0000, expected range: 1544.3595 2145.3905
NPP CRIS RADIANCES CHANNEL 64 : out of range
Considerable: obs_number=1158.0000, expected range: 1402.7647 2121.9853
NPP CRIS RADIANCES CHANNEL 65 : out of range
Considerable: obs_number=1221.0000, expected range: 1458.6270 2128.1230
NPP CRIS RADIANCES CHANNEL 66 : out of range
Considerable: obs_number=1100.0000, expected range: 1319.7008 2121.1742
NOAA20 CRIS RADIANCES (123 channels affected) : out of range
Considerable: obs_number=2840.0000, expected range: 12015.4172 32766.9281
airs
AQUA AIRS RADIANCES CHANNEL 1948 : missing
10 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 1692.9061 8726.7881
gpsro
All COSMIC2-E5 GPSRO RISING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 299.77 3256.01
Radiosondes
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : missing
7 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 179.5228 190.4772
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 0-300 (HPA) : missing
6 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 11.2947 558.0230
LAND TEMP Q (G/KG) 28661 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=2.0790, expected range: 0.0000 0.9710
LAND TEMP Q (G/KG) 96035 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=2.1296, expected range: 0.0969 0.7101
LAND TEMP Q (G/KG) 74455 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=5.3494, expected range: 0.0000 2.1242
LAND TEMP Q (G/KG) 83566 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=5.5480, expected range: 0.0000 3.4382
Severe: avg_pge=0.8904, expected range: -0.0015 0.0079
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 57447 PRESSURE LAYER 0-300 : out of range
Severe: avg_fgdepar=20.3348, expected range: -0.0427 4.3577
Severe: rms_fgdepar=23.0182, expected range: 0.0000 4.9128
HIGH RESO LAND TEMP Q (G/KG) 74560 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=4.6307, expected range: 0.0000 1.9178
HIGH RESO LAND TEMP Q (G/KG) 72451 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=4.6880, expected range: 0.0000 2.4411
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 48 : all data missing
Severe: obs_number=0, expected range: 117.86 185.64
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 37 : all data missing
Severe: obs_number=0, expected range: 89.62 97.98
amdar
WIGOS AMDAR TEMPERATURE (K) EU0758 PRESSURE LAYER 0-300 (HPA) : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8119, expected range: 0.6318 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) BTSX1DZA PRESSURE LAYER 0-300 (HPA) : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=29.1007, expected range: -30.9808 55.8772
AMDAR TEMPERATURE (K) 00000248 (3 pressure layers affected) : out of range
Severe: avg_fgdepar=13.2099, expected range: -0.8535 1.3598
AMDAR TEMPERATURE (K) 00000248 (4 pressure layers affected) : out of range
Severe: rms_fgdepar=13.2159, expected range: 0.0000 1.7145
Severe: avg_pge=0.9159, expected range: -0.1448 0.1806
WIGOS AMDAR WIND VECTOR DIFF (M/S) PO2XOGJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.7366, expected range: 1.2430 6.7566
WIGOS AMDAR WIND VECTOR DIFF (M/S) BTSX1DZA (2 pressure layers affecte : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=30.1777, expected range: 0.0000 56.7524
Severe: avg_pge=0.8916, expected range: -1.6224 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) DIJX1DJA PRESSURE LAYER 600-900 (HP : out of range
Severe: avg_fgdepar=25.3987, expected range: -10.1087 19.7302
Severe: rms_fgdepar=25.3987, expected range: 0.0000 20.2600
Severe: avg_pge=0.8859, expected range: -1.1701 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) EOEYF2BA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=16.6339, expected range: 0.1510 4.0486
WIGOS AMDAR WIND VECTOR DIFF (M/S) 31GEOGRA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=16.7151, expected range: 0.0000 5.8839
WIGOS AMDAR WIND VECTOR DIFF (M/S) X030YLZA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=15.0871, expected range: 0.0000 8.0527
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : missing
1 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 490.4777
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 43279 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.1015, expected range: 0.0000 15.1220
synop
MANUAL LAND SYNOP RH2M (%) 76040 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8047, expected range: -0.7438 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72494 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8408, expected range: 0.7284 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72327 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8624, expected range: 0.8527 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 68843 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9406, expected range: -0.2558 0.2959
MANUAL LAND SYNOP RH2M (%) 65330 : out of range
Severe: rms_fgdepar=39.8955, expected range: 0.0000 13.3097
Severe: avg_pge=0.8979, expected range: -0.0003 0.0065
MANUAL LAND SYNOP RH2M (%) 60390 : out of range
Severe: avg_pge=0.9656, expected range: -0.4834 0.5776
MANUAL LAND SYNOP RH2M (%) 42935 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=38.4090, expected range: 22.4480 34.5642
Severe: avg_pge=0.9021, expected range: -0.4762 0.7500
MANUAL LAND SYNOP RH2M (%) 35497 : out of range
Severe: rms_fgdepar=33.4167, expected range: 0.0000 11.2500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 82990 : out of range
Severe: rms_fgdepar=349.4775, expected range: 61.6986 269.5164
Severe: avg_pge=0.8385, expected range: 0.3446 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 80405 : out of range
Severe: avg_fgdepar=-1087.8713, expected range: -385.2148 275.0844
Severe: rms_fgdepar=1087.8713, expected range: 9.3728 221.5921
Severe: avg_pge=0.9448, expected range: -1.0084 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 82246 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=382.7962, expected range: -162.3680 239.4747
Severe: avg_pge=0.8280, expected range: -1.0553 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 87497 : out of range
Severe: rms_fgdepar=436.8451, expected range: 0.0000 101.4078
Severe: avg_pge=0.8249, expected range: -0.2141 0.2950
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 36859 : out of range
Severe: rms_fgdepar=559.8847, expected range: 0.0000 271.2915
BUFR LAND SYNOP RH2M (%) 29974 : out of range
Severe: rms_fgdepar=34.2395, expected range: 0.0000 18.3212
BUFR LAND SYNOP SURFACE PRESSURE (PA) 94514 : out of range
Severe: avg_fgdepar=768.8989, expected range: -62.4498 68.1048
Severe: rms_fgdepar=768.8989, expected range: 0.0000 43.3670
Severe: avg_pge=0.9262, expected range: -0.2761 0.3133
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48075 : out of range
Severe: avg_pge=0.8114, expected range: -0.5552 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 58926 : out of range
Severe: rms_fgdepar=312.8313, expected range: 0.0000 127.2253
BUFR LAND SYNOP SURFACE PRESSURE (PA) 12836 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=330.7035, expected range: 0.0000 157.5332
Severe: avg_pge=0.8626, expected range: -0.3422 0.4184
MANUAL LAND SYNOP RH2M (%) : out of range
Considerable: obs_number=108.0000, expected range: 93.5730 97.9826
BUFR LAND SYNOP RH2M (%) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=72.0000, expected range: 46.7925 58.0964
ship
SHIP SURFACE PRESSURE (PA) WGAH : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=645.2860, expected range: -1086.7403 1143.0006
Severely_persistent: rms_fgdepar=647.3819, expected range: -733.4132 1059.7441
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRKK2 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8198, expected range: -0.8309 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WGAH : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=645.2860, expected range: -1090.9867 1144.1964
Severely_persistent: rms_fgdepar=647.3819, expected range: -728.7294 1057.5532
Severely_persistent: avg_pge=0.8450, expected range: -1.3314 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRMD3 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=20.6086, expected range: -14.0470 35.4936
Severely_persistent: rms_fgdepar=20.6111, expected range: 0.0000 35.5848
Severely_persistent: avg_pge=0.9119, expected range: -0.6090 0.7500
AUTOMATIC SHIP SURFACE PRESSURE (PA) 45149 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=312.2237, expected range: 0.0000 156.0515
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VROO4 : out of range
Severe: avg_fgdepar=531.7680, expected range: -90.3712 155.9569
Severe: rms_fgdepar=531.7680, expected range: 0.0000 218.8490
Severe: avg_pge=0.8077, expected range: -0.6084 0.7448
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 45149 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=312.2237, expected range: 0.0000 157.8281
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101771 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8544, expected range: -0.9054 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1701532 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=512.6984, expected range: 0.0000 123.1324
MOORED BUOYS SURFACE PRESSURE (PA) : out of range
Considerable: obs_number=106.0000, expected range: 90.8377 97.1623
metar
METAR SURFACE PRESSURE (PA) KSPI : out of range
Severe: rms_fgdepar=360.3220, expected range: 0.0000 120.3023
METAR SURFACE PRESSURE (PA) PALJ : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=362.2923, expected range: 0.0000 131.9712
t2m
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.7395, expected range: -20.3309 -13.4744
Severely_persistent: rms_fgdepar=15.7457, expected range: 13.6273 20.3418
METAR 2M TEMPERATURE (K) KMYR : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-17.0467, expected range: -14.4426 14.1813
Severe: rms_fgdepar=17.0467, expected range: -8.6745 14.7904
METAR 2M TEMPERATURE (K) KDOV : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-17.2773, expected range: -4.3595 2.3614
Severe: rms_fgdepar=17.2773, expected range: 0.0000 5.7149
LAND TEMP 2M TEMPERATURE (K) 72363 : out of range
Severe: avg_fgdepar=12.1791, expected range: -5.2427 5.6948
Severe: rms_fgdepar=12.1791, expected range: 0.0000 5.4141
LAND TEMP 2M TEMPERATURE (K) 89009 : out of range
Severe: avg_fgdepar=-12.7244, expected range: -15.8232 -0.5289
Severe: rms_fgdepar=12.7244, expected range: 0.5289 15.8232
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) : out of range
Considerable: obs_number=158.0000, expected range: 194.2005 256.5495
rh2m
MANUAL LAND SYNOP RH2M (%) 94463 : out of range
Severe: rms_fgdepar=33.0800, expected range: 0.0000 16.9929
MANUAL LAND SYNOP RH2M (%) 87648 : out of range
Severe: rms_fgdepar=34.9701, expected range: 0.0000 19.2361
METAR RH2M (%) CYJF : out of range
Severe: rms_fgdepar=34.7476, expected range: 0.0000 17.4285
BUFR LAND SYNOP RH2M (%) 94463 : out of range
Severe: rms_fgdepar=33.0148, expected range: 0.0000 17.2100