Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-10-04 00:00

atms
NPP ATMS RADIANCES CHANNEL 12 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.3048, expected range: -0.2750 -0.2527
Severely_persistent: avg_biascorr=-0.2956, expected range: -0.2092 -0.1816
NPP ATMS RADIANCES CHANNEL 10 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2136, expected range: -0.1940 -0.1728
NPP ATMS RADIANCES CHANNEL 8 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.6728, expected range: -0.6076 -0.5346
NOAA20 ATMS RADIANCES CHANNEL 7 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.3369, expected range: -0.3904 -0.3618
NOAA20 ATMS RADIANCES CHANNEL 12 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.3980, expected range: -0.3168 -0.3063
gpsro
All TERRASAR-X GPSRO SETTING ALL HEIGHTS Global : all data missing
Severe: obs_number=0, expected range: 74.68 718.04
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1-2 (HPA) : out of range
30 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.0115, expected range: -0.0078 -0.0030
METOP-B GOME-2 OZONE, TOP PRESSURE LAYER 12-13 (HPA) : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.7743, expected range: -0.9434 -0.9301
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1010-1011 (HPA) : out of range
18 times in the last 10 days for at least one item
Slight: avg_fgdepar=-3.7852, expected range: -3.3301 -3.3301
Radiosondes
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9960, expected range: -0.4715 0.6931
LAND TEMP Q (G/KG) 40373 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.2630, expected range: 0.0000 1.1936
LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=9.5873, expected range: 0.1792 5.1076
LAND TEMP WIND VECTOR DIFF (M/S) 40265 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.7837, expected range: 0.7890 5.9442
LAND TEMP TEMPERATURE (K) 91348 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.3297, expected range: 0.9438 2.5270
HIGH RESO LAND TEMP Q (G/KG) 60630 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.5018, expected range: 0.0000 1.1881
HIGH RESO LAND TEMP TEMPERATURE (K) 58203 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.3133, expected range: 0.0108 2.2563
HIGH RESO LAND TEMP TEMPERATURE (K) 72562 PRESSURE LAYER 900-1200 (HPA : out of range
Severe: rms_fgdepar=6.5322, expected range: 0.1387 3.0390
LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Considerable: rms_fgdepar=4.7103, expected range: 0.4668 3.0719
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : out of range
Considerable: obs_number=273.0000, expected range: 354.9802 375.4198
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) YMH2X3RA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=15.1970, expected range: 0.0388 4.7902
ADS-C WIND VECTOR DIFF (M/S) A3SKLBRA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=22.3916, expected range: 0.0000 24.6075
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 14472 PRESSURE LAYER 300-600 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8059, expected range: -1.1530 0.7500
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 97460 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=15.6389, expected range: 0.0000 7.3822
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 68392 : out of range
25 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8976, expected range: -0.6583 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 36736 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8661, expected range: -0.4871 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 89011 : out of range
Severe: avg_fgdepar=53.3364, expected range: -37.0726 62.0975
Severe: rms_fgdepar=53.3364, expected range: 0.0000 62.1060
MANUAL LAND SYNOP RH2M (%) 67581 : out of range
Severe: rms_fgdepar=34.8720, expected range: 0.0000 9.5918
MANUAL LAND SYNOP RH2M (%) 76122 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=53.8341, expected range: -50.3255 89.7056
Severe: rms_fgdepar=53.8341, expected range: 0.0000 89.7056
Severe: avg_pge=0.9941, expected range: -1.6829 0.7500
MANUAL LAND SYNOP RH2M (%) 38343 : out of range
Severe: rms_fgdepar=31.8226, expected range: 0.0000 10.9259
MANUAL LAND SYNOP RH2M (%) 87774 : out of range
Severe: rms_fgdepar=36.6051, expected range: 0.0000 7.0786
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 60690 : out of range
Severe: rms_fgdepar=497.0965, expected range: 0.0000 307.9434
Severe: avg_pge=0.8822, expected range: -0.5036 0.7177
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42415 : out of range
Severe: rms_fgdepar=575.8264, expected range: 0.0000 314.5747
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 67237 : out of range
Severe: rms_fgdepar=365.0428, expected range: 27.4016 191.6235
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62458 : out of range
Severe: rms_fgdepar=417.5691, expected range: 0.0000 134.0814
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40859 : out of range
Severe: rms_fgdepar=318.3862, expected range: 0.0000 73.3625
BUFR LAND SYNOP RH2M (%) 64040 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-52.1530, expected range: -66.5288 -31.4658
Severe: rms_fgdepar=52.1530, expected range: 31.6727 62.5855
BUFR LAND SYNOP RH2M (%) 76122 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=52.1856, expected range: -9.5764 62.5088
Severe: rms_fgdepar=52.1856, expected range: 0.0000 62.5088
Severe: avg_pge=0.9912, expected range: -1.5394 0.7500
BUFR LAND SYNOP RH2M (%) 72562 : out of range
Severe: rms_fgdepar=42.0814, expected range: 0.0000 23.5141
BUFR LAND SYNOP RH2M (%) 72662 : out of range
Severe: rms_fgdepar=35.6078, expected range: 0.0000 17.7515
BUFR LAND SYNOP RH2M (%) 81643 : out of range
Severe: avg_pge=0.9750, expected range: -0.7404 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 23992 : out of range
Severe: rms_fgdepar=344.6831, expected range: 0.0000 139.1556
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48085 : out of range
Severe: avg_fgdepar=619.0647, expected range: -121.8069 95.9099
Severe: rms_fgdepar=620.9107, expected range: 0.0000 142.1335
Severe: avg_pge=0.9116, expected range: -0.4005 0.5509
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48018 : out of range
Severe: rms_fgdepar=436.5201, expected range: 21.5219 155.5307
Severe: avg_pge=0.8664, expected range: -0.5987 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 57348 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=388.5902, expected range: 0.0000 163.9886
Severe: avg_pge=0.8692, expected range: -0.5906 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 13629 : out of range
Severe: avg_pge=0.8023, expected range: -0.9051 0.7500
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) YBBQ2 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=777.0498, expected range: 454.3229 1076.4970
Severely_persistent: rms_fgdepar=777.0498, expected range: 409.1352 1136.8747
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V3143 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1376.1611, expected range: 694.7988 1880.4954
Severely_persistent: rms_fgdepar=1379.2544, expected range: 695.6648 1881.7426
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRSJ8 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-502.9645, expected range: -719.2207 -448.7356
Severely_persistent: rms_fgdepar=514.2086, expected range: 449.6047 719.5489
BUFR SHIP SYNOP SURFACE PRESSURE (PA) KIAB : out of range
30 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=625.7250, expected range: 345.5599 1049.8082
Severely_persistent: rms_fgdepar=625.7250, expected range: 344.1567 1051.6044
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 3FNE4 : out of range
Severe: avg_fgdepar=26.4197, expected range: -11.7547 20.6049
Severe: rms_fgdepar=26.4197, expected range: 0.0000 20.6049
Severe: avg_pge=0.8884, expected range: -1.0232 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRFB8 : out of range
Severe: rms_fgdepar=18.6791, expected range: 0.0000 8.5328
Severe: avg_pge=0.9003, expected range: -0.8658 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA4612 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=1256.4119, expected range: -1084.1282 1352.2556
Severe: rms_fgdepar=1256.4119, expected range: 0.0000 988.2268
Severe: avg_pge=0.9176, expected range: -1.1142 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OWCM2 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=648.9999, expected range: -419.4646 265.4258
Severe: rms_fgdepar=648.9999, expected range: 0.0000 419.9043
Severe: avg_pge=0.8458, expected range: -1.1269 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VROO6 : out of range
Severe: avg_fgdepar=-542.7186, expected range: -154.0764 141.8978
Severe: rms_fgdepar=562.4549, expected range: 0.0000 268.8794
Severe: avg_pge=0.8395, expected range: -0.8848 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VTOT : out of range
Severe: avg_fgdepar=-854.1639, expected range: -701.9444 -65.1183
Severe: rms_fgdepar=854.1639, expected range: 60.1077 710.3454
Severe: avg_pge=0.8950, expected range: 0.4512 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) JPTX : out of range
Severe: rms_fgdepar=405.7049, expected range: 0.0000 100.4898
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 6501670 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8622, expected range: -0.5628 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6203843 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8394, expected range: -0.9461 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 3301581 : out of range
Severe: rms_fgdepar=374.5671, expected range: 0.0000 170.8673
Severe: avg_pge=0.8415, expected range: -0.5353 0.6291
DRIFTING BUOYS SURFACE PRESSURE (PA) 3301603 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=465.2213, expected range: -234.3604 328.8376
Severe: avg_pge=0.8807, expected range: -1.0671 0.7500
metar
METAR SURFACE PRESSURE (PA) FALA : out of range
Severe: rms_fgdepar=412.8728, expected range: 0.0000 171.3771
METAR SURFACE PRESSURE (PA) DAOF : out of range
Severe: rms_fgdepar=303.3730, expected range: 0.0000 171.0663
METAR SURFACE PRESSURE (PA) SLET : out of range
Severe: rms_fgdepar=360.6729, expected range: 0.0000 199.2737
METAR SURFACE PRESSURE (PA) EQAY : out of range
Severe: rms_fgdepar=473.6749, expected range: 0.0000 374.7179
Severe: avg_pge=0.8069, expected range: -0.8508 0.7500
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-746.4571, expected range: -798.2426 -760.9589
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=747.0572, expected range: 761.1755 798.1022
MANUAL LAND SYNOP SNOW (CM) 31004 : out of range
Severe: rms_fgdepar=15.5186, expected range: 0.0000 5.2594
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71052 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-18.0196, expected range: -19.0274 -4.2424
Severely_persistent: rms_fgdepar=18.0552, expected range: 4.1710 19.3708
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1D122 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=14.1222, expected range: -16.1018 20.0663
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1D122 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=14.2854, expected range: -11.1701 19.9706
BUFR LAND SYNOP 2M TEMPERATURE (K) 71052 : out of range
22 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-18.0025, expected range: -19.3469 -4.2674
Severely_persistent: rms_fgdepar=18.0482, expected range: 4.2053 19.6677
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 11310 : out of range
Severe: rms_fgdepar=10.0991, expected range: 0.0000 5.1475
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 52836 : out of range
Severe: avg_fgdepar=12.3719, expected range: -14.7411 18.3827
Severe: rms_fgdepar=12.3719, expected range: 0.0000 14.0494
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 51076 : out of range
Severe: avg_fgdepar=12.0733, expected range: -11.3763 13.2325
Severe: rms_fgdepar=12.0733, expected range: 0.0000 9.7177
METAR 2M TEMPERATURE (K) KEVB : out of range
Severe: rms_fgdepar=11.1528, expected range: 0.1414 3.8004
METAR 2M TEMPERATURE (K) KFMY : out of range
Severe: avg_fgdepar=-17.7123, expected range: -0.0369 4.3512
Severe: rms_fgdepar=17.7123, expected range: 0.8158 4.8018
BUFR LAND SYNOP 2M TEMPERATURE (K) 06750 : out of range
Severe: rms_fgdepar=10.3899, expected range: 0.0000 4.0423
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI19890 : out of range
Severe: rms_fgdepar=10.2151, expected range: 0.0000 4.2237
BUFR LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=12.2075, expected range: 0.2345 14.2154
Severe: rms_fgdepar=12.2535, expected range: 1.3756 13.8169
BUFR LAND SYNOP 2M TEMPERATURE (K) _1701B45 : out of range
Severe: rms_fgdepar=10.1437, expected range: 0.1283 5.3542
BUFR LAND SYNOP 2M TEMPERATURE (K) 06799 : out of range
Severe: avg_fgdepar=13.3586, expected range: -2.2478 5.9080
Severe: rms_fgdepar=13.3700, expected range: 0.0000 5.7004
BUFR LAND SYNOP 2M TEMPERATURE (K) _1701F9F : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=12.5634, expected range: -5.6950 20.0875
BUFR LAND SYNOP 2M TEMPERATURE (K) _1701F9F : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=13.5636, expected range: 0.8214 18.1582
rh2m
MANUAL LAND SYNOP RH2M (%) 40833 : out of range
Severe: rms_fgdepar=33.7443, expected range: 0.0000 15.3595
METAR RH2M (%) PALP : out of range
Severe: rms_fgdepar=30.4384, expected range: 0.0000 14.6377
BUFR LAND SYNOP RH2M (%) _1701B45 : out of range
Severe: rms_fgdepar=38.2351, expected range: 0.0000 18.3361
BUFR LAND SYNOP RH2M (%) _MF1638B : out of range
Severe: rms_fgdepar=31.4653, expected range: 0.4446 16.0867
BUFR LAND SYNOP RH2M (%) _MI143DE : out of range
Severe: rms_fgdepar=31.0776, expected range: 1.5887 17.6716