Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-11-16 00:00

AMSUA Pacific RARS
All NOAA-18 AMSUA ALL SKY CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 359.87 1681.12
All NOAA-19 AMSUA ALL SKY CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 114.61 1466.89
iasi
METOP-B IASI RADIANCES (220 channels affected) : out of range
Severe: obs_number=15698.0000, expected range: 22888.3037 23095.3213
gpsro
All KOMPSAT-5 GPSRO SETTING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 184.24 921.16
Atmospheric Motion Vector
All HIMAWARI-8 AMV CLOUDY WV3 ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 256.69 867.14
Radiosondes
LAND TEMP Q (G/KG) 41891 PRESSURE LAYER 600-900 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=2.9896, expected range: 0.0000 1.2754
LAND TEMP TEMPERATURE (K) 41977 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_fgdepar=-9.6196, expected range: -0.7672 1.4090
Severe: avg_pge=0.9128, expected range: -0.5560 0.7500
LAND TEMP TEMPERATURE (K) 24908 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.4827, expected range: 0.0000 3.4484
LAND TEMP TEMPERATURE (K) 30054 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=7.7143, expected range: 0.0000 2.3418
Severe: avg_pge=0.8441, expected range: -0.6028 0.7500
HIGH RESO LAND TEMP Q (G/KG) 07645 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.1496, expected range: 0.0229 1.4079
HIGH RESO LAND TEMP TEMPERATURE (K) 01241 PRESSURE LAYER 900-1200 (HPA : out of range
Severe: rms_fgdepar=6.0331, expected range: 0.0000 2.5241
amdar
WIGOS AMDAR TEMPERATURE (K) CNNMWQ PRESSURE LAYER 300-600 (HPA) : out of range
9 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=9.7422, expected range: 0.0000 23.1920
Severely_persistent: avg_pge=0.8421, expected range: -0.0535 0.7500
WIGOS AMDAR TEMPERATURE (K) CNSSQK PRESSURE LAYER 300-600 (HPA) : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8364, expected range: -0.3183 0.7500
WIGOS AMDAR TEMPERATURE (K) CNLQPP PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_fgdepar=-11.6975, expected range: -14.9317 6.7493
Severe: rms_fgdepar=11.6975, expected range: 0.0000 18.6057
Severe: avg_pge=0.9099, expected range: -0.6529 0.7500
WIGOS AMDAR TEMPERATURE (K) CNNKXR PRESSURE LAYER 300-600 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.9492, expected range: -17.3396 10.6863
Severe: rms_fgdepar=12.9492, expected range: 0.0000 17.5862
Severe: avg_pge=0.9142, expected range: -0.5238 0.7500
WIGOS AMDAR TEMPERATURE (K) 0J2IC1RA PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=8.3300, expected range: 0.0000 3.2934
Severe: avg_pge=0.8439, expected range: -1.0775 0.7500
WIGOS AMDAR TEMPERATURE (K) WFRKIEZA PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=7.3744, expected range: 0.0000 3.5182
Severe: avg_pge=0.8683, expected range: -0.6873 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU1039 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=17.3872, expected range: 0.0000 9.1277
ADS-C WIND VECTOR DIFF (M/S) 2CGXUXJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.7832, expected range: 0.0000 8.3907
ADS-C WIND VECTOR DIFF (M/S) LBNQYFJQ PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=20.0173, expected range: -3.4179 10.5332
Severe: rms_fgdepar=36.8719, expected range: 0.0000 12.2637
ADS-C WIND VECTOR DIFF (M/S) 2QNYLZBA PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=16.7373, expected range: 0.0000 6.4419
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 01405 PRESSURE LAYER 600-900 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=22.2854, expected range: 1.6532 7.5136
Severe: rms_fgdepar=22.5653, expected range: 1.8599 9.1923
Severe: avg_pge=0.8761, expected range: -0.5190 0.7500
JAPANESE WIND PROFILER VECTOR DIFF (M/S) 47423 PRESSURE LAYER 300-600 : out of range
Severe: rms_fgdepar=17.1077, expected range: 0.0000 9.9665
Severe: avg_pge=0.8590, expected range: -0.2177 0.3641
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 42647 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=25.0372, expected range: -41.3608 54.3398
LAND PILOT WIND VECTOR DIFF (M/S) 42299 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=22.2502, expected range: 0.7499 5.2665
synop
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 63450 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8029, expected range: -1.8501 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 63533 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=529.9698, expected range: -1316.8353 1488.2037
Severely_persistent: rms_fgdepar=532.3320, expected range: -929.1659 1292.7117
Severely_persistent: avg_pge=0.8530, expected range: -1.7038 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83522 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8053, expected range: 0.6298 0.7500
MANUAL LAND SYNOP RH2M (%) 65125 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9785, expected range: -1.3324 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48988 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8029, expected range: -1.5466 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 81797 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=593.6550, expected range: 482.1233 716.7206
Severely_persistent: rms_fgdepar=593.7439, expected range: 482.2792 717.2856
BUFR LAND SYNOP SURFACE PRESSURE (PA) 84825 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-512.2568, expected range: -677.7824 -394.1972
Severely_persistent: rms_fgdepar=514.3069, expected range: 396.3091 677.8686
BUFR LAND SYNOP SURFACE PRESSURE (PA) 23471 : out of range
Severe: rms_fgdepar=365.6207, expected range: 0.0000 175.6810
BUFR LAND SYNOP SURFACE PRESSURE (PA) 28097 : out of range
Severe: rms_fgdepar=575.9392, expected range: 0.0000 150.6471
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33376 : out of range
Severe: rms_fgdepar=473.5264, expected range: 0.0000 139.2007
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33377 : out of range
Severe: rms_fgdepar=445.2050, expected range: 0.0000 153.9815
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33621 : out of range
Severe: rms_fgdepar=521.3738, expected range: 0.0000 106.8283
BUFR LAND SYNOP SURFACE PRESSURE (PA) 34740 : out of range
Severe: rms_fgdepar=437.2778, expected range: 0.0000 125.4395
BUFR LAND SYNOP SURFACE PRESSURE (PA) 38223 : out of range
Severe: rms_fgdepar=382.2339, expected range: 0.0000 160.1495
BUFR LAND SYNOP SURFACE PRESSURE (PA) 91772 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8352, expected range: -1.2460 0.7500
BUFR LAND SYNOP RH2M (%) 94213 : out of range
Severe: avg_pge=0.9977, expected range: -0.0594 0.0846
ship
AUTOMATIC SHIP WIND VECTOR DIFF (M/S) 62153 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8656, expected range: -0.6288 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) WDM2180 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8627, expected range: -0.1152 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 7JWH : out of range
21 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=520.2395, expected range: -635.1433 1507.9831
Severely_persistent: rms_fgdepar=520.2755, expected range: 0.0000 1337.2124
Severely_persistent: avg_pge=0.8062, expected range: -0.8275 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) LAON8 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=494.3577, expected range: 0.0000 449.7770
Severely_persistent: avg_pge=0.8749, expected range: -1.2472 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OXLD2 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=553.6045, expected range: -1174.8189 1674.3564
Severely_persistent: rms_fgdepar=553.6045, expected range: 0.0000 1572.2552
Severely_persistent: avg_pge=0.8120, expected range: -1.7125 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WYQ4356 : out of range
26 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=735.4514, expected range: -1907.9731 2369.0705
Severely_persistent: rms_fgdepar=740.3051, expected range: -1575.9333 2332.7148
Severely_persistent: avg_pge=0.8587, expected range: -1.5487 0.7500
SHIP WIND VECTOR DIFF (M/S) 9HA3047 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=18.3756, expected range: 0.0000 10.1931
Severe: avg_pge=0.9172, expected range: -1.0078 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) A8IF2 : out of range
Severe: rms_fgdepar=17.3198, expected range: 0.7858 9.0201
Severe: avg_pge=0.8743, expected range: -0.9460 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRCZ7 : out of range
Severe: avg_pge=0.8082, expected range: -0.2584 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 3EFK6 : out of range
Severe: avg_fgdepar=646.5640, expected range: -485.4953 162.8051
Severe: rms_fgdepar=646.5640, expected range: 0.0000 486.4482
Severe: avg_pge=0.8384, expected range: -0.7359 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 3FYD4 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=522.4741, expected range: -252.0562 1344.5782
Severe: rms_fgdepar=522.4741, expected range: 0.0000 1295.6280
Severe: avg_pge=0.8101, expected range: -0.7290 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V6814 : out of range
Severe: avg_fgdepar=571.9815, expected range: -448.1143 803.5087
Severe: rms_fgdepar=571.9815, expected range: 0.0000 636.7807
Severe: avg_pge=0.8201, expected range: -0.7437 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6RZ7 : out of range
Severe: rms_fgdepar=529.6096, expected range: 0.0000 203.2929
BUFR SHIP SYNOP SURFACE PRESSURE (PA) D5BF7 : out of range
Severe: rms_fgdepar=466.6448, expected range: 0.0000 455.7680
Severe: avg_pge=0.8004, expected range: -0.7135 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7QT7 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=595.0031, expected range: -579.2376 816.1005
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRJM6 : out of range
Severe: avg_fgdepar=779.3329, expected range: -160.3092 651.9745
Severe: rms_fgdepar=779.3329, expected range: 0.0000 606.1957
Severe: avg_pge=0.8721, expected range: -0.5705 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WDK7414 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-830.2668, expected range: -780.5086 290.0626
Severe: rms_fgdepar=830.2668, expected range: 0.0000 780.5086
Severe: avg_pge=0.8941, expected range: -1.1196 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 1301612 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-501.8046, expected range: -614.8735 692.0556
Severely_persistent: rms_fgdepar=501.8828, expected range: -634.9613 880.0748
Severely_persistent: avg_pge=0.9003, expected range: -1.4368 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 3301615 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8428, expected range: -1.3986 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101718 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=578.0140, expected range: -591.0589 704.0939
Severely_persistent: rms_fgdepar=579.6009, expected range: -623.7362 834.8805
Severely_persistent: avg_pge=0.9020, expected range: -1.4978 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6204562 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-542.9238, expected range: -727.4279 650.6179
Severely_persistent: rms_fgdepar=545.2679, expected range: -657.4196 917.4614
Severely_persistent: avg_pge=0.9045, expected range: -1.3117 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6501679 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8548, expected range: -1.1904 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 2101836 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8609, expected range: -0.9259 0.7500
metar
METAR SURFACE PRESSURE (PA) GOSM : out of range
Severe: rms_fgdepar=437.3751, expected range: 0.0000 183.1428
METAR SURFACE PRESSURE (PA) LPOV : out of range
Severe: rms_fgdepar=556.9324, expected range: 0.0000 149.0291
METAR SURFACE PRESSURE (PA) MMPG : out of range
Severe: rms_fgdepar=540.5841, expected range: 0.0000 227.0867
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-790.2392, expected range: -794.3763 -781.5984
Severely_persistent: rms_fgdepar=790.2454, expected range: 781.7291 794.2946
BUFR LAND SYNOP SNOW (CM) _MI17AC6 : out of range
30 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-72.4084, expected range: -78.8738 -29.1514
Severely_persistent: rms_fgdepar=72.4188, expected range: 29.1845 78.8877
BUFR LAND SYNOP SNOW (CM) : out of range
3 times in the last 10 days for at least one item
Slight: avg_fgdepar=-54.2741, expected range: -47.7412 -33.8162
Slight: rms_fgdepar=401.3830, expected range: 319.6036 381.0097
t2m
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1D581 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-16.3648, expected range: -19.7852 -10.4705
Severely_persistent: rms_fgdepar=16.3658, expected range: 10.4242 19.9010
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 94619 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.2318, expected range: -15.6119 11.1164
Severe: rms_fgdepar=12.2418, expected range: 0.0000 12.2760
MANUAL LAND SYNOP 2M TEMPERATURE (K) 22798 : out of range
Severe: rms_fgdepar=10.5864, expected range: 0.0000 3.7588
MANUAL LAND SYNOP 2M TEMPERATURE (K) 94619 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-13.5518, expected range: -12.9648 9.3630
Severe: rms_fgdepar=13.5518, expected range: 0.0000 11.4368
METAR 2M TEMPERATURE (K) EFHA : out of range
Severe: avg_fgdepar=16.2398, expected range: -3.2221 3.3997
Severe: rms_fgdepar=16.2398, expected range: 0.0000 2.5041
METAR 2M TEMPERATURE (K) ESPE : out of range
Severe: rms_fgdepar=11.5315, expected range: 0.0000 5.8572
METAR 2M TEMPERATURE (K) LTBD : out of range
Severe: rms_fgdepar=10.0835, expected range: 0.3170 5.3613
BUFR LAND SYNOP 2M TEMPERATURE (K) 02031 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-17.0261, expected range: -7.9627 5.7995
Severe: rms_fgdepar=17.0368, expected range: 0.0000 8.1195
BUFR LAND SYNOP 2M TEMPERATURE (K) 02036 : out of range
Severe: avg_fgdepar=-16.1046, expected range: -8.7265 8.3008
Severe: rms_fgdepar=16.1207, expected range: 0.0000 8.2919
BUFR LAND SYNOP 2M TEMPERATURE (K) 94619 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.5018, expected range: -14.9957 10.4514
Severe: rms_fgdepar=12.5196, expected range: 0.0000 12.0259
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI176D9 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=13.5406, expected range: 1.0912 16.0358
Severe: rms_fgdepar=13.6030, expected range: 1.4141 16.2038
rh2m
AUTOMATIC LAND SYNOP RH2M (%) 02019 : out of range
Severe: rms_fgdepar=34.4013, expected range: 0.0000 19.3350
MANUAL LAND SYNOP RH2M (%) 27393 : out of range
Severe: rms_fgdepar=32.3416, expected range: 0.0000 17.7589
BUFR LAND SYNOP RH2M (%) 01183 : out of range
Severe: rms_fgdepar=37.3790, expected range: 0.4491 13.0928