Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-07-12 00:00

iasi
METOP-B IASI RADIANCES (11 channels affected) : out of range
Considerable: stdev_fgdepar=0.4848, expected range: 0.2976 0.4222
METOP-B IASI RADIANCES CHANNEL 101 : out of range
2 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.5473, expected range: 0.4375 0.5056
saphir
All MEGHA-TROPIQUES SAPHIR ALLSKY ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 1209.98 17481.72
atms
NOAA20 ATMS RADIANCES CHANNEL 15 : out of range
Considerable: avg_biascorr=-0.2045, expected range: -0.2411 -0.2171
gpsro
All KOMPSAT-5 GPSRO SETTING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 217.54 845.82
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 20-21 (HPA) : out of range
25 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=0.0148, expected range: 0.0093 0.0113
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 30-31 (HPA) : out of range
8 times in the last 10 days for at least one item
Slight: stdev_fgdepar=0.0237, expected range: 0.0209 0.0209
Radiosondes
LAND TEMP TEMPERATURE (K) 40754 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=10.4572, expected range: 0.3165 2.4892
LAND TEMP WIND VECTOR DIFF (M/S) 21824 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=18.4399, expected range: 0.0000 5.6837
HIGH RESO LAND TEMP TEMPERATURE (K) 71823 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=7.8807, expected range: 0.3863 1.6159
HIGH RESO LAND TEMP TEMPERATURE (K) 57083 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=7.3694, expected range: 0.3562 2.4008
HIGH RESO LAND TEMP TEMPERATURE (K) (3 pressure layers affected) : missing
2 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 176.9257 196.0743
Severe: obs_number=0.0000, expected range: 176.9257 196.0743
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 51656 PRESSURE LAYER 0-300 : out of range
Severe: avg_fgdepar=20.7520, expected range: -0.9391 6.1366
Severe: rms_fgdepar=20.7520, expected range: 0.0000 7.0201
Severe: avg_pge=0.8689, expected range: -0.0777 0.1257
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 72363 PRESSURE LAYER 600-90 : out of range
Severe: rms_fgdepar=18.8835, expected range: 0.0000 8.1509
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 54857 PRESSURE LAYER 600-90 : out of range
Severe: rms_fgdepar=15.2074, expected range: 0.0000 7.7037
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA : out of range
Severe: avg_fgdepar=9.5954, expected range: 1.1965 4.4049
Severe: rms_fgdepar=15.6126, expected range: 1.1355 5.3522
HIGH RESO LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: rms_fgdepar=3.0999, expected range: 0.2622 1.9137
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=217.0000, expected range: 14.4160 106.8340
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: obs_number=237.0000, expected range: 261.9901 284.5099
amdar
AMDAR WIND VECTOR DIFF (M/S) JP9ZV859 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=18.0897, expected range: 0.0000 7.0638
WIGOS AMDAR WIND VECTOR DIFF (M/S) KVNWUUBA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=16.3495, expected range: 0.0000 8.8598
Severe: avg_pge=0.8252, expected range: -0.4807 0.7500
WIGOS AMDAR TEMPERATURE (K) KVNWUUBA PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_pge=0.9315, expected range: -0.5011 0.7500
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) (2 pressure layers affected) : out of range
Considerable: obs_number=719.0000, expected range: 1025.9766 1194.8806
Considerable: obs_number=719.0000, expected range: 1025.9766 1194.8806
synop
AUTOMATIC LAND SYNOP RH2M (%) 35182 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-50.3150, expected range: -72.0932 -19.4809
Severely_persistent: rms_fgdepar=50.3150, expected range: 22.2696 63.8229
Severely_persistent: avg_pge=0.9999, expected range: -1.6854 0.7500
MANUAL LAND SYNOP RH2M (%) 68098 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=57.2090, expected range: -128.8759 182.2834
Severely_persistent: rms_fgdepar=57.2090, expected range: -128.8759 182.2834
Severely_persistent: avg_pge=0.9629, expected range: -2.1831 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43012 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8117, expected range: -0.8662 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48921 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=577.9177, expected range: 0.0000 1118.2337
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72494 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8340, expected range: 0.7544 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72327 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8634, expected range: 0.8454 0.7500
MANUAL LAND SYNOP Z (M) 67665 : out of range
Severe: rms_fgdepar=220.6358, expected range: 0.0000 122.3793
MANUAL LAND SYNOP RH2M (%) 67261 : out of range
Severe: rms_fgdepar=42.5915, expected range: 0.0000 15.0096
Severe: avg_pge=0.9936, expected range: -0.0006 0.0067
MANUAL LAND SYNOP RH2M (%) 35067 : out of range
Severe: rms_fgdepar=39.0118, expected range: 0.0000 11.7006
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42441 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8830, expected range: -1.7191 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40646 : out of range
Severe: rms_fgdepar=403.9827, expected range: 0.0000 76.1529
Severe: avg_pge=0.8665, expected range: 0.0000 0.0000
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 67327 : out of range
Severe: avg_fgdepar=-1074.6930, expected range: -251.2405 19.3906
Severe: rms_fgdepar=1076.6864, expected range: 0.0000 253.7679
Severe: avg_pge=0.9472, expected range: -0.5528 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40818 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=396.9508, expected range: 0.0000 123.5024
BUFR LAND SYNOP Z (M) 56172 : out of range
Severe: avg_pge=0.9361, expected range: -1.4028 0.7500
BUFR LAND SYNOP RH2M (%) 72421 : out of range
Severe: rms_fgdepar=36.4280, expected range: 0.0000 13.6187
BUFR LAND SYNOP RH2M (%) 71752 : out of range
Severe: rms_fgdepar=30.2244, expected range: 0.0000 16.9133
BUFR LAND SYNOP RH2M (%) 94323 : out of range
Severe: rms_fgdepar=35.7292, expected range: 0.0000 16.0077
BUFR LAND SYNOP RH2M (%) 60253 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=51.4405, expected range: -57.3423 118.9333
Severe: rms_fgdepar=51.4405, expected range: 0.0000 118.9333
Severe: avg_pge=0.9989, expected range: -1.9087 0.7500
BUFR LAND SYNOP RH2M (%) 94215 : out of range
Severe: avg_fgdepar=59.1375, expected range: -6.1056 14.0630
Severe: rms_fgdepar=59.1375, expected range: 0.0000 14.0630
Severe: avg_pge=1.0000, expected range: 0.0015 0.0040
BUFR LAND SYNOP RH2M (%) 25469 : out of range
Severe: rms_fgdepar=43.4217, expected range: 0.0000 21.1010
BUFR LAND SYNOP SURFACE PRESSURE (PA) 13622 : out of range
Severe: avg_pge=0.8959, expected range: -1.0018 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 22546 : out of range
Severe: rms_fgdepar=405.4032, expected range: 0.0000 119.1618
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48938 : out of range
Severe: rms_fgdepar=664.2556, expected range: 0.0000 195.4573
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72259 : out of range
Severe: rms_fgdepar=334.2897, expected range: 0.0000 113.1749
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33299 : out of range
Severe: rms_fgdepar=452.8873, expected range: 0.0000 193.5470
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) AUBC : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8896, expected range: 0.8253 0.7500
All BUFR SHIP SYNOP WMO BLOCK 41 : all data missing
Severely_persistent: obs_number=0, expected range: 277.50 333.50
All BUFR SHIP SYNOP WMO BLOCK 42 : all data missing
Severely_persistent: obs_number=0, expected range: 242.12 360.71
All BUFR SHIP SYNOP WMO BLOCK 51 : all data missing
Severely_persistent: obs_number=0, expected range: 71.61 130.05
SHIP SURFACE PRESSURE (PA) 9V6212 : out of range
Severe: avg_fgdepar=-945.4793, expected range: -324.9913 151.2658
Severe: rms_fgdepar=945.4793, expected range: 0.0000 295.6383
SHIP SURFACE PRESSURE (PA) OUOW2 : out of range
Severe: avg_fgdepar=-631.0916, expected range: -1347.0091 1454.6017
Severe: rms_fgdepar=631.0916, expected range: 0.0000 968.8368
SHIP SURFACE PRESSURE (PA) V7WS4 : out of range
Severe: avg_fgdepar=657.7070, expected range: -427.6580 1964.5405
Severe: rms_fgdepar=657.7070, expected range: 0.0000 1964.5405
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V6212 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-945.4793, expected range: -362.9296 205.3692
Severe: rms_fgdepar=945.4793, expected range: 0.0000 311.2252
Severe: avg_pge=0.9011, expected range: -0.8286 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRGO2 : out of range
Severe: avg_fgdepar=509.4608, expected range: 212.6675 775.7462
Severe: rms_fgdepar=521.1800, expected range: 215.2271 778.1441
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OUOW2 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-631.0916, expected range: -1145.3364 1274.1679
Severe: rms_fgdepar=631.0916, expected range: 0.0000 826.2730
Severe: avg_pge=0.8462, expected range: -1.0946 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7WS4 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=657.7070, expected range: 24.4192 1630.9082
Severe: rms_fgdepar=657.7070, expected range: 24.4192 1630.9082
Severe: avg_pge=0.8408, expected range: 0.4897 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) KABL : out of range
Severe: rms_fgdepar=329.4712, expected range: 0.0000 130.5427
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 5501594 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-503.5606, expected range: -1341.4307 1238.4415
Severely_persistent: rms_fgdepar=545.2747, expected range: -1042.2337 1331.8171
DRIFTING BUOYS SURFACE PRESSURE (PA) 1501748 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-638.6280, expected range: -424.8884 374.8577
Severely_persistent: rms_fgdepar=641.4566, expected range: -359.5096 481.9699
Severely_persistent: avg_pge=0.9069, expected range: -0.6125 0.7500
DRIBU SURFACE PRESSURE (PA) 23491 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8220, expected range: -0.1927 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6203703 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=330.4359, expected range: 0.0000 88.8868
MOORED BUOYS SURFACE PRESSURE (PA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=266.0000, expected range: 231.2302 251.5198
metar
METAR SURFACE PRESSURE (PA) OIBH : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-542.6358, expected range: -735.3654 -107.0651
Severely_persistent: rms_fgdepar=546.6781, expected range: 113.1047 735.9546
METAR SURFACE PRESSURE (PA) FNSA : out of range
Severe: avg_fgdepar=-527.9039, expected range: -689.0480 845.3466
Severe: rms_fgdepar=527.9039, expected range: 0.0000 545.6044
METAR SURFACE PRESSURE (PA) FBKE : out of range
Severe: rms_fgdepar=390.1153, expected range: 0.0000 152.2999
AUTOMATIC METAR SURFACE PRESSURE (PA) KF00 : out of range
Severe: rms_fgdepar=384.5431, expected range: 0.0000 166.7927
AUTOMATIC METAR SURFACE PRESSURE (PA) K4O4 : out of range
Severe: rms_fgdepar=342.0589, expected range: 2.7097 144.5109
AUTOMATIC METAR SURFACE PRESSURE (PA) KDUA : out of range
Severe: rms_fgdepar=458.1271, expected range: 0.0000 227.6728
AUTOMATIC METAR SURFACE PRESSURE (PA) KTKI : out of range
Severe: rms_fgdepar=350.3848, expected range: 0.0000 102.9927
AUTOMATIC METAR SURFACE PRESSURE (PA) KGYI : out of range
Severe: rms_fgdepar=422.4217, expected range: 0.0000 135.6186
AUTOMATIC METAR SURFACE PRESSURE (PA) KTXK : out of range
Severe: rms_fgdepar=307.3033, expected range: 0.0000 119.1769
AUTOMATIC METAR SURFACE PRESSURE (PA) KDEQ : out of range
Severe: rms_fgdepar=340.9862, expected range: 0.0000 161.1946
AUTOMATIC METAR SURFACE PRESSURE (PA) KAQR : out of range
Severe: rms_fgdepar=493.8838, expected range: 0.0000 279.6475
AUTOMATIC METAR SURFACE PRESSURE (PA) KADS : out of range
Severe: rms_fgdepar=346.4608, expected range: 0.0000 112.9732
AUTOMATIC METAR SURFACE PRESSURE (PA) KGVT : out of range
Severe: rms_fgdepar=310.2961, expected range: 0.0000 146.4990
AUTOMATIC METAR SURFACE PRESSURE (PA) KPRX : out of range
Severe: rms_fgdepar=405.1493, expected range: 0.0000 140.8562
AUTOMATIC METAR SURFACE PRESSURE (PA) KMEZ : out of range
Severe: rms_fgdepar=307.9310, expected range: 0.0000 159.4170
snow
BUFR LAND SYNOP SNOW (CM) 01035 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=82.7950, expected range: 73.9475 125.3388
Severely_persistent: rms_fgdepar=82.7950, expected range: 73.9506 125.3390
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 68817 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=17.4997, expected range: -6.4944 13.1066
Severely_persistent: rms_fgdepar=17.5059, expected range: 0.0000 13.1144
Severely_persistent: avg_est_pge=0.8358, expected range: -0.4804 0.9286
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.0374, expected range: -14.7568 -2.8554
Severely_persistent: rms_fgdepar=14.0850, expected range: 2.8916 14.8107
Severely_persistent: avg_est_pge=0.8705, expected range: 0.5836 0.9610
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
28 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-18.2140, expected range: -21.0377 -13.4647
Severely_persistent: rms_fgdepar=18.2197, expected range: 13.5424 21.0034
BUFR LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.5353, expected range: -14.7676 -2.8836
Severely_persistent: rms_fgdepar=14.5960, expected range: 2.9336 14.8145
Severely_persistent: avg_est_pge=0.8746, expected range: 0.5915 0.9537
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89625 : out of range
4 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8210, expected range: -0.0919 1.1068
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89828 : out of range
3 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8205, expected range: -0.1805 1.1383
METAR 2M TEMPERATURE (K) MHLC : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=11.5739, expected range: 0.0680 5.2622
METAR 2M TEMPERATURE (K) ETAR : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=11.0366, expected range: 0.0103 4.8256
BUFR LAND SYNOP 2M TEMPERATURE (K) 89828 : out of range
3 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8195, expected range: -0.1095 1.0870
rh2m
MANUAL LAND SYNOP RH2M (%) 34871 : out of range
Severe: rms_fgdepar=33.8665, expected range: 0.0000 18.5775
MANUAL LAND SYNOP RH2M (%) 25378 : out of range
Severe: rms_fgdepar=30.7512, expected range: 0.0000 15.3973