Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-01-16 00:00

iasi
METOP-A IASI RADIANCES CHANNEL 2019 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.0608, expected range: -0.0444 -0.0173
cris
NPP CRIS RADIANCES CHANNEL 118 : out of range
Slight: obs_number=4843.0000, expected range: 3741.2441 4705.5559
NPP CRIS RADIANCES CHANNEL 121 : out of range
Slight: obs_number=4771.0000, expected range: 3694.0440 4657.6893
NPP CRIS RADIANCES CHANNEL 123 : out of range
Slight: obs_number=4674.0000, expected range: 3579.6210 4557.4456
NOAA20 CRIS RADIANCES CHANNEL 912 : out of range
Slight: obs_number=5603.0000, expected range: 4501.7655 5489.3012
NOAA20 CRIS RADIANCES CHANNEL 915 : out of range
Slight: obs_number=6365.0000, expected range: 5015.8286 6163.3714
NOAA20 CRIS RADIANCES CHANNEL 929 : out of range
Slight: obs_number=5740.0000, expected range: 4586.0874 5602.8460
NOAA20 CRIS RADIANCES CHANNEL 949 : out of range
Slight: obs_number=6251.0000, expected range: 4955.8563 6041.8770
NOAA20 CRIS RADIANCES CHANNEL 963 : out of range
Slight: obs_number=6852.0000, expected range: 5399.7275 6602.4058
NOAA20 CRIS RADIANCES CHANNEL 965 : out of range
Slight: obs_number=6602.0000, expected range: 5225.3253 6381.7414
NOAA20 CRIS RADIANCES CHANNEL 981 : out of range
Slight: obs_number=7418.0000, expected range: 5847.2383 7229.8284
NOAA20 CRIS RADIANCES CHANNEL 991 : out of range
Slight: obs_number=6786.0000, expected range: 5345.2152 6548.3848
NOAA20 CRIS RADIANCES CHANNEL 993 : out of range
Slight: obs_number=6916.0000, expected range: 5444.7341 6680.7326
airs
AQUA AIRS RADIANCES CHANNEL 1424 : out of range
Slight: obs_number=6532.0000, expected range: 5305.3851 6261.2816
AQUA AIRS RADIANCES CHANNEL 1794 : out of range
Slight: obs_number=1182.0000, expected range: 3529.9597 17856.6710
mhs
METOP-B MHS ALLSKY RADIANCES CHANNEL 4 : out of range
Considerable: stdev_norm_fgdepar=0.4572, expected range: 0.4820 0.5722
mwhs
FY-3B MWHS RADIANCES CHANNEL 3 : out of range
Severe: avg_fgdepar=0.0775, expected range: -0.0462 -0.0324
Severe: obs_number=211.0000, expected range: 14.2993 118.4413
FY-3B MWHS RADIANCES CHANNEL 4 : out of range
Severe: stdev_fgdepar=0.9224, expected range: 0.5899 0.7730
Severe: obs_number=211.0000, expected range: 14.2993 118.4413
Atmospheric Motion Vector
METEOSAT-8 AMV CLOUDY WV1 WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-60 : out of range
Slight: stdev_press=28.6395, expected range: 25.2779 27.8333
GOES-16 AMV VIS1 WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : out of range
Slight: stdev_press=55.0537, expected range: 49.0780 54.5009
Radiosondes
LAND TEMP TEMPERATURE (K) 30758 PRESSURE LAYER 900-1200 (HPA) : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9016, expected range: 0.3181 0.7500
LAND TEMP TEMPERATURE (K) 24688 PRESSURE LAYER 900-1200 (HPA) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8072, expected range: 0.3065 0.7500
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 67 : all data missing
Severely_persistent: obs_number=0, expected range: 83.83 147.84
All HIGH RESO SEA TEMP ALL LAYERS Tropics : all data missing
Severely_persistent: obs_number=0, expected range: 84.31 123.69
All HIGH RESO SEA TEMP ALL LAYERS Alantic Tropical are : all data missing
Severely_persistent: obs_number=0, expected range: 84.31 123.69
LAND TEMP TEMPERATURE (K) 43285 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.6012, expected range: 0.0000 3.0827
HIGH RESO LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=3.9470, expected range: 0.6730 1.6936
HIGH RESO LAND TEMP TEMPERATURE (K) 78954 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=8.2892, expected range: 0.3282 1.7394
HIGH RESO LAND TEMP TEMPERATURE (K) 53068 PRESSURE LAYER 900-1200 (HPA : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8804, expected range: 0.2675 0.7500
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 56651 PRESSURE LAYER 300-60 : out of range
Severe: avg_pge=0.8058, expected range: -0.8287 0.7500
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (4 pressure layers affected : out of range
Severe: obs_number=151.0000, expected range: 256.9506 332.7637
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
2 times in the last 10 days for at least one item
Severe: obs_number=284.0000, expected range: 383.6737 416.0406
Severe: obs_number=135.0000, expected range: 65.2530 69.0327
Severe: obs_number=127.0000, expected range: 61.8274 67.1726
Severe: obs_number=265.0000, expected range: 191.0556 202.7222
HIGH RESO LAND TEMP Q (G/KG) 76458 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.9865, expected range: 0.7112 1.8987
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
Severe: obs_number=378.0000, expected range: 271.5082 289.6347
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 88 : all data missing
Severe: obs_number=0, expected range: 132.22 152.92
All HIGH RESO LAND TEMP ALL LAYERS South Atlantic : all data missing
Severe: obs_number=0, expected range: 132.22 152.92
HIGH RESO SEA TEMP Q (G/KG) (2 pressure layers affected) : out of range
Severe: obs_number=139.0000, expected range: 187.8274 193.1726
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 300-600 (HPA) : out of range
Considerable: obs_number=83.0000, expected range: 90.3755 100.5134
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: rms_fgdepar=1.8390, expected range: 0.3334 1.3272
amdar
AMDAR TEMPERATURE (K) FJI911 PRESSURE LAYER 300-600 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=9.1067, expected range: 0.0000 1.7091
WIGOS AMDAR TEMPERATURE (K) SL0009 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=8.4895, expected range: 0.0116 1.5923
WIGOS AMDAR TEMPERATURE (K) 550IZAZA PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.2564, expected range: 0.0000 3.4579
Severe: avg_pge=0.8629, expected range: -1.1105 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) VJ3H1DBA (3 pressure layers affecte : out of range
Severe: rms_fgdepar=39.2270, expected range: 0.2443 6.9797
WIGOS AMDAR WIND VECTOR DIFF (M/S) VJ3H1DBA (2 pressure layers affecte : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9249, expected range: -0.2075 0.3020
WIGOS AMDAR WIND VECTOR DIFF (M/S) XIZX1KBA PRESSURE LAYER 600-900 (HP : out of range
Severe: rms_fgdepar=53.1927, expected range: -24.6175 35.1618
Severe: avg_pge=0.9520, expected range: -1.4224 0.7500
airep
AIREP WIND VECTOR DIFF (M/S) LOT4 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.6952, expected range: 0.0000 5.6983
AIREP WIND VECTOR DIFF (M/S) ETD485 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.0347, expected range: 0.0000 7.4454
AIREP WIND VECTOR DIFF (M/S) ACA57 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=20.8574, expected range: 0.0000 11.5981
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 10132 PRESSURE LAYER 600-900 : out of range
Severe: rms_fgdepar=18.3889, expected range: 0.0000 8.0304
Severe: avg_pge=0.9079, expected range: -0.1629 0.5705
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 06234 PRESSURE LAYER 600-900 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=20.8049, expected range: 0.0000 11.3270
Severe: avg_pge=0.8890, expected range: -0.9889 0.7500
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : missing
Severe: obs_number=0.0000, expected range: 0.0000 766.7911
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 65387 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=19.2726, expected range: 2.2073 7.1756
synop
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71021 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8307, expected range: -1.1915 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24585 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8708, expected range: 0.5435 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72386 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8056, expected range: 0.7279 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71648 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8730, expected range: -1.5065 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24588 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8352, expected range: 0.3607 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 68819 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=32.0214, expected range: 5.3397 10.2443
MANUAL LAND SYNOP RH2M (%) 76040 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.9968, expected range: -1.2792 0.7500
MANUAL LAND SYNOP RH2M (%) 63340 : out of range
Severe: avg_pge=0.8487, expected range: -0.4381 0.5796
MANUAL LAND SYNOP RH2M (%) 40265 : out of range
Severe: rms_fgdepar=35.8754, expected range: 0.0000 19.1950
MANUAL LAND SYNOP RH2M (%) 64706 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9571, expected range: -1.4420 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83980 : out of range
Severe: avg_pge=0.8371, expected range: -0.9172 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43241 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8294, expected range: -0.9726 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40672 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=604.5183, expected range: 0.0000 102.8840
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 67225 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8994, expected range: -0.4910 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43355 : out of range
Severe: rms_fgdepar=305.0452, expected range: 0.0000 189.1038
Severe: avg_pge=0.8044, expected range: -0.6633 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 37897 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8011, expected range: -1.2756 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 41268 : out of range
Severe: avg_pge=0.8657, expected range: 0.5164 0.7500
MANUAL LAND SYNOP Z (M) 38725 : out of range
Severe: rms_fgdepar=293.3444, expected range: 0.0000 127.9763
Severe: avg_pge=0.9990, expected range: -0.9059 0.7500
BUFR LAND SYNOP RH2M (%) 41140 : out of range
Severe: rms_fgdepar=39.0056, expected range: 0.0000 25.8944
Severe: avg_pge=0.9954, expected range: -0.0349 0.0462
BUFR LAND SYNOP RH2M (%) 08304 : out of range
Severe: rms_fgdepar=31.4448, expected range: 0.0000 10.8018
BUFR LAND SYNOP RH2M (%) 94415 : out of range
Severe: avg_pge=0.9888, expected range: -1.9953 0.7500
BUFR LAND SYNOP RH2M (%) 15118 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9268, expected range: -1.4413 0.7500
BUFR LAND SYNOP RH2M (%) 86988 : out of range
Severe: rms_fgdepar=31.8352, expected range: 0.0000 8.2707
BUFR LAND SYNOP RH2M (%) 40439 : out of range
Severe: avg_pge=0.9916, expected range: -0.2538 0.3307
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71032 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=331.5656, expected range: 0.0000 137.7647
BUFR LAND SYNOP SURFACE PRESSURE (PA) 01203 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8398, expected range: -0.5613 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71114 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=507.9951, expected range: 0.0000 265.9137
Severe: avg_pge=0.8745, expected range: -0.9531 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71216 : out of range
Severe: rms_fgdepar=442.3207, expected range: 0.0000 205.9538
BUFR LAND SYNOP SURFACE PRESSURE (PA) 30636 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8082, expected range: 0.1475 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71187 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=490.9241, expected range: 0.0000 247.9392
Severe: avg_pge=0.8681, expected range: -0.9064 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71768 : out of range
Severe: avg_pge=0.8202, expected range: -0.4731 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71889 : out of range
Severe: rms_fgdepar=496.2048, expected range: 0.0000 272.4961
ship
SHIP WIND VECTOR DIFF (M/S) : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8343, expected range: -0.3766 0.7500
All AUTOMATIC SHIP East pacific Tropica : all data missing
Severe: obs_number=0, expected range: 48.80 59.49
SHIP SURFACE PRESSURE (PA) C6FV8 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8525, expected range: -1.2254 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA5063 : out of range
Severe: avg_pge=0.8037, expected range: -1.1855 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) D5LD4 : out of range
Severe: avg_pge=0.8081, expected range: -0.5795 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) TBWUK35 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=504.1500, expected range: 0.0000 164.7322
BUFR SHIP SYNOP SURFACE PRESSURE (PA) S6AN5 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8013, expected range: 0.4893 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V7987 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9187, expected range: 0.5152 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6VG7 : out of range
Severe: avg_pge=0.8112, expected range: -0.8990 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VXKF : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=872.9663, expected range: 0.0000 330.8803
Severe: avg_pge=0.9420, expected range: -1.2069 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 5601550 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8923, expected range: -0.7209 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101771 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=456.0301, expected range: 0.0000 124.8329
DRIFTING BUOYS SURFACE PRESSURE (PA) 4801718 : out of range
Severe: rms_fgdepar=349.9098, expected range: 0.0000 164.6426
Severe: avg_pge=0.8161, expected range: -0.2312 0.3009
metar
METAR SURFACE PRESSURE (PA) FNUE : out of range
Severe: rms_fgdepar=601.6935, expected range: 0.0000 294.9456
METAR SURFACE PRESSURE (PA) FNLU : out of range
Severe: rms_fgdepar=314.8853, expected range: 29.3968 169.8033
METAR SURFACE PRESSURE (PA) ENBV : out of range
Severe: rms_fgdepar=402.2054, expected range: 0.0000 178.7225
AUTOMATIC METAR SURFACE PRESSURE (PA) CYHE : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=464.5381, expected range: 0.0000 194.7723
AUTOMATIC METAR SURFACE PRESSURE (PA) PAKW : out of range
Severe: rms_fgdepar=302.0794, expected range: 0.0000 149.9598
snow
AUTOMATIC LAND SYNOP SNOW (CM) 36856 : out of range
Severe: rms_fgdepar=43.5166, expected range: 0.0000 3.2166
BUFR LAND SYNOP SNOW (CM) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=70.7942, expected range: 0.2172 2.3477
Severe: rms_fgdepar=25.9046, expected range: 2.1446 4.6783
t2m
LAND TEMP 2M TEMPERATURE (K) 30372 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8866, expected range: 0.4159 1.1072
LAND TEMP 2M TEMPERATURE (K) 30965 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8239, expected range: -0.2181 1.4636
MANUAL LAND SYNOP 2M TEMPERATURE (K) 43136 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.3663, expected range: 0.3617 3.4051
MANUAL LAND SYNOP 2M TEMPERATURE (K) 17098 : out of range
Severe: avg_est_pge=0.8072, expected range: 0.0449 1.0022
BUFR LAND SYNOP 2M TEMPERATURE (K) 04121 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.2087, expected range: 0.0000 5.6564
BUFR LAND SYNOP 2M TEMPERATURE (K) 33646 : out of range
Severe: rms_fgdepar=11.1129, expected range: 0.0000 5.9667
Severe: avg_est_pge=0.8005, expected range: -0.2155 0.6593
LAND TEMP 2M TEMPERATURE (K) : out of range
Slight: obs_number=664.0000, expected range: 531.4761 647.8572
rh2m
MANUAL LAND SYNOP RH2M (%) 94500 : out of range
Severe: rms_fgdepar=30.9032, expected range: 3.6400 13.8360
MANUAL LAND SYNOP RH2M (%) 43136 : out of range
Severe: rms_fgdepar=34.6860, expected range: 0.0000 19.7930