Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-07-03 00:00

amsua
METOP-B AMSUA RADIANCES CHANNEL 6 : out of range
Considerable: obs_number=4038.0000, expected range: 7723.7485 20979.0015
METOP-B AMSUA RADIANCES CHANNEL 11 : out of range
Considerable: avg_biascorr=0.2093, expected range: 0.2378 0.2776
METOP-B AMSUA RADIANCES CHANNEL 12 : out of range
Considerable: avg_biascorr=0.4439, expected range: 0.4734 0.5235
METOP-B AMSUA RADIANCES CHANNEL 13 : out of range
Considerable: avg_biascorr=0.4301, expected range: 0.4616 0.5204
METOP-B AMSUA RADIANCES (8 channels affected) : out of range
Considerable: obs_number=1544.0000, expected range: 3503.5663 7226.0587
cris
NOAA20 CRIS RADIANCES CHANNEL 75 : out of range
Considerable: obs_number=2431.0000, expected range: 2024.9875 2340.1375
NOAA20 CRIS RADIANCES CHANNEL 77 : out of range
Considerable: obs_number=2403.0000, expected range: 2011.5238 2314.7262
NOAA20 CRIS RADIANCES CHANNEL 78 : out of range
Considerable: obs_number=2425.0000, expected range: 2014.7385 2331.8865
NOAA20 CRIS RADIANCES CHANNEL 79 : out of range
Considerable: obs_number=2380.0000, expected range: 1998.2713 2288.6037
NOAA20 CRIS RADIANCES CHANNEL 81 : out of range
Considerable: obs_number=2391.0000, expected range: 2004.9133 2302.8367
atms
NPP ATMS RADIANCES (7 channels affected) : out of range
Considerable: obs_number=3537.0000, expected range: 2973.5108 3398.6142
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 10-11 (HPA) : out of range
3 times in the last 10 days for at least one item
Considerable: stdev_fgdepar=0.0000, expected range: 0.0045 0.0131
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 20-21 (HPA) : out of range
6 times in the last 10 days for at least one item
Slight: avg_fgdepar=-0.0425, expected range: -0.0404 -0.0333
Radiosondes
LAND TEMP TEMPERATURE (K) 34882 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=9.3557, expected range: 0.4263 2.1924
LAND TEMP TEMPERATURE (K) 22543 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=7.1309, expected range: 0.0000 2.8159
Severe: avg_pge=0.8711, expected range: -0.6188 0.7500
LAND TEMP WIND VECTOR DIFF (M/S) 34882 PRESSURE LAYER 300-600 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=16.8667, expected range: 0.0000 6.2336
LAND TEMP WIND VECTOR DIFF (M/S) 91334 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=17.4884, expected range: 1.1668 5.8427
LAND TEMP Q (G/KG) 91366 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.8771, expected range: 0.0000 1.7804
LAND TEMP Q (G/KG) 40437 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.9868, expected range: 0.0000 1.6787
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : missing
2 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 77.6866 364.5770
Severe: obs_number=0.0000, expected range: 0.0000 495.7291
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : missing
1 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 172.0901 197.9099
HIGH RESO LAND TEMP Q (G/KG) 72240 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=3.1642, expected range: 0.4605 1.9278
HIGH RESO LAND TEMP Q (G/KG) 72235 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=4.7787, expected range: 0.6432 2.0132
HIGH RESO LAND TEMP Q (G/KG) 72249 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=-7.6800, expected range: -3.5899 1.2209
Severe: rms_fgdepar=7.7744, expected range: 0.0000 3.8710
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : missing
Severe: obs_number=0.0000, expected range: 0.0000 369.5269
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 37 : all data missing
Severe: obs_number=0, expected range: 29.99 164.41
All HIGH RESO LAND TEMP ALL LAYERS South pole : all data missing
Severe: obs_number=0, expected range: 63.05 346.29
LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: rms_fgdepar=3.4490, expected range: 0.6084 2.2321
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) PRESSURE LAYER 900-1200 (HPA) : out of range
Considerable: obs_number=156.0000, expected range: 217.4942 315.7558
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 96737 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=15.6846, expected range: 0.0000 7.5910
synop
AUTOMATIC LAND SYNOP RH2M (%) : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9998, expected range: -1.8780 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 41308 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9998, expected range: -1.8780 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40674 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=510.8939, expected range: -708.7706 915.8674
Severely_persistent: rms_fgdepar=511.3951, expected range: -692.2719 910.3146
Severely_persistent: avg_pge=0.8875, expected range: -1.2347 0.7500
MANUAL LAND SYNOP RH2M (%) 41560 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8816, expected range: -0.7160 0.7500
MANUAL LAND SYNOP RH2M (%) 76122 : out of range
Severe: rms_fgdepar=33.2934, expected range: 0.0000 18.5249
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42471 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=395.0613, expected range: 0.0000 251.1749
Severe: avg_pge=0.8445, expected range: -1.0548 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40103 : out of range
Severe: rms_fgdepar=310.2372, expected range: 0.0000 148.2401
Severe: avg_pge=0.8112, expected range: -0.6553 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43309 : out of range
Severe: avg_pge=0.8334, expected range: -0.8916 0.7500
BUFR LAND SYNOP RH2M (%) 72450 : out of range
Severe: rms_fgdepar=39.7059, expected range: 0.0000 11.1705
Severe: avg_pge=0.9963, expected range: 0.0000 0.0058
BUFR LAND SYNOP RH2M (%) 94311 : out of range
Severe: rms_fgdepar=37.8396, expected range: 0.0000 6.1821
Severe: avg_pge=0.9585, expected range: 0.0012 0.0041
BUFR LAND SYNOP RH2M (%) 71621 : out of range
Severe: rms_fgdepar=43.8897, expected range: 0.0000 22.1194
Severe: avg_pge=0.9988, expected range: -0.0011 0.0076
BUFR LAND SYNOP RH2M (%) 71161 : out of range
Severe: rms_fgdepar=41.7344, expected range: 0.0000 20.7859
BUFR LAND SYNOP RH2M (%) 71281 : out of range
Severe: avg_pge=0.8512, expected range: -0.0230 0.0346
BUFR LAND SYNOP RH2M (%) 60253 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=47.7758, expected range: 0.0000 20.5999
Severe: avg_pge=0.9980, expected range: 0.0001 0.0058
BUFR LAND SYNOP RH2M (%) 41114 : out of range
Severe: rms_fgdepar=31.0688, expected range: 0.0000 16.1403
BUFR LAND SYNOP RH2M (%) 72274 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=47.4313, expected range: 0.0000 3.3125
Severe: avg_pge=0.9840, expected range: 0.0023 0.0028
BUFR LAND SYNOP RH2M (%) 33717 : out of range
Severe: rms_fgdepar=33.0474, expected range: 0.0000 16.9119
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71410 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=310.8082, expected range: 0.0000 166.9393
Severe: avg_pge=0.8006, expected range: -0.3346 0.4175
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71370 : out of range
Severe: rms_fgdepar=348.8776, expected range: 0.0000 118.1417
BUFR LAND SYNOP SURFACE PRESSURE (PA) 11880 : out of range
Severe: rms_fgdepar=404.1692, expected range: 4.4138 58.3268
Severe: avg_pge=0.8365, expected range: -0.1716 0.2095
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48921 : out of range
Severe: rms_fgdepar=489.4848, expected range: 0.0000 286.6271
Severe: avg_pge=0.8639, expected range: -0.9701 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24588 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=585.4391, expected range: 0.0000 187.7664
ship
ABBREVIATED SHIP SURFACE PRESSURE (PA) : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-563.6931, expected range: -996.2503 376.0045
Severely_persistent: rms_fgdepar=639.3585, expected range: 0.0000 1123.1342
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7SD8 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=559.3683, expected range: -343.9965 1345.2828
Severely_persistent: rms_fgdepar=559.3683, expected range: 0.0000 1341.8762
Severely_persistent: avg_pge=0.8239, expected range: -0.4193 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) OXCR2 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=21.5372, expected range: -9.6709 17.9221
Severe: rms_fgdepar=21.5372, expected range: 0.0000 18.7233
Severe: avg_pge=0.9250, expected range: -1.6320 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) CQIX3 : out of range
Severe: rms_fgdepar=17.5178, expected range: 0.7344 9.4861
Severe: avg_pge=0.9092, expected range: 0.2459 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRZU4 : out of range
Severe: rms_fgdepar=19.0364, expected range: 0.0000 10.2251
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRBH9 : out of range
Severe: rms_fgdepar=18.7038, expected range: 0.0000 14.6945
Severe: avg_pge=0.9086, expected range: -1.0631 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6DQ4 : out of range
Severe: rms_fgdepar=582.7095, expected range: -1153.9852 1629.2009
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 5300041 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8370, expected range: 0.3631 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601701 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=531.4225, expected range: -1125.3644 1356.0529
Severely_persistent: rms_fgdepar=531.8285, expected range: -950.0698 1289.9704
Severely_persistent: avg_pge=0.9032, expected range: -1.6022 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 3301574 : out of range
Severe: rms_fgdepar=305.8875, expected range: 0.0000 91.3112
DRIFTING BUOYS SURFACE PRESSURE (PA) 3101546 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=502.7581, expected range: 0.0000 359.3076
Severe: avg_pge=0.8811, expected range: -0.7396 0.7500
MOORED BUOYS SURFACE PRESSURE (PA) : out of range
Considerable: obs_number=69.0000, expected range: 87.1873 107.4793
Considerable: obs_number=69.0000, expected range: 87.1873 107.4793
snow
BUFR LAND SYNOP SNOW (CM) 01035 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=109.5684, expected range: 104.9548 132.1361
Severely_persistent: rms_fgdepar=109.5689, expected range: 105.0672 132.7416
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8044, expected range: 0.6158 0.9041
METAR 2M TEMPERATURE (K) KLCK : out of range
27 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.6505, expected range: -18.2621 -9.0816
Severely_persistent: rms_fgdepar=15.7823, expected range: 9.4349 18.4807
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
30 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-16.2975, expected range: -20.9998 -11.3925
Severely_persistent: rms_fgdepar=16.2975, expected range: 11.6610 20.8926
BUFR LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8079, expected range: 0.6367 0.8953
METAR 2M TEMPERATURE (K) KCNO : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.7846, expected range: 1.5032 6.6650
METAR 2M TEMPERATURE (K) KSRQ : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=13.5480, expected range: 1.1718 3.2228
METAR 2M TEMPERATURE (K) KRIV : out of range
Severe: avg_fgdepar=-19.0639, expected range: -3.5510 3.1930
Severe: rms_fgdepar=19.0639, expected range: 1.4406 5.8292
Severe: avg_est_pge=0.8135, expected range: 0.0046 0.3133
LAND TEMP 2M TEMPERATURE (K) 83937 : out of range
Severe: avg_fgdepar=-12.9384, expected range: -3.4140 2.8137
Severe: rms_fgdepar=12.9384, expected range: 0.0000 3.5187
rh2m
All BUFR LAND SYNOP WMO BLOCK 98 : all data missing
Severely_persistent: obs_number=0, expected range: 123.58 134.05
MANUAL LAND SYNOP RH2M (%) 94311 : out of range
Severe: rms_fgdepar=34.7311, expected range: 0.0000 18.2432
MANUAL LAND SYNOP RH2M (%) 72274 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=31.6594, expected range: 0.0000 13.8199