Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-08-09 12:00

cris
NOAA20 CRIS RADIANCES CHANNEL 72 : out of range
Severe: stdev_fgdepar=0.0947, expected range: 0.0774 0.0864
NOAA20 CRIS RADIANCES CHANNEL 74 : out of range
Severe: stdev_fgdepar=0.0855, expected range: 0.0711 0.0793
NOAA20 CRIS RADIANCES CHANNEL 75 : out of range
Severe: stdev_fgdepar=0.0907, expected range: 0.0753 0.0830
NOAA20 CRIS RADIANCES (99 channels affected) : out of range
Considerable: obs_number=3378.0000, expected range: 12015.4172 32766.9281
NOAA20 CRIS RADIANCES CHANNEL 1109 : out of range
Slight: stdev_fgdepar=0.8694, expected range: 0.6241 0.8165
airs
AQUA AIRS RADIANCES CHANNEL 1948 : missing
7 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 1931.9526 4128.6474
gpsro
All COSMIC2-E5 GPSRO RISING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 355.38 3202.37
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 10-11 (HPA) : out of range
Slight: stdev_fgdepar=0.0022, expected range: 0.0000 0.0000
Radiosondes
LAND TEMP TEMPERATURE (K) 61660 PRESSURE LAYER 0-300 (HPA) : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.6450, expected range: -17.8946 -12.7119
Severely_persistent: rms_fgdepar=20.0301, expected range: 18.3771 24.4128
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 26 : all data missing
Severely_persistent: obs_number=0, expected range: 102.60 126.40
LAND TEMP Q (G/KG) 37259 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-6.1935, expected range: -5.1222 3.5479
Severe: rms_fgdepar=6.2756, expected range: 0.0000 4.9773
HIGH RESO LAND TEMP Q (G/KG) 47102 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=5.7407, expected range: 0.0000 2.4825
HIGH RESO LAND TEMP Q (G/KG) 72558 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=-7.3373, expected range: -2.3443 3.4627
Severe: rms_fgdepar=7.3421, expected range: 0.0000 3.6019
HIGH RESO LAND TEMP Q (G/KG) 72649 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=3.9045, expected range: 0.0000 1.8785
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 0-300 (HPA) : missing
3 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 541.0276
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 900-1200 (HPA) : missing
Severe: obs_number=0.0000, expected range: 23.9619 183.3809
Considerable: rms_fgdepar=2.2882, expected range: 0.8420 1.7637
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=56.0000, expected range: 89.3672 148.4105
amdar
AMDAR WIND VECTOR DIFF (M/S) BR712393 PRESSURE LAYER 0-300 (HPA) : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=31.6303, expected range: -11.7895 53.4709
Severely_persistent: rms_fgdepar=31.6686, expected range: 0.0000 53.3033
Severely_persistent: avg_pge=0.8919, expected range: 0.2393 0.7500
AMDAR WIND VECTOR DIFF (M/S) BR379791 PRESSURE LAYER 300-600 (HPA) : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8090, expected range: 0.0853 0.7500
AMDAR WIND VECTOR DIFF (M/S) BR151888 PRESSURE LAYER 300-600 (HPA) : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=33.0556, expected range: -20.0168 55.6656
Severely_persistent: rms_fgdepar=33.0556, expected range: 0.0000 56.2945
Severely_persistent: avg_pge=0.9066, expected range: -0.6853 0.7500
AMDAR TEMPERATURE (K) PRESSURE LAYER 600-900 (HPA) : missing
Severe: obs_number=0.0000, expected range: 0.0000 470.9751
AMDAR WIND VECTOR DIFF (M/S) BR937510 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=27.3960, expected range: 3.4875 32.7495
Severe: rms_fgdepar=27.6510, expected range: 7.6637 31.9275
Severe: avg_pge=0.8820, expected range: 0.3186 0.7500
AMDAR WIND VECTOR DIFF (M/S) BR792831 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=30.6033, expected range: 0.3245 36.7985
Severe: rms_fgdepar=30.6033, expected range: 0.6940 38.3477
Severe: avg_pge=0.8975, expected range: 0.5000 0.7500
AMDAR WIND VECTOR DIFF (M/S) BR853092 PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=20.9489, expected range: -6.9645 40.3104
Severe: rms_fgdepar=21.3521, expected range: 0.0000 41.1827
AMDAR WIND VECTOR DIFF (M/S) BR784445 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=34.1439, expected range: 0.2809 40.0830
Severe: rms_fgdepar=34.3430, expected range: 0.3023 42.6135
Severe: avg_pge=0.9029, expected range: 0.3669 0.7500
AMDAR WIND VECTOR DIFF (M/S) BR510055 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=20.3015, expected range: 1.6661 36.5891
Severe: rms_fgdepar=21.1699, expected range: 6.2866 34.3099
AMDAR WIND VECTOR DIFF (M/S) BR998497 PRESSURE LAYER 0-300 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=21.6006, expected range: 0.0000 32.9514
AMDAR WIND VECTOR DIFF (M/S) BR156248 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=33.0662, expected range: 5.1252 37.3151
Severe: rms_fgdepar=33.1215, expected range: 6.0165 37.8142
Severe: avg_pge=0.8995, expected range: 0.6757 0.7500
WIGOS AMDAR TEMPERATURE (K) EU0223 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=8.8506, expected range: 0.0000 4.5578
Severe: avg_pge=0.8733, expected range: -0.4114 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) MTCHLDJA (2 pressure layers affecte : out of range
Severe: rms_fgdepar=20.4273, expected range: 0.0000 10.0493
WIGOS AMDAR WIND VECTOR DIFF (M/S) MTCHLDJA PRESSURE LAYER 600-900 (HP : out of range
Severe: avg_fgdepar=22.4746, expected range: -1.7825 7.4926
WIGOS AMDAR WIND VECTOR DIFF (M/S) Y2IINGRA PRESSURE LAYER 600-900 (HP : out of range
Severe: rms_fgdepar=16.3024, expected range: 0.0000 7.1965
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 96075 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_pge=0.8030, expected range: -0.6736 0.7500
BUFR LAND PILOT WIND VECTOR DIFF (M/S) 40179 PRESSURE LAYER 600-900 (H : out of range
Severe: rms_fgdepar=16.5169, expected range: 0.0000 7.0326
Severe: avg_pge=0.8721, expected range: -0.6573 0.7500
synop
MANUAL LAND SYNOP RH2M (%) 76040 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8535, expected range: -1.1512 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42654 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8197, expected range: -1.0270 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42295 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1564.7059, expected range: 1332.5606 1720.0172
Severely_persistent: rms_fgdepar=1564.7059, expected range: 1332.5606 1720.0172
BUFR LAND SYNOP RH2M (%) 02102 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-57.4712, expected range: -73.3504 -34.3599
Severely_persistent: rms_fgdepar=57.4829, expected range: 34.5902 73.1686
Severely_persistent: avg_pge=0.9976, expected range: 0.8359 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 91682 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8869, expected range: 0.3302 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 41178 : out of range
Severe: avg_pge=0.8606, expected range: -0.8131 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 54511 : out of range
Severe: rms_fgdepar=308.2310, expected range: 0.0000 110.0896
MANUAL LAND SYNOP RH2M (%) 35283 : out of range
Severe: rms_fgdepar=30.6882, expected range: 0.0000 9.4296
MANUAL LAND SYNOP RH2M (%) 42935 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9052, expected range: -1.3426 0.7500
MANUAL LAND SYNOP RH2M (%) 66285 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.9013, expected range: -1.2126 0.7500
MANUAL LAND SYNOP RH2M (%) 35188 : out of range
Severe: rms_fgdepar=48.5211, expected range: 0.0000 7.6971
Severe: avg_pge=0.9930, expected range: 0.0020 0.0032
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 60520 : out of range
Severe: rms_fgdepar=531.1071, expected range: 0.0000 372.4873
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 37711 : out of range
Severe: avg_pge=0.8241, expected range: -0.7530 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62271 : out of range
Severe: avg_pge=0.8498, expected range: -1.3286 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62054 : out of range
Severe: avg_fgdepar=1072.2972, expected range: -2575.8533 3615.7059
Severe: rms_fgdepar=1072.2972, expected range: -2465.3235 3537.8150
Severe: avg_pge=0.9436, expected range: -2.2520 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 41725 : out of range
Severe: rms_fgdepar=539.7275, expected range: 0.0000 300.2767
BUFR LAND SYNOP RH2M (%) 28661 : out of range
Severe: rms_fgdepar=31.5129, expected range: 0.0000 14.2277
BUFR LAND SYNOP RH2M (%) 51656 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9938, expected range: -1.1939 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 60146 : out of range
Severe: rms_fgdepar=480.3837, expected range: 0.0000 106.9388
BUFR LAND SYNOP SURFACE PRESSURE (PA) 86246 : out of range
Severe: rms_fgdepar=306.7509, expected range: 0.0000 165.9319
BUFR LAND SYNOP SURFACE PRESSURE (PA) 85766 : out of range
Severe: rms_fgdepar=376.1610, expected range: 0.0000 99.4372
BUFR LAND SYNOP SURFACE PRESSURE (PA) 25248 : out of range
Severe: rms_fgdepar=494.3749, expected range: 0.0000 166.9033
Severe: avg_pge=0.8756, expected range: -0.4526 0.7500
ship
SHIP SURFACE PRESSURE (PA) V7FF3 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1028.7286, expected range: 699.8772 1222.6933
Severely_persistent: rms_fgdepar=1028.7286, expected range: 699.8772 1222.6933
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7FF3 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1028.7286, expected range: 699.8772 1222.6933
Severely_persistent: rms_fgdepar=1028.7286, expected range: 699.8772 1222.6933
Severely_persistent: avg_pge=0.8974, expected range: 0.8647 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WGAH : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=620.4541, expected range: -533.0110 460.4191
Severely_persistent: rms_fgdepar=622.9357, expected range: 0.0000 438.5055
Severely_persistent: avg_pge=0.8231, expected range: -0.9598 0.7500
SHIP SURFACE PRESSURE (PA) WGAH : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=620.4541, expected range: -530.2571 461.3592
Severe: rms_fgdepar=622.9357, expected range: 0.0000 438.8632
SHIP SURFACE PRESSURE (PA) PDAN : out of range
Severe: rms_fgdepar=348.5745, expected range: 0.0000 181.8445
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ASES01 : out of range
Severe: avg_pge=0.8625, expected range: -1.1205 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) PDAN : out of range
Severe: rms_fgdepar=348.5745, expected range: 0.0000 180.5721
BUFR SHIP SYNOP RH2M (%) DCQN : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8608, expected range: -0.9991 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 1501748 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=522.6656, expected range: -1515.0484 1401.2996
Severely_persistent: rms_fgdepar=613.5772, expected range: 0.0000 963.1275
DRIFTING BUOYS SURFACE PRESSURE (PA) 1701531 : out of range
Severe: rms_fgdepar=438.9818, expected range: 0.0000 110.6671
Severe: avg_pge=0.8061, expected range: -0.2479 0.2791
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101771 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=401.8741, expected range: 0.0000 65.7765
metar
METAR SURFACE PRESSURE (PA) DNJO : out of range
Severe: avg_fgdepar=-578.4909, expected range: -185.7192 316.0990
Severe: rms_fgdepar=578.4909, expected range: 0.0000 247.8824
t2m
MANUAL LAND SYNOP 2M TEMPERATURE (K) 89055 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.6897, expected range: -20.0261 10.1354
Severely_persistent: rms_fgdepar=13.4886, expected range: 0.0000 18.6674
LAND TEMP 2M TEMPERATURE (K) 72376 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8347, expected range: -0.3831 1.4357
BUFR LAND SYNOP 2M TEMPERATURE (K) 85504 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=13.8567, expected range: -11.9928 19.7792
Severely_persistent: rms_fgdepar=14.1710, expected range: 0.0000 19.3104
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.6130, expected range: -20.5237 -13.3822
Severely_persistent: rms_fgdepar=17.6130, expected range: 13.5332 20.5466
BUFR LAND SYNOP 2M TEMPERATURE (K) 89055 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.2313, expected range: -19.8508 9.6460
Severely_persistent: rms_fgdepar=14.6266, expected range: 0.0000 19.0293
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
4 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8154, expected range: -0.1922 1.3230
MANUAL LAND SYNOP 2M TEMPERATURE (K) 07028 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.2074, expected range: 0.0000 3.9038
METAR 2M TEMPERATURE (K) SCTN : out of range
Severe: avg_fgdepar=15.5298, expected range: -0.4654 5.0397
Severe: rms_fgdepar=15.5298, expected range: 0.8485 4.6719
METAR 2M TEMPERATURE (K) LEVX : out of range
Severe: rms_fgdepar=11.4997, expected range: 0.4324 3.6215
LAND TEMP 2M TEMPERATURE (K) 56137 : out of range
4 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8735, expected range: -0.3797 1.4234
rh2m
AUTOMATIC LAND SYNOP RH2M (%) 07046 : out of range
Severe: rms_fgdepar=35.0180, expected range: 0.0000 18.3018