Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-08-10 12:00

amsua
NOAA-15 AMSUA RADIANCES CHANNEL 13 : out of range
3 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.1704, expected range: 0.2067 0.2657
cris
NOAA20 CRIS RADIANCES (136 channels affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=2331.0000, expected range: 12015.4172 32766.9281
NOAA20 CRIS RADIANCES CHANNEL 1133 : out of range
Considerable: stdev_fgdepar=0.7289, expected range: 0.8261 0.9975
NOAA20 CRIS RADIANCES CHANNEL 981 : out of range
Considerable: avg_biascorr=-0.2822, expected range: -0.3535 -0.3108
NOAA20 CRIS RADIANCES CHANNEL 1005 : out of range
Considerable: avg_biascorr=0.0392, expected range: -0.0212 0.0176
NOAA20 CRIS RADIANCES CHANNEL 1189 : out of range
Slight: avg_fgdepar=-0.0816, expected range: -0.0402 0.0750
NOAA20 CRIS RADIANCES CHANNEL 1251 : out of range
Slight: avg_fgdepar=-0.1234, expected range: -0.0726 0.1019
airs
AQUA AIRS RADIANCES CHANNEL 1948 : missing
9 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 1692.9061 8726.7881
gpsro
All COSMIC2-E5 GPSRO RISING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 320.39 3240.24
Radiosondes
LAND TEMP TEMPERATURE (K) 61660 PRESSURE LAYER 0-300 (HPA) : out of range
31 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-11.6933, expected range: -18.0522 -12.3976
Severely_persistent: rms_fgdepar=18.7292, expected range: 18.7720 24.2091
All HIGH RESO LAND TEMP Q (G/KG) ALL LAYERS WMO BLOCK 81 : all data missing
Severely_persistent: obs_number=0, expected range: 0.00 709.26
LAND TEMP TEMPERATURE (K) 23933 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.3278, expected range: 0.0000 2.7671
LAND TEMP WIND VECTOR DIFF (M/S) 32389 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=18.6957, expected range: 0.0000 7.8340
All LAND TEMP ALL LAYERS WMO BLOCK 62 : all data missing
Severe: obs_number=0, expected range: 35.13 230.60
HIGH RESO LAND TEMP Q (G/KG) 59211 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=2.2099, expected range: 0.0000 1.1759
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 0-300 (HPA) : missing
3 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 561.9173
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : missing
Severe: obs_number=0.0000, expected range: 23.0454 281.6050
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : missing
1 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 447.5994
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 59211 PRESSURE LAYER 900-12 : out of range
Severe: avg_fgdepar=21.1429, expected range: -5.5199 12.6931
Severe: rms_fgdepar=21.1931, expected range: 0.0000 12.8010
Severe: avg_pge=0.9025, expected range: -0.9502 0.7500
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (3 pressure layers affected : missing
Severe: obs_number=0.0000, expected range: 104.0318 124.7682
amdar
AMDAR WIND VECTOR DIFF (M/S) BR853092 PRESSURE LAYER 0-300 (HPA) : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8051, expected range: -0.1121 0.7500
AMDAR WIND VECTOR DIFF (M/S) BR712393 PRESSURE LAYER 0-300 (HPA) : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=41.8161, expected range: -11.7922 52.0011
Severely_persistent: rms_fgdepar=42.8975, expected range: 0.0000 51.9306
Severely_persistent: avg_pge=0.9159, expected range: 0.2201 0.7500
WIGOS AMDAR TEMPERATURE (K) EU0758 PRESSURE LAYER 0-300 (HPA) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8005, expected range: 0.6384 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) DIJX1DJA PRESSURE LAYER 0-300 (HPA) : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=37.5060, expected range: -28.9436 47.4001
Severely_persistent: rms_fgdepar=37.5403, expected range: 0.0000 48.8243
AMDAR WIND VECTOR DIFF (M/S) BR156248 (2 pressure layers affected) : out of range
Severe: avg_fgdepar=41.3167, expected range: 6.0880 39.2433
Severe: rms_fgdepar=43.0435, expected range: 7.9716 38.9369
Severe: avg_pge=0.9095, expected range: 0.6840 0.7500
AMDAR WIND VECTOR DIFF (M/S) BR540815 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_fgdepar=20.5311, expected range: -0.5856 18.0082
Severe: rms_fgdepar=21.5069, expected range: 0.0000 20.5025
Severe: avg_pge=0.8294, expected range: -0.4391 0.7500
WIGOS AMDAR TEMPERATURE (K) EO2YNGBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.6285, expected range: 0.0000 2.2366
WIGOS AMDAR WIND VECTOR DIFF (M/S) EO2YNGBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.2161, expected range: 0.0000 8.4187
WIGOS AMDAR WIND VECTOR DIFF (M/S) DIJX1DJA (2 pressure layers affecte : out of range
Severe: avg_pge=0.9220, expected range: -1.4632 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) MOTINLJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=31.9463, expected range: -2.7681 7.2704
Severe: rms_fgdepar=31.9463, expected range: 0.0000 8.3924
WIGOS AMDAR WIND VECTOR DIFF (M/S) WAAMIQJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.0399, expected range: 0.8216 6.1874
WIGOS AMDAR WIND VECTOR DIFF (M/S) XDOENXJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.2689, expected range: 0.0000 7.2383
WIGOS AMDAR WIND VECTOR DIFF (M/S) D3VICKRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.4201, expected range: 0.0947 6.9059
WIGOS AMDAR WIND VECTOR DIFF (M/S) GD4UISRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.3356, expected range: 0.0000 8.3469
WIGOS AMDAR WIND VECTOR DIFF (M/S) SJGEITRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.1439, expected range: 0.0000 6.5150
WIGOS AMDAR WIND VECTOR DIFF (M/S) H0GENWZA (2 pressure layers affecte : out of range
Severe: rms_fgdepar=17.9742, expected range: 0.0000 9.6180
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : missing
Severe: obs_number=0.0000, expected range: 0.0000 254.7451
synop
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43012 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8322, expected range: 0.6179 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43083 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8512, expected range: -0.5272 0.7500
MANUAL LAND SYNOP RH2M (%) 76040 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9960, expected range: -1.3047 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 91682 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8949, expected range: 0.3726 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 55664 : out of range
27 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-743.0007, expected range: -1127.2956 -50.7370
Severely_persistent: rms_fgdepar=743.0007, expected range: 143.1091 1110.9216
Severely_persistent: avg_pge=0.9038, expected range: 0.3280 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72327 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8841, expected range: 0.8592 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 76220 : out of range
Severe: avg_fgdepar=573.9599, expected range: -46.7005 94.0333
Severe: rms_fgdepar=574.4494, expected range: 0.0000 97.4028
Severe: avg_pge=0.8685, expected range: -0.1665 0.1903
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 72651 : out of range
Severe: rms_fgdepar=447.6501, expected range: 0.0000 158.3655
Severe: avg_pge=0.8643, expected range: 0.0000 0.0000
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83916 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8139, expected range: -1.2385 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 84036 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=379.3704, expected range: 9.6754 57.5390
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 82246 : out of range
Severe: avg_pge=0.8399, expected range: -0.4059 0.7500
MANUAL LAND SYNOP RH2M (%) 42770 : out of range
Severe: avg_pge=0.8677, expected range: 0.8532 0.7500
MANUAL LAND SYNOP RH2M (%) 60714 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9794, expected range: -1.0554 0.7500
MANUAL LAND SYNOP RH2M (%) 42935 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.9321, expected range: -1.4726 0.7500
MANUAL LAND SYNOP RH2M (%) 66285 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.9481, expected range: -1.2625 0.7500
MANUAL LAND SYNOP RH2M (%) 36658 : out of range
Severe: avg_fgdepar=53.9628, expected range: -13.3727 13.1816
Severe: rms_fgdepar=53.9628, expected range: 0.0000 8.4198
MANUAL LAND SYNOP RH2M (%) 35078 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9070, expected range: -0.0041 0.0102
MANUAL LAND SYNOP RH2M (%) 35188 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=34.5659, expected range: 0.0000 11.6830
MANUAL LAND SYNOP RH2M (%) 12488 : out of range
Severe: rms_fgdepar=32.2334, expected range: 0.0000 13.7712
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72544 : out of range
Severe: rms_fgdepar=395.6903, expected range: 0.0000 194.0622
Severe: avg_pge=0.8198, expected range: -0.4508 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 12836 : out of range
Severe: rms_fgdepar=353.9926, expected range: 0.0000 109.3050
BUFR LAND SYNOP SURFACE PRESSURE (PA) 30028 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-554.1544, expected range: -950.9970 735.1317
Severe: rms_fgdepar=694.0809, expected range: -1030.1216 1316.2112
BUFR LAND SYNOP RH2M (%) 33231 : out of range
Severe: rms_fgdepar=33.0156, expected range: 0.0000 14.8004
BUFR LAND SYNOP RH2M (%) 33312 : out of range
Severe: rms_fgdepar=31.5591, expected range: 0.0000 15.5798
BUFR LAND SYNOP RH2M (%) 29612 : out of range
Severe: rms_fgdepar=32.4867, expected range: 0.0000 14.9507
BUFR LAND SYNOP RH2M (%) 72422 : out of range
Severe: rms_fgdepar=37.7608, expected range: 0.0000 20.5921
BUFR LAND SYNOP RH2M (%) 28863 : out of range
Severe: rms_fgdepar=31.7424, expected range: 0.0000 15.0869
BUFR LAND SYNOP RH2M (%) 08165 : out of range
Severe: rms_fgdepar=33.3657, expected range: 0.0000 15.2513
BUFR LAND SYNOP RH2M (%) 28775 : out of range
Severe: rms_fgdepar=32.1123, expected range: 0.0000 9.6570
BUFR LAND SYNOP RH2M (%) 10495 : out of range
Severe: rms_fgdepar=30.7630, expected range: 0.5141 12.2563
BUFR LAND SYNOP RH2M (%) 24606 : out of range
Severe: avg_pge=0.8608, expected range: -1.2543 0.7500
BUFR LAND SYNOP RH2M (%) 51777 : out of range
Severe: avg_pge=0.9911, expected range: -1.4430 0.7500
BUFR LAND SYNOP RH2M (%) 10488 : out of range
Severe: rms_fgdepar=41.5267, expected range: 0.0000 18.1297
Severe: rms_fgdepar=33.6091, expected range: 1.4166 18.9182
BUFR LAND SYNOP RH2M (%) 29209 : out of range
Severe: avg_fgdepar=51.0139, expected range: -16.8559 10.2251
Severe: rms_fgdepar=51.0139, expected range: 0.0000 13.2957
Severe: avg_pge=0.9993, expected range: -0.0427 0.0543
ship
SHIP SURFACE PRESSURE (PA) WGAH : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=613.0510, expected range: -1046.2602 1109.5346
Severely_persistent: rms_fgdepar=620.7362, expected range: -680.1894 969.0199
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WGAH : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=613.0510, expected range: -1061.2620 1122.7847
Severely_persistent: rms_fgdepar=620.7362, expected range: -685.2829 978.7080
Severely_persistent: avg_pge=0.8153, expected range: -1.2390 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) AVBC : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8865, expected range: -1.4699 0.7500
AUTOMATIC SHIP SURFACE PRESSURE (PA) 45172 : out of range
Severe: rms_fgdepar=563.5621, expected range: 38.8016 268.9615
SHIP SURFACE PRESSURE (PA) UAKA : out of range
Severe: avg_fgdepar=531.1263, expected range: -239.7117 218.2998
Severe: rms_fgdepar=745.9930, expected range: 0.0000 142.3668
SHIP SURFACE PRESSURE (PA) FNUY : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=724.8047, expected range: -374.7253 533.3980
Severe: rms_fgdepar=724.8047, expected range: 0.0000 424.2277
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ASES01 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=609.8081, expected range: -473.8876 496.4958
Severe: rms_fgdepar=611.1817, expected range: 0.0000 418.0484
Severe: avg_pge=0.8983, expected range: -1.0468 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 45172 : out of range
Severe: rms_fgdepar=595.3195, expected range: 0.0000 343.0555
BUFR SHIP SYNOP SURFACE PRESSURE (PA) UAKA : out of range
Severe: avg_fgdepar=531.1263, expected range: -239.7117 218.2998
Severe: rms_fgdepar=745.9930, expected range: 0.0000 142.3668
BUFR SHIP SYNOP SURFACE PRESSURE (PA) PCHM : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=513.5148, expected range: -889.2334 969.0143
Severe: rms_fgdepar=513.5378, expected range: 0.0000 803.5497
Severe: avg_pge=0.8168, expected range: -0.7572 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) FNUY : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=724.8047, expected range: -374.2569 534.0288
Severe: rms_fgdepar=724.8047, expected range: 0.0000 423.6874
Severe: avg_pge=0.8538, expected range: -1.0944 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) V7DQ3 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=20.5833, expected range: 0.0000 16.7297
BUFR SHIP SYNOP RH2M (%) DCQN : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9984, expected range: -1.3892 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601531 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8237, expected range: 0.0903 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1701531 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=419.5829, expected range: 0.0000 114.0852
Severely_persistent: avg_pge=0.8161, expected range: -0.2479 0.2791
DRIFTING BUOYS SURFACE PRESSURE (PA) 4801670 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8193, expected range: -0.5260 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101771 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8282, expected range: -0.4698 0.5332
DRIFTING BUOYS SURFACE PRESSURE (PA) 1701532 : out of range
Severe: rms_fgdepar=303.8084, expected range: 0.0000 124.8368
metar
METAR SURFACE PRESSURE (PA) FQNC : out of range
Severe: rms_fgdepar=330.3947, expected range: 0.0000 108.2717
METAR SURFACE PRESSURE (PA) PALJ : out of range
Severe: rms_fgdepar=379.4420, expected range: 0.0000 163.6921
METAR SURFACE PRESSURE (PA) SBMK : out of range
Severe: rms_fgdepar=310.9560, expected range: 0.0000 109.2584
t2m
LAND TEMP 2M TEMPERATURE (K) 72376 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.5083, expected range: -17.3321 10.7050
Severely_persistent: rms_fgdepar=12.5083, expected range: 0.0000 14.2346
Severely_persistent: avg_est_pge=0.8819, expected range: -0.2875 1.3961
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-18.6623, expected range: -20.4867 -13.5079
Severely_persistent: rms_fgdepar=18.6623, expected range: 13.6560 20.5084
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 38112 : out of range
Severe: avg_fgdepar=-12.9366, expected range: -8.3257 9.6154
Severe: rms_fgdepar=13.1601, expected range: 0.0000 8.6031
MANUAL LAND SYNOP 2M TEMPERATURE (K) 85364 : out of range
Severe: avg_est_pge=0.8221, expected range: -0.3568 0.9078
METAR 2M TEMPERATURE (K) KNEL : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.8815, expected range: -15.1433 11.9658
Severe: rms_fgdepar=14.8815, expected range: 0.0000 15.5428
METAR 2M TEMPERATURE (K) OITL : out of range
Severe: rms_fgdepar=13.4020, expected range: 0.0000 5.6302
BUFR LAND SYNOP 2M TEMPERATURE (K) 38112 : out of range
Severe: avg_fgdepar=-12.9866, expected range: -8.2267 9.2725
Severe: rms_fgdepar=13.2093, expected range: 0.0000 7.8694
rh2m
AUTOMATIC LAND SYNOP RH2M (%) 85934 : out of range
Severe: rms_fgdepar=33.9034, expected range: 0.0000 16.4769
MANUAL LAND SYNOP RH2M (%) 43275 : out of range
Severe: rms_fgdepar=31.1837, expected range: 0.0000 17.7209
METAR RH2M (%) SCCI : out of range
Severe: rms_fgdepar=33.8392, expected range: 0.0000 12.5015
LAND TEMP RH2M (%) 85934 : out of range
Severe: rms_fgdepar=34.8036, expected range: 0.0000 16.2922