Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-08-10 00:00

amsua
NOAA-15 AMSUA RADIANCES CHANNEL 13 : out of range
2 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.1750, expected range: 0.2067 0.2631
iasi
METOP-C IASI RADIANCES CHANNEL 176 : out of range
Considerable: avg_biascorr=0.0655, expected range: -0.0627 0.0173
cris
NOAA20 CRIS RADIANCES (136 channels affected) : out of range
Considerable: obs_number=2204.0000, expected range: 12015.4172 32766.9281
NOAA20 CRIS RADIANCES CHANNEL 1109 : out of range
1 times in the last 10 days for at least one item
Slight: avg_fgdepar=-0.0828, expected range: -0.0472 0.0795
airs
AQUA AIRS RADIANCES CHANNEL 1948 : missing
8 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 1692.9061 7840.0809
gpsro
All COSMIC2-E5 GPSRO RISING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 336.30 3220.27
Atmospheric Motion Vector
HIMAWARI-8 AMV IR1 WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: obs_number=946.0000, expected range: 466.4315 779.3185
Radiosondes
LAND TEMP TEMPERATURE (K) 61660 PRESSURE LAYER 0-300 (HPA) : out of range
32 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=9.4202, expected range: 11.2542 30.0920
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : missing
3 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 178.1389 193.1944
Severe: obs_number=0.0000, expected range: 14.4443 395.4841
Severe: obs_number=0.0000, expected range: 0.0000 554.8576
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 0-300 (HPA) : missing
5 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 5.0987 541.4035
LAND TEMP TEMPERATURE (K) 60715 PRESSURE LAYER 0-300 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8758, expected range: -1.7276 0.7500
LAND TEMP TEMPERATURE (K) 71926 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=19.3555, expected range: -0.6052 0.2965
Severe: rms_fgdepar=19.3575, expected range: 0.0000 2.4613
Severe: avg_pge=0.8662, expected range: -0.0591 0.1087
LAND TEMP Q (G/KG) 41024 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=6.1448, expected range: 0.0000 8.7758
LAND TEMP Q (G/KG) 41217 PRESSURE LAYER 900-1200 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=6.8319, expected range: 0.0000 14.6578
HIGH RESO LAND TEMP TEMPERATURE (K) (3 pressure layers affected) : missing
3 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 1022.6818
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA : missing
Severe: obs_number=0.0000, expected range: 5.3572 851.2746
HIGH RESO LAND TEMP Q (G/KG) 72634 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.8917, expected range: 0.0000 1.5922
HIGH RESO LAND TEMP Q (G/KG) 72659 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=4.1883, expected range: 0.0000 2.2450
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : missing
Severe: obs_number=0.0000, expected range: 32.8233 603.3398
BUFR TEMP DESCENT Q (G/KG) 10113 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.0029, expected range: 0.0000 1.4747
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=170.0000, expected range: 49.7567 91.9933
amdar
AMDAR WIND VECTOR DIFF (M/S) BR712393 PRESSURE LAYER 0-300 (HPA) : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=31.3954, expected range: -11.7922 52.0011
Severely_persistent: rms_fgdepar=31.4021, expected range: 0.0000 51.9306
Severely_persistent: avg_pge=0.8990, expected range: 0.2201 0.7500
AMDAR TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=3.2152, expected range: 0.3503 1.6045
Severe: rms_fgdepar=3.5538, expected range: 0.2755 1.4934
AMDAR WIND VECTOR DIFF (M/S) BR853092 PRESSURE LAYER 0-300 (HPA) : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=24.0527, expected range: -6.9645 40.3104
Severe: rms_fgdepar=25.0454, expected range: 0.0000 41.1827
Severe: avg_pge=0.8556, expected range: -0.1121 0.7500
AMDAR WIND VECTOR DIFF (M/S) 00000315 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.4108, expected range: 0.0000 9.0914
AMDAR WIND VECTOR DIFF (M/S) BR998497 PRESSURE LAYER 0-300 (HPA) : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=29.1009, expected range: 2.8907 25.8034
Severe: rms_fgdepar=29.1009, expected range: 3.4385 26.6721
Severe: avg_pge=0.8888, expected range: 0.0782 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) NQXIR3RA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=25.8334, expected range: -1.6933 6.5981
Severe: rms_fgdepar=25.8334, expected range: 0.0000 8.0317
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) PRESSURE LAYER 900-1200 (HPA) : out of range
Considerable: obs_number=250.0000, expected range: 296.7254 352.2746
synop
MANUAL LAND SYNOP RH2M (%) 76040 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9778, expected range: -0.6320 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42441 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8084, expected range: -1.2587 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 91425 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8238, expected range: -1.4263 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43359 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-533.3417, expected range: -1042.6787 716.1997
Severely_persistent: rms_fgdepar=533.3417, expected range: -700.5918 1032.8610
Severely_persistent: avg_pge=0.8814, expected range: -1.6068 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 91682 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8935, expected range: -0.8276 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72494 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8238, expected range: 0.7207 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72327 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8723, expected range: 0.8500 0.7500
MANUAL LAND SYNOP Z (M) 38734 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9427, expected range: -1.8028 0.7500
MANUAL LAND SYNOP RH2M (%) 38511 : out of range
Severe: rms_fgdepar=38.0103, expected range: 0.0000 20.5474
Severe: avg_pge=0.9161, expected range: -0.1586 0.1884
MANUAL LAND SYNOP RH2M (%) 42935 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8985, expected range: -0.5163 0.7500
MANUAL LAND SYNOP RH2M (%) 42546 : out of range
Severe: avg_fgdepar=53.3134, expected range: -15.3078 28.6796
Severe: rms_fgdepar=53.3134, expected range: 0.0000 28.6796
Severe: avg_pge=1.0000, expected range: -0.0043 0.0120
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42740 : out of range
Severe: avg_fgdepar=-893.3138, expected range: -127.9856 241.8849
Severe: rms_fgdepar=893.3138, expected range: 0.0000 241.8849
Severe: avg_pge=0.9366, expected range: -0.2771 0.3805
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42744 : out of range
Severe: avg_fgdepar=-1010.5264, expected range: -69.5591 228.9484
Severe: rms_fgdepar=1010.5264, expected range: 0.0000 228.9484
Severe: avg_pge=0.9432, expected range: -0.6036 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 97284 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=409.5288, expected range: 0.0000 105.1578
Severe: avg_pge=0.8177, expected range: -1.1875 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 91317 : out of range
Severe: avg_pge=0.8074, expected range: -1.1100 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 61099 : out of range
Severe: rms_fgdepar=397.6743, expected range: 0.0000 254.8457
Severe: avg_pge=0.8477, expected range: -0.8898 0.7500
BUFR LAND SYNOP RH2M (%) 07153 : out of range
Severe: rms_fgdepar=30.4516, expected range: 0.0000 16.9235
BUFR LAND SYNOP RH2M (%) 16084 : out of range
Severe: avg_pge=0.8649, expected range: -0.8975 0.7500
BUFR LAND SYNOP RH2M (%) 10348 : out of range
Severe: rms_fgdepar=41.3427, expected range: 0.0000 17.6759
BUFR LAND SYNOP RH2M (%) 72659 : out of range
Severe: avg_fgdepar=-50.9943, expected range: -42.6272 41.8880
Severe: rms_fgdepar=50.9943, expected range: 0.0000 32.6103
BUFR LAND SYNOP SURFACE PRESSURE (PA) 06400 : out of range
Severe: rms_fgdepar=316.3739, expected range: 7.7562 145.6657
BUFR LAND SYNOP SURFACE PRESSURE (PA) 42740 : out of range
Severe: avg_fgdepar=-893.3138, expected range: -256.1292 429.6783
Severe: rms_fgdepar=893.3138, expected range: 0.0000 429.6783
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48112 : out of range
Severe: avg_pge=0.8542, expected range: -0.8675 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 25503 : out of range
Severe: rms_fgdepar=543.1940, expected range: 0.0000 197.8314
BUFR LAND SYNOP SURFACE PRESSURE (PA) 27176 : out of range
Severe: rms_fgdepar=517.8943, expected range: 0.0000 82.7447
BUFR LAND SYNOP SURFACE PRESSURE (PA) 27648 : out of range
Severe: rms_fgdepar=524.5386, expected range: 0.0000 75.9915
ship
SHIP SURFACE PRESSURE (PA) V7FF3 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1090.3755, expected range: 693.0756 1226.5863
Severely_persistent: rms_fgdepar=1090.3755, expected range: 693.0756 1226.5863
SHIP SURFACE PRESSURE (PA) WGAH : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=642.4588, expected range: -874.8670 873.3869
Severely_persistent: rms_fgdepar=646.5340, expected range: -538.5746 776.5675
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7FF3 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1090.3755, expected range: 693.0756 1226.5863
Severely_persistent: rms_fgdepar=1090.3755, expected range: 693.0756 1226.5863
Severely_persistent: avg_pge=0.9044, expected range: 0.8634 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7BN6 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-791.4610, expected range: -1801.8071 1178.8797
Severely_persistent: rms_fgdepar=791.4610, expected range: 0.0000 1692.1144
Severely_persistent: avg_pge=0.8856, expected range: -0.8885 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WGAH : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=652.1512, expected range: -893.4023 890.0611
Severely_persistent: rms_fgdepar=656.0239, expected range: -548.4576 791.3322
Severely_persistent: avg_pge=0.8376, expected range: -1.1318 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) AVBC : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8864, expected range: -1.4607 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) ELDMMXN : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9005, expected range: -0.1236 0.7500
SHIP SURFACE PRESSURE (PA) VRKK2 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-511.9169, expected range: -958.6608 660.6089
Severe: rms_fgdepar=511.9169, expected range: 0.0000 754.3086
SHIP SURFACE PRESSURE (PA) V7BN6 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-791.4610, expected range: -1940.6055 1280.9844
Severe: rms_fgdepar=791.4610, expected range: 0.0000 1801.6759
SHIP SURFACE PRESSURE (PA) FNUY : out of range
Severe: avg_fgdepar=633.6853, expected range: -402.3478 560.8586
Severe: rms_fgdepar=633.6862, expected range: 0.0000 442.8022
ABBREVIATED SHIP SURFACE PRESSURE (PA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=570.6671, expected range: 0.0000 937.6286
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ASES01 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=553.4205, expected range: -451.3223 453.7111
Severe: rms_fgdepar=554.3123, expected range: 0.0000 412.5881
Severe: avg_pge=0.8952, expected range: -1.0735 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRKK2 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-511.9169, expected range: -970.6346 639.4687
Severe: rms_fgdepar=511.9169, expected range: 0.0000 762.1330
Severe: avg_pge=0.8366, expected range: -0.8309 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) FNUY : out of range
Severe: avg_fgdepar=633.6853, expected range: -401.8250 561.5572
Severe: rms_fgdepar=633.6862, expected range: 0.0000 442.0971
Severe: avg_pge=0.8383, expected range: -1.1188 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRMD3 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8819, expected range: -0.6037 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) V7KD5 : out of range
Severe: avg_pge=0.9023, expected range: -1.1759 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) V7OE6 : out of range
Severe: rms_fgdepar=15.0103, expected range: 0.0000 8.2634
Severe: avg_pge=0.8878, expected range: -1.1352 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 1701531 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-572.1066, expected range: -109.0987 101.7001
Severe: rms_fgdepar=575.8633, expected range: 0.0000 115.4271
Severe: avg_pge=0.9033, expected range: -0.2533 0.2861
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101771 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=508.1401, expected range: 0.0000 189.2324
Severe: avg_pge=0.8556, expected range: -0.3231 0.3535
DRIFTING BUOYS SURFACE PRESSURE (PA) 3401504 : out of range
Severe: rms_fgdepar=353.6629, expected range: 0.0000 248.8161
Severe: avg_pge=0.8263, expected range: -0.4328 0.7027
metar
METAR SURFACE PRESSURE (PA) EGYE : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=514.9663, expected range: -491.0627 680.2348
AUTOMATIC METAR SURFACE PRESSURE (PA) EBFN : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=359.1332, expected range: 0.0000 71.7520
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8324, expected range: -0.1653 1.2492
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-16.4539, expected range: -20.4557 -13.4173
Severely_persistent: rms_fgdepar=16.8088, expected range: 13.5657 20.4809
BUFR LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8317, expected range: -0.1890 1.2666
METAR 2M TEMPERATURE (K) KSKA : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-16.1073, expected range: -6.9712 5.1144
Severe: rms_fgdepar=16.1073, expected range: 0.0000 9.9428
LAND TEMP 2M TEMPERATURE (K) 48565 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.7679, expected range: -4.5292 6.1167
Severe: rms_fgdepar=12.7679, expected range: 0.0000 4.6165
rh2m
MANUAL LAND SYNOP RH2M (%) 08223 : out of range
Severe: rms_fgdepar=33.4744, expected range: 0.0000 15.2347