Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2019-09-16 00:00

gpsro
All TERRASAR-X SETTING ALL HEIGHTS Global : all data missing
Severe: obs_number=0, expected range: 0.00 1482.14
All TANDEM-X RISING ALL HEIGHTS Global : all data missing
Severe: obs_number=0, expected range: 10.05 1137.00
Radiosondes
LAND TEMP TEMPERATURE (K) 29612 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=8.8995, expected range: 0.0966 2.0078
Severe: avg_pge=0.9038, expected range: -0.0692 0.0979
LAND TEMP TEMPERATURE (K) 29263 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=7.3406, expected range: 0.1985 2.0268
LAND TEMP TEMPERATURE (K) 29263 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_pge=0.8836, expected range: -0.1050 0.1906
LAND TEMP TEMPERATURE (K) 42339 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=14.3645, expected range: 0.0000 5.0103
All LAND TEMP WIND VECTOR DIFF (M/S) ALL LAYERS WMO BLOCK 16 : all data missing
Severe: obs_number=0, expected range: 28.79 123.55
HIGH RESO LAND TEMP TEMPERATURE (K) (3 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=769.0000, expected range: 939.5148 988.9297
HIGH RESO LAND TEMP Q (G/KG) 72764 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=4.1262, expected range: 0.0000 1.7130
amdar
AMDAR WIND VECTOR DIFF (M/S) (2 pressure layers affected) : out of range
Severe: rms_fgdepar=5.4234, expected range: 2.4055 4.0864
Considerable: avg_fgdepar=4.1164, expected range: 2.0896 3.3898
AMDAR WIND VECTOR DIFF (M/S) JP9ZV879 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=15.4298, expected range: 0.0000 7.3359
AMDAR WIND VECTOR DIFF (M/S) JP9Z5Y49 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=16.5114, expected range: 0.0000 8.6433
AMDAR WIND VECTOR DIFF (M/S) JP9ZXY89 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=16.4180, expected range: 0.0000 8.3051
AMDAR WIND VECTOR DIFF (M/S) JP9Z46X9 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=17.7379, expected range: 0.0000 6.3603
AMDAR TEMPERATURE (K) JP9Z4X79 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=7.5515, expected range: 0.0000 2.6696
WIGOS AMDAR WIND VECTOR DIFF (M/S) CARWUWBA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=16.2161, expected range: 0.0000 7.6709
airep
AIREP WIND VECTOR DIFF (M/S) AAL156 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.9268, expected range: 0.0000 10.1905
AIREP WIND VECTOR DIFF (M/S) AFR008 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.4897, expected range: 0.0000 7.7861
AIREP WIND VECTOR DIFF (M/S) BAW21G PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.7235, expected range: 0.0000 7.8018
Severe: avg_pge=0.8062, expected range: -0.2449 0.3245
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 10169 PRESSURE LAYER 600-900 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=15.2367, expected range: 0.0000 11.0499
Severe: avg_pge=0.8676, expected range: -0.6702 0.7500
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 48551 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=31.6099, expected range: 0.0000 17.6218
Severe: avg_pge=0.8876, expected range: -0.1549 0.7500
synop
AUTOMATIC LAND SYNOP RH2M (%) 68155 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9474, expected range: -0.6355 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42711 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8905, expected range: -1.2131 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42894 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8259, expected range: -1.3694 0.7500
BUFR LAND SYNOP RH2M (%) 02468 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=56.8200, expected range: 0.0000 36.0688
Severely_persistent: avg_pge=0.9957, expected range: -1.2075 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 47670 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=309.8178, expected range: 0.0000 131.7424
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 47672 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=345.6124, expected range: 0.0000 106.4961
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 47682 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=405.6599, expected range: 0.0000 153.3260
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 47674 : out of range
Severe: rms_fgdepar=437.8037, expected range: 0.0000 111.7037
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 89815 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8619, expected range: -0.3650 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 47648 : out of range
Severe: rms_fgdepar=460.3377, expected range: 0.0000 133.5279
AUTOMATIC LAND SYNOP RH2M (%) 94306 : out of range
Severe: rms_fgdepar=27.7407, expected range: 0.0000 14.6184
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40930 : out of range
Severe: rms_fgdepar=1092.5450, expected range: 8.5576 208.6323
Severe: avg_pge=0.9185, expected range: -0.1721 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 47662 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=346.9076, expected range: 0.0000 125.5332
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 80214 : out of range
Severe: avg_pge=0.8257, expected range: 0.4310 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40606 : out of range
Severe: rms_fgdepar=680.2745, expected range: 0.0000 194.8077
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 94229 : out of range
Severe: rms_fgdepar=380.4855, expected range: 0.0000 107.0739
Severe: avg_pge=0.8344, expected range: -0.3519 0.3902
MANUAL LAND SYNOP RH2M (%) 60430 : out of range
Severe: avg_pge=0.9354, expected range: -0.0391 0.0515
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48930 : out of range
Severe: rms_fgdepar=718.9301, expected range: 0.0000 228.4022
BUFR LAND SYNOP SURFACE PRESSURE (PA) 26763 : out of range
Severe: rms_fgdepar=308.8134, expected range: 0.0000 62.4440
BUFR LAND SYNOP SURFACE PRESSURE (PA) 30637 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8470, expected range: -1.3948 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 94229 : out of range
Severe: rms_fgdepar=398.6489, expected range: 0.0000 62.8750
Severe: avg_pge=0.8604, expected range: 0.0000 0.0000
BUFR LAND SYNOP SURFACE PRESSURE (PA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_biascorr=1.2575, expected range: 6.9450 12.3947
BUFR LAND SYNOP RH2M (%) 40420 : out of range
Severe: rms_fgdepar=44.1732, expected range: 0.0000 23.3785
BUFR LAND SYNOP RH2M (%) 71550 : out of range
Severe: rms_fgdepar=37.8316, expected range: 0.0000 29.8548
Severe: avg_pge=0.9025, expected range: -0.0630 0.0757
BUFR LAND SYNOP RH2M (%) 94721 : out of range
Severe: rms_fgdepar=43.1925, expected range: 0.0000 37.9027
Severe: avg_pge=0.9605, expected range: -0.0125 0.0219
BUFR LAND SYNOP RH2M (%) 71312 : out of range
Severe: rms_fgdepar=24.5547, expected range: 0.0000 13.9160
BUFR LAND SYNOP RH2M (%) 72462 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=42.5018, expected range: 0.0000 12.6572
BUFR LAND SYNOP RH2M (%) 94772 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8547, expected range: -1.3204 0.7500
BUFR LAND SYNOP RH2M (%) 10743 : out of range
Severe: rms_fgdepar=19.6377, expected range: 0.0000 8.6100
BUFR LAND SYNOP RH2M (%) 94673 : out of range
Severe: avg_pge=1.0000, expected range: -0.1084 0.1401
BUFR LAND SYNOP RH2M (%) 71036 : out of range
Severe: rms_fgdepar=37.9275, expected range: 0.0000 28.3485
Severe: avg_pge=0.9224, expected range: -0.0148 0.0230
ship
AUTOMATIC SHIP SURFACE PRESSURE (PA) 44058 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8208, expected range: 0.1549 0.7500
SHIP SURFACE PRESSURE (PA) UDKG : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8755, expected range: -0.8710 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) LF4J : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9051, expected range: 0.3116 0.7500
SHIP SURFACE PRESSURE (PA) 9VDD2 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8122, expected range: -0.3071 0.7500
SHIP SURFACE PRESSURE (PA) OXLT2 : out of range
Severe: avg_pge=0.8303, expected range: -1.0855 0.7500
SHIP SURFACE PRESSURE (PA) D5LA6 : out of range
Severe: avg_pge=0.8204, expected range: -1.1991 0.7500
SHIP SURFACE PRESSURE (PA) C6DD6 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8719, expected range: -1.0626 0.7500
SHIP SURFACE PRESSURE (PA) V7QK9 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8208, expected range: -0.4169 0.7500
SHIP SURFACE PRESSURE (PA) WPTC : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8430, expected range: 0.1196 0.7500
SHIP WIND VECTOR DIFF (M/S) OUHC2 : out of range
Severe: rms_fgdepar=16.8533, expected range: 0.0000 14.2713
Severe: avg_pge=0.8723, expected range: -0.8469 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-7.5646, expected range: 0.0000 0.0000
DRIFTING BUOYS SURFACE PRESSURE (PA) 5301764 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=679.9701, expected range: 0.0000 144.7002
Severe: avg_pge=0.9246, expected range: -0.6202 0.7473
snow
BUFR LAND SYNOP SNOW (CM) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.0051, expected range: 0.0000 0.0000
Severely_persistent: rms_fgdepar=0.0462, expected range: 0.0000 0.0000
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89799 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8158, expected range: 0.2387 1.1177
MANUAL LAND SYNOP 2M TEMPERATURE (K) : out of range
8 times in the last 10 days for at least one item
Severely_persistent: obs_number=67.0000, expected range: 66.0000 66.0000
LAND TEMP 2M TEMPERATURE (K) 89009 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8558, expected range: 0.4454 1.0972
MANUAL LAND SYNOP 2M TEMPERATURE (K) 89532 : out of range
Severe: rms_fgdepar=7.3627, expected range: 0.0000 3.9267
MANUAL LAND SYNOP 2M TEMPERATURE (K) 89009 : out of range
2 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8209, expected range: 0.3215 1.0604
METAR 2M TEMPERATURE (K) EGHC : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=11.4662, expected range: 0.0000 3.2768
METAR 2M TEMPERATURE (K) KMYR : out of range
Severe: rms_fgdepar=9.3993, expected range: 0.0000 4.4027
METAR 2M TEMPERATURE (K) LPCS : out of range
Severe: rms_fgdepar=7.9185, expected range: 0.1712 4.2460
LAND TEMP 2M TEMPERATURE (K) 89664 : out of range
1 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8070, expected range: -0.5542 1.3140
BUFR LAND SYNOP 2M TEMPERATURE (K) : out of range
3 times in the last 10 days for at least one item
Severe: obs_number=191.0000, expected range: 89.2375 141.8976
rh2m
MANUAL LAND SYNOP RH2M (%) 83377 : out of range
Severe: rms_fgdepar=30.8026, expected range: 0.0000 13.8323
BUFR LAND SYNOP RH2M (%) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=190.0000, expected range: 71.4123 159.5606