Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2019-08-18 12:00

cris
NPP/CRIS RADIANCES (111 channels affected) : out of range
Severe: avg_biascorr=0.2549, expected range: 0.1706 0.2148
NPP/CRIS RADIANCES (139 channels affected) : out of range
Severe: obs_number=8918.0000, expected range: 4555.1757 6066.2761
NPP/CRIS RADIANCES (17 channels affected) : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=0.3620, expected range: -0.0527 0.0714
NPP/CRIS RADIANCES (23 channels affected) : out of range
Severe: stdev_fgdepar=2.2640, expected range: 0.3586 0.5682
Atmospheric Motion Vector
METEOSAT-11/AMV CLOUDY WV2 WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 : out of range
Considerable: obs_number=2944.0000, expected range: 1283.8021 2600.7862
Geostationary CSR
GOES-15/IMAGER RADIANCES CHANNEL 2 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: obs_number=124882.0000, expected range: 16964.8647 35595.6496
GOES-15/IMAGER RADIANCES CHANNEL 3 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: obs_number=34802.0000, expected range: 3203.5514 15539.7058
Radiosondes
LAND TEMP TEMPERATURE (K) 24959 PRESSURE LAYER 300-600 (HPA) : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=8.6232, expected range: 0.0000 3.8649
Severely_persistent: avg_pge=0.8815, expected range: -0.7018 0.7500
HIGH RESO LAND TEMP TEMPERATURE (K) (4 pressure layers affected) : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0000, expected range: 0.4001 0.6186
LAND TEMP WIND VECTOR DIFF (M/S) 32389 PRESSURE LAYER 300-600 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=17.6452, expected range: 0.0000 9.9283
LAND TEMP WIND VECTOR DIFF (M/S) 72456 PRESSURE LAYER 900-1200 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=17.5966, expected range: 0.0000 10.1806
Severe: avg_pge=0.8917, expected range: -1.0894 0.7500
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
3 times in the last 10 days for at least one item
Severe: obs_number=91.0000, expected range: 165.2900 212.4600
amdar
WIGOS AMDAR TEMPERATURE (K) PMGEIRJA (2 pressure layers affected) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=5.3296, expected range: 0.0000 1.3256
AMDAR WIND VECTOR DIFF (M/S) AU0160 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=17.1141, expected range: 0.0000 7.4591
WIGOS AMDAR TEMPERATURE (K) MX0004 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.2109, expected range: 0.0000 5.1246
Severe: avg_pge=0.8924, expected range: -0.7103 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) O3CIR4JA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.8513, expected range: 0.0000 10.6131
WIGOS AMDAR WIND VECTOR DIFF (M/S) A0CYR4JA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.4498, expected range: 0.0000 8.9104
WIGOS AMDAR WIND VECTOR DIFF (M/S) CMFYCKJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.1735, expected range: 0.0000 8.3442
WIGOS AMDAR WIND VECTOR DIFF (M/S) OFRENVJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.8404, expected range: 0.0000 8.5336
WIGOS AMDAR WIND VECTOR DIFF (M/S) YWVENVJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.9560, expected range: 0.0000 7.9649
WIGOS AMDAR WIND VECTOR DIFF (M/S) 2HKBO0RA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.8895, expected range: 0.0000 8.5124
WIGOS AMDAR WIND VECTOR DIFF (M/S) 5MLIR4RA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.6852, expected range: 1.4583 6.4945
WIGOS AMDAR WIND VECTOR DIFF (M/S) R31EITRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.2802, expected range: 0.0000 9.9733
WIGOS AMDAR WIND VECTOR DIFF (M/S) 03ZYTKZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.2659, expected range: 0.0000 9.2671
WIGOS AMDAR WIND VECTOR DIFF (M/S) J32YR3JA PRESSURE LAYER 300-600 (HP : out of range
Severe: rms_fgdepar=19.4923, expected range: 0.0000 11.0857
WIGOS AMDAR WIND VECTOR DIFF (M/S) ZRCIR4ZA PRESSURE LAYER 300-600 (HP : out of range
Severe: rms_fgdepar=19.2232, expected range: 0.0000 7.5192
WIGOS AMDAR WIND VECTOR DIFF (M/S) MX0023 PRESSURE LAYER 600-900 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=49.9196, expected range: 0.6570 5.8981
Severe: avg_pge=0.9401, expected range: -0.2065 0.4325
WIGOS AMDAR WIND VECTOR DIFF (M/S) V2VFJEJA PRESSURE LAYER 600-900 (HP : out of range
Severe: rms_fgdepar=18.1633, expected range: 0.0000 8.0204
WIGOS AMDAR WIND VECTOR DIFF (M/S) R0AVJEJA PRESSURE LAYER 600-900 (HP : out of range
Severe: rms_fgdepar=21.6429, expected range: 0.0000 8.0728
WIGOS AMDAR WIND VECTOR DIFF (M/S) AU0160 PRESSURE LAYER 900-1200 (HPA : out of range
Severe: rms_fgdepar=17.1086, expected range: 0.0000 6.5369
WIGOS AMDAR WIND VECTOR DIFF (M/S) ID1HWEZA PRESSURE LAYER 900-1200 (H : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=15.2268, expected range: 0.0000 5.4048
WIGOS AMDAR TEMPERATURE (K) PRESSURE LAYER 300-600 (HPA) : out of range
Considerable: rms_fgdepar=0.9814, expected range: 0.4853 0.7853
Slight: avg_fgdepar=0.2443, expected range: -0.1951 0.1814
WIGOS AMDAR WIND VECTOR DIFF (M/S) (2 pressure layers affected) : out of range
Slight: rms_fgdepar=4.1809, expected range: 2.0721 3.9227
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 10950 PRESSURE LAYER 300-600 : out of range
Severe: rms_fgdepar=27.0035, expected range: 0.0000 15.3015
Severe: avg_pge=0.8863, expected range: -0.4304 0.7500
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 10629 PRESSURE LAYER 600-900 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=22.8449, expected range: 0.0000 17.2432
Severe: avg_pge=0.8206, expected range: -0.6476 0.7500
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 74455 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=15.5372, expected range: 0.0000 6.3734
synop
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42473 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8312, expected range: -1.2735 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=128.7934, expected range: 53.9750 93.9774
BUFR LAND SYNOP SURFACE PRESSURE (PA) 81870 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=673.0807, expected range: 0.0000 131.9880
Severely_persistent: avg_pge=0.9415, expected range: -0.4710 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) : out of range
4 times in the last 10 days for at least one item
Severe: obs_number=1333.0000, expected range: 2535.3506 3150.9827
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 72451 : out of range
Severe: rms_fgdepar=339.7273, expected range: 0.0000 148.4931
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 89542 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=601.3700, expected range: 0.0000 448.3182
Severe: avg_pge=0.8766, expected range: -1.1273 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 68443 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=318.0161, expected range: 0.0000 231.7218
Severe: avg_pge=0.8066, expected range: -1.0214 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 68840 : out of range
Severe: rms_fgdepar=24.3617, expected range: 0.0000 13.5061
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 72546 : out of range
Severe: rms_fgdepar=395.2250, expected range: 0.0000 204.3739
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42456 : out of range
Severe: avg_pge=0.8373, expected range: -0.8631 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42367 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8879, expected range: -0.9092 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42408 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8171, expected range: -1.3936 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62309 : out of range
Severe: rms_fgdepar=304.4796, expected range: 0.0000 102.0691
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 13629 : out of range
Severe: avg_pge=0.8167, expected range: -0.7735 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) : out of range
3 times in the last 10 days for at least one item
Severe: avg_biascorr=3.8095, expected range: 0.0000 0.0000
MANUAL LAND SYNOP RH2M (%) 17191 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=26.2520, expected range: 0.0000 9.9473
MANUAL LAND SYNOP RH2M (%) 41712 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8819, expected range: -1.2750 0.7500
MANUAL LAND SYNOP RH2M (%) 51777 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.9688, expected range: -1.7071 0.7500
MANUAL LAND SYNOP RH2M (%) 17248 : out of range
Severe: rms_fgdepar=21.6660, expected range: 0.0000 11.3442
BUFR LAND SYNOP SURFACE PRESSURE (PA) 81982 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=312.0302, expected range: 0.0000 142.1805
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48037 : out of range
Severe: avg_pge=0.8143, expected range: -1.1522 0.7500
BUFR LAND SYNOP RH2M (%) : out of range
Severe: obs_number=168.0000, expected range: 169.0000 169.0000
ship
AUTOMATIC SHIP WIND VECTOR DIFF (M/S) 62140 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8969, expected range: -1.4161 0.7500
SHIP SURFACE PRESSURE (PA) BQHZ : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8590, expected range: -1.2287 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) LF4J : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8723, expected range: 0.0821 0.7500
SHIP WIND VECTOR DIFF (M/S) D5PC7 : out of range
Severe: rms_fgdepar=23.3114, expected range: 0.0000 11.4251
Severe: avg_pge=0.9356, expected range: -0.7727 0.7500
SHIP WIND VECTOR DIFF (M/S) VRXL8 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=27.0083, expected range: 0.0000 15.5387
Severe: avg_pge=0.9432, expected range: -0.3192 0.7500
SHIP SURFACE PRESSURE (PA) D5KR2 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=410.7341, expected range: 0.0000 311.8945
Severe: avg_pge=0.8450, expected range: -0.9378 0.7500
SHIP SURFACE PRESSURE (PA) C6YM5 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=474.9487, expected range: 0.0000 394.2110
Severe: avg_pge=0.8415, expected range: -1.0702 0.7500
SHIP SURFACE PRESSURE (PA) WPAJ : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8260, expected range: -1.0127 0.7500
ABBREVIATED SHIP SURFACE PRESSURE (PA) WCW7550 : out of range
Severe: rms_fgdepar=724.2576, expected range: 0.0000 301.1170
Severe: avg_pge=0.9184, expected range: -1.2820 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 4401549 : out of range
Severe: rms_fgdepar=319.0790, expected range: 0.0000 143.2708
metar
METAR SURFACE PRESSURE (PA) WAHQ : out of range
Severe: rms_fgdepar=420.6271, expected range: 0.0000 181.4322
AUTOMATIC METAR SURFACE PRESSURE (PA) KPEA : out of range
Severe: rms_fgdepar=309.1992, expected range: 0.0000 145.6481
AUTOMATIC METAR SURFACE PRESSURE (PA) KOOA : out of range
Severe: rms_fgdepar=329.0843, expected range: 0.0000 137.7427
AUTOMATIC METAR SURFACE PRESSURE (PA) KOJC : out of range
Severe: rms_fgdepar=316.2805, expected range: 0.0000 178.2447
AUTOMATIC METAR SURFACE PRESSURE (PA) KIXD : out of range
Severe: rms_fgdepar=374.0690, expected range: 0.0000 178.4406
AUTOMATIC METAR SURFACE PRESSURE (PA) KTVK : out of range
Severe: rms_fgdepar=307.3099, expected range: 0.0234 154.7312
AUTOMATIC METAR SURFACE PRESSURE (PA) KMSN : out of range
Severe: rms_fgdepar=344.0446, expected range: 0.0000 137.5874
AUTOMATIC METAR SURFACE PRESSURE (PA) KHYS : out of range
Severe: rms_fgdepar=563.2659, expected range: 0.0000 296.8482
gbrad
GROUND-BASED RADAR WIND VECTOR DIFF (M/S) : out of range
7 times in the last 10 days for at least one item
Slight: obs_number=1100.0000, expected range: 1432.7100 3460.3850
snow
BUFR LAND SYNOP SNOW (CM) : out of range
Severe: rms_fgdepar=0.4699, expected range: -0.1048 0.1445
Considerable: avg_fgdepar=0.0147, expected range: -0.0049 0.0069
t2m
LAND TEMP 2M TEMPERATURE (K) 56137 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8992, expected range: -0.3219 1.4028
LAND TEMP 2M TEMPERATURE (K) 56029 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8568, expected range: 0.0579 1.1974
MANUAL LAND SYNOP 2M TEMPERATURE (K) 84088 : out of range
Severe: rms_fgdepar=10.4636, expected range: 0.0000 4.3499
METAR 2M TEMPERATURE (K) KAFF : out of range
Severe: rms_fgdepar=19.2604, expected range: 0.0000 9.2079
Severe: avg_est_pge=0.8569, expected range: -0.1952 0.5810
METAR 2M TEMPERATURE (K) MHTG : out of range
Severe: rms_fgdepar=8.7119, expected range: 0.8900 5.3246
METAR 2M TEMPERATURE (K) UGMS : out of range
3 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8154, expected range: 0.3390 1.0430
METAR 2M TEMPERATURE (K) MMMT : out of range
Severe: rms_fgdepar=7.2434, expected range: 0.5986 3.8875
LAND TEMP 2M TEMPERATURE (K) 72582 : out of range
Severe: avg_est_pge=0.8001, expected range: -0.0372 1.0877
LAND TEMP 2M TEMPERATURE (K) 16045 : out of range
Severe: rms_fgdepar=10.7152, expected range: 0.0000 4.1768
Severe: avg_est_pge=0.8401, expected range: -0.3558 0.7022
BUFR LAND SYNOP 2M TEMPERATURE (K) 60037 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.3019, expected range: 0.0000 4.2914
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) : out of range
Slight: obs_number=22049.0000, expected range: 22549.5489 24658.6133
rh2m
AUTOMATIC LAND SYNOP RH2M (%) : out of range
5 times in the last 10 days for at least one item
Severely_persistent: obs_number=201.0000, expected range: 1368.3612 1733.6388
MANUAL LAND SYNOP RH2M (%) : out of range
2 times in the last 10 days for at least one item
Severe: obs_number=65.0000, expected range: 66.0000 66.0000