Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-07-02 12:00

atms
NOAA20 ATMS RADIANCES CHANNEL 8 : out of range
Considerable: stdev_fgdepar=0.1498, expected range: 0.0662 0.1192
ssmis
DMSP-17 SSMIS RADIANCES (6 channels affected) : out of range
Considerable: obs_number=19330.0000, expected range: 20202.2820 22933.0121
gpsro
METOP-C GRAS RISING HEIGHT 2 : out of range
Considerable: obs_number=2433.0000, expected range: 1875.8260 2319.9387
Atmospheric Motion Vector
METEOSAT-11 AMV VIS2 WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HP : out of range
Considerable: avg_fgdepar=2.6709, expected range: 2.0124 2.3252
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 10-11 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: stdev_fgdepar=0.0000, expected range: 0.0061 0.0094
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 20-21 (HPA) : out of range
4 times in the last 10 days for at least one item
Severe: stdev_fgdepar=0.0140, expected range: 0.0081 0.0106
Severe: avg_fgdepar=-0.0421, expected range: -0.0377 -0.0349
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 30-31 (HPA) : out of range
2 times in the last 10 days for at least one item
Considerable: stdev_fgdepar=0.0234, expected range: 0.0124 0.0189
Radiosondes
LAND TEMP TEMPERATURE (K) 28661 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.0159, expected range: 0.0000 2.3423
LAND TEMP TEMPERATURE (K) 23933 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=11.9105, expected range: -0.1487 1.7816
Severe: rms_fgdepar=12.0794, expected range: 0.4030 2.2765
Severe: avg_pge=0.8372, expected range: -0.1086 0.2802
LAND TEMP TEMPERATURE (K) 74455 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=6.0535, expected range: 0.1600 3.1573
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=9.4450, expected range: -2.1490 9.4140
Severe: rms_fgdepar=9.4450, expected range: 0.0000 9.5520
LAND TEMP Q (G/KG) 28695 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=5.1120, expected range: 0.0000 1.4177
Severe: avg_pge=0.9689, expected range: 0.0007 0.0051
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : missing
Severe: obs_number=0.0000, expected range: 0.0000 808.8510
HIGH RESO SEA TEMP TEMPERATURE (K) (3 pressure layers affected) : missing
2 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 25.2348 678.7331
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=220.0000, expected range: 21.7205 126.0979
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=100.0000, expected range: 127.5000 137.5000
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=54.0000, expected range: 85.5002 135.2998
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) AI2UNVBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.7031, expected range: 0.0000 10.0756
WIGOS AMDAR WIND VECTOR DIFF (M/S) 1X4GUWJA PRESSURE LAYER 600-900 (HP : out of range
Severe: rms_fgdepar=16.9830, expected range: 0.0000 7.9553
WIGOS AMDAR Q (G/KG) DVPUOFZA PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-6.3880, expected range: -10.0432 1.5267
Severe: rms_fgdepar=6.4548, expected range: 0.0000 10.2537
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 44373 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=26.2118, expected range: -0.0408 8.4722
Severe: rms_fgdepar=26.2714, expected range: 0.0000 8.7487
Severe: avg_pge=0.8516, expected range: -0.7329 0.7500
synop
AUTOMATIC LAND SYNOP RH2M (%) : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9992, expected range: -0.2222 0.3167
AUTOMATIC LAND SYNOP RH2M (%) 41308 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9992, expected range: -0.2222 0.3167
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 89662 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-525.3753, expected range: -546.0864 584.1259
Severely_persistent: rms_fgdepar=576.7117, expected range: 0.0000 505.5186
Severely_persistent: avg_pge=0.8562, expected range: -0.5509 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40674 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=548.0218, expected range: -644.6123 963.1123
Severely_persistent: rms_fgdepar=548.1438, expected range: 0.0000 959.0133
Severely_persistent: avg_pge=0.8889, expected range: -0.8311 0.7500
MANUAL LAND SYNOP RH2M (%) 62120 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9948, expected range: -1.5764 0.7500
MANUAL LAND SYNOP RH2M (%) 42770 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9730, expected range: -1.8766 0.7500
MANUAL LAND SYNOP RH2M (%) 43021 : out of range
Severe: avg_pge=0.9470, expected range: -0.0977 0.1346
MANUAL LAND SYNOP RH2M (%) 36126 : out of range
Severe: rms_fgdepar=30.2520, expected range: 0.0000 16.5288
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 87320 : out of range
Severe: rms_fgdepar=340.8640, expected range: 0.0000 143.1144
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42661 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8501, expected range: -0.7351 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42181 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=598.5273, expected range: 0.0000 207.2684
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62405 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=416.2028, expected range: 0.0000 111.8686
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40745 : out of range
Severe: rms_fgdepar=318.4149, expected range: 0.0000 94.6170
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 31026 : out of range
Severe: avg_fgdepar=519.9477, expected range: -157.0365 153.4490
Severe: rms_fgdepar=521.2535, expected range: 0.0000 115.2573
Severe: avg_pge=0.8634, expected range: -0.2047 0.2556
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 67297 : out of range
Severe: avg_fgdepar=-1018.3950, expected range: -95.9527 4.8672
Severe: rms_fgdepar=1018.3950, expected range: 0.0000 98.5405
Severe: avg_pge=0.9435, expected range: 0.0000 0.0000
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33513 : out of range
Severe: rms_fgdepar=488.9994, expected range: 0.0000 249.0794
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24967 : out of range
Severe: avg_fgdepar=674.7734, expected range: -337.9459 390.7521
Severe: rms_fgdepar=762.1884, expected range: 0.0000 289.1891
Severe: avg_pge=0.8385, expected range: -1.0130 0.7500
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7SD8 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=630.8956, expected range: -472.7075 1448.5749
Severely_persistent: rms_fgdepar=630.8956, expected range: 0.0000 1446.6026
Severely_persistent: avg_pge=0.8264, expected range: -0.4193 0.7500
SHIP SURFACE PRESSURE (PA) V7FF3 : out of range
Severe: avg_fgdepar=881.6136, expected range: 592.5449 1283.3926
Severe: rms_fgdepar=881.6136, expected range: 592.5449 1283.3926
SHIP SURFACE PRESSURE (PA) V7SD8 : out of range
Severe: avg_fgdepar=630.8956, expected range: -546.6483 1483.1830
Severe: rms_fgdepar=630.8956, expected range: 0.0000 1483.1830
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OZBY2 : out of range
Severe: rms_fgdepar=624.8079, expected range: 0.0000 1453.3019
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7FF3 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=881.6136, expected range: 594.0515 1311.6829
Severe: rms_fgdepar=881.6136, expected range: 594.0515 1311.6829
BUFR SHIP SYNOP SURFACE PRESSURE (PA) D5CN5 : out of range
Severe: avg_pge=0.8031, expected range: -1.0518 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7JD6 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8235, expected range: -0.5477 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 9V5601 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8212, expected range: -1.1001 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRBI2 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8505, expected range: -0.6513 0.7500
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 5300041 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8468, expected range: 0.3581 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601701 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=696.3061, expected range: -980.1802 1148.2715
Severely_persistent: rms_fgdepar=700.2207, expected range: -798.9373 1079.9664
Severely_persistent: avg_pge=0.9140, expected range: -1.4677 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101769 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=703.2678, expected range: -2476.7672 2147.1256
Severely_persistent: rms_fgdepar=705.1389, expected range: 0.0000 1373.5796
DRIFTING BUOYS SURFACE PRESSURE (PA) 3101546 : out of range
Severe: rms_fgdepar=498.0974, expected range: 0.0000 342.8835
Severe: avg_pge=0.8706, expected range: -0.6737 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 3301607 : out of range
Severe: rms_fgdepar=303.3985, expected range: 8.9339 76.8292
metar
METAR SURFACE PRESSURE (PA) FZNA : out of range
Severe: rms_fgdepar=556.0998, expected range: 0.0000 223.4103
METAR SURFACE PRESSURE (PA) EGYE : out of range
Severe: rms_fgdepar=334.2002, expected range: 0.0000 124.9734
snow
BUFR LAND SYNOP SNOW (CM) 01035 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=108.0128, expected range: 106.5556 132.5556
Severely_persistent: rms_fgdepar=108.0185, expected range: 106.5523 132.5661
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89734 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.2247, expected range: -15.7889 1.0063
Severely_persistent: rms_fgdepar=12.2405, expected range: 0.0000 15.7556
Severely_persistent: avg_est_pge=0.8521, expected range: 0.3383 1.0939
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8004, expected range: 0.6076 0.8903
MANUAL LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8097, expected range: 0.2742 1.0969
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
30 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-18.6747, expected range: -20.8597 -11.1762
Severely_persistent: rms_fgdepar=18.6747, expected range: 11.3882 20.8160
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
2 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8123, expected range: 0.3024 1.0768
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 51777 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.6013, expected range: -17.8798 13.6379
Severe: rms_fgdepar=14.6013, expected range: 0.0000 14.1422
Severe: avg_est_pge=0.8337, expected range: -0.2138 1.2525
METAR 2M TEMPERATURE (K) KDXR : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.2624, expected range: 1.2635 4.0687
BUFR LAND SYNOP 2M TEMPERATURE (K) 89734 : out of range
Severe: avg_fgdepar=-12.1787, expected range: -15.4621 0.6885
Severe: rms_fgdepar=12.2004, expected range: 0.0000 15.4114
rh2m
MANUAL LAND SYNOP RH2M (%) 71917 : out of range
Severe: rms_fgdepar=32.0966, expected range: 0.0000 18.0394
All BUFR LAND SYNOP WMO BLOCK 98 : all data missing
Severe: obs_number=0, expected range: 19.58 228.31