Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-01-19 00:00

amsua
NOAA-15 AMSUA RADIANCES CHANNEL 13 : out of range
Considerable: avg_biascorr=-0.1434, expected range: -0.2137 -0.1595
AQUA AMSUA RADIANCES CHANNEL 14 : out of range
Considerable: stdev_fgdepar=1.3517, expected range: 0.6086 1.2015
iasi
METOP-A IASI RADIANCES (213 channels affected) : out of range
Severe: obs_number=84363.0000, expected range: 122552.1330 127137.8670
cris
NOAA20 CRIS RADIANCES CHANNEL 91 : out of range
Considerable: avg_fgdepar=0.0249, expected range: -0.0144 0.0145
NOAA20 CRIS RADIANCES CHANNEL 93 : out of range
Considerable: avg_fgdepar=0.0274, expected range: -0.0171 0.0160
airs
AQUA AIRS RADIANCES CHANNEL 1794 : missing
7 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 3529.9597 16680.7276
mwhs
FY-3B MWHS RADIANCES CHANNEL 3 : out of range
Severe: stdev_fgdepar=1.6310, expected range: 0.5413 1.2144
atms
NPP ATMS RADIANCES CHANNEL 13 : out of range
1 times in the last 10 days for at least one item
Considerable: stdev_fgdepar=0.4546, expected range: 0.2931 0.4126
NOAA20 ATMS RADIANCES CHANNEL 13 : out of range
Considerable: stdev_fgdepar=0.4252, expected range: 0.2700 0.3737
gpsro
KOMPSAT-5 GPSRO SETTING HEIGHT 16 : out of range
Slight: avg_norm_fgdepar=-0.0515, expected range: 0.0124 0.3540
KOMPSAT-5 GPSRO RISING HEIGHT 13 : out of range
Slight: avg_norm_fgdepar=0.5405, expected range: -0.2020 0.4219
KOMPSAT-5 GPSRO RISING HEIGHT 17 : out of range
Slight: avg_norm_fgdepar=-0.1390, expected range: -0.0408 0.4141
Atmospheric Motion Vector
GOES-17 AMV IR1 WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : out of range
4 times in the last 10 days for at least one item
Slight: stdev_press=89.7884, expected range: 78.0615 85.7546
resat
METOP-B GOME-2 OZONE, TOP PRESSURE LAYER 0-1 (HPA) : out of range
Severe: obs_number=15876.0000, expected range: 13727.6488 14857.6846
Radiosondes
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 67 : all data missing
Severely_persistent: obs_number=0, expected range: 43.13 178.37
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 84 : all data missing
Severely_persistent: obs_number=0, expected range: 112.86 143.47
All HIGH RESO SEA TEMP ALL LAYERS Tropics : all data missing
Severely_persistent: obs_number=0, expected range: 82.71 126.29
All HIGH RESO SEA TEMP ALL LAYERS Alantic Tropical are : all data missing
Severely_persistent: obs_number=0, expected range: 82.71 126.29
LAND TEMP Q (G/KG) 96645 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=3.1010, expected range: 0.0000 1.6336
Severe: avg_pge=0.9770, expected range: -0.0255 0.0376
LAND TEMP Q (G/KG) 97014 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.7421, expected range: 0.4934 1.3963
LAND TEMP Q (G/KG) 96749 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.9789, expected range: 0.0000 1.6472
LAND TEMP TEMPERATURE (K) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=11.3586, expected range: 0.0000 4.2967
Severe: avg_pge=0.9297, expected range: -0.9378 0.7500
LAND TEMP TEMPERATURE (K) 36096 PRESSURE LAYER 900-1200 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=7.6111, expected range: 0.0000 5.7491
Severe: avg_pge=0.8873, expected range: -0.4698 0.7500
LAND TEMP TEMPERATURE (K) 32389 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.3326, expected range: 0.0000 2.7400
HIGH RESO LAND TEMP Q (G/KG) 47991 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=5.3950, expected range: 0.0000 2.5711
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : out of range
Severe: obs_number=597.0000, expected range: 734.2694 806.0163
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 07110 PRESSURE LAYER 300-60 : out of range
Severe: rms_fgdepar=19.2548, expected range: 0.0000 10.0347
HIGH RESO LAND TEMP TEMPERATURE (K) 52203 PRESSURE LAYER 900-1200 (HPA : out of range
Severe: rms_fgdepar=6.1269, expected range: 0.0000 4.8815
Severe: avg_pge=0.8357, expected range: -0.2868 0.7105
HIGH RESO LAND TEMP TEMPERATURE (K) (4 pressure layers affected) : out of range
Severe: obs_number=577.0000, expected range: 270.6024 326.6476
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 88 : all data missing
Severe: obs_number=0, expected range: 55.06 279.13
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 95 : all data missing
Severe: obs_number=0, expected range: 91.73 152.94
All HIGH RESO LAND TEMP ALL LAYERS South Atlantic : all data missing
Severe: obs_number=0, expected range: 55.06 279.13
All HIGH RESO SEA TEMP ALL LAYERS North East Pacific : all data missing
Severe: obs_number=0, expected range: 261.76 324.90
LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=77.0000, expected range: 32.0167 61.6976
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 900-1200 (HPA) : out of range
Considerable: rms_fgdepar=1.2900, expected range: 0.2425 0.8618
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) KBAHPCRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.9580, expected range: 0.0000 7.4459
WIGOS AMDAR WIND VECTOR DIFF (M/S) IBGEIEZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.1093, expected range: 0.0000 5.5280
WIGOS AMDAR TEMPERATURE (K) PRESSURE LAYER 300-600 (HPA) : out of range
Considerable: obs_number=289.0000, expected range: 75.9324 217.8009
airep
AIREP WIND VECTOR DIFF (M/S) ACA859 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=20.9108, expected range: 0.0000 11.2373
Severe: avg_pge=0.8202, expected range: -0.6019 0.7500
AIREP WIND VECTOR DIFF (M/S) BAW6NC PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=23.4690, expected range: 0.0000 6.5657
Severe: avg_pge=0.8423, expected range: -0.6838 0.7500
AIREP WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : out of range
1 times in the last 10 days for at least one item
Slight: obs_number=386.0000, expected range: 70.2432 318.1887
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 07223 PRESSURE LAYER 900-1200 : out of range
Severe: rms_fgdepar=17.7523, expected range: 0.6381 4.2276
Severe: avg_pge=0.9086, expected range: -0.2923 0.4608
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 65510 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=19.2816, expected range: 0.1589 7.7676
LAND PILOT WIND VECTOR DIFF (M/S) 42971 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=16.6789, expected range: 1.7087 5.5930
synop
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71021 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8598, expected range: -0.6287 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24588 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8000, expected range: 0.5704 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=189.5545, expected range: 28.6040 101.3465
Severe: rms_fgdepar=247.5296, expected range: 40.8978 78.8633
Severe: rms_fgdepar=176.2628, expected range: 37.1039 96.5851
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 89014 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=639.4853, expected range: 0.0000 140.9343
Severe: avg_pge=0.9224, expected range: -0.5076 0.7310
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42441 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=520.5046, expected range: 0.0000 244.8944
Severe: avg_pge=0.8897, expected range: -1.3213 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 67225 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8479, expected range: -0.5101 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42237 : out of range
Severe: rms_fgdepar=529.8196, expected range: 0.0000 269.0466
Severe: avg_pge=0.8906, expected range: -0.8337 0.7500
MANUAL LAND SYNOP RH2M (%) 64600 : out of range
Severe: avg_pge=0.9764, expected range: -0.7963 0.7500
MANUAL LAND SYNOP RH2M (%) 38613 : out of range
Severe: rms_fgdepar=58.7810, expected range: 0.0000 47.7735
Severe: avg_pge=0.8579, expected range: -0.0094 0.0197
MANUAL LAND SYNOP RH2M (%) 32477 : out of range
Severe: rms_fgdepar=32.7358, expected range: 0.5959 18.3711
BUFR LAND SYNOP SURFACE PRESSURE (PA) 61641 : out of range
Severe: rms_fgdepar=387.5908, expected range: 0.0000 145.7090
BUFR LAND SYNOP SURFACE PRESSURE (PA) 16263 : out of range
Severe: rms_fgdepar=1005.0966, expected range: 0.0000 111.8826
Severe: avg_pge=0.9372, expected range: -0.2579 0.3425
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72386 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8202, expected range: 0.7324 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24737 : out of range
Severe: rms_fgdepar=553.6978, expected range: 0.0000 117.0861
BUFR LAND SYNOP RH2M (%) 15316 : out of range
Severe: rms_fgdepar=49.2543, expected range: 0.0000 22.1586
BUFR LAND SYNOP RH2M (%) 86626 : out of range
Severe: rms_fgdepar=32.0690, expected range: 0.0000 23.5238
Severe: avg_pge=0.8192, expected range: -0.1079 0.1306
BUFR LAND SYNOP RH2M (%) 56187 : out of range
Severe: rms_fgdepar=38.8190, expected range: 0.0000 17.0192
BUFR LAND SYNOP RH2M (%) 07638 : out of range
Severe: rms_fgdepar=30.5233, expected range: 0.0000 13.4918
BUFR LAND SYNOP Z (M) : out of range
Considerable: rms_fgdepar=56.8734, expected range: 81.2087 125.7736
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V7987 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9199, expected range: 0.5733 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) LAZU5 : out of range
Severe: rms_fgdepar=26.4672, expected range: 0.0000 8.0718
Severe: avg_pge=0.9381, expected range: -0.6875 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) NYKSHIP : out of range
Severe: avg_pge=0.8787, expected range: -1.0142 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) TBWUK50 : out of range
Severe: rms_fgdepar=345.0168, expected range: 0.0000 158.7608
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7LE8 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=873.0780, expected range: 0.0000 464.4677
Severe: avg_pge=0.9023, expected range: -0.5873 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRPF9 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8536, expected range: -0.1023 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HJG9 : out of range
Severe: rms_fgdepar=407.4442, expected range: 0.0000 170.6291
Severe: avg_pge=0.8134, expected range: -0.1142 0.1416
BUFR SHIP SYNOP SURFACE PRESSURE (PA) PDAN : out of range
Severe: rms_fgdepar=719.8570, expected range: 0.0000 284.2460
BUFR SHIP SYNOP SURFACE PRESSURE (PA) DGOQ : out of range
Severe: rms_fgdepar=650.4461, expected range: 0.0000 158.1929
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 4602502 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8376, expected range: -1.7452 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5102721 : out of range
Severe: rms_fgdepar=368.1885, expected range: 0.0000 152.8526
DRIFTING BUOYS SURFACE PRESSURE (PA) 7100061 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8363, expected range: -0.6259 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1701516 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=337.8231, expected range: 0.0000 92.8364
DRIFTING BUOYS SURFACE PRESSURE (PA) 6203576 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=394.4576, expected range: 0.0000 179.3386
metar
METAR SURFACE PRESSURE (PA) LIRN : out of range
Severe: rms_fgdepar=369.8130, expected range: 15.8111 66.1891
snow
MANUAL LAND SYNOP SNOW (CM) 22212 : out of range
Severe: rms_fgdepar=18.5638, expected range: 0.0000 3.4422
MANUAL LAND SYNOP SNOW (CM) 40713 : out of range
Severe: rms_fgdepar=15.1258, expected range: 0.0000 8.5743
MANUAL LAND SYNOP SNOW (CM) 36535 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=41.0142, expected range: 0.0000 9.5230
MANUAL LAND SYNOP SNOW (CM) 17285 : out of range
Severe: rms_fgdepar=21.3350, expected range: 1.1266 8.5754
MANUAL LAND SYNOP SNOW (CM) 14006 : out of range
Severe: rms_fgdepar=18.7556, expected range: 9.1238 12.0822
MANUAL LAND SYNOP SNOW (CM) 29937 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=19.5299, expected range: 0.0000 9.0874
ROCOB TEMP SNOW (CM) 63300872 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=28.5835, expected range: 19.5496 23.7162
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 01084 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=17.4414, expected range: 0.0000 7.5627
Severely_persistent: avg_est_pge=0.8332, expected range: -0.3561 0.5601
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24076 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8069, expected range: 0.5907 0.9280
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24477 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=15.5382, expected range: 6.5712 14.1559
Severely_persistent: avg_est_pge=0.8358, expected range: 0.6690 0.8343
LAND TEMP 2M TEMPERATURE (K) 30372 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8602, expected range: 0.5009 1.0998
BUFR LAND SYNOP 2M TEMPERATURE (K) 51542 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8530, expected range: 0.5697 1.0196
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02890 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=18.4100, expected range: 0.0000 11.1858
Severe: avg_est_pge=0.8431, expected range: -0.3578 0.6552
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 01082 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=17.5484, expected range: 0.0000 8.9420
Severe: avg_est_pge=0.8359, expected range: -0.3490 0.5206
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71192 : out of range
Severe: rms_fgdepar=11.8017, expected range: 0.0000 4.8568
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 01076 : out of range
Severe: rms_fgdepar=11.8488, expected range: 0.0000 5.3387
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02858 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=13.9889, expected range: 0.0000 7.5577
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71779 : out of range
Severe: rms_fgdepar=11.9507, expected range: 0.0000 4.9715
MANUAL LAND SYNOP 2M TEMPERATURE (K) 15320 : out of range
Severe: rms_fgdepar=12.7064, expected range: 0.0000 7.7269
Severe: avg_est_pge=0.8261, expected range: -0.1005 0.7204
MANUAL LAND SYNOP 2M TEMPERATURE (K) 22481 : out of range
Severe: rms_fgdepar=14.2054, expected range: 0.0000 1.7344
MANUAL LAND SYNOP 2M TEMPERATURE (K) 44203 : out of range
4 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8266, expected range: 0.6724 0.8507
MANUAL LAND SYNOP 2M TEMPERATURE (K) 22583 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=11.1455, expected range: 0.0000 2.9797
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24525 : out of range
Severe: avg_est_pge=0.8110, expected range: 0.1763 1.0687
MANUAL LAND SYNOP 2M TEMPERATURE (K) 22127 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=14.3367, expected range: 0.0000 8.0186
MANUAL LAND SYNOP 2M TEMPERATURE (K) 25627 : out of range
2 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8223, expected range: -0.3942 1.1704
MANUAL LAND SYNOP 2M TEMPERATURE (K) 22249 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=14.5189, expected range: -3.5778 6.1769
Severe: avg_est_pge=0.8009, expected range: -0.3814 0.4732
LAND TEMP 2M TEMPERATURE (K) 40265 : out of range
Severe: avg_est_pge=0.8429, expected range: -0.6145 1.6443
BUFR LAND SYNOP 2M TEMPERATURE (K) 71192 : out of range
Severe: rms_fgdepar=11.8788, expected range: 0.0000 4.8446
BUFR LAND SYNOP 2M TEMPERATURE (K) 02805 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=16.6352, expected range: 0.0000 8.1335
Severe: avg_est_pge=0.8270, expected range: -0.3016 0.5200
BUFR LAND SYNOP 2M TEMPERATURE (K) 01076 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=11.9275, expected range: 0.0000 5.3773
BUFR LAND SYNOP 2M TEMPERATURE (K) 71779 : out of range
Severe: rms_fgdepar=12.0689, expected range: 0.0000 4.9640