Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-04-14 12:00

iasi
METOP-A IASI RADIANCES CHANNEL 236 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0086, expected range: 0.0038 0.0110
METOP-A IASI RADIANCES CHANNEL 292 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.0722, expected range: -0.0535 -0.0342
METOP-B IASI RADIANCES CHANNEL 236 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0394, expected range: 0.0528 0.0578
METOP-C IASI RADIANCES CHANNEL 236 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0076, expected range: 0.0044 0.0123
METOP-C IASI RADIANCES CHANNEL 292 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.0858, expected range: -0.0569 -0.0261
METOP-A IASI RADIANCES CHANNEL 272 : out of range
2 times in the last 10 days for at least one item
Considerable: avg_fgdepar=-0.0989, expected range: -0.0749 -0.0409
METOP-C IASI RADIANCES CHANNEL 566 : out of range
Considerable: stdev_fgdepar=0.4132, expected range: 0.2928 0.3709
cris
NPP CRIS RADIANCES CHANNEL 84 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0360, expected range: -0.0307 -0.0271
NPP CRIS RADIANCES CHANNEL 111 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0235, expected range: -0.0144 -0.0075
NPP CRIS RADIANCES CHANNEL 124 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0687, expected range: -0.0618 -0.0533
NPP CRIS RADIANCES CHANNEL 143 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1122, expected range: -0.1022 -0.0917
NPP CRIS RADIANCES CHANNEL 85 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0723, expected range: -0.0658 -0.0603
NPP CRIS RADIANCES CHANNEL 86 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0495, expected range: -0.0407 -0.0343
NOAA20 CRIS RADIANCES CHANNEL 83 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0008, expected range: 0.0110 0.0116
NOAA20 CRIS RADIANCES CHANNEL 85 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0239, expected range: 0.0275 0.0308
NOAA20 CRIS RADIANCES CHANNEL 109 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.0519, expected range: -0.0392 -0.0261
NOAA20 CRIS RADIANCES CHANNEL 120 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0641, expected range: -0.0587 -0.0531
NOAA20 CRIS RADIANCES CHANNEL 123 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0314, expected range: -0.0232 -0.0222
NOAA20 CRIS RADIANCES CHANNEL 124 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0534, expected range: -0.0411 -0.0381
NOAA20 CRIS RADIANCES CHANNEL 125 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1020, expected range: -0.0901 -0.0868
NOAA20 CRIS RADIANCES CHANNEL 143 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1096, expected range: -0.0925 -0.0886
NOAA20 CRIS RADIANCES CHANNEL 86 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0461, expected range: 0.0525 0.0549
NOAA20 CRIS RADIANCES CHANNEL 110 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0709, expected range: 0.0808 0.0839
airs
AQUA AIRS RADIANCES (125 channels affected) : out of range
Slight: avg_fgdepar=-0.0069, expected range: 0.0374 0.0374
AQUA AIRS RADIANCES CHANNEL 309 : out of range
Slight: stdev_fgdepar=0.4188, expected range: 0.3945 0.3945
AQUA AIRS RADIANCES CHANNEL 338 : out of range
Slight: stdev_fgdepar=0.4018, expected range: 0.3763 0.3763
AQUA AIRS RADIANCES CHANNEL 475 : out of range
Slight: stdev_fgdepar=0.3651, expected range: 0.3428 0.3428
AQUA AIRS RADIANCES CHANNEL 787 : out of range
Slight: stdev_fgdepar=0.2470, expected range: 0.2299 0.2299
AQUA AIRS RADIANCES CHANNEL 1115 : out of range
Slight: stdev_fgdepar=0.3986, expected range: 0.3694 0.3694
AQUA AIRS RADIANCES CHANNEL 1329 : out of range
Slight: stdev_fgdepar=0.2865, expected range: 0.2531 0.2531
mwhs2
FY-3C MWHS2 ALLSKY RADIANCES CHANNEL 15 : out of range
Severe: stdev_norm_fgdepar=1.2735, expected range: 0.6115 0.9584
FY-3C MWHS2 ALLSKY RADIANCES CHANNEL 14 : out of range
Considerable: stdev_norm_fgdepar=1.0913, expected range: 0.6060 0.8939
gpsro
All COSMIC2-E5 GPSRO RISING ALL HEIGHTS Global : all data missing
Severe: obs_number=0, expected range: 577.41 2716.64
COSMIC2-E1 GPSRO SETTING HEIGHT 48-50 KM : out of range
Slight: stdev_norm_fgdepar=0.6047, expected range: 0.2864 0.5095
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1010-1011 (HPA) : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-5.5963, expected range: -5.1319 -4.5394
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1600-1601 (HPA) : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-8.3706, expected range: -7.5458 -7.4766
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 6390-6391 (HPA) : out of range
8 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=5.8912, expected range: 2.8532 4.4850
Radiosondes
LAND TEMP WIND VECTOR DIFF (M/S) 32540 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=21.3815, expected range: 0.0000 14.3569
LAND TEMP WIND VECTOR DIFF (M/S) 31977 (3 pressure layers affected) : out of range
Severe: rms_fgdepar=17.9671, expected range: 0.0000 9.7818
LAND TEMP WIND VECTOR DIFF (M/S) 31977 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_pge=0.8291, expected range: -0.5780 0.7500
LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=140.0000, expected range: 25.3998 95.9335
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=842.0000, expected range: 929.0632 977.8257
HIGH RESO SEA TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=1051.0000, expected range: 416.5124 828.9876
amdar
ADS-C TEMPERATURE (K) PRESSURE LAYER 300-600 (HPA) : missing
7 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 0.0000 286.7588
AMDAR WIND VECTOR DIFF (M/S) JP9ZXXW9 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=15.3183, expected range: 0.0486 5.6090
AMDAR WIND VECTOR DIFF (M/S) JP9Z4XW4 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=16.3546, expected range: 0.0000 8.1371
Severe: avg_pge=0.8229, expected range: -0.5930 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) 41SEWGRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.1708, expected range: 0.0000 7.0009
WIGOS AMDAR WIND VECTOR DIFF (M/S) H0CEILRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.8258, expected range: 0.3923 7.2852
WIGOS AMDAR WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : out of range
Considerable: obs_number=1633.0000, expected range: 154.1564 538.7848
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 67083 (2 pressure layers affected) : out of range
Severe: avg_fgdepar=29.1298, expected range: 1.4554 5.5306
Severe: rms_fgdepar=41.0324, expected range: 1.4699 6.4439
LAND PILOT WIND VECTOR DIFF (M/S) 67083 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_pge=0.9406, expected range: -0.1154 0.1549
synop
MANUAL LAND SYNOP RH2M (%) 42915 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9621, expected range: -1.6193 0.7500
BUFR LAND SYNOP RH2M (%) 86850 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-52.3152, expected range: -93.0610 -13.2774
Severely_persistent: rms_fgdepar=52.7639, expected range: 14.8489 92.2176
BUFR LAND SYNOP SURFACE PRESSURE (PA) 60100 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=725.8753, expected range: -1305.7042 1449.8175
Severely_persistent: rms_fgdepar=725.9820, expected range: 0.0000 1189.0692
Severely_persistent: avg_pge=0.9183, expected range: -0.7102 0.7500
MANUAL LAND SYNOP RH2M (%) 43014 : out of range
Severe: rms_fgdepar=41.0454, expected range: 0.0000 10.9166
Severe: avg_pge=0.8750, expected range: -0.0091 0.0162
MANUAL LAND SYNOP RH2M (%) 42709 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.9998, expected range: -1.8459 0.7500
MANUAL LAND SYNOP RH2M (%) 41739 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9580, expected range: -0.4762 0.6510
MANUAL LAND SYNOP RH2M (%) 42969 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=56.4251, expected range: -17.8190 60.8812
Severe: rms_fgdepar=56.4251, expected range: 0.0000 60.8812
Severe: avg_pge=1.0000, expected range: -1.8315 0.7500
MANUAL LAND SYNOP RH2M (%) 43289 : out of range
Severe: avg_pge=0.9999, expected range: -0.0349 0.0617
MANUAL LAND SYNOP Z (M) 41508 : out of range
Severe: avg_pge=0.9325, expected range: -0.1918 0.2220
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62212 : out of range
Severe: avg_pge=0.8245, expected range: -0.8461 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62305 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=428.0219, expected range: 0.0000 156.5608
Severe: avg_pge=0.8107, expected range: -0.6775 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 44275 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=310.1917, expected range: 0.0000 135.4276
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42937 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8394, expected range: -0.8400 0.7500
BUFR LAND SYNOP RH2M (%) 71002 : out of range
Severe: rms_fgdepar=45.0839, expected range: 0.0000 25.0061
BUFR LAND SYNOP SURFACE PRESSURE (PA) 15302 : out of range
Severe: rms_fgdepar=361.2531, expected range: 0.0000 101.6214
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48074 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8395, expected range: -1.3593 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 40435 : out of range
Severe: avg_pge=0.8247, expected range: -1.1519 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 20967 : out of range
Severe: rms_fgdepar=327.8964, expected range: 0.0000 154.9475
BUFR LAND SYNOP SURFACE PRESSURE (PA) : out of range
Considerable: obs_number=94.0000, expected range: 106.7978 113.8689
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRIC5 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=20.8803, expected range: -12.5448 26.6845
Severe: rms_fgdepar=23.5972, expected range: 0.0000 31.4103
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WC5932 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-533.3542, expected range: -475.9876 672.1389
Severe: rms_fgdepar=555.1237, expected range: 0.0000 484.9126
Severe: avg_pge=0.8311, expected range: -0.8371 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VREU4 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=608.9552, expected range: -100.8834 847.0378
Severe: rms_fgdepar=608.9552, expected range: 0.0000 828.1101
Severe: avg_pge=0.8355, expected range: 0.0255 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 1501741 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8734, expected range: -0.9912 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 2300593 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8245, expected range: -1.1818 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5501670 : out of range
Severe: rms_fgdepar=452.0284, expected range: 0.0000 146.0388
DRIFTING BUOYS SURFACE PRESSURE (PA) 3101602 : out of range
Severe: rms_fgdepar=349.8649, expected range: 0.0000 154.9782
metar
METAR SURFACE PRESSURE (PA) OPMJ : out of range
42 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-1009.6475, expected range: -2498.8570 1310.5140
Severely_persistent: rms_fgdepar=1010.2629, expected range: 0.0000 2454.4744
Severely_persistent: avg_pge=0.8973, expected range: -1.2199 0.7500
snow
MANUAL LAND SYNOP SNOW (CM) 71816 : out of range
30 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-67.0426, expected range: -77.1784 -65.5956
Severely_persistent: rms_fgdepar=67.0426, expected range: 65.5965 77.1799
BUFR LAND SYNOP SNOW (CM) 01192 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-51.3630, expected range: -93.0216 -16.3952
Severely_persistent: rms_fgdepar=51.4299, expected range: 16.4083 93.0312
BUFR LAND SYNOP SNOW (CM) 71816 : out of range
30 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-66.9873, expected range: -77.0781 -65.5015
Severely_persistent: rms_fgdepar=66.9873, expected range: 65.5024 77.0796
AUTOMATIC LAND SYNOP SNOW (CM) 71029 : out of range
Severe: avg_fgdepar=-53.4482, expected range: -57.4524 -55.3661
Severe: rms_fgdepar=53.4482, expected range: 55.2248 57.2654
t2m
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24691 : out of range
Severe: avg_fgdepar=-12.7766, expected range: -10.0963 8.4772
Severe: rms_fgdepar=12.9738, expected range: 0.0000 9.2837
MANUAL LAND SYNOP 2M TEMPERATURE (K) 43017 : out of range
Severe: rms_fgdepar=10.3550, expected range: 0.0000 4.2388
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24588 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.8916, expected range: -4.4596 4.6321
Severe: rms_fgdepar=12.9289, expected range: 0.0000 8.7218
BUFR LAND SYNOP 2M TEMPERATURE (K) 24691 : out of range
Severe: avg_fgdepar=-12.7917, expected range: -10.1047 8.3594
Severe: rms_fgdepar=12.9871, expected range: 0.0000 9.3390
BUFR LAND SYNOP 2M TEMPERATURE (K) 24588 : out of range
Severe: avg_fgdepar=-12.9212, expected range: -4.5013 4.5729
Severe: rms_fgdepar=12.9584, expected range: 0.0000 8.7343
rh2m
MANUAL LAND SYNOP RH2M (%) : out of range
Considerable: obs_number=90.0000, expected range: 120.3365 134.6635