Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-06-01 00:00

iasi
METOP-A IASI RADIANCES CHANNEL 3168 : out of range
Considerable: stdev_fgdepar=0.6328, expected range: 0.3947 0.5494
METOP-A IASI RADIANCES CHANNEL 3448 : out of range
Considerable: stdev_fgdepar=0.7847, expected range: 0.5386 0.6895
METOP-A IASI RADIANCES CHANNEL 3575 : out of range
Considerable: stdev_fgdepar=1.0250, expected range: 0.6251 0.8647
METOP-A IASI RADIANCES CHANNEL 3580 : out of range
Considerable: stdev_fgdepar=1.1160, expected range: 0.6418 0.9419
METOP-A IASI RADIANCES CHANNEL 3653 : out of range
Considerable: stdev_fgdepar=1.0167, expected range: 0.6744 0.8912
cris
NOAA20 CRIS RADIANCES (32 channels affected) : out of range
Considerable: obs_number=2469.0000, expected range: 2138.7487 2306.6263
saphir
All MEGHA-TROPIQUES SAPHIR ALLSKY ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 764.25 18649.09
mwhs
FY-3B MWHS RADIANCES CHANNEL 3 : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=5209.0000, expected range: 13890.2449 21135.6301
FY-3B MWHS RADIANCES CHANNEL 4 : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=5213.0000, expected range: 13910.1963 21153.4287
FY-3B MWHS RADIANCES CHANNEL 5 : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=3381.0000, expected range: 8921.7867 13790.7133
atms
NPP ATMS RADIANCES (10 channels affected) : out of range
Considerable: obs_number=5200.0000, expected range: 6423.3636 8682.0114
NOAA20 ATMS RADIANCES (10 channels affected) : out of range
Considerable: obs_number=5656.0000, expected range: 6420.5529 8811.9471
gpsro
All FY-3C GNOS RISING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 467.59 2312.99
All COSMIC2-E3 GPSRO RISING ALL HEIGHTS Global : all data missing
Severe: obs_number=0, expected range: 892.68 3135.38
COSMIC2-E5 GPSRO SETTING (9 impact heights affected) : out of range
Considerable: obs_number=586.0000, expected range: 864.2359 1925.9070
COSMIC2-E6 GPSRO SETTING (24 impact heights affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=502.0000, expected range: 1062.5825 2621.4175
SPIRE LEMUR 3U GPSRO RISING HEIGHT 3 : out of range
Considerable: stdev_norm_fgdepar=0.2111, expected range: 0.0953 0.1690
Radiosondes
LAND TEMP WIND VECTOR DIFF (M/S) 29839 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_pge=0.8299, expected range: -0.8275 0.7500
LAND TEMP WIND VECTOR DIFF (M/S) 36003 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=19.9843, expected range: 0.0000 7.8048
Severe: avg_pge=0.9074, expected range: -0.6533 0.7500
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 42339 PRESSURE LAYER 900-12 : out of range
Severe: avg_fgdepar=21.1421, expected range: 0.9273 3.5465
HIGH RESO LAND TEMP TEMPERATURE (K) 57131 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=6.5978, expected range: 0.0000 3.5733
HIGH RESO LAND TEMP TEMPERATURE (K) 52267 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=-14.0573, expected range: -1.6350 2.0808
Severe: rms_fgdepar=16.3031, expected range: 0.3195 2.5769
HIGH RESO LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=5.4836, expected range: 1.1971 1.9328
HIGH RESO LAND TEMP TEMPERATURE (K) (4 pressure layers affected) : out of range
Severe: obs_number=61.0000, expected range: 294.4643 326.5357
HIGH RESO LAND TEMP Q (G/KG) 47909 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.7191, expected range: 0.3738 1.5709
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=196.0000, expected range: 128.3572 131.8928
LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: obs_number=141.0000, expected range: 11.3812 71.6188
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=668.0000, expected range: 747.0120 766.2380
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 97260 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_pge=0.8956, expected range: -1.2200 0.7500
synop
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 60602 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8585, expected range: 0.5758 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 68839 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=55.0296, expected range: -31.8494 45.2095
Severe: rms_fgdepar=55.0296, expected range: 0.0000 38.9458
Severe: avg_pge=0.9778, expected range: -0.5637 0.6517
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43207 : out of range
Severe: avg_pge=0.8418, expected range: -0.7558 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42588 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-1131.3405, expected range: -689.5009 582.8310
Severe: rms_fgdepar=1131.3405, expected range: 0.0000 942.3058
Severe: avg_pge=0.9489, expected range: -1.3144 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43309 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-693.8754, expected range: -368.9257 397.3512
Severe: rms_fgdepar=693.8754, expected range: 0.0000 309.2395
Severe: avg_pge=0.9081, expected range: -1.2735 0.7500
MANUAL LAND SYNOP RH2M (%) 38911 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9688, expected range: -1.1351 0.7500
MANUAL LAND SYNOP RH2M (%) 60141 : out of range
Severe: avg_pge=0.8949, expected range: -1.7151 0.7500
MANUAL LAND SYNOP RH2M (%) 43012 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9999, expected range: -1.1972 0.7500
MANUAL LAND SYNOP RH2M (%) 40016 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9856, expected range: -1.7630 0.7500
MANUAL LAND SYNOP RH2M (%) 42148 : out of range
Severe: rms_fgdepar=30.5832, expected range: 0.2398 15.3295
MANUAL LAND SYNOP RH2M (%) 68619 : out of range
Severe: avg_fgdepar=54.7369, expected range: -65.3459 84.2074
Severe: rms_fgdepar=54.7369, expected range: 0.0000 67.5812
Severe: avg_pge=0.9733, expected range: -0.0841 0.1131
MANUAL LAND SYNOP Z (M) 38856 : out of range
Severe: avg_pge=0.9094, expected range: -0.0750 0.0918
BUFR LAND SYNOP SURFACE PRESSURE (PA) 23471 : out of range
Severe: rms_fgdepar=472.8615, expected range: 0.0000 215.8900
Severe: avg_pge=0.8535, expected range: -0.4741 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 23823 : out of range
Severe: rms_fgdepar=394.3685, expected range: 0.0000 89.5802
BUFR LAND SYNOP SURFACE PRESSURE (PA) 57025 : out of range
Severe: rms_fgdepar=357.7020, expected range: 0.0000 101.3815
BUFR LAND SYNOP SURFACE PRESSURE (PA) 16138 : out of range
Severe: rms_fgdepar=497.0809, expected range: 0.0000 123.7181
Severe: avg_pge=0.8988, expected range: -0.1626 0.1846
BUFR LAND SYNOP RH2M (%) 71281 : out of range
Severe: rms_fgdepar=38.1065, expected range: 0.0000 18.9916
BUFR LAND SYNOP RH2M (%) 94781 : out of range
Severe: rms_fgdepar=30.3020, expected range: 0.0000 16.5209
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) : out of range
Considerable: rms_fgdepar=165.8151, expected range: 23.5020 111.8118
Considerable: rms_fgdepar=248.3246, expected range: 28.4501 171.3787
Considerable: rms_fgdepar=224.4903, expected range: 43.7333 151.3411
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) TBWUK48 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8841, expected range: 0.0342 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) PCHF : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9079, expected range: 0.4533 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OYIK2 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=576.4938, expected range: 436.9601 785.8894
Severely_persistent: rms_fgdepar=577.1697, expected range: 436.8864 786.4870
Severely_persistent: avg_pge=0.8302, expected range: -0.0724 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRDJ3 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8120, expected range: 0.7243 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRQK3 : out of range
21 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-691.2212, expected range: -781.0041 -407.9147
Severely_persistent: rms_fgdepar=691.8978, expected range: 399.3257 800.5230
Severely_persistent: avg_pge=0.8729, expected range: 0.7772 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRMO4 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-517.6212, expected range: -661.6553 -410.6690
Severely_persistent: rms_fgdepar=517.6212, expected range: 349.7736 687.5775
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6DF6 : out of range
24 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=558.4328, expected range: -922.8721 1572.0400
Severely_persistent: rms_fgdepar=558.4710, expected range: 0.0000 1591.5312
Severely_persistent: avg_pge=0.8100, expected range: -1.5415 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) S6DU6 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=613.0398, expected range: 335.1003 827.8629
Severely_persistent: rms_fgdepar=615.6562, expected range: 335.1003 827.8629
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ONGI : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=744.4905, expected range: -824.1855 1219.8812
Severely_persistent: rms_fgdepar=744.4905, expected range: 0.0000 1231.9488
Severely_persistent: avg_pge=0.8695, expected range: -1.3819 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) UCQX : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1065.5677, expected range: -137.7400 1916.1054
Severely_persistent: rms_fgdepar=1065.5677, expected range: 0.0000 1912.5503
Severely_persistent: avg_pge=0.9047, expected range: 0.6043 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) C6SJ5 : out of range
Severe: avg_fgdepar=33.2726, expected range: -5.0095 12.5087
Severe: rms_fgdepar=33.2726, expected range: 0.0000 12.4820
Severe: avg_pge=0.9503, expected range: -0.9123 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) V7JD6 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8878, expected range: -0.9754 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRJV2 : out of range
Severe: avg_fgdepar=671.1493, expected range: -284.7426 186.9918
Severe: rms_fgdepar=671.1493, expected range: 0.0000 256.4246
Severe: avg_pge=0.8425, expected range: -0.7974 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) TBWUK34 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=550.5875, expected range: -958.9216 1064.2693
Severe: rms_fgdepar=550.5875, expected range: -839.1921 1024.9574
Severe: avg_pge=0.8048, expected range: -1.1750 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7CS8 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=536.3499, expected range: 107.8307 738.5944
Severe: rms_fgdepar=536.3499, expected range: 107.8307 738.5944
Severe: avg_pge=0.8033, expected range: 0.3132 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HJD9 : out of range
Severe: rms_fgdepar=508.9267, expected range: 0.0000 527.7575
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WCAJ : out of range
Severe: avg_fgdepar=508.4973, expected range: -60.1172 241.9149
Severe: rms_fgdepar=508.4973, expected range: 0.0000 237.2032
buoy
MOORED BUOYS SURFACE PRESSURE (PA) 2200186 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8463, expected range: -1.1318 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601700 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-505.8183, expected range: -1235.8877 1393.8734
Severely_persistent: rms_fgdepar=508.1550, expected range: 0.0000 1195.5280
DRIFTING BUOYS SURFACE PRESSURE (PA) 6301676 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8719, expected range: -1.1953 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4601586 : out of range
Severe: rms_fgdepar=397.3871, expected range: 0.0000 65.9622
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101757 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=443.5445, expected range: 0.0000 206.8939
Severe: avg_pge=0.8246, expected range: -0.1219 0.1525
metar
METAR SURFACE PRESSURE (PA) OIBH : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-551.2957, expected range: -624.2216 -146.2503
Severe: rms_fgdepar=551.6775, expected range: 152.9083 624.9063
Severe: avg_pge=0.8001, expected range: 0.3968 0.7500
snow
AUTOMATIC LAND SYNOP SNOW (CM) 01132 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=58.0000, expected range: 65.6160 78.2135
Severely_persistent: rms_fgdepar=58.0000, expected range: 65.6160 78.2135
MANUAL LAND SYNOP SNOW (CM) 11138 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=83.0272, expected range: 60.3285 93.3226
Severely_persistent: rms_fgdepar=83.0272, expected range: 60.3285 93.3226
BUFR LAND SYNOP SNOW (CM) 01361 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=104.0000, expected range: 97.3198 113.6077
Severely_persistent: rms_fgdepar=104.0000, expected range: 97.3236 113.6067
BUFR LAND SYNOP SNOW (CM) 01132 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=58.5000, expected range: 64.7557 79.3353
Severely_persistent: rms_fgdepar=58.5021, expected range: 64.7637 79.3309
BUFR LAND SYNOP SNOW (CM) 01435 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=99.1242, expected range: 99.0995 115.6272
Severely_persistent: rms_fgdepar=99.1245, expected range: 99.1059 115.6264
BUFR LAND SYNOP SNOW (CM) 11138 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=83.8798, expected range: 60.9049 96.2444
Severely_persistent: rms_fgdepar=83.8798, expected range: 60.9049 96.2444
AUTOMATIC LAND SYNOP SNOW (CM) 01435 : out of range
Severe: avg_fgdepar=98.8357, expected range: 98.9762 113.8113
Severe: rms_fgdepar=98.8357, expected range: 98.9762 113.8113
AUTOMATIC LAND SYNOP SNOW (CM) 15307 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=68.0000, expected range: -29.8748 37.8748
Severe: rms_fgdepar=68.0000, expected range: -42.2493 53.5630
MANUAL LAND SYNOP SNOW (CM) : out of range
Severe: rms_fgdepar=115.3158, expected range: 0.2178 5.9145
ROCOB TEMP SNOW (CM) 64301557 : out of range
Severe: rms_fgdepar=30.3081, expected range: 0.1856 11.2438
BUFR LAND SYNOP SNOW (CM) 01346 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=87.4786, expected range: 88.4917 91.8782
Severe: rms_fgdepar=87.4786, expected range: 88.4921 91.8802
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02221 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.6131, expected range: 0.0000 5.2773
MANUAL LAND SYNOP 2M TEMPERATURE (K) 64706 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.7566, expected range: 0.0000 3.1349
METAR 2M TEMPERATURE (K) MMLM : out of range
Severe: rms_fgdepar=10.7899, expected range: 0.0000 3.3729
rh2m
MANUAL LAND SYNOP RH2M (%) 41660 : out of range
Severe: rms_fgdepar=30.8464, expected range: 0.0000 17.3810
METAR RH2M (%) KHIF : out of range
Severe: rms_fgdepar=30.6840, expected range: 0.0000 9.6913