Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-04-13 12:00

iasi
METOP-A IASI RADIANCES CHANNEL 236 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0073, expected range: 0.0038 0.0122
METOP-B IASI RADIANCES CHANNEL 236 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0413, expected range: 0.0528 0.0582
METOP-C IASI RADIANCES CHANNEL 236 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0064, expected range: 0.0044 0.0132
cris
NPP CRIS RADIANCES CHANNEL 84 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0383, expected range: -0.0307 -0.0266
NPP CRIS RADIANCES CHANNEL 92 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1143, expected range: 0.1257 0.1304
NPP CRIS RADIANCES CHANNEL 85 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0705, expected range: -0.0658 -0.0608
NPP CRIS RADIANCES CHANNEL 86 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0466, expected range: -0.0407 -0.0345
NOAA20 CRIS RADIANCES CHANNEL 83 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0004, expected range: 0.0110 0.0121
NOAA20 CRIS RADIANCES CHANNEL 120 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0646, expected range: -0.0587 -0.0531
NOAA20 CRIS RADIANCES CHANNEL 123 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0322, expected range: -0.0232 -0.0198
NOAA20 CRIS RADIANCES CHANNEL 124 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0539, expected range: -0.0411 -0.0362
NOAA20 CRIS RADIANCES CHANNEL 125 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1014, expected range: -0.0901 -0.0858
NOAA20 CRIS RADIANCES CHANNEL 138 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1150, expected range: -0.1037 -0.0993
NOAA20 CRIS RADIANCES CHANNEL 143 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1083, expected range: -0.0925 -0.0911
NOAA20 CRIS RADIANCES CHANNEL 86 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0466, expected range: 0.0525 0.0571
NOAA20 CRIS RADIANCES CHANNEL 110 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0716, expected range: 0.0808 0.0861
NOAA20 CRIS RADIANCES CHANNEL 126 : out of range
3 times in the last 10 days for at least one item
Considerable: avg_biascorr=-0.0410, expected range: -0.0356 -0.0250
airs
AQUA AIRS RADIANCES (21 channels affected) : out of range
Considerable: obs_number=377.0000, expected range: 1368.7785 5008.1203
Geostationary CSR
GOES-16 ABI RADIANCES CHANNEL 7 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.5313, expected range: -0.3823 -0.2125
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1010-1011 (HPA) : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-5.7886, expected range: -5.1319 -4.5488
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 6390-6391 (HPA) : out of range
7 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=6.7801, expected range: 2.9102 4.4850
Radiosondes
LAND TEMP WIND VECTOR DIFF (M/S) 64400 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=17.6893, expected range: 0.7560 9.1322
LAND TEMP WIND VECTOR DIFF (M/S) 32150 PRESSURE LAYER 600-900 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=19.3699, expected range: 0.0000 9.8505
Severe: avg_pge=0.8081, expected range: -0.6059 0.7500
LAND TEMP TEMPERATURE (K) 64400 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=8.5549, expected range: 0.2063 2.7499
Severe: avg_pge=0.8627, expected range: -0.1352 0.1774
LAND TEMP TEMPERATURE (K) 72393 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_pge=0.8396, expected range: -0.4619 0.7500
LAND TEMP TEMPERATURE (K) 24688 PRESSURE LAYER 900-1200 (HPA) : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-11.6440, expected range: -17.2163 15.3763
Severe: rms_fgdepar=11.6440, expected range: 0.0000 13.7713
Severe: avg_pge=0.9351, expected range: -1.6092 0.7500
LAND TEMP Q (G/KG) 61052 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=2.6755, expected range: 0.0000 0.7451
HIGH RESO LAND TEMP Q (G/KG) 72248 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=2.9863, expected range: 0.0000 1.3973
LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Considerable: rms_fgdepar=4.6006, expected range: 0.2467 3.0587
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=631.0000, expected range: 509.2760 579.9740
Considerable: obs_number=86.0000, expected range: 110.1552 151.5591
amdar
ADS-C WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : missing
6 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 0.0000 260.4454
AMDAR WIND VECTOR DIFF (M/S) AU0157 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=16.0026, expected range: 0.0000 7.2162
WIGOS AMDAR TEMPERATURE (K) PEMFWGBA PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_fgdepar=-12.5104, expected range: -4.1209 3.9017
Severe: rms_fgdepar=12.5104, expected range: 0.0000 3.1878
Severe: avg_pge=0.9033, expected range: -0.3749 0.4362
ADS-C WIND VECTOR DIFF (M/S) 3PQUMAZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.6520, expected range: 0.0000 8.5924
synop
MANUAL LAND SYNOP RH2M (%) 42915 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9579, expected range: -1.8117 0.7500
MANUAL LAND SYNOP RH2M (%) 42459 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=50.9045, expected range: -7.2625 92.2836
Severely_persistent: rms_fgdepar=50.9045, expected range: 0.0000 92.2836
BUFR LAND SYNOP SURFACE PRESSURE (PA) 60100 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=742.6892, expected range: -1093.4585 1090.6109
Severely_persistent: rms_fgdepar=743.6585, expected range: -644.8977 939.7516
Severely_persistent: avg_pge=0.9192, expected range: -0.6252 0.7500
BUFR LAND SYNOP RH2M (%) 86850 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-66.4522, expected range: -90.7022 -16.4837
Severely_persistent: rms_fgdepar=66.7644, expected range: 16.9199 90.7619
Severely_persistent: avg_pge=0.9992, expected range: 0.5488 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 89577 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-1088.0366, expected range: -307.9611 171.2254
Severe: rms_fgdepar=1088.0723, expected range: 0.0000 292.7071
Severe: avg_pge=0.9289, expected range: -0.5235 0.6938
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 47022 : out of range
Severe: rms_fgdepar=370.6856, expected range: 0.0000 162.2869
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42383 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=1013.0413, expected range: -19.9482 419.7076
Severe: rms_fgdepar=1013.0413, expected range: 0.0000 419.7076
Severe: avg_pge=0.9455, expected range: 0.5202 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62305 : out of range
Severe: rms_fgdepar=308.2422, expected range: 0.0000 156.6789
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 37675 : out of range
Severe: rms_fgdepar=619.1433, expected range: 0.0000 181.0681
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 32027 : out of range
Severe: rms_fgdepar=390.2412, expected range: 0.0000 152.3326
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42237 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8676, expected range: -1.3595 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83937 : out of range
Severe: avg_fgdepar=-538.0404, expected range: -290.6959 194.7285
Severe: rms_fgdepar=722.8875, expected range: 0.0000 182.2375
MANUAL LAND SYNOP RH2M (%) 43200 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9107, expected range: -1.3040 0.7500
MANUAL LAND SYNOP RH2M (%) 42500 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=55.1840, expected range: -48.5907 86.9906
Severe: rms_fgdepar=55.1840, expected range: 0.0000 86.9906
Severe: avg_pge=1.0000, expected range: -1.8103 0.7500
MANUAL LAND SYNOP RH2M (%) 43321 : out of range
Severe: rms_fgdepar=38.9393, expected range: 0.0000 22.8672
Severe: avg_pge=0.8553, expected range: -0.0012 0.0077
MANUAL LAND SYNOP RH2M (%) 65432 : out of range
Severe: avg_pge=0.9458, expected range: -0.9677 0.7500
MANUAL LAND SYNOP RH2M (%) 42792 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=52.3587, expected range: 8.0913 74.1781
Severe: rms_fgdepar=52.3587, expected range: 8.0913 74.1781
MANUAL LAND SYNOP RH2M (%) 42603 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9985, expected range: -1.9622 0.7500
MANUAL LAND SYNOP RH2M (%) 43025 : out of range
Severe: rms_fgdepar=46.0530, expected range: 0.0000 15.3583
Severe: avg_pge=0.9924, expected range: -0.0068 0.0143
MANUAL LAND SYNOP RH2M (%) 83698 : out of range
Severe: avg_fgdepar=70.5393, expected range: -38.9387 54.2193
Severe: rms_fgdepar=70.5393, expected range: 0.0000 51.2078
MANUAL LAND SYNOP RH2M (%) 43229 : out of range
Severe: rms_fgdepar=49.6695, expected range: 0.0000 22.5227
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48033 : out of range
Severe: avg_pge=0.8145, expected range: -1.0565 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 08345 : out of range
Severe: rms_fgdepar=529.7798, expected range: 0.0000 139.0162
BUFR LAND SYNOP RH2M (%) 41084 : out of range
Severe: rms_fgdepar=45.5187, expected range: 0.0000 11.4717
BUFR LAND SYNOP RH2M (%) 72265 : out of range
Severe: rms_fgdepar=32.0988, expected range: 0.0000 10.4176
BUFR LAND SYNOP RH2M (%) 33658 : out of range
Severe: rms_fgdepar=30.6078, expected range: 0.0000 16.8862
MANUAL LAND SYNOP SURFACE PRESSURE (PA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=103.0000, expected range: 80.3631 90.0813
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRCC8 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-893.6916, expected range: -630.4259 596.8859
Severely_persistent: rms_fgdepar=893.6916, expected range: 0.0000 916.4446
Severely_persistent: avg_pge=0.9049, expected range: -1.3009 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) KRGB : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-533.1232, expected range: -1545.0248 856.2667
Severely_persistent: rms_fgdepar=533.1232, expected range: 0.0000 1543.8957
Severely_persistent: avg_pge=0.8366, expected range: -1.5816 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 3ETM6 : out of range
Severe: rms_fgdepar=16.3779, expected range: 0.3132 7.4094
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6PT7 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-613.7747, expected range: -804.1578 1210.6505
Severe: rms_fgdepar=724.1634, expected range: 0.0000 1086.8106
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA5209 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8162, expected range: -0.6610 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRLU9 : out of range
Severe: avg_fgdepar=591.4388, expected range: 32.3554 926.1963
Severe: rms_fgdepar=591.4388, expected range: 16.3531 945.5488
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6BX9 : out of range
Severe: rms_fgdepar=369.2338, expected range: 0.0000 170.3290
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 2200189 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8471, expected range: 0.3175 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5501622 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8512, expected range: -0.8862 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5601653 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=745.0677, expected range: -1304.5399 1289.9370
Severely_persistent: rms_fgdepar=745.0677, expected range: 0.0000 1113.9737
Severely_persistent: avg_pge=0.9244, expected range: -0.6051 0.7500
MOORED BUOYS WIND VECTOR DIFF (M/S) 4600014 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=20.0092, expected range: 0.1683 3.1170
Severe: rms_fgdepar=20.1396, expected range: 0.2831 3.3022
Severe: avg_pge=0.9371, expected range: -0.3545 0.7366
DRIFTING BUOYS SURFACE PRESSURE (PA) 1501741 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-526.6396, expected range: -83.0357 84.1302
Severe: rms_fgdepar=540.4154, expected range: 0.0000 144.1855
Severe: avg_pge=0.8841, expected range: -0.1164 0.1290
DRIFTING BUOYS SURFACE PRESSURE (PA) 1401761 : out of range
Severe: rms_fgdepar=454.9032, expected range: 0.0000 211.2226
Severe: avg_pge=0.8488, expected range: -0.5192 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 2300593 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=308.1028, expected range: 0.0000 48.7802
Severe: avg_pge=0.8060, expected range: 0.0000 0.0000
DRIFTING BUOYS SURFACE PRESSURE (PA) : out of range
Considerable: obs_number=989.0000, expected range: 1052.7784 1178.7510
metar
METAR SURFACE PRESSURE (PA) OPMJ : out of range
37 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-1037.0430, expected range: -2344.1327 1411.9774
Severely_persistent: rms_fgdepar=1039.1718, expected range: 0.0000 2266.5033
Severely_persistent: avg_pge=0.9012, expected range: -1.4286 0.7500
METAR SURFACE PRESSURE (PA) FQNC : out of range
Severe: rms_fgdepar=602.5230, expected range: 0.0000 129.2546
METAR SURFACE PRESSURE (PA) OPRK : out of range
Severe: rms_fgdepar=309.5316, expected range: 0.0000 140.0499
METAR SURFACE PRESSURE (PA) HKNW : out of range
Severe: rms_fgdepar=325.3170, expected range: 0.0000 184.6797
snow
AUTOMATIC LAND SYNOP SNOW (CM) 71743 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-63.8278, expected range: -84.9517 -62.2765
Severely_persistent: rms_fgdepar=63.8278, expected range: 62.2765 84.9517
AUTOMATIC LAND SYNOP SNOW (CM) 71604 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=54.0568, expected range: 46.0989 125.4111
Severely_persistent: rms_fgdepar=54.0568, expected range: 46.0989 125.4111
MANUAL LAND SYNOP SNOW (CM) 71816 : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-67.0541, expected range: -77.8825 -64.2419
Severely_persistent: rms_fgdepar=67.0541, expected range: 64.2727 77.8619
BUFR LAND SYNOP SNOW (CM) 71816 : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-67.0068, expected range: -77.8464 -64.0673
Severely_persistent: rms_fgdepar=67.0068, expected range: 64.0779 77.8413
t2m
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24076 : out of range
Severe: rms_fgdepar=12.2539, expected range: 0.0000 12.2680
BUFR LAND SYNOP 2M TEMPERATURE (K) 24076 : out of range
Severe: avg_fgdepar=-12.0298, expected range: -13.3598 7.9124
Severe: rms_fgdepar=12.4084, expected range: 0.0000 12.4387