Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-04-11 12:00

iasi
METOP-B IASI RADIANCES CHANNEL 236 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0434, expected range: 0.0528 0.0577
cris
NPP CRIS RADIANCES CHANNEL 92 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1150, expected range: 0.1257 0.1332
NOAA20 CRIS RADIANCES CHANNEL 83 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0044, expected range: 0.0110 0.0130
NOAA20 CRIS RADIANCES CHANNEL 87 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0906, expected range: 0.1001 0.1040
NOAA20 CRIS RADIANCES CHANNEL 123 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0314, expected range: -0.0232 -0.0180
NOAA20 CRIS RADIANCES CHANNEL 124 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0516, expected range: -0.0411 -0.0342
NOAA20 CRIS RADIANCES CHANNEL 125 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0987, expected range: -0.0901 -0.0849
NOAA20 CRIS RADIANCES CHANNEL 138 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1135, expected range: -0.1037 -0.0973
NOAA20 CRIS RADIANCES CHANNEL 143 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1061, expected range: -0.0925 -0.0914
NOAA20 CRIS RADIANCES CHANNEL 110 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0697, expected range: 0.0808 0.0843
amsr2
AMSR2 GCOM-W1 ALLSKY RADIANCES (6 channels affected) : out of range
Considerable: obs_number=2500.0000, expected range: 3221.4344 4304.4480
Atmospheric Motion Vector
METEOSAT-11 AMV VIS2 WIND VECTOR DIFF (M/S) PRESSURE LAYER 900-1200 (H : out of range
Considerable: obs_number=476.0000, expected range: 741.3881 1235.6119
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1010-1011 (HPA) : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-5.7816, expected range: -5.1319 -4.6736
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1600-1601 (HPA) : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-8.5614, expected range: -7.5458 -7.3120
Radiosondes
BUFR TEMP DESCENT TEMPERATURE (K) PRESSURE LAYER 900-1200 (HPA) : missing
7 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 0.0000 536.1930
LAND TEMP WIND VECTOR DIFF (M/S) 32098 (2 pressure layers affected) : out of range
Severe: avg_fgdepar=32.5505, expected range: 0.2377 5.9680
LAND TEMP WIND VECTOR DIFF (M/S) 32098 (3 pressure layers affected) : out of range
Severe: rms_fgdepar=32.5505, expected range: 0.2052 6.4748
Severe: avg_pge=0.9314, expected range: -0.4005 0.5311
LAND TEMP Q (G/KG) 65578 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=3.1109, expected range: 0.1065 1.5834
LAND TEMP Q (G/KG) 36872 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.4883, expected range: 0.0000 1.2019
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 57993 (2 pressure layers af : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=20.8431, expected range: -19.4027 27.7813
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 57993 PRESSURE LAYER 300-60 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=20.2362, expected range: -25.9697 37.3390
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
2 times in the last 10 days for at least one item
Severe: obs_number=764.0000, expected range: 855.1118 870.6382
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
Considerable: obs_number=171.0000, expected range: 230.6840 277.8160
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
Considerable: obs_number=79.0000, expected range: 160.7712 187.2288
amdar
ADS-C WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : missing
5 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 0.0000 273.8844
AMDAR WIND VECTOR DIFF (M/S) 00040228 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=19.4440, expected range: 0.0000 6.4153
Severe: avg_pge=0.8620, expected range: -0.1992 0.3041
WIGOS AMDAR WIND VECTOR DIFF (M/S) V3KSFABA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.2301, expected range: 0.0000 9.4834
WIGOS AMDAR WIND VECTOR DIFF (M/S) OIRHLDRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=25.1065, expected range: -1.7698 8.0401
Severe: rms_fgdepar=25.1065, expected range: 0.0000 9.7452
Severe: avg_pge=0.8544, expected range: -0.2662 0.4503
WIGOS AMDAR WIND VECTOR DIFF (M/S) KL5VJLZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=24.8861, expected range: -2.1036 7.4738
Severe: rms_fgdepar=25.0872, expected range: 0.0000 8.5205
WIGOS AMDAR WIND VECTOR DIFF (M/S) HW0TFRZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.4667, expected range: 0.0000 6.0195
WIGOS AMDAR WIND VECTOR DIFF (M/S) MQERFCBA PRESSURE LAYER 300-600 (HP : out of range
Severe: rms_fgdepar=18.0389, expected range: 0.0000 9.6757
WIGOS AMDAR WIND VECTOR DIFF (M/S) KMBQOOBA PRESSURE LAYER 300-600 (HP : out of range
Severe: rms_fgdepar=15.8455, expected range: 0.0000 3.7877
WIGOS AMDAR TEMPERATURE (K) BZ1VYWJA (2 pressure layers affected) : out of range
Severe: rms_fgdepar=6.9976, expected range: 0.0000 1.8558
WIGOS AMDAR TEMPERATURE (K) BZ1VYWJA PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_pge=0.8009, expected range: -0.1461 0.1768
WIGOS AMDAR Q (G/KG) TCXUOFJA PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_pge=0.9452, expected range: -0.0138 0.0228
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 97530 (2 pressure layers affected) : out of range
Severe: avg_pge=0.8588, expected range: -1.3271 0.7500
synop
MANUAL LAND SYNOP RH2M (%) 42963 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=51.8665, expected range: 16.3557 74.9467
Severely_persistent: rms_fgdepar=51.8665, expected range: 16.3557 74.9467
MANUAL LAND SYNOP RH2M (%) 42488 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9853, expected range: -1.8519 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 41620 : out of range
Severe: rms_fgdepar=374.7148, expected range: 134.0138 232.4303
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 64040 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8410, expected range: -1.5983 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 87750 : out of range
Severe: rms_fgdepar=323.6440, expected range: 0.0000 163.9571
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 78384 : out of range
Severe: rms_fgdepar=679.6508, expected range: 0.0000 56.1357
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62225 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=533.5331, expected range: 244.2398 797.9195
Severe: rms_fgdepar=533.5331, expected range: 244.4354 797.8132
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 86255 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=525.9050, expected range: 0.0000 277.4621
Severe: avg_pge=0.8836, expected range: -0.5543 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42557 : out of range
Severe: rms_fgdepar=413.3482, expected range: 152.8394 281.3379
Severe: avg_pge=0.8302, expected range: 0.4317 0.7500
MANUAL LAND SYNOP RH2M (%) 42500 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=1.0000, expected range: -0.1687 0.2431
MANUAL LAND SYNOP RH2M (%) 40710 : out of range
Severe: rms_fgdepar=30.4740, expected range: 0.0000 13.0119
MANUAL LAND SYNOP RH2M (%) 62011 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.9677, expected range: -1.4210 0.7500
MANUAL LAND SYNOP RH2M (%) 42792 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.9638, expected range: 0.4142 0.7500
MANUAL LAND SYNOP RH2M (%) 42506 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9015, expected range: -2.0507 0.7500
MANUAL LAND SYNOP RH2M (%) 41756 : out of range
Severe: avg_pge=0.9727, expected range: -0.1038 0.1372
MANUAL LAND SYNOP RH2M (%) 43086 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.9845, expected range: -1.8205 0.7500
MANUAL LAND SYNOP RH2M (%) 43197 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9965, expected range: -1.5922 0.7500
MANUAL LAND SYNOP RH2M (%) 44418 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9989, expected range: -1.4414 0.7500
MANUAL LAND SYNOP RH2M (%) 80428 : out of range
Severe: avg_fgdepar=60.3047, expected range: -79.8416 142.3323
Severe: rms_fgdepar=60.3047, expected range: 0.0000 143.1846
Severe: avg_pge=0.9973, expected range: -1.8142 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 60100 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=534.7099, expected range: -224.6230 63.2921
Severe: rms_fgdepar=535.2097, expected range: 0.0000 204.6693
Severe: avg_pge=0.8896, expected range: -0.4842 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48930 : out of range
Severe: rms_fgdepar=598.6917, expected range: 0.0000 443.9285
Severe: avg_pge=0.8269, expected range: -0.4294 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72203 : out of range
Severe: rms_fgdepar=374.1347, expected range: 0.0000 144.7685
Severe: avg_pge=0.8057, expected range: -0.1621 0.1840
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48053 : out of range
Severe: avg_fgdepar=616.6788, expected range: -263.8859 127.9911
Severe: rms_fgdepar=616.6788, expected range: 0.0000 240.5816
Severe: avg_pge=0.9160, expected range: -0.8833 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 23418 : out of range
Severe: rms_fgdepar=546.8647, expected range: 0.0000 144.6944
BUFR LAND SYNOP RH2M (%) 01440 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=30.7924, expected range: 0.0000 15.2603
BUFR LAND SYNOP RH2M (%) 23823 : out of range
Severe: rms_fgdepar=30.9905, expected range: 0.0000 13.4335
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) : out of range
Considerable: obs_number=71.0000, expected range: 101.7106 139.7894
Considerable: obs_number=62.0000, expected range: 91.8991 129.6009
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) EUCDE56 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=20.0272, expected range: -22.0924 47.0369
Severely_persistent: rms_fgdepar=20.0272, expected range: 0.0000 47.0369
Severely_persistent: avg_pge=0.8344, expected range: -0.4454 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) KRGB : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-627.8477, expected range: -1419.8141 948.1442
Severely_persistent: rms_fgdepar=627.8477, expected range: 0.0000 1416.9694
Severely_persistent: avg_pge=0.8586, expected range: -1.7832 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) SJA4RSK : out of range
27 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-590.0343, expected range: -1418.3181 1092.4021
Severely_persistent: rms_fgdepar=590.5015, expected range: -1000.4312 1368.3461
Severely_persistent: avg_pge=0.9076, expected range: -1.8307 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) ONIS : out of range
Severe: avg_fgdepar=20.3957, expected range: -6.2019 12.9839
Severe: rms_fgdepar=20.3957, expected range: 0.0000 13.6139
Severe: avg_pge=0.9095, expected range: -0.8343 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) DITI2 : out of range
Severe: rms_fgdepar=370.3047, expected range: 0.0000 203.4312
BUFR SHIP SYNOP SURFACE PRESSURE (PA) IDDEU03 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-784.8337, expected range: -269.5326 229.7221
Severe: rms_fgdepar=785.1350, expected range: 0.0000 210.8095
Severe: avg_pge=0.9354, expected range: -0.4535 0.5206
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VROB9 : out of range
Severe: rms_fgdepar=511.5548, expected range: 0.0000 304.8492
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ONIS : out of range
Severe: avg_fgdepar=541.9562, expected range: -761.8467 457.0822
Severe: rms_fgdepar=541.9562, expected range: 0.0000 458.4904
Severe: avg_pge=0.8299, expected range: -1.1748 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) UGYU : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8214, expected range: -0.3085 0.7500
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 4600001 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9181, expected range: -0.8620 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5601653 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8793, expected range: -1.0482 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601701 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-635.9456, expected range: -745.1288 654.1399
Severe: rms_fgdepar=637.3225, expected range: 0.0000 921.2883
Severe: avg_pge=0.9168, expected range: -1.1903 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601633 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=409.8039, expected range: 0.0000 87.3437
Severe: avg_pge=0.8783, expected range: -0.1061 0.1284
DRIFTING BUOYS SURFACE PRESSURE (PA) 6301564 : out of range
Severe: rms_fgdepar=334.4627, expected range: 0.0000 182.3650
DRIFTING BUOYS SURFACE PRESSURE (PA) 5601646 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8113, expected range: -0.6729 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4601797 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=349.2069, expected range: 0.0000 144.0740
metar
METAR SURFACE PRESSURE (PA) OPMJ : out of range
27 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-838.4714, expected range: -1834.5269 1246.9026
Severely_persistent: rms_fgdepar=839.5403, expected range: 0.0000 1785.1655
METAR SURFACE PRESSURE (PA) MGPB : out of range
Severe: rms_fgdepar=312.7204, expected range: 0.0000 161.1786
METAR SURFACE PRESSURE (PA) MMNL : out of range
Severe: rms_fgdepar=347.5350, expected range: 0.0000 160.4969
snow
AUTOMATIC LAND SYNOP SNOW (CM) 71743 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-67.1587, expected range: -84.4406 -67.1388
Severely_persistent: rms_fgdepar=67.1587, expected range: 67.1388 84.4406
AUTOMATIC LAND SYNOP SNOW (CM) 71576 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-52.0435, expected range: -62.7508 -50.4840
Severely_persistent: rms_fgdepar=52.0435, expected range: 50.4840 62.7508
MANUAL LAND SYNOP SNOW (CM) 16021 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=63.3618, expected range: 50.0472 60.7163
Severely_persistent: rms_fgdepar=63.3618, expected range: 50.0472 60.7163
MANUAL LAND SYNOP SNOW (CM) 71816 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-69.7214, expected range: -83.6889 -54.2265
Severely_persistent: rms_fgdepar=69.7214, expected range: 58.4170 81.8380
BUFR LAND SYNOP SNOW (CM) 71816 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-69.6421, expected range: -83.5634 -54.1579
Severely_persistent: rms_fgdepar=69.6421, expected range: 58.2998 81.7545
AUTOMATIC LAND SYNOP SNOW (CM) 71604 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=63.0988, expected range: 60.0635 121.2510
Severe: rms_fgdepar=63.0988, expected range: 60.0635 121.2510
t2m
MANUAL LAND SYNOP 2M TEMPERATURE (K) 61679 : out of range
Severe: rms_fgdepar=12.0204, expected range: 0.0000 6.4339
LAND TEMP 2M TEMPERATURE (K) 71043 : out of range
Severe: rms_fgdepar=11.9400, expected range: 0.0000 5.2389
BUFR LAND SYNOP 2M TEMPERATURE (K) 41897 : out of range
Severe: rms_fgdepar=10.6947, expected range: 0.9002 5.9761
BUFR LAND SYNOP 2M TEMPERATURE (K) 61679 : out of range
Severe: rms_fgdepar=12.1618, expected range: 0.0000 6.3346
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=252.0000, expected range: 299.8121 357.3644
rh2m
MANUAL LAND SYNOP RH2M (%) 24338 : out of range
Severe: rms_fgdepar=31.0002, expected range: 0.0000 16.8860
METAR RH2M (%) SBNM : out of range
Severe: rms_fgdepar=36.7147, expected range: 0.0000 13.6227