Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-02-22 12:00

amsua
NOAA-19 AMSUA RADIANCES CHANNEL 14 : out of range
Severe: stdev_fgdepar=1.0104, expected range: 0.6796 0.8603
iasi
METOP-C IASI RADIANCES CHANNEL 3452 : out of range
2 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.1110, expected range: 0.1493 0.2123
mhs
METOP-A MHS ALLSKY RADIANCES CHANNEL 1 : out of range
Severe: stdev_norm_fgdepar=0.0547, expected range: 0.0456 0.0493
METOP-A MHS ALLSKY RADIANCES CHANNEL 5 : out of range
1 times in the last 10 days for at least one item
Considerable: avg_norm_fgdepar=0.0662, expected range: -0.1130 0.0031
METOP-A MHS ALLSKY RADIANCES CHANNEL 4 : out of range
1 times in the last 10 days for at least one item
Considerable: avg_norm_fgdepar=0.0494, expected range: -0.1150 -0.0153
Slight: stdev_norm_fgdepar=0.7795, expected range: 0.5973 0.7216
METOP-A MHS ALLSKY RADIANCES CHANNEL 3 : out of range
1 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.8527, expected range: 0.6259 0.7780
atms
NOAA20 ATMS RADIANCES CHANNEL 15 : out of range
Considerable: stdev_fgdepar=0.9119, expected range: 0.5367 0.7652
ssmis
DMSP-17 SSMIS RADIANCES (9 channels affected) : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=9526.0000, expected range: 13527.4210 22242.2933
DMSP-17 SSMIS RADIANCES CHANNEL 11 : out of range
Slight: stdev_norm_fgdepar=0.7272, expected range: 0.5801 0.6946
Atmospheric Motion Vector
GOES-16 AMV CLOUDY WV3 WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HP : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=266.0000, expected range: 645.9416 1341.4909
Radiosondes
LAND TEMP TEMPERATURE (K) 24688 PRESSURE LAYER 900-1200 (HPA) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8588, expected range: -0.5421 0.7500
LAND TEMP TEMPERATURE (K) 24266 PRESSURE LAYER 900-1200 (HPA) : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8629, expected range: -1.0043 0.7500
LAND TEMP WIND VECTOR DIFF (M/S) 34731 PRESSURE LAYER 0-300 (HPA) : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8110, expected range: -0.4421 0.7500
All LAND TEMP ALL LAYERS WMO BLOCK 47 : all data missing
Severe: obs_number=0, expected range: 46.56 221.76
LAND TEMP Q (G/KG) 33317 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.3440, expected range: 0.0000 0.8416
LAND TEMP Q (G/KG) 65344 PRESSURE LAYER 900-1200 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=6.6050, expected range: 0.0000 12.9144
Severe: avg_fgdepar=6.2001, expected range: -7.7008 13.0185
LAND TEMP TEMPERATURE (K) 34731 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_pge=0.8944, expected range: -0.3423 0.7500
Severe: rms_fgdepar=8.1969, expected range: 0.0000 4.0118
LAND TEMP WIND VECTOR DIFF (M/S) 98433 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=18.7893, expected range: 0.0000 8.0360
LAND TEMP WIND VECTOR DIFF (M/S) 25123 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_pge=0.8737, expected range: -0.9371 0.7500
Severe: rms_fgdepar=24.3947, expected range: 0.0000 7.4292
Severe: avg_fgdepar=24.3947, expected range: -1.0327 6.4948
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
Severe: obs_number=96.0000, expected range: 269.7235 300.7765
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
Severe: rms_fgdepar=3.4415, expected range: 0.5629 1.1322
HIGH RESO LAND TEMP TEMPERATURE (K) 94998 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=6.6544, expected range: 0.4048 1.1349
HIGH RESO LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=3.0049, expected range: 0.6847 1.0372
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: obs_number=714.0000, expected range: 623.1254 660.8746
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 300-600 (HPA) : out of range
Considerable: obs_number=94.0000, expected range: 107.1863 133.0637
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=5976.0000, expected range: 4847.5070 5521.4930
amdar
ADS-C TEMPERATURE (K) PRESSURE LAYER 300-600 (HPA) : missing
5 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 0.0000 272.5973
ADS-C WIND VECTOR DIFF (M/S) 0ZZKG5ZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.2851, expected range: 0.0000 7.7400
airep
AIREP WIND VECTOR DIFF (M/S) BAW99 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.9135, expected range: 0.0000 18.2543
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 10103 (2 pressure layers affe : out of range
Severe: avg_pge=0.9022, expected range: -0.8711 0.7500
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 07462 PRESSURE LAYER 600-900 : out of range
Severe: rms_fgdepar=17.1248, expected range: 0.0000 9.5598
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 10410 PRESSURE LAYER 600-900 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8830, expected range: -0.8011 0.7500
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 96749 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=16.4795, expected range: 0.2555 5.3305
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 18138 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8293, expected range: 0.4081 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 18162 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=760.4669, expected range: 475.7548 913.4852
Severely_persistent: avg_fgdepar=759.8849, expected range: 474.3516 913.6714
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 17841 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8291, expected range: 0.7508 0.7500
MANUAL LAND SYNOP RH2M (%) 42776 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_pge=1.0000, expected range: -1.7023 0.7500
Severely_persistent: rms_fgdepar=59.3096, expected range: 0.0000 142.5637
Severely_persistent: avg_fgdepar=59.3096, expected range: -53.6329 142.5637
MANUAL LAND SYNOP RH2M (%) 76040 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9989, expected range: -0.2702 0.7500
Severely_persistent: rms_fgdepar=64.7109, expected range: 17.3438 70.4929
Severely_persistent: avg_fgdepar=64.7109, expected range: 12.6358 74.1107
AUTOMATIC LAND SYNOP RH2M (%) 93792 : out of range
Severe: avg_pge=0.8217, expected range: -0.2917 0.3379
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43354 : out of range
Severe: avg_pge=0.9215, expected range: -0.8148 0.7500
Severe: rms_fgdepar=763.9789, expected range: 0.0000 289.2855
Severe: avg_fgdepar=-763.9789, expected range: -373.4018 324.8247
MANUAL LAND SYNOP RH2M (%) 68438 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=30.1137, expected range: 0.0000 16.0256
MANUAL LAND SYNOP RH2M (%) 42961 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8529, expected range: -1.6053 0.7500
MANUAL LAND SYNOP RH2M (%) 62120 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8851, expected range: -1.3206 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 40435 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8243, expected range: -1.1041 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 01064 : out of range
Severe: avg_pge=0.8421, expected range: -1.0684 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48952 : out of range
Severe: avg_pge=0.8140, expected range: -1.0833 0.7500
BUFR LAND SYNOP RH2M (%) 94588 : out of range
Severe: rms_fgdepar=31.4946, expected range: 0.0000 12.5194
BUFR LAND SYNOP RH2M (%) 61627 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9957, expected range: -1.1155 0.7500
BUFR LAND SYNOP RH2M (%) 93773 : out of range
Severe: avg_pge=0.9995, expected range: -0.0043 0.0127
Severe: rms_fgdepar=54.5720, expected range: 0.0000 36.2404
Severe: avg_fgdepar=54.5720, expected range: -28.9027 48.0896
BUFR LAND SYNOP RH2M (%) 60160 : out of range
Severe: rms_fgdepar=31.5054, expected range: 0.0000 11.4264
BUFR LAND SYNOP SURFACE PRESSURE (PA) : out of range
Considerable: obs_number=425.0000, expected range: 488.3851 546.5038
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VREM6 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=619.5634, expected range: 0.0000 371.6401
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V9400 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9147, expected range: 0.6127 0.7500
Severely_persistent: rms_fgdepar=1063.0145, expected range: 0.0000 1324.6400
Severely_persistent: avg_fgdepar=-1058.1450, expected range: -1303.7541 111.5760
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WSAF : out of range
Severe: rms_fgdepar=814.9064, expected range: 0.0000 2268.3023
Severe: avg_fgdepar=-813.8578, expected range: -4818.9632 4849.1716
BUFR SHIP SYNOP SURFACE PRESSURE (PA) KRGB : out of range
Severe: rms_fgdepar=779.0862, expected range: 0.0000 288.6664
Severe: avg_fgdepar=545.3361, expected range: -351.3729 273.1982
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7DQ5 : out of range
Severe: avg_pge=0.8002, expected range: 0.3738 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V9404 : out of range
Severe: rms_fgdepar=388.8121, expected range: 0.0000 199.3658
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7DQ3 : out of range
Severe: rms_fgdepar=505.0572, expected range: 0.0000 392.5541
Severe: avg_fgdepar=-503.0412, expected range: -461.1109 270.2383
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OUUY2 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=373.0897, expected range: 0.0000 134.8090
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) D5ET2 : out of range
Severe: avg_pge=0.8810, expected range: -1.1527 0.7500
buoy
MOORED BUOYS SURFACE PRESSURE (PA) 6301004 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9243, expected range: -0.9395 0.7500
Severely_persistent: rms_fgdepar=742.0157, expected range: 0.0000 837.3034
Severely_persistent: avg_fgdepar=741.1842, expected range: -806.5447 677.2117
DRIFTING BUOYS SURFACE PRESSURE (PA) 4401577 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8440, expected range: -0.9938 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4601840 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8607, expected range: -0.8266 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601624 : out of range
Severe: rms_fgdepar=412.5594, expected range: 0.0000 163.0659
DRIFTING BUOYS SURFACE PRESSURE (PA) 6203582 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=436.4409, expected range: 0.0000 75.6802
metar
METAR SURFACE PRESSURE (PA) FDSK : out of range
Severe: rms_fgdepar=470.5278, expected range: 0.0000 190.7752
METAR SURFACE PRESSURE (PA) FNCA : out of range
Severe: rms_fgdepar=659.1894, expected range: 0.0000 138.9041
snow
AUTOMATIC LAND SYNOP SNOW (CM) 71029 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=57.6569, expected range: 52.6507 54.6189
Severely_persistent: avg_fgdepar=-57.6569, expected range: -54.6189 -52.6507
AUTOMATIC LAND SYNOP SNOW (CM) 71576 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=52.7416, expected range: 50.7246 53.2930
Severely_persistent: avg_fgdepar=-52.7416, expected range: -53.2930 -50.7246
AUTOMATIC LAND SYNOP SNOW (CM) 71743 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=69.0824, expected range: 64.5568 74.6725
Severely_persistent: avg_fgdepar=-69.0824, expected range: -74.6725 -64.5568
AUTOMATIC LAND SYNOP SNOW (CM) 71742 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=60.7275, expected range: 33.0076 62.5723
Severely_persistent: avg_fgdepar=-60.7275, expected range: -62.5723 -33.0076
MANUAL LAND SYNOP SNOW (CM) 71816 : out of range
26 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=63.9318, expected range: 62.5151 73.0615
Severely_persistent: avg_fgdepar=-63.9318, expected range: -73.0611 -62.5153
BUFR LAND SYNOP SNOW (CM) 01036 : out of range
32 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=118.9159, expected range: 45.0455 136.3264
Severely_persistent: avg_fgdepar=-118.9128, expected range: -136.2830 -45.0126
BUFR LAND SYNOP SNOW (CM) 71816 : out of range
22 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=63.9145, expected range: 62.5041 73.0757
Severely_persistent: avg_fgdepar=-63.9145, expected range: -73.0753 -62.5042
BUFR LAND SYNOP SNOW (CM) 01091 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=107.1203, expected range: 70.9162 98.6378
Severely_persistent: avg_fgdepar=-107.1167, expected range: -98.6148 -70.9041
BUFR LAND SYNOP SNOW (CM) 01480 : out of range
22 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=66.3000, expected range: 49.3279 70.7194
Severely_persistent: avg_fgdepar=-66.2989, expected range: -90.9917 -24.8215
t2m
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
28 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=14.8333, expected range: 9.4420 21.7215
Severely_persistent: avg_fgdepar=14.8333, expected range: 9.4022 21.7003
BUFR LAND SYNOP 2M TEMPERATURE (K) 44213 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=12.2181, expected range: 0.0000 17.8609
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 50557 : out of range
Severe: rms_fgdepar=12.1770, expected range: 0.0000 10.7298
Severe: avg_fgdepar=-12.1770, expected range: -12.4048 11.3204
MANUAL LAND SYNOP 2M TEMPERATURE (K) 25627 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.5467, expected range: 0.0000 11.9938
Severe: avg_fgdepar=-12.5177, expected range: -13.7718 7.5059
MANUAL LAND SYNOP 2M TEMPERATURE (K) 44256 : out of range
Severe: rms_fgdepar=14.7414, expected range: 0.0000 7.2757
Severe: avg_fgdepar=-14.6079, expected range: -6.3179 2.8796
MANUAL LAND SYNOP 2M TEMPERATURE (K) 30664 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.1114, expected range: 0.0000 11.4853
MANUAL LAND SYNOP 2M TEMPERATURE (K) 36022 : out of range
Severe: rms_fgdepar=10.5958, expected range: 0.0000 5.3666
LAND TEMP 2M TEMPERATURE (K) 61291 : out of range
Severe: rms_fgdepar=13.0043, expected range: 0.2770 6.7073
LAND TEMP 2M TEMPERATURE (K) 94120 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=18.0004, expected range: 0.0000 2.8349
Severe: avg_fgdepar=-18.0004, expected range: -1.8876 2.3493
BUFR LAND SYNOP 2M TEMPERATURE (K) 44256 : out of range
Severe: rms_fgdepar=14.7910, expected range: 0.0000 7.3027
Severe: avg_fgdepar=-14.6579, expected range: -6.7105 3.3059
BUFR LAND SYNOP 2M TEMPERATURE (K) 01035 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.1391, expected range: 0.0000 10.3960
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) : out of range
Considerable: obs_number=339.0000, expected range: 391.2987 430.1750
MANUAL LAND SYNOP 2M TEMPERATURE (K) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=73.0000, expected range: 100.7954 141.5576
BUFR LAND SYNOP 2M TEMPERATURE (K) : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=352.0000, expected range: 408.0106 447.3579
Considerable: obs_number=52.0000, expected range: 55.9783 59.6884
rh2m
AUTOMATIC LAND SYNOP RH2M (%) : out of range
Considerable: obs_number=325.0000, expected range: 374.7308 445.1639
BUFR LAND SYNOP RH2M (%) : out of range
Considerable: obs_number=332.0000, expected range: 384.7043 456.4536