Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-06-17 00:00

iasi
METOP-C IASI RADIANCES CHANNEL 151 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1986, expected range: 0.2321 0.2618
METOP-A IASI RADIANCES CHANNEL 151 : out of range
3 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.2335, expected range: 0.2598 0.2969
mwhs2
FY-3D MWHS2 ALLSKY RADIANCES CHANNEL 7 : out of range
Considerable: stdev_norm_fgdepar=0.6362, expected range: 0.5233 0.5984
gpsro
COSMIC2-E1 GPSRO SETTING (24 impact heights affected) : out of range
Considerable: obs_number=1038.0000, expected range: 1859.3251 3168.9249
COSMIC2-E2 GPSRO SETTING (23 impact heights affected) : out of range
Considerable: obs_number=2368.0000, expected range: 2890.3702 4513.6298
COSMIC2-E3 GPSRO RISING (24 impact heights affected) : out of range
Considerable: obs_number=696.0000, expected range: 934.5048 1790.2452
COSMIC2-E4 GPSRO SETTING (24 impact heights affected) : out of range
Considerable: obs_number=1486.0000, expected range: 1906.6296 3076.6204
COSMIC2-E1 GPSRO RISING HEIGHT 40-42 KM : out of range
Slight: stdev_norm_fgdepar=0.8625, expected range: 0.5468 0.7891
Radiosondes
LAND TEMP WIND VECTOR DIFF (M/S) 72201 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=15.5957, expected range: 0.0000 6.8800
LAND TEMP Q (G/KG) 91680 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.1291, expected range: 0.0000 1.3447
LAND TEMP Q (G/KG) 35394 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.0923, expected range: 0.0000 1.0139
LAND TEMP Q (G/KG) 37259 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.6478, expected range: 0.0000 5.9538
HIGH RESO LAND TEMP TEMPERATURE (K) 52267 PRESSURE LAYER 900-1200 (HPA : out of range
Severe: rms_fgdepar=7.9978, expected range: 0.0000 4.3232
Severe: avg_pge=0.8853, expected range: -0.5634 0.7500
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: obs_number=66.0000, expected range: 132.6707 139.0793
Considerable: obs_number=366.0000, expected range: 443.2190 540.5310
HIGH RESO LAND TEMP Q (G/KG) 71934 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.3416, expected range: 0.0000 1.2528
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 300-600 (HPA) : out of range
Severe: obs_number=193.0000, expected range: 93.0695 100.5972
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
Severe: obs_number=381.0000, expected range: 281.3709 290.6291
Considerable: obs_number=186.0000, expected range: 233.7093 321.0407
Considerable: obs_number=476.0000, expected range: 526.8277 558.4223
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 48 : all data missing
Severe: obs_number=0, expected range: 68.92 293.87
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 81 : all data missing
Severe: obs_number=0, expected range: 111.99 158.51
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=780.0000, expected range: 636.9863 702.0137
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
Considerable: obs_number=75.0000, expected range: 123.8471 180.9029
amdar
WIGOS AMDAR Q (G/KG) GRBWUUZA PRESSURE LAYER 900-1200 (HPA) : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-6.7771, expected range: -13.6092 4.3907
Severely_persistent: rms_fgdepar=6.7786, expected range: 0.2408 10.0770
Severely_persistent: avg_pge=0.9141, expected range: -1.0145 0.7500
AMDAR WIND VECTOR DIFF (M/S) AAL72 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_pge=0.8203, expected range: -0.6253 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU6637 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=19.0288, expected range: 0.0000 6.5192
WIGOS AMDAR WIND VECTOR DIFF (M/S) QBOVLUJA PRESSURE LAYER 300-600 (HP : out of range
Severe: rms_fgdepar=16.2775, expected range: 0.0000 4.7961
WIGOS AMDAR WIND VECTOR DIFF (M/S) MOHENXRA PRESSURE LAYER 600-900 (HP : out of range
Severe: rms_fgdepar=17.2061, expected range: 1.2808 4.9559
WIGOS AMDAR WIND VECTOR DIFF (M/S) CNFNDM PRESSURE LAYER 900-1200 (HPA : out of range
Severe: rms_fgdepar=15.4629, expected range: 0.0000 7.7716
WIGOS AMDAR Q (G/KG) 3OXWUWJA PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_pge=0.8303, expected range: -0.8535 0.7500
MODE-S WIND VECTOR DIFF (M/S) MD317D0 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.9638, expected range: 0.3247 5.1316
MODE-S WIND VECTOR DIFF (M/S) M0A92A3 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.3858, expected range: 0.4106 3.8755
MODE-S WIND VECTOR DIFF (M/S) M6546C3 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.0284, expected range: 0.0000 7.7819
MODE-S WIND VECTOR DIFF (M/S) MA69035 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.0133, expected range: 0.2025 4.4990
MODE-S WIND VECTOR DIFF (M/S) M432755 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.3615, expected range: 0.7235 4.7817
MODE-S WIND VECTOR DIFF (M/S) ME866B6 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.1723, expected range: 0.0000 5.8631
MODE-S WIND VECTOR DIFF (M/S) MBE2797 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.3814, expected range: 0.0000 5.4099
MODE-S WIND VECTOR DIFF (M/S) MAB1BB8 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.9370, expected range: 0.1676 4.5856
MODE-S WIND VECTOR DIFF (M/S) MB4B499 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.0024, expected range: 0.0000 4.8078
MODE-S WIND VECTOR DIFF (M/S) M093A8A PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.8906, expected range: 0.0000 7.0098
MODE-S WIND VECTOR DIFF (M/S) M25436C PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.8372, expected range: 0.3455 4.1353
MODE-S WIND VECTOR DIFF (M/S) M94C7BC PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.3123, expected range: 0.7999 4.0474
MODE-S WIND VECTOR DIFF (M/S) M9DD7AF PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=19.0735, expected range: 0.0000 7.3207
ADS-C WIND VECTOR DIFF (M/S) A3SKLBRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.4152, expected range: 0.0000 8.7857
airep
AIREP WIND VECTOR DIFF (M/S) AAL72 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=20.2964, expected range: -4.4390 13.4403
Severe: rms_fgdepar=26.7449, expected range: 0.0000 13.1519
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : missing
2 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 938.4924
pilot
LAND PILOT WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=80.0000, expected range: 41.0120 60.2380
synop
AUTOMATIC LAND SYNOP RH2M (%) : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=27.1673, expected range: 0.0000 14.3342
AUTOMATIC LAND SYNOP RH2M (%) 04351 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=51.1947, expected range: 0.0000 14.1001
MANUAL LAND SYNOP RH2M (%) 40305 : out of range
Severe: avg_pge=0.9978, expected range: -0.6414 0.7500
MANUAL LAND SYNOP RH2M (%) 42935 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9993, expected range: -1.4939 0.7500
MANUAL LAND SYNOP RH2M (%) 74486 : out of range
Severe: rms_fgdepar=40.0893, expected range: 0.0000 20.5816
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42456 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-784.5038, expected range: -112.6706 243.2776
Severe: rms_fgdepar=784.5038, expected range: 0.0000 243.2776
Severe: avg_pge=0.9198, expected range: -0.9658 0.7500
BUFR LAND SYNOP RH2M (%) 71832 : out of range
Severe: rms_fgdepar=44.1953, expected range: 0.0000 25.9585
Severe: avg_pge=0.9490, expected range: -0.0035 0.0105
BUFR LAND SYNOP RH2M (%) 72414 : out of range
Severe: avg_pge=0.9791, expected range: -0.3618 0.4426
BUFR LAND SYNOP SURFACE PRESSURE (PA) 28843 : out of range
Severe: rms_fgdepar=409.3191, expected range: 0.0000 104.6853
BUFR LAND SYNOP SURFACE PRESSURE (PA) 26393 : out of range
Severe: rms_fgdepar=316.6436, expected range: 0.0000 85.7472
Severe: avg_pge=0.8332, expected range: 0.0000 0.0000
BUFR LAND SYNOP SURFACE PRESSURE (PA) 28275 : out of range
Severe: rms_fgdepar=598.0894, expected range: 0.0000 69.1856
BUFR LAND SYNOP SURFACE PRESSURE (PA) 34238 : out of range
Severe: avg_fgdepar=-669.3489, expected range: -73.0976 3.2116
Severe: rms_fgdepar=669.7435, expected range: 2.6010 76.8509
Severe: avg_pge=0.9210, expected range: -0.0356 0.0405
BUFR LAND SYNOP SURFACE PRESSURE (PA) 13459 : out of range
Severe: rms_fgdepar=369.6918, expected range: 0.0000 195.7647
BUFR LAND SYNOP Z (M) 44517 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9950, expected range: -1.4177 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=835.0000, expected range: 670.1631 708.0591
BUFR LAND SYNOP Z (M) : out of range
3 times in the last 10 days for at least one item
Considerable: obs_number=55.0000, expected range: 42.4444 45.7778
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9VBN2 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=555.0262, expected range: 350.4342 724.0294
Severely_persistent: rms_fgdepar=555.0806, expected range: 342.8556 738.4660
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRBQ2 : out of range
Severe: avg_fgdepar=-509.3286, expected range: -360.1457 503.8880
Severe: rms_fgdepar=533.0636, expected range: 0.0000 372.4258
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRLJ3 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=758.2146, expected range: 560.8085 831.4183
Severe: rms_fgdepar=758.2474, expected range: 561.9145 830.7493
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 2IYH4 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=349.6537, expected range: 0.0000 99.1599
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6BX9 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=401.3047, expected range: 0.0000 220.8847
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WFLH : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=681.0235, expected range: -243.2762 332.4826
Severe: rms_fgdepar=681.0235, expected range: 0.0000 282.7685
Severe: avg_pge=0.8443, expected range: -1.0025 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) AUYN : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=646.8559, expected range: 0.0000 218.4785
BUFR SHIP SYNOP SURFACE PRESSURE (PA) PHOS : out of range
Severe: avg_fgdepar=-688.0559, expected range: -406.8132 355.3381
Severe: rms_fgdepar=923.6862, expected range: 0.0000 214.2545
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) WACW : out of range
Severe: rms_fgdepar=17.3680, expected range: 0.0000 6.4031
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101743 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8650, expected range: -1.4851 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1701529 : out of range
Severe: avg_fgdepar=-654.8533, expected range: -178.5285 108.5428
Severe: rms_fgdepar=732.6598, expected range: 0.0000 233.9640
snow
MANUAL LAND SYNOP SNOW (CM) 20107 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=55.1543, expected range: 42.9154 127.3783
Severely_persistent: rms_fgdepar=55.1543, expected range: 42.9154 127.3783
BUFR LAND SYNOP SNOW (CM) 20107 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=54.9370, expected range: 43.1398 125.6920
Severely_persistent: rms_fgdepar=54.9370, expected range: 43.1398 125.6920
BUFR LAND SYNOP SNOW (CM) 52908 : out of range
Severe: rms_fgdepar=22.5989, expected range: 0.0000 0.9325
t2m
BUFR LAND SYNOP 2M TEMPERATURE (K) 27648 : out of range
25 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.7685, expected range: -27.6554 4.2109
Severely_persistent: rms_fgdepar=13.7685, expected range: 0.0000 26.3606
MANUAL LAND SYNOP 2M TEMPERATURE (K) 25062 : out of range
Severe: rms_fgdepar=10.8484, expected range: 0.0000 4.0191
MANUAL LAND SYNOP 2M TEMPERATURE (K) 32076 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.1650, expected range: -8.4859 0.2376
Severe: rms_fgdepar=12.2364, expected range: 0.0000 8.8744
MANUAL LAND SYNOP 2M TEMPERATURE (K) 43207 : out of range
Severe: avg_fgdepar=12.4851, expected range: -3.4717 5.8698
Severe: rms_fgdepar=12.4851, expected range: 0.0000 4.6073
METAR 2M TEMPERATURE (K) PHJH : out of range
Severe: rms_fgdepar=11.5827, expected range: 1.4062 5.7871
BUFR LAND SYNOP 2M TEMPERATURE (K) 32076 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.2138, expected range: -8.5341 0.1874
Severe: rms_fgdepar=12.2848, expected range: 0.0000 8.9242
BUFR LAND SYNOP 2M TEMPERATURE (K) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=936.0000, expected range: 773.3285 800.0465
rh2m
MANUAL LAND SYNOP RH2M (%) 60368 : out of range
Severe: rms_fgdepar=36.8457, expected range: 0.0000 21.0055
BUFR LAND SYNOP RH2M (%) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=932.0000, expected range: 753.1536 813.7875