Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-05-02 00:00

amsua
NOAA 15 AMSUA ALL SKY RADIANCES CHANNEL 12 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0599, expected range: -0.0801 -0.0695
NOAA 18 AMSUA ALL SKY RADIANCES CHANNEL 13 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2439, expected range: -0.3260 -0.3185
METOP-B AMSUA ALL SKY RADIANCES CHANNEL 13 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.3441, expected range: 0.3026 0.3063
METOP-B AMSUA ALL SKY RADIANCES CHANNEL 7 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.4680, expected range: -0.3936 -0.3575
atms
NPP ATMS RADIANCES CHANNEL 20 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0116, expected range: -0.0621 -0.0209
NPP ATMS RADIANCES CHANNEL 21 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1736, expected range: 0.0931 0.1371
NPP ATMS RADIANCES CHANNEL 13 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2494, expected range: -0.2996 -0.2951
NOAA20 ATMS RADIANCES CHANNEL 14 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1868, expected range: -0.2248 -0.2043
Atmospheric Motion Vector
AQUA MODIS CLEAR WV WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=486.0000, expected range: 39.0118 261.4521
Radiosondes
LAND TEMP Q (G/KG) 42809 PRESSURE LAYER 900-1200 (HPA) : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-7.6207, expected range: -6.4715 8.1643
Severely_persistent: rms_fgdepar=7.6820, expected range: 0.0000 11.7253
LAND TEMP TEMPERATURE (K) 37259 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=7.7396, expected range: 0.4036 1.9360
LAND TEMP TEMPERATURE (K) 29862 PRESSURE LAYER 900-1200 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8913, expected range: -0.9178 0.7500
LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=5.4265, expected range: 0.0784 2.7063
LAND TEMP WIND VECTOR DIFF (M/S) 25403 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_fgdepar=20.5460, expected range: -2.6670 7.9739
LAND TEMP WIND VECTOR DIFF (M/S) 25403 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=20.9111, expected range: 0.0000 8.7922
Severe: avg_pge=0.8582, expected range: -0.3687 0.4841
LAND TEMP WIND VECTOR DIFF (M/S) 42971 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=18.6688, expected range: 0.0000 6.3288
LAND TEMP Q (G/KG) 98444 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.8744, expected range: 0.3838 1.2656
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 51839 PRESSURE LAYER 300-60 : out of range
Severe: rms_fgdepar=17.1529, expected range: 0.0000 8.0985
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 900-1200 (HPA) : out of range
Considerable: rms_fgdepar=1.2395, expected range: 0.4733 0.9333
amdar
MODE-S WIND VECTOR DIFF (M/S) MEA2D5E PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.5189, expected range: 0.0000 7.1317
ADS-C WIND VECTOR DIFF (M/S) 0N413JRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.1442, expected range: 0.0000 20.4719
airep
AIREP WIND VECTOR DIFF (M/S) AAL728 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=24.2269, expected range: 0.0000 20.3263
synop
MANUAL LAND SYNOP RH2M (%) 42770 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=52.3016, expected range: -35.6474 119.3012
Severely_persistent: rms_fgdepar=52.3016, expected range: 0.0000 119.3012
Severely_persistent: avg_pge=0.9999, expected range: -1.8417 0.7500
MANUAL LAND SYNOP RH2M (%) 42714 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9234, expected range: -1.7158 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 86748 : out of range
25 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=313.2235, expected range: 327.3733 1176.7302
Severely_persistent: avg_pge=0.8227, expected range: -0.1131 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71588 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=516.5968, expected range: 341.5496 657.0175
BUFR LAND SYNOP SURFACE PRESSURE (PA) _80779BD : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=709.3001, expected range: 590.8848 845.8792
BUFR LAND SYNOP SURFACE PRESSURE (PA) _80779BD : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=709.6183, expected range: 591.2634 846.4542
AUTOMATIC LAND SYNOP RH2M (%) 18210 : out of range
Severe: avg_pge=0.8399, expected range: -0.0527 0.0913
AUTOMATIC LAND SYNOP RH2M (%) 68353 : out of range
Severe: avg_fgdepar=-54.8696, expected range: -26.7109 21.2414
Severe: rms_fgdepar=54.8696, expected range: 0.0000 18.2569
Severe: avg_pge=0.9493, expected range: 0.0017 0.0038
MANUAL LAND SYNOP RH2M (%) 42463 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=49.0151, expected range: 12.7657 26.2983
MANUAL LAND SYNOP RH2M (%) 42516 : out of range
Severe: rms_fgdepar=30.2332, expected range: 0.0000 9.7098
MANUAL LAND SYNOP RH2M (%) 36546 : out of range
Severe: avg_pge=0.8093, expected range: -0.1271 0.1544
MANUAL LAND SYNOP RH2M (%) 42469 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=40.7946, expected range: 4.0490 40.5182
Severe: avg_pge=0.8346, expected range: -0.3572 0.5827
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42557 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8012, expected range: -1.0908 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42077 : out of range
Severe: rms_fgdepar=333.9668, expected range: 0.0000 250.0650
Severe: avg_pge=0.8187, expected range: -1.0225 0.7500
BUFR LAND SYNOP RH2M (%) 60522 : out of range
Severe: avg_fgdepar=51.3227, expected range: -20.4604 23.1092
Severe: rms_fgdepar=51.3227, expected range: 0.0000 20.5321
BUFR LAND SYNOP RH2M (%) 60507 : out of range
Severe: rms_fgdepar=48.2921, expected range: 0.0000 17.4451
BUFR LAND SYNOP RH2M (%) 72268 : out of range
Severe: rms_fgdepar=37.2086, expected range: 0.0000 4.7586
BUFR LAND SYNOP RH2M (%) 25129 : out of range
Severe: avg_pge=0.8292, expected range: -0.1510 0.2193
BUFR LAND SYNOP SURFACE PRESSURE (PA) 36090 : out of range
Severe: rms_fgdepar=460.9305, expected range: 0.0000 94.3458
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33511 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8045, expected range: -1.3557 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24753 : out of range
Severe: rms_fgdepar=577.3936, expected range: 0.0000 162.2306
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48435 : out of range
Severe: rms_fgdepar=305.6933, expected range: 0.0000 113.4713
BUFR LAND SYNOP SURFACE PRESSURE (PA) 56966 : out of range
Severe: rms_fgdepar=308.1760, expected range: 0.0000 123.4659
BUFR LAND SYNOP SURFACE PRESSURE (PA) 62309 : out of range
Severe: rms_fgdepar=567.9592, expected range: 33.8153 178.0753
BUFR LAND SYNOP SURFACE PRESSURE (PA) 13369 : out of range
Severe: rms_fgdepar=600.4800, expected range: 0.0000 187.0021
BUFR LAND SYNOP SURFACE PRESSURE (PA) : out of range
Considerable: obs_number=386.0000, expected range: 442.7849 514.5484
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6FR3 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=567.9597, expected range: 0.0000 1525.4896
Severely_persistent: avg_pge=0.8098, expected range: 0.3487 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WTEA : out of range
27 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-1311.8207, expected range: -2795.7778 1965.6988
Severely_persistent: rms_fgdepar=1321.2279, expected range: 0.0000 2648.1330
SHIP WIND VECTOR DIFF (M/S) WXY6216 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=20.4176, expected range: -2.8493 23.1769
Severe: rms_fgdepar=20.9129, expected range: 0.0000 25.3274
Severe: avg_pge=0.9225, expected range: 0.4411 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRKE9 : out of range
Severe: rms_fgdepar=18.3995, expected range: 0.0000 10.0326
Severe: avg_pge=0.8688, expected range: -0.6247 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) WACW : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9060, expected range: -1.3038 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6SA3 : out of range
Severe: rms_fgdepar=349.8437, expected range: 0.0000 44.2737
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ONLD : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-568.0980, expected range: -1145.9438 878.3450
Severe: rms_fgdepar=568.0980, expected range: 0.0000 1046.7271
Severe: avg_pge=0.8411, expected range: -1.3030 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 4602724 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=616.5904, expected range: -1508.0126 1183.7084
Severely_persistent: rms_fgdepar=617.1832, expected range: 0.0000 909.1935
Severely_persistent: avg_pge=0.9163, expected range: 0.2317 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6501674 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=542.5915, expected range: -1440.9202 1262.5961
Severely_persistent: rms_fgdepar=543.5873, expected range: 0.0000 1013.3540
Severely_persistent: avg_pge=0.9000, expected range: -0.1908 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101719 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=637.7929, expected range: -155.0785 173.7595
Severely_persistent: rms_fgdepar=637.8323, expected range: -524.6186 714.9368
Severely_persistent: avg_pge=0.9097, expected range: -1.4452 0.7500
metar
METAR SURFACE PRESSURE (PA) FQIN : out of range
Severe: rms_fgdepar=422.4775, expected range: 0.0000 146.0599
METAR SURFACE PRESSURE (PA) PALP : out of range
Severe: rms_fgdepar=475.4198, expected range: 0.0000 119.0322
METAR SURFACE PRESSURE (PA) DAOY : out of range
Severe: rms_fgdepar=323.0297, expected range: 0.0000 178.1669
snow
ROCOB TEMP SNOW (CM) 63301060 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=65.7018, expected range: 61.8601 86.3884
Severely_persistent: rms_fgdepar=65.7018, expected range: 61.8601 86.3884
BUFR LAND SYNOP SNOW (CM) _MF11A70 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-53.2268, expected range: -93.7698 -53.4186
BUFR LAND SYNOP SNOW (CM) _MF11A70 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=53.2332, expected range: 53.4306 93.7763
BUFR LAND SYNOP SNOW (CM) _MF1DB41 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-55.3816, expected range: -69.6388 -44.7401
BUFR LAND SYNOP SNOW (CM) _MF1DB41 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=55.3839, expected range: 44.7103 69.7880
BUFR LAND SYNOP SNOW (CM) _MI136C1 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-54.1456, expected range: -72.2770 -49.7710
BUFR LAND SYNOP SNOW (CM) _MI136C1 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=54.1534, expected range: 49.7675 72.3404
BUFR LAND SYNOP SNOW (CM) 01003 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-79.7504, expected range: -85.1563 -79.8382
Severely_persistent: rms_fgdepar=79.7504, expected range: 79.8382 85.1563
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
28 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-722.6732, expected range: -728.9810 -710.1299
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
28 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=722.6737, expected range: 710.1324 728.9825
BUFR LAND SYNOP SNOW (CM) _MI161D5 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=62.1534, expected range: 63.7447 72.5656
BUFR LAND SYNOP SNOW (CM) _MI161D5 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=62.1580, expected range: 63.7912 72.5607
BUFR LAND SYNOP SNOW (CM) _MI1CD76 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-77.5321, expected range: -116.6665 -50.7258
BUFR LAND SYNOP SNOW (CM) _MI1CD76 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=77.5397, expected range: 50.6599 116.8909
BUFR LAND SYNOP SNOW (CM) _MI17AC6 : out of range
30 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=72.5151, expected range: 59.9889 76.6655
BUFR LAND SYNOP SNOW (CM) _MI17AC6 : out of range
30 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=72.5219, expected range: 60.0209 76.6813
BUFR LAND SYNOP SNOW (CM) _MI11AD6 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=64.8783, expected range: 59.6445 70.6923
BUFR LAND SYNOP SNOW (CM) _MI11AD6 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=64.9167, expected range: 59.7581 70.6491
BUFR LAND SYNOP SNOW (CM) 01008 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-92.7773, expected range: -96.1314 -92.9733
Severely_persistent: rms_fgdepar=92.7774, expected range: 92.9733 96.1316
BUFR LAND SYNOP SNOW (CM) _7052E08 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=50.0174, expected range: 48.4129 103.4156
BUFR LAND SYNOP SNOW (CM) _7052E08 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=50.0202, expected range: 48.4196 103.4231
BUFR LAND SYNOP SNOW (CM) 01429 : out of range
24 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=53.0190, expected range: 44.8298 56.4861
Severely_persistent: rms_fgdepar=53.0210, expected range: 44.8306 56.4891
BUFR LAND SYNOP SNOW (CM) _MI1BB4C : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-66.1739, expected range: -89.6617 -65.5194
BUFR LAND SYNOP SNOW (CM) _MI1BB4C : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=66.1811, expected range: 65.5241 89.6807
BUFR LAND SYNOP SNOW (CM) _MI135AD : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-61.7964, expected range: -61.2153 -15.8720
BUFR LAND SYNOP SNOW (CM) _MI135AD : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=61.7995, expected range: 15.9493 61.2405
BUFR LAND SYNOP SNOW (CM) _MF1C1DE : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-57.7158, expected range: -114.7075 -51.3925
BUFR LAND SYNOP SNOW (CM) _MF1C1DE : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=57.7180, expected range: 51.3975 114.7193
BUFR LAND SYNOP SNOW (CM) _MI1B83F : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=62.1322, expected range: 55.7181 73.6018
BUFR LAND SYNOP SNOW (CM) _MI1B83F : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=62.1353, expected range: 55.8276 73.6062
BUFR LAND SYNOP SNOW (CM) _MI196EF : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=100.0000, expected range: 100.0000 100.0000
BUFR LAND SYNOP SNOW (CM) _MI196EF : out of range
36 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=100.0000, expected range: 100.0000 100.0000
ROCOB TEMP SNOW (CM) 63308284 : out of range
Severe: rms_fgdepar=23.6474, expected range: -1.1769 2.1597
ROCOB TEMP SNOW (CM) 64301727 : out of range
Severe: rms_fgdepar=40.5931, expected range: 1.1304 9.1600
BUFR LAND SYNOP SNOW (CM) 13492 : out of range
Severe: rms_fgdepar=35.5356, expected range: -0.8278 1.0130
BUFR LAND SYNOP SNOW (CM) _MI1A5CE : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-57.7041, expected range: -60.5794 -14.9915
BUFR LAND SYNOP SNOW (CM) _MI1A5CE : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=57.7066, expected range: 15.0138 60.6638
BUFR LAND SYNOP SNOW (CM) : out of range
Severe: rms_fgdepar=27.7542, expected range: -0.8612 1.2861
t2m
BUFR LAND SYNOP 2M TEMPERATURE (K) 04112 : out of range
25 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.6065, expected range: -15.9369 -8.0881
Severely_persistent: rms_fgdepar=17.6167, expected range: 8.1423 16.2395
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 36974 : out of range
Severe: avg_fgdepar=12.2021, expected range: -8.9005 14.4506
Severe: rms_fgdepar=12.2021, expected range: 0.0000 12.7883
MANUAL LAND SYNOP 2M TEMPERATURE (K) 36090 : out of range
Severe: rms_fgdepar=11.3363, expected range: 0.0000 6.4165
METAR 2M TEMPERATURE (K) KOCF : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.0346, expected range: 1.5727 4.8106
BUFR LAND SYNOP 2M TEMPERATURE (K) : out of range
Considerable: obs_number=147.0000, expected range: 224.7278 282.5222
rh2m
MANUAL LAND SYNOP RH2M (%) 25121 : out of range
Severe: rms_fgdepar=31.6824, expected range: 0.0000 17.5626
MANUAL LAND SYNOP RH2M (%) 07775 : out of range
Severe: rms_fgdepar=39.7870, expected range: 0.0000 16.9575
BUFR LAND SYNOP RH2M (%) : out of range
Considerable: obs_number=143.0000, expected range: 198.1735 299.8265