Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-09-22 12:00

iasi
METOP-B IASI RADIANCES CHANNEL 70 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.3232, expected range: 0.2487 0.2836
METOP-B IASI RADIANCES CHANNEL 81 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.4474, expected range: 0.3829 0.4078
METOP-B IASI RADIANCES CHANNEL 83 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.5254, expected range: 0.4381 0.4687
METOP-B IASI RADIANCES CHANNEL 85 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.4917, expected range: 0.4034 0.4433
METOP-B IASI RADIANCES CHANNEL 87 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.3122, expected range: 0.2366 0.2784
METOP-B IASI RADIANCES CHANNEL 55 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2491, expected range: 0.2747 0.2920
METOP-B IASI RADIANCES CHANNEL 61 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2642, expected range: 0.2993 0.3100
METOP-B IASI RADIANCES CHANNEL 79 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2772, expected range: 0.3115 0.3272
METOP-B IASI RADIANCES CHANNEL 133 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2270, expected range: 0.2779 0.2873
METOP-B IASI RADIANCES CHANNEL 111 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2202, expected range: 0.2489 0.2577
METOP-B IASI RADIANCES CHANNEL 386 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=0.0391, expected range: 0.0886 0.1225
METOP-C IASI RADIANCES CHANNEL 70 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2470, expected range: 0.2133 0.2310
METOP-C IASI RADIANCES CHANNEL 38 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1896, expected range: 0.1453 0.1459
METOP-C IASI RADIANCES CHANNEL 161 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1736, expected range: 0.1464 0.1495
METOP-C IASI RADIANCES CHANNEL 49 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2795, expected range: 0.2326 0.2446
METOP-B IASI RADIANCES CHANNEL 74 : out of range
2 times in the last 10 days for at least one item
Severe: avg_biascorr=0.4449, expected range: 0.3872 0.4197
METOP-B IASI RADIANCES (28 channels affected) : out of range
Severe: avg_biascorr=0.2995, expected range: -0.0021 0.0954
METOP-C IASI RADIANCES (33 channels affected) : out of range
Severe: avg_biascorr=0.0993, expected range: 0.1543 0.1836
METOP-C IASI RADIANCES (11 channels affected) : out of range
Severe: stdev_fgdepar=0.3688, expected range: 0.4122 0.4376
airs
AQUA AIRS RADIANCES CHANNEL 104 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0183, expected range: -0.1405 -0.0869
AQUA AIRS RADIANCES CHANNEL 110 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0179, expected range: -0.1211 -0.0727
AQUA AIRS RADIANCES CHANNEL 116 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0390, expected range: -0.1703 -0.1103
AQUA AIRS RADIANCES CHANNEL 128 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0106, expected range: -0.1178 -0.1007
AQUA AIRS RADIANCES CHANNEL 129 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1114, expected range: -0.2034 -0.1793
AQUA AIRS RADIANCES CHANNEL 69 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1373, expected range: -0.3494 -0.2410
AQUA AIRS RADIANCES CHANNEL 1869 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1908, expected range: 0.2331 0.2540
AQUA AIRS RADIANCES (87 channels affected) : out of range
Severe: obs_number=6923.0000, expected range: 9543.5437 10689.8681
mwhs2
FY-3C MWHS2 ALLSKY RADIANCES CHANNEL 7 : out of range
Slight: stdev_norm_fgdepar=0.9771, expected range: 0.6012 0.9004
atms
NPP ATMS RADIANCES CHANNEL 9 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.5831, expected range: -0.4580 -0.4568
NPP ATMS RADIANCES (15 channels affected) : out of range
Severe: obs_number=16839.0000, expected range: 22061.9350 24661.7120
ssmis
DMSP-17 SSMIS RADIANCES CHANNEL 17 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-2.5957, expected range: -2.9838 -2.8491
DMSP-17 SSMIS RADIANCES CHANNEL 10 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_norm_fgdepar=-0.1371, expected range: -0.1024 -0.0598
DMSP-17 SSMIS RADIANCES CHANNEL 11 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_norm_fgdepar=-0.1861, expected range: -0.1309 -0.0823
DMSP-18 SSMIS RADIANCES CHANNEL 7 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=4.8326, expected range: 4.0427 4.2196
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1010-1011 (HPA) : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-3.8655, expected range: -3.3301 -3.2969
Radiosondes
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=6.7996, expected range: -4.9141 16.1759
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
14 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=6.8501, expected range: 0.0000 16.1632
All BUFR TEMP DESCENT ALL LAYERS Alantic Tropical are : all data missing
Severely_persistent: obs_number=0, expected range: 80.96 102.64
LAND TEMP WIND VECTOR DIFF (M/S) 32618 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=19.0604, expected range: 0.0000 10.9357
Severe: avg_pge=0.9029, expected range: -0.9763 0.7500
LAND TEMP WIND VECTOR DIFF (M/S) (4 pressure layers affected) : out of range
Severe: obs_number=792.0000, expected range: 7.6873 120.7744
All HIGH RESO SEA TEMP ALL LAYERS Alantic Tropical are : all data missing
Severe: obs_number=0, expected range: 155.32 166.28
All BUFR TEMP DESCENT ALL LAYERS North Atlantic : all data missing
Severe: obs_number=0, expected range: 0.00 273.71
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
Considerable: obs_number=254.0000, expected range: 318.8096 340.1904
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
Considerable: obs_number=279.0000, expected range: 364.6471 390.5529
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 600-900 (HPA) : out of range
1 times in the last 10 days for at least one item
Considerable: rms_fgdepar=1.9505, expected range: 0.4305 1.3172
amdar
AMDAR WIND VECTOR DIFF (M/S) ANZ281 PRESSURE LAYER 0-300 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=26.1184, expected range: -4.2921 10.1683
Severe: rms_fgdepar=26.1184, expected range: 0.0000 10.3434
Severe: avg_pge=0.8861, expected range: -0.6199 0.7500
AMDAR WIND VECTOR DIFF (M/S) ANZ176 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=17.3924, expected range: 0.4791 5.7962
WIGOS AMDAR TEMPERATURE (K) EU8525 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-10.8625, expected range: -0.6630 0.7119
Severe: rms_fgdepar=10.8625, expected range: 0.0000 1.6854
Severe: avg_pge=0.8938, expected range: -0.2154 0.3015
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU1722 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_pge=0.8219, expected range: -1.2682 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU8525 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=50.1826, expected range: -0.8675 6.5691
Severe: rms_fgdepar=50.1826, expected range: 0.0000 10.3330
Severe: avg_pge=0.9444, expected range: -0.3217 0.4915
ADS-C WIND VECTOR DIFF (M/S) QPNEILBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.9328, expected range: 0.0000 15.5033
ADS-C WIND VECTOR DIFF (M/S) 1NISBMJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.1720, expected range: 0.0000 8.2002
ADS-C WIND VECTOR DIFF (M/S) UOVDEXJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.3250, expected range: 0.0000 10.1921
airep
AIREP WIND VECTOR DIFF (M/S) ETH575 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.7571, expected range: 0.0000 9.2881
AIREP WIND VECTOR DIFF (M/S) UPS217 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.0990, expected range: 0.8918 4.5757
synop
MANUAL LAND SYNOP RH2M (%) 66285 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=63.5270, expected range: 34.5966 61.7270
MANUAL LAND SYNOP RH2M (%) 66285 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=63.5270, expected range: 34.8978 61.7305
MANUAL LAND SYNOP RH2M (%) : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=1.0000, expected range: -1.0179 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 68939 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9092, expected range: -0.4339 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 18195 : out of range
Severe: rms_fgdepar=334.7975, expected range: 18.8771 175.0692
MANUAL LAND SYNOP RH2M (%) 67280 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9871, expected range: -1.9551 0.7500
MANUAL LAND SYNOP RH2M (%) 63533 : out of range
Severe: rms_fgdepar=30.3138, expected range: 0.0000 9.1365
MANUAL LAND SYNOP RH2M (%) 67229 : out of range
Severe: rms_fgdepar=50.1713, expected range: 0.0000 81.4827
Severe: avg_pge=0.9967, expected range: -1.1066 0.7500
MANUAL LAND SYNOP RH2M (%) 43379 : out of range
Severe: avg_pge=0.8976, expected range: -0.0159 0.0303
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 41660 : out of range
Severe: rms_fgdepar=444.2071, expected range: 0.0000 190.1755
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 37735 : out of range
Severe: rms_fgdepar=311.0400, expected range: 0.0000 131.4586
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83736 : out of range
Severe: avg_fgdepar=567.2739, expected range: -332.3869 111.7472
Severe: rms_fgdepar=916.1952, expected range: 0.0000 280.0199
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 37749 : out of range
Severe: rms_fgdepar=302.8941, expected range: 0.0000 95.9073
BUFR LAND SYNOP RH2M (%) 72450 : out of range
Severe: rms_fgdepar=30.7721, expected range: 0.0000 16.0748
BUFR LAND SYNOP RH2M (%) 86661 : out of range
Severe: rms_fgdepar=31.6084, expected range: 0.0000 8.4800
BUFR LAND SYNOP RH2M (%) 51243 : out of range
Severe: rms_fgdepar=38.9030, expected range: 0.0000 19.6489
Severe: avg_pge=0.9098, expected range: -0.0070 0.0145
BUFR LAND SYNOP RH2M (%) 42506 : out of range
Severe: rms_fgdepar=36.0923, expected range: 0.0000 13.5796
BUFR LAND SYNOP RH2M (%) 42506 : out of range
Severe: avg_pge=0.9126, expected range: 0.0017 0.0037
BUFR LAND SYNOP RH2M (%) 86706 : out of range
Severe: rms_fgdepar=34.7061, expected range: 0.0000 7.3075
BUFR LAND SYNOP RH2M (%) 86666 : out of range
Severe: rms_fgdepar=30.9174, expected range: 0.0000 12.6383
BUFR LAND SYNOP SURFACE PRESSURE (PA) 16153 : out of range
Severe: avg_fgdepar=542.6734, expected range: -123.8901 205.1190
Severe: rms_fgdepar=544.6554, expected range: 0.0000 238.3223
Severe: avg_pge=0.9010, expected range: -0.4055 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48329 : out of range
Severe: rms_fgdepar=657.6243, expected range: 0.0000 186.3613
BUFR LAND SYNOP SURFACE PRESSURE (PA) 30439 : out of range
Severe: rms_fgdepar=314.1203, expected range: 0.0000 109.9698
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OWLD2 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-506.3041, expected range: -676.9743 -17.0555
Severely_persistent: rms_fgdepar=508.0748, expected range: 8.1502 695.6888
Severely_persistent: avg_pge=0.8205, expected range: 0.4041 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRRD7 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=772.9226, expected range: 285.3279 1009.3206
Severely_persistent: rms_fgdepar=772.9226, expected range: 276.1739 1024.5604
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VABC : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=756.0278, expected range: -1647.5673 2462.7196
Severely_persistent: rms_fgdepar=772.2547, expected range: 0.0000 2054.0574
Severely_persistent: avg_pge=0.8694, expected range: -0.8374 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) DDOQ2 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=594.3950, expected range: 0.0000 228.5790
BUFR SHIP SYNOP SURFACE PRESSURE (PA) MLTH5 : out of range
Severe: avg_fgdepar=532.8559, expected range: -307.9663 135.6247
Severe: rms_fgdepar=719.7969, expected range: 0.0000 316.7299
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V6408 : out of range
Severe: rms_fgdepar=521.4703, expected range: 0.0000 463.3877
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA4048 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=840.9783, expected range: 359.4575 1494.6100
Severe: rms_fgdepar=851.9857, expected range: 359.4575 1494.6100
BUFR SHIP SYNOP SURFACE PRESSURE (PA) CQNL : out of range
Severe: avg_fgdepar=-530.6514, expected range: -116.4460 420.4491
Severe: rms_fgdepar=530.6514, expected range: 0.0000 446.5326
Severe: avg_pge=0.8458, expected range: -0.9163 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 6501670 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8601, expected range: -0.8350 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5401581 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8599, expected range: -1.4525 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 3301611 : out of range
Severe: avg_fgdepar=543.4828, expected range: -142.2522 131.8572
Severe: rms_fgdepar=543.4828, expected range: 0.0000 211.8646
Severe: avg_pge=0.8954, expected range: -0.3721 0.4831
DRIFTING BUOYS SURFACE PRESSURE (PA) 4102636 : out of range
Severe: rms_fgdepar=315.9311, expected range: 0.0000 66.3205
metar
METAR SURFACE PRESSURE (PA) UGTB : out of range
Severe: rms_fgdepar=312.8898, expected range: 0.0000 173.8725
METAR SURFACE PRESSURE (PA) SGPC : out of range
Severe: avg_fgdepar=-598.4141, expected range: -669.0357 509.5701
Severe: rms_fgdepar=598.4141, expected range: 0.0000 563.8589
Severe: avg_pge=0.8324, expected range: -0.9994 0.7500
METAR SURFACE PRESSURE (PA) HTMH : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=789.7335, expected range: 698.5718 1014.7005
Severe: rms_fgdepar=789.7335, expected range: 698.5721 1014.9857
METAR SURFACE PRESSURE (PA) SBFL : out of range
Severe: rms_fgdepar=300.9460, expected range: 0.0000 160.1726
METAR SURFACE PRESSURE (PA) LIMU : out of range
Severe: avg_fgdepar=544.1344, expected range: -224.6986 279.6689
Severe: rms_fgdepar=548.9529, expected range: 0.0000 281.6425
Severe: avg_pge=0.8308, expected range: -0.3742 0.5332
gbrad
All GROUND-BASED RADAR Global : all data missing
Severe: obs_number=0, expected range: 0.00 3500.36
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-778.8603, expected range: -792.9292 -761.4075
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=778.8604, expected range: 761.3968 792.9633
BUFR LAND SYNOP SNOW (CM) _MF12FF7 : out of range
24 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=53.8182, expected range: 40.4603 59.4221
BUFR LAND SYNOP SNOW (CM) _MF12FF7 : out of range
24 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=53.8938, expected range: 41.9508 58.5962
BUFR LAND SYNOP SNOW (CM) _MI1F9AC : out of range
28 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=57.5000, expected range: 40.8395 64.3958
BUFR LAND SYNOP SNOW (CM) _MI1F9AC : out of range
28 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=58.7697, expected range: 41.7504 64.8701
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 51777 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.1563, expected range: -26.1198 8.6856
Severely_persistent: rms_fgdepar=12.1563, expected range: 0.0000 25.2719
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
24 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-16.0653, expected range: -21.9040 -8.6684
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
24 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=16.2295, expected range: 8.7175 21.9312
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
28 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.4890, expected range: -22.3959 -7.1712
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
28 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=13.6899, expected range: 7.2697 22.4021
MANUAL LAND SYNOP 2M TEMPERATURE (K) 32165 : out of range
Severe: rms_fgdepar=13.7826, expected range: 0.0000 3.0608
LAND TEMP 2M TEMPERATURE (K) 71836 : out of range
Severe: rms_fgdepar=11.2228, expected range: 0.0000 3.2464
BUFR LAND SYNOP 2M TEMPERATURE (K) 32165 : out of range
Severe: rms_fgdepar=13.7416, expected range: 0.0000 3.1402