Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-08-16 12:00

amsua
NOAA-19 AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1633, expected range: -0.4869 -0.2586
iasi
METOP-B IASI RADIANCES CHANNEL 278 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0193, expected range: -0.0492 -0.0374
Severely_persistent: avg_biascorr=-0.0016, expected range: -0.0670 -0.0353
METOP-B IASI RADIANCES CHANNEL 314 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1165, expected range: -0.1443 -0.1323
METOP-B IASI RADIANCES CHANNEL 5379 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1395, expected range: -0.1225 -0.1048
METOP-C IASI RADIANCES CHANNEL 278 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0408, expected range: -0.0718 -0.0587
Severely_persistent: avg_biascorr=-0.0309, expected range: -0.1012 -0.0620
METOP-C IASI RADIANCES CHANNEL 5379 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1668, expected range: -0.1300 -0.1153
METOP-B IASI RADIANCES (197 channels affected) : out of range
Severe: obs_number=15925.0000, expected range: 22753.9908 23121.6563
METOP-B IASI RADIANCES CHANNEL 87 : out of range
Severe: avg_biascorr=0.1468, expected range: 0.1882 0.2337
METOP-B IASI RADIANCES CHANNEL 141 : out of range
Severe: avg_biascorr=0.2416, expected range: 0.2663 0.2971
METOP-B IASI RADIANCES CHANNEL 144 : out of range
Severe: avg_biascorr=0.2640, expected range: 0.2848 0.3063
METOP-B IASI RADIANCES CHANNEL 163 : out of range
Severe: avg_biascorr=0.2348, expected range: 0.2548 0.2800
METOP-B IASI RADIANCES CHANNEL 191 : out of range
Severe: avg_biascorr=0.0046, expected range: 0.0312 0.0626
METOP-B IASI RADIANCES CHANNEL 197 : out of range
Severe: avg_biascorr=0.0239, expected range: 0.0443 0.0668
METOP-C IASI RADIANCES (162 channels affected) : out of range
Severe: obs_number=15975.0000, expected range: 22793.5194 23106.5983
cris
All NPP CRIS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 15013.26 15792.94
NOAA20 CRIS RADIANCES CHANNEL 594 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0494, expected range: -0.0613 -0.0551
NOAA20 CRIS RADIANCES CHANNEL 121 : out of range
Slight: stdev_fgdepar=0.1495, expected range: 0.1304 0.1433
mwhs2
FY-3C MWHS2 ALLSKY RADIANCES CHANNEL 14 : out of range
2 times in the last 10 days for at least one item
Severe: avg_biascorr=2.7807, expected range: 3.8734 5.1285
atms
All NPP ATMS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 11641.17 13886.03
Atmospheric Motion Vector
All AQUA MODIS CLEAR WV ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 22.00 1213.16
All NPP VIIRS AMV IR ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 180.16 1458.91
HIMAWARI-8 AMV IR1 WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : out of range
Slight: stdev_fgdepar=2.3381, expected range: 1.7583 2.1418
Radiosondes
LAND TEMP Q (G/KG) 35700 PRESSURE LAYER 900-1200 (HPA) : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=6.2707, expected range: -5.4001 15.2000
Severely_persistent: rms_fgdepar=6.3645, expected range: 0.0000 14.9784
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=7.4741, expected range: -4.8943 17.1117
Severely_persistent: rms_fgdepar=7.6817, expected range: 0.0000 17.1865
HIGH RESO LAND TEMP Q (G/KG) 51656 PRESSURE LAYER 900-1200 (HPA) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=8.3246, expected range: -2.6681 12.9257
Severely_persistent: rms_fgdepar=8.3246, expected range: 0.0000 12.9257
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 46 : all data missing
Severely_persistent: obs_number=0, expected range: 13.55 677.83
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 82 : all data missing
Severely_persistent: obs_number=0, expected range: 84.96 122.64
All HIGH RESO SEA TEMP ALL LAYERS North East Pacific : all data missing
Severely_persistent: obs_number=0, expected range: 88.75 147.65
All BUFR TEMP DESCENT ALL LAYERS North pole : all data missing
Severely_persistent: obs_number=0, expected range: 13.39 335.74
LAND TEMP TEMPERATURE (K) 72393 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=7.3547, expected range: 0.0000 7.2047
Severe: avg_pge=0.8102, expected range: -0.2793 0.7500
LAND TEMP WIND VECTOR DIFF (M/S) 24947 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=16.3393, expected range: 0.0000 8.0358
LAND TEMP Q (G/KG) 83208 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.8766, expected range: 0.4754 1.7741
LAND TEMP Q (G/KG) 41217 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.4790, expected range: 0.0000 5.5228
All LAND TEMP ALL LAYERS WMO BLOCK 4 : all data missing
Severe: obs_number=0, expected range: 0.00 271.28
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=835.0000, expected range: 646.6491 669.6009
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
Severe: obs_number=96.0000, expected range: 186.6549 194.0951
HIGH RESO LAND TEMP Q (G/KG) 47600 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=3.4924, expected range: 0.0000 1.6409
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
Severe: obs_number=281.0000, expected range: 368.8094 384.9684
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 20 : all data missing
Severe: obs_number=0, expected range: 92.21 189.46
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 88 : all data missing
Severe: obs_number=0, expected range: 0.00 471.17
amdar
WIGOS AMDAR TEMPERATURE (K) 0JXWU1JA (4 pressure layers affected) : out of range
Severe: avg_pge=0.8146, expected range: -0.6345 0.7500
WIGOS AMDAR TEMPERATURE (K) 0JXWU1JA (3 pressure layers affected) : out of range
Severe: rms_fgdepar=6.6357, expected range: 0.0000 2.7559
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU0628 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=18.7780, expected range: 0.0000 5.0458
ADS-C WIND VECTOR DIFF (M/S) X3RYN1JA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=26.6290, expected range: 1.0081 5.4694
Severe: rms_fgdepar=26.6290, expected range: 0.7964 7.0180
ADS-C WIND VECTOR DIFF (M/S) THOVEGRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=31.0820, expected range: 0.0000 8.3402
ADS-C WIND VECTOR DIFF (M/S) BNNW5LZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=21.0127, expected range: -0.4559 6.8537
Severe: rms_fgdepar=21.0127, expected range: 0.0000 8.0026
airep
AIREP WIND VECTOR DIFF (M/S) ACA81 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.6749, expected range: 0.0000 7.2263
AIREP WIND VECTOR DIFF (M/S) ACA827 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.7271, expected range: 0.0456 5.7566
pilot
LAND PILOT WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.2962, expected range: 2.7956 9.1844
Considerable: rms_fgdepar=9.2639, expected range: 3.9754 7.3298
LAND PILOT WIND VECTOR DIFF (M/S) 43333 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=21.2254, expected range: -0.9342 11.0723
Severe: rms_fgdepar=42.5779, expected range: 0.0000 12.0403
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 41244 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8765, expected range: -0.5478 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 37308 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8311, expected range: 0.0634 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 17928 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=534.5607, expected range: -1681.6802 1365.9053
Severely_persistent: rms_fgdepar=534.5607, expected range: 0.0000 1048.9942
BUFR LAND SYNOP RH2M (%) 04162 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-51.5906, expected range: -152.3441 146.3508
Severely_persistent: rms_fgdepar=52.0508, expected range: 0.0000 111.4301
BUFR LAND SYNOP SURFACE PRESSURE (PA) 36736 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8410, expected range: -0.9170 0.7500
MANUAL LAND SYNOP RH2M (%) 62120 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=1.0000, expected range: -1.2448 0.7500
MANUAL LAND SYNOP RH2M (%) 35393 : out of range
Severe: rms_fgdepar=40.6960, expected range: 0.0000 25.7077
Severe: avg_pge=0.8459, expected range: -0.0340 0.0467
MANUAL LAND SYNOP RH2M (%) 87467 : out of range
Severe: rms_fgdepar=42.2571, expected range: 0.0000 19.2472
MANUAL LAND SYNOP RH2M (%) 41697 : out of range
Severe: avg_fgdepar=-58.9885, expected range: -27.3595 36.5406
Severe: rms_fgdepar=58.9885, expected range: 0.0000 37.2588
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 63720 : out of range
Severe: rms_fgdepar=348.3671, expected range: 0.0000 136.4762
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 82696 : out of range
Severe: rms_fgdepar=658.6042, expected range: 0.0000 119.3331
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 41678 : out of range
Severe: rms_fgdepar=585.8999, expected range: 0.0000 186.2942
BUFR LAND SYNOP RH2M (%) 02561 : out of range
Severe: rms_fgdepar=33.9587, expected range: 0.0000 10.6246
BUFR LAND SYNOP RH2M (%) 12455 : out of range
Severe: rms_fgdepar=31.4457, expected range: 3.4370 16.4460
BUFR LAND SYNOP RH2M (%) 70326 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=46.5110, expected range: 0.0000 19.1177
Severe: avg_pge=0.9725, expected range: -1.3632 0.7500
BUFR LAND SYNOP RH2M (%) 51656 : out of range
Severe: avg_pge=0.8465, expected range: -0.6747 0.7500
BUFR LAND SYNOP RH2M (%) _3486D5D : out of range
Severe: rms_fgdepar=35.7609, expected range: 0.0000 15.7425
BUFR LAND SYNOP SURFACE PRESSURE (PA) 32562 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=360.2878, expected range: 0.0000 176.8631
BUFR LAND SYNOP SURFACE PRESSURE (PA) 22762 : out of range
Severe: rms_fgdepar=361.8613, expected range: 0.0000 112.1684
BUFR LAND SYNOP SURFACE PRESSURE (PA) 98334 : out of range
Severe: rms_fgdepar=429.5269, expected range: 0.0000 192.2415
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48437 : out of range
Severe: rms_fgdepar=554.7393, expected range: 0.0000 143.3772
BUFR LAND SYNOP SURFACE PRESSURE (PA) 42367 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=301.4795, expected range: 0.0000 137.4009
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48099 : out of range
Severe: avg_pge=0.8767, expected range: -1.4459 0.7500
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V7980 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=546.2329, expected range: -1139.8452 1376.5696
Severely_persistent: rms_fgdepar=546.2329, expected range: 0.0000 1018.2778
Severely_persistent: avg_pge=0.8163, expected range: -1.1407 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7OJ5 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1094.3379, expected range: 829.6567 1551.1790
Severely_persistent: rms_fgdepar=1094.3379, expected range: 833.1211 1550.0509
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V6207 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=867.0575, expected range: -143.3345 428.8501
Severely_persistent: rms_fgdepar=873.2748, expected range: 0.0000 428.9649
Severely_persistent: avg_pge=0.8753, expected range: -0.7532 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6NR7 : out of range
22 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8846, expected range: 0.0833 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OZDJ2 : out of range
Severe: avg_fgdepar=830.5793, expected range: -364.8872 410.8957
Severe: rms_fgdepar=830.5793, expected range: 0.0000 309.4617
Severe: avg_pge=0.8752, expected range: -0.5664 0.6992
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRLJ4 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=1182.9510, expected range: 241.2971 1788.1349
Severe: rms_fgdepar=1182.9510, expected range: 242.0136 1791.6455
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6BQ4 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=516.1475, expected range: 0.0000 679.7764
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRJU8 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=566.9709, expected range: -790.1248 724.8887
Severe: rms_fgdepar=577.5070, expected range: -470.5503 702.9106
Severe: avg_pge=0.8132, expected range: -1.0276 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) A8ZU9 : out of range
Severe: avg_pge=0.8377, expected range: -1.5028 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 7JUN : out of range
Severe: avg_fgdepar=-527.4095, expected range: -1096.8267 46.4488
Severe: rms_fgdepar=527.4095, expected range: 0.0000 1096.8267
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) C6OT4 : out of range
Severe: avg_pge=0.8885, expected range: -1.4022 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 1501741 : out of range
22 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8465, expected range: -0.0584 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5601693 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=755.0189, expected range: -783.8477 796.2453
Severely_persistent: rms_fgdepar=755.5151, expected range: -591.5610 766.8096
Severely_persistent: avg_pge=0.9173, expected range: -0.9013 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4801707 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8279, expected range: -0.4340 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4701737 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=485.6913, expected range: 0.0000 69.3763
Severe: avg_pge=0.8846, expected range: -0.3337 0.4022
snow
MANUAL LAND SYNOP SNOW (CM) 87803 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-74.5441, expected range: -73.6801 -42.7361
Severely_persistent: rms_fgdepar=74.5441, expected range: 42.7361 73.6801
BUFR LAND SYNOP SNOW (CM) 87803 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-74.5441, expected range: -73.6801 -42.7361
Severely_persistent: rms_fgdepar=74.5441, expected range: 42.7361 73.6801
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-772.5641, expected range: -773.0747 -772.3732
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=772.5642, expected range: 772.3734 773.0746
BUFR LAND SYNOP SNOW (CM) 15341 : out of range
Severe: avg_fgdepar=66.0000, expected range: 0.0000 0.0000
Severe: rms_fgdepar=66.0000, expected range: 0.0000 0.0000
t2m
METAR 2M TEMPERATURE (K) UGMS : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=13.0990, expected range: 8.4245 15.3057
Severely_persistent: rms_fgdepar=13.1085, expected range: 8.6302 15.2908
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-19.5342, expected range: -21.6313 -14.1292
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=19.5342, expected range: 14.1836 21.6108
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 51644 : out of range
Severe: avg_fgdepar=-12.3542, expected range: -16.5344 15.8799
Severe: rms_fgdepar=12.3542, expected range: 0.0000 12.9478