Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-08-15 12:00

amsua
NOAA-19 AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2477, expected range: -0.4801 -0.2586
iasi
METOP-C IASI RADIANCES CHANNEL 320 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0667, expected range: -0.0842 -0.0743
METOP-B IASI RADIANCES CHANNEL 284 : out of range
3 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.0066, expected range: -0.0307 -0.0170
METOP-C IASI RADIANCES CHANNEL 284 : out of range
3 times in the last 10 days for at least one item
Considerable: avg_biascorr=-0.0164, expected range: -0.0342 -0.0234
cris
All NPP CRIS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 14969.75 15838.06
airs
AQUA AIRS RADIANCES (39 channels affected) : out of range
Slight: obs_number=7688.0000, expected range: 9013.2712 10514.7288
mwhs2
FY-3C MWHS2 ALLSKY RADIANCES CHANNEL 14 : out of range
Considerable: avg_biascorr=3.1995, expected range: 3.8734 5.1285
atms
All NPP ATMS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 11599.55 13890.70
gpsro
All KOMPSAT-5 GPSRO SETTING ALL HEIGHTS Global : all data missing
Severe: obs_number=0, expected range: 132.17 742.02
METOP-C GRAS SETTING (24 impact heights affected) : out of range
1 times in the last 10 days for at least one item
Slight: obs_number=1329.0000, expected range: 1506.6741 2011.5612
Atmospheric Motion Vector
All AQUA MODIS CLEAR WV ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 41.55 1189.83
All NPP VIIRS AMV IR ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 192.48 1431.33
GOES-16 AMV IR1 WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : out of range
Slight: stdev_fgdepar=1.9673, expected range: 1.3381 1.7470
Radiosondes
LAND TEMP Q (G/KG) 35700 PRESSURE LAYER 900-1200 (HPA) : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=6.5565, expected range: -5.2648 15.3390
Severely_persistent: rms_fgdepar=6.7994, expected range: 0.0000 15.0924
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=11.9901, expected range: -5.2598 18.0124
Severely_persistent: rms_fgdepar=12.1110, expected range: 0.0000 18.0488
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 46 : all data missing
Severely_persistent: obs_number=0, expected range: 198.64 364.56
All HIGH RESO SEA TEMP ALL LAYERS North East Pacific : all data missing
Severely_persistent: obs_number=0, expected range: 95.91 142.49
All BUFR TEMP DESCENT ALL LAYERS North pole : all data missing
Severely_persistent: obs_number=0, expected range: 14.44 197.31
LAND TEMP TEMPERATURE (K) 82244 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=7.3251, expected range: 0.4005 2.2261
LAND TEMP WIND VECTOR DIFF (M/S) 32540 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=21.7463, expected range: 0.0000 6.6810
LAND TEMP WIND VECTOR DIFF (M/S) 32540 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_pge=0.8516, expected range: -0.3471 0.5443
HIGH RESO LAND TEMP Q (G/KG) 54857 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=4.9991, expected range: 0.1540 2.4194
HIGH RESO LAND TEMP Q (G/KG) 51656 PRESSURE LAYER 900-1200 (HPA) : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=6.5495, expected range: 1.8515 9.2217
Severe: rms_fgdepar=6.5495, expected range: 1.8515 9.2217
HIGH RESO LAND TEMP Q (G/KG) 54857 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=6.7738, expected range: -2.1288 3.2691
HIGH RESO LAND TEMP Q (G/KG) 72797 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.9812, expected range: 0.0000 1.4953
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 89571 PRESSURE LAYER 900-12 : out of range
Severe: rms_fgdepar=16.0994, expected range: 0.0000 11.0129
Severe: avg_pge=0.8128, expected range: -0.4625 0.6976
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : missing
3 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 364.3773
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 82 : all data missing
Severe: obs_number=0, expected range: 95.65 115.15
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 88 : all data missing
Severe: obs_number=0, expected range: 17.53 343.36
LAND TEMP Q (G/KG) PRESSURE LAYER 600-900 (HPA) : out of range
1 times in the last 10 days for at least one item
Considerable: rms_fgdepar=1.6914, expected range: 1.1851 1.4877
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU1656 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=20.6122, expected range: 0.1363 5.8887
ADS-C WIND VECTOR DIFF (M/S) J4RYCOJA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=16.8148, expected range: 0.0000 7.1888
ADS-C WIND VECTOR DIFF (M/S) 2CGXUXJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.0185, expected range: 0.4292 7.3118
ADS-C WIND VECTOR DIFF (M/S) ZTEIN5RA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=19.9371, expected range: 0.1359 5.9690
ADS-C WIND VECTOR DIFF (M/S) LGHEIERA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=20.7284, expected range: 0.9738 4.4158
Severe: rms_fgdepar=29.9801, expected range: 0.2654 6.8005
ADS-C WIND VECTOR DIFF (M/S) 4MVHHLRA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=19.0950, expected range: 0.2550 7.2422
ADS-C WIND VECTOR DIFF (M/S) B2OJM4ZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.7747, expected range: 0.8634 5.9761
ADS-C WIND VECTOR DIFF (M/S) XJ1UIEZA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=22.3384, expected range: 0.0000 24.2804
airep
AIREP WIND VECTOR DIFF (M/S) RJA266 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.3361, expected range: 0.0000 8.8202
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 97372 PRESSURE LAYER 0-300 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8175, expected range: -1.4604 0.7500
LAND PILOT WIND VECTOR DIFF (M/S) 43333 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.5157, expected range: 0.0000 11.9858
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 17928 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=780.9101, expected range: 0.0000 1209.6723
Severe: avg_pge=0.9194, expected range: 0.2605 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 60729 : out of range
Severe: rms_fgdepar=490.9563, expected range: 41.5344 182.3182
Severe: avg_pge=0.9240, expected range: 0.0146 0.7500
MANUAL LAND SYNOP RH2M (%) 62011 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9097, expected range: -1.2256 0.7500
MANUAL LAND SYNOP RH2M (%) 41712 : out of range
Severe: rms_fgdepar=31.4841, expected range: 0.0000 14.8220
MANUAL LAND SYNOP RH2M (%) 61024 : out of range
Severe: rms_fgdepar=32.9491, expected range: 0.0000 18.8129
MANUAL LAND SYNOP RH2M (%) 41194 : out of range
Severe: avg_pge=0.8896, expected range: -1.2005 0.7500
MANUAL LAND SYNOP RH2M (%) 41675 : out of range
Severe: rms_fgdepar=47.3646, expected range: 0.0000 12.5247
Severe: avg_pge=0.9998, expected range: -0.0023 0.0085
MANUAL LAND SYNOP RH2M (%) 83916 : out of range
Severe: avg_pge=0.8030, expected range: -0.0047 0.0140
MANUAL LAND SYNOP RH2M (%) 82996 : out of range
Severe: avg_pge=0.9063, expected range: -0.0534 0.0726
MANUAL LAND SYNOP RH2M (%) 61679 : out of range
Severe: rms_fgdepar=30.5012, expected range: 1.6394 13.9191
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 82246 : out of range
Severe: rms_fgdepar=449.7444, expected range: 0.0000 333.1238
Severe: avg_pge=0.8569, expected range: -0.2835 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) : out of range
Severe: rms_fgdepar=164.1552, expected range: 12.4929 98.2392
BUFR LAND SYNOP RH2M (%) 86950 : out of range
Severe: rms_fgdepar=30.6370, expected range: 0.0000 17.1205
BUFR LAND SYNOP RH2M (%) 06490 : out of range
Severe: rms_fgdepar=36.3552, expected range: 0.0000 10.5666
BUFR LAND SYNOP RH2M (%) 41112 : out of range
Severe: rms_fgdepar=52.1568, expected range: 0.0000 55.9078
BUFR LAND SYNOP RH2M (%) 04162 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-58.2039, expected range: -84.2364 98.8807
Severe: rms_fgdepar=58.2516, expected range: 0.0000 78.2035
Severe: avg_pge=0.9938, expected range: -1.4158 0.7500
BUFR LAND SYNOP RH2M (%) 16084 : out of range
Severe: avg_pge=0.8002, expected range: -1.1125 0.7500
BUFR LAND SYNOP RH2M (%) 10458 : out of range
Severe: rms_fgdepar=32.8377, expected range: 0.0000 14.8436
BUFR LAND SYNOP RH2M (%) 06478 : out of range
Severe: rms_fgdepar=30.9378, expected range: 0.0000 11.9792
BUFR LAND SYNOP RH2M (%) 16459 : out of range
Severe: avg_pge=0.8706, expected range: -0.5502 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 86960 : out of range
Severe: rms_fgdepar=331.8191, expected range: 0.0000 123.3667
BUFR LAND SYNOP SURFACE PRESSURE (PA) 86961 : out of range
Severe: rms_fgdepar=307.7292, expected range: 0.0000 131.5799
BUFR LAND SYNOP SURFACE PRESSURE (PA) 36012 : out of range
Severe: rms_fgdepar=340.3829, expected range: 0.0000 111.4759
BUFR LAND SYNOP SURFACE PRESSURE (PA) 30372 : out of range
Severe: rms_fgdepar=543.7316, expected range: 0.0000 64.7778
BUFR LAND SYNOP SURFACE PRESSURE (PA) 91843 : out of range
Severe: rms_fgdepar=540.0908, expected range: 0.0000 101.7073
BUFR LAND SYNOP SURFACE PRESSURE (PA) 14554 : out of range
Severe: rms_fgdepar=355.9332, expected range: 22.3481 110.9717
BUFR LAND SYNOP SURFACE PRESSURE (PA) 36736 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-533.3692, expected range: -283.2337 225.7412
Severe: rms_fgdepar=533.8037, expected range: 0.0000 302.5598
Severe: avg_pge=0.8907, expected range: -0.5004 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 86977 : out of range
Severe: rms_fgdepar=349.2620, expected range: 0.0000 179.4765
BUFR LAND SYNOP SURFACE PRESSURE (PA) 86978 : out of range
Severe: rms_fgdepar=337.0023, expected range: 0.0000 150.7244
BUFR LAND SYNOP SURFACE PRESSURE (PA) 60419 : out of range
Severe: rms_fgdepar=309.7226, expected range: 15.4956 109.5631
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V7980 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=500.4854, expected range: -1018.9112 1176.8217
Severely_persistent: rms_fgdepar=500.4854, expected range: 0.0000 894.6257
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7OJ5 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1153.0587, expected range: 826.8666 1563.5062
Severely_persistent: rms_fgdepar=1153.0587, expected range: 830.5307 1562.1865
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6NR7 : out of range
25 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8602, expected range: -0.7240 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRRU4 : out of range
Severe: avg_pge=0.8397, expected range: -0.7442 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 8VY2YWF : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8619, expected range: -1.0178 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRLJ4 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=1220.8018, expected range: -97.8666 2170.1132
Severe: rms_fgdepar=1220.8018, expected range: 0.0000 2171.7291
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V6207 : out of range
Severe: avg_fgdepar=691.2868, expected range: -274.1836 514.9809
Severe: rms_fgdepar=694.1620, expected range: 0.0000 481.7395
Severe: avg_pge=0.8479, expected range: -0.7532 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) TBWUK47 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=657.8502, expected range: -597.3574 997.1144
Severe: rms_fgdepar=657.8502, expected range: 0.0000 989.0699
Severe: avg_pge=0.8431, expected range: -1.3082 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) LAPE7 : out of range
Severe: avg_fgdepar=808.9175, expected range: -298.2529 919.7041
Severe: rms_fgdepar=808.9175, expected range: 0.0000 993.9333
Severe: avg_pge=0.8708, expected range: -0.0965 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 1501741 : out of range
21 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8250, expected range: -0.0690 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4801707 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8567, expected range: -0.4077 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1701618 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=503.6065, expected range: -1235.9579 1176.1532
Severely_persistent: rms_fgdepar=503.6065, expected range: 0.0000 687.0826
Severely_persistent: avg_pge=0.8873, expected range: -0.4321 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5601693 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=648.8473, expected range: -214.8526 145.1489
Severe: rms_fgdepar=678.1023, expected range: 0.0000 194.2155
DRIFTING BUOYS SURFACE PRESSURE (PA) 4701737 : out of range
Severe: avg_fgdepar=-539.8864, expected range: -83.6510 93.3184
Severe: rms_fgdepar=539.8864, expected range: 0.0000 72.8888
Severe: avg_pge=0.9007, expected range: -0.3396 0.4028
metar
METAR SURFACE PRESSURE (PA) SBBG : out of range
Severe: rms_fgdepar=317.7005, expected range: 0.0000 121.6893
METAR SURFACE PRESSURE (PA) SBSM : out of range
Severe: rms_fgdepar=302.2009, expected range: 0.0000 115.0172
snow
MANUAL LAND SYNOP SNOW (CM) 37552 : out of range
21 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=65.5000, expected range: 18.0122 96.1753
Severely_persistent: rms_fgdepar=65.5172, expected range: 21.0238 94.8668
MANUAL LAND SYNOP SNOW (CM) 87803 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-69.5134, expected range: -69.9811 -45.3105
Severely_persistent: rms_fgdepar=69.5134, expected range: 45.3105 69.9811
BUFR LAND SYNOP SNOW (CM) 87803 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-69.5134, expected range: -69.9811 -45.3105
Severely_persistent: rms_fgdepar=69.5134, expected range: 45.3105 69.9811
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-772.8368, expected range: -773.0559 -772.3706
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=772.8368, expected range: 772.3708 773.0558
t2m
METAR 2M TEMPERATURE (K) UGMS : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=13.3668, expected range: 8.7077 14.9927
Severely_persistent: rms_fgdepar=13.3668, expected range: 8.8796 15.0156
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-19.5871, expected range: -22.2826 -12.6303
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=19.5887, expected range: 12.6885 22.2673
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 68353 : out of range
Severe: rms_fgdepar=11.6235, expected range: 0.0000 3.1403
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.4743, expected range: -14.9804 -0.8074
Severe: rms_fgdepar=13.0183, expected range: 0.8278 15.2932
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 68329 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-13.2651, expected range: -3.3626 5.0347
Severe: rms_fgdepar=13.2651, expected range: 0.0000 5.9010
METAR 2M TEMPERATURE (K) KFOK : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.6205, expected range: 0.0000 5.4940
METAR 2M TEMPERATURE (K) RODN : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-18.6974, expected range: -0.0182 2.6747
Severe: rms_fgdepar=18.6974, expected range: 0.0000 3.4620
BUFR LAND SYNOP 2M TEMPERATURE (K) 87046 : out of range
Severe: avg_fgdepar=12.9319, expected range: -8.4275 8.5780
Severe: rms_fgdepar=12.9319, expected range: 0.0000 8.8681
BUFR LAND SYNOP 2M TEMPERATURE (K) 87047 : out of range
Severe: avg_fgdepar=12.9922, expected range: -5.5285 9.6742
Severe: rms_fgdepar=12.9922, expected range: 0.0000 10.1114
BUFR LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.8977, expected range: -15.1892 -0.7341
Severe: rms_fgdepar=13.4144, expected range: 0.7647 15.4874
rh2m
AUTOMATIC LAND SYNOP RH2M (%) 06490 : out of range
Severe: rms_fgdepar=32.8437, expected range: 0.0000 13.9537
AUTOMATIC LAND SYNOP RH2M (%) 06494 : out of range
Severe: rms_fgdepar=35.6703, expected range: 0.0000 18.4884
AUTOMATIC LAND SYNOP RH2M (%) 11406 : out of range
Severe: rms_fgdepar=36.1259, expected range: 1.0194 19.7562
BUFR LAND SYNOP RH2M (%) _DW1K210 : out of range
Severe: rms_fgdepar=32.1357, expected range: 0.0000 17.6988