Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-07-28 12:00

iasi
METOP-C IASI RADIANCES (160 channels affected) : out of range
Severe: obs_number=15634.0000, expected range: 22686.8474 23201.2703
cris
NOAA20 CRIS RADIANCES CHANNEL 989 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0458, expected range: 0.0665 0.0883
NOAA20 CRIS RADIANCES CHANNEL 1005 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0830, expected range: 0.1105 0.1227
airs
AQUA AIRS RADIANCES (52 channels affected) : out of range
Slight: obs_number=7647.0000, expected range: 9057.6953 10679.2459
mhs
METOP-C MHS ALLSKY RADIANCES CHANNEL 3 : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=33765.0000, expected range: 46809.2575 50713.2131
METOP-C MHS ALLSKY RADIANCES CHANNEL 4 : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=32362.0000, expected range: 45039.5977 48278.2847
METOP-C MHS ALLSKY RADIANCES CHANNEL 5 : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=20736.0000, expected range: 27825.5496 30301.5093
atms
All NPP ATMS ALL CHANNELS Global : all data missing
Severe: obs_number=0, expected range: 8709.85 16403.42
ssmis
DMSP-17 SSMIS RADIANCES CHANNEL 8 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.1194, expected range: 0.4890 0.6144
DMSP-17 SSMIS RADIANCES CHANNEL 9 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.1002, expected range: 0.5093 0.6348
DMSP-18 SSMIS RADIANCES CHANNEL 9 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.0727, expected range: 0.4020 0.4579
Slight: stdev_norm_fgdepar=0.0787, expected range: 0.5113 0.5113
DMSP-17 SSMIS RADIANCES CHANNEL 10 : out of range
10 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.0732, expected range: 0.5579 0.5579
DMSP-17 SSMIS RADIANCES CHANNEL 11 : out of range
7 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.0417, expected range: 0.6108 0.6108
DMSP-17 SSMIS RADIANCES CHANNEL 17 : out of range
8 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.0817, expected range: 0.7707 0.7707
DMSP-18 SSMIS RADIANCES CHANNEL 10 : out of range
13 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.0553, expected range: 0.5874 0.5874
DMSP-18 SSMIS RADIANCES CHANNEL 11 : out of range
10 times in the last 10 days for at least one item
Slight: stdev_norm_fgdepar=0.0330, expected range: 0.6393 0.6393
gpsro
METOP-C GRAS RISING (24 impact heights affected) : out of range
Slight: obs_number=795.0000, expected range: 985.6965 1588.1858
Atmospheric Motion Vector
All AQUA MODIS CLEAR WV ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 95.81 1038.76
All NPP VIIRS AMV IR ALL LAYERS Global : all data missing
Severe: obs_number=0, expected range: 74.80 1519.75
DUAL-METOP AMV IR WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : out of range
Considerable: avg_fgdepar=3.8890, expected range: 4.3502 4.9014
scatt
METOP-C ASCAT WIND VECTOR DIFF (M/S) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=25322.0000, expected range: 32590.1138 37732.2391
Radiosondes
All MOBILE TEMP ALL LAYERS North East Pacific : all data missing
Severely_persistent: obs_number=0, expected range: 0.00 253.21
All MOBILE TEMP ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 0.00 253.21
All HIGH RESO SEA TEMP ALL LAYERS North East Pacific : all data missing
Severely_persistent: obs_number=0, expected range: 72.15 525.37
LAND TEMP TEMPERATURE (K) 28695 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.3818, expected range: 0.0000 2.9096
Severe: avg_pge=0.8181, expected range: -0.8458 0.7500
LAND TEMP Q (G/KG) 31300 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=4.4787, expected range: 0.0000 2.1484
LAND TEMP Q (G/KG) 40582 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.5235, expected range: 0.0000 1.4372
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 53543 PRESSURE LAYER 600-90 : out of range
Severe: rms_fgdepar=20.0632, expected range: 0.0000 9.9968
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (3 pressure layers affected : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=95.0000, expected range: 185.0745 195.4255
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
Severe: obs_number=95.0000, expected range: 185.2491 194.5287
HIGH RESO LAND TEMP Q (G/KG) 70361 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.0864, expected range: 0.0000 1.1129
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 24 : all data missing
Severe: obs_number=0, expected range: 120.30 146.45
amdar
WIGOS AMDAR TEMPERATURE (K) EU0133 PRESSURE LAYER 0-300 (HPA) : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8649, expected range: -1.6618 0.7500
TAMDAR WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : missing
3 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 254.5390
WIGOS AMDAR Q (G/KG) WWJWUUJA PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=6.0898, expected range: 1.6484 8.9571
WIGOS AMDAR Q (G/KG) 3OXWUWJA PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=-6.0561, expected range: -12.2751 7.2638
Severe: rms_fgdepar=6.0561, expected range: 0.0000 10.8022
Severe: avg_pge=0.9568, expected range: -0.8063 0.7500
airep
AIREP WIND VECTOR DIFF (M/S) UAL1295 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.4950, expected range: 0.0000 6.5349
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 17952 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8176, expected range: -1.4497 0.7500
MANUAL LAND SYNOP RH2M (%) 62124 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=41.7758, expected range: 0.0000 41.2558
Severely_persistent: avg_pge=1.0000, expected range: -1.5221 0.7500
BUFR LAND SYNOP Z (M) : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=246.2256, expected range: 94.0806 232.2329
Severely_persistent: avg_pge=0.8111, expected range: -0.1868 0.7500
MANUAL LAND SYNOP RH2M (%) 42770 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8056, expected range: -1.5041 0.7500
MANUAL LAND SYNOP RH2M (%) 62435 : out of range
Severe: rms_fgdepar=42.2874, expected range: 0.0000 12.2277
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83780 : out of range
Severe: avg_fgdepar=566.7557, expected range: -13.1393 120.0592
Severe: rms_fgdepar=763.1027, expected range: 0.0000 116.5281
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 82571 : out of range
Severe: rms_fgdepar=350.4739, expected range: 0.0000 289.4187
Severe: avg_pge=0.8476, expected range: -0.5230 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83952 : out of range
Severe: rms_fgdepar=326.8194, expected range: 0.0000 123.7245
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 63862 : out of range
Severe: rms_fgdepar=327.2661, expected range: 0.0000 83.1778
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83967 : out of range
Severe: rms_fgdepar=327.4547, expected range: 0.0000 139.6806
BUFR LAND SYNOP Z (M) 07591 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9091, expected range: -1.0102 0.7500
BUFR LAND SYNOP Z (M) 08103 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=246.2256, expected range: 94.0806 232.2329
Severe: avg_pge=0.8111, expected range: -0.1868 0.7500
BUFR LAND SYNOP RH2M (%) 72360 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=35.0161, expected range: 0.0000 15.7306
BUFR LAND SYNOP RH2M (%) 15265 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=37.1838, expected range: 0.0000 6.5164
BUFR LAND SYNOP RH2M (%) 28985 : out of range
Severe: rms_fgdepar=37.0857, expected range: 0.0000 20.8298
BUFR LAND SYNOP RH2M (%) 72356 : out of range
Severe: rms_fgdepar=34.2571, expected range: 0.0000 18.5984
BUFR LAND SYNOP RH2M (%) 24817 : out of range
Severe: rms_fgdepar=30.4484, expected range: 0.0000 13.6213
BUFR LAND SYNOP RH2M (%) 51777 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9999, expected range: -1.4263 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33651 : out of range
Severe: rms_fgdepar=529.6717, expected range: 0.0000 249.1680
BUFR LAND SYNOP SURFACE PRESSURE (PA) 36736 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8262, expected range: -1.0558 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 13586 : out of range
Severe: rms_fgdepar=382.2553, expected range: 0.0000 163.3387
Severe: avg_pge=0.8271, expected range: -0.6769 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48018 : out of range
Severe: avg_fgdepar=-1006.5826, expected range: -252.1843 30.2749
Severe: rms_fgdepar=1006.5826, expected range: 0.0000 252.1843
Severe: avg_pge=0.9447, expected range: -1.0068 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 29059 : out of range
Severe: rms_fgdepar=551.8987, expected range: 0.0000 76.3907
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V7693 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=550.5164, expected range: 24.2751 854.9872
Severely_persistent: rms_fgdepar=550.5164, expected range: 30.3656 851.7750
Severely_persistent: avg_pge=0.8120, expected range: 0.5473 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V8838 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=780.3360, expected range: -294.8233 1508.9105
Severely_persistent: rms_fgdepar=780.3360, expected range: 112.7230 1215.4402
Severely_persistent: avg_pge=0.8637, expected range: -0.5324 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRFT7 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=38.7296, expected range: -2.2190 7.9586
Severe: rms_fgdepar=38.7296, expected range: 0.0000 9.3503
Severe: avg_pge=0.9576, expected range: -0.8214 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OZDL2 : out of range
Severe: avg_fgdepar=-1154.8895, expected range: -259.5060 250.1238
Severe: rms_fgdepar=1154.8895, expected range: 0.0000 325.5759
Severe: avg_pge=0.9233, expected range: -0.7883 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) D5LH4 : out of range
Severe: avg_fgdepar=618.3293, expected range: -453.1674 1697.8491
Severe: rms_fgdepar=618.3293, expected range: 0.0000 1697.8491
Severe: avg_pge=0.8342, expected range: 0.4995 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 2IYH4 : out of range
Severe: rms_fgdepar=613.3330, expected range: 0.0000 525.2269
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 6201065 : out of range
Severe: rms_fgdepar=524.3162, expected range: 0.0000 280.4855
Severe: avg_pge=0.8769, expected range: -0.3617 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V8585 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=705.5457, expected range: 515.4863 870.7904
Severe: rms_fgdepar=705.5457, expected range: 515.4863 870.7904
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V6408 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-869.2590, expected range: -412.9190 450.5842
Severe: rms_fgdepar=874.9932, expected range: 0.0000 351.1817
Severe: avg_pge=0.8919, expected range: -0.3999 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 7KJS : out of range
Severe: avg_fgdepar=521.8688, expected range: -172.9684 153.5912
Severe: rms_fgdepar=521.8688, expected range: 0.0000 122.1307
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 1401817 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8376, expected range: -0.6090 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6402659 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=594.8733, expected range: -904.6734 1337.8218
Severely_persistent: rms_fgdepar=594.8743, expected range: 0.0000 783.1141
Severely_persistent: avg_pge=0.9061, expected range: 0.0640 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4701747 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=648.3033, expected range: -908.9475 1557.9228
Severe: rms_fgdepar=648.3503, expected range: 0.0000 1422.9064
Severe: avg_pge=0.9100, expected range: -0.5391 0.7500
metar
METAR SURFACE PRESSURE (PA) SBSP : out of range
Severe: rms_fgdepar=334.6842, expected range: 31.2253 146.3752
METAR SURFACE PRESSURE (PA) FNCT : out of range
Severe: avg_fgdepar=633.3174, expected range: -115.7505 158.3205
Severe: rms_fgdepar=633.3174, expected range: 0.0000 164.2719
Severe: avg_pge=0.8303, expected range: -0.2022 0.2298
snow
MANUAL LAND SYNOP SNOW (CM) 37552 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=54.0000, expected range: 9.7571 80.0554
Severely_persistent: rms_fgdepar=54.0093, expected range: 10.0063 81.5368
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-772.5863, expected range: -773.0654 -772.4185
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=772.5864, expected range: 772.4186 773.0653
BUFR LAND SYNOP SNOW (CM) : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-22.3693, expected range: -168.1326 -128.0748
Severely_persistent: rms_fgdepar=143.2908, expected range: 664.5922 742.5462
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89004 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.7037, expected range: -27.1015 16.5259
Severely_persistent: rms_fgdepar=17.7037, expected range: 0.0000 24.7186
MANUAL LAND SYNOP 2M TEMPERATURE (K) 89004 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.0828, expected range: -24.3706 16.4793
Severely_persistent: rms_fgdepar=17.1025, expected range: -11.5653 23.0546
METAR 2M TEMPERATURE (K) OIGK : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.3295, expected range: -14.6814 -2.4685
Severely_persistent: rms_fgdepar=12.5078, expected range: 2.6398 15.1262
METAR 2M TEMPERATURE (K) UGMS : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=12.9642, expected range: 5.5316 14.6105
Severely_persistent: rms_fgdepar=12.9906, expected range: 5.5246 14.7208
BUFR LAND SYNOP 2M TEMPERATURE (K) 89004 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.2383, expected range: -25.5549 15.4598
Severely_persistent: rms_fgdepar=17.2513, expected range: 0.0000 23.7159
BUFR LAND SYNOP 2M TEMPERATURE (K) 78896 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.2690, expected range: -18.8857 -3.1553
Severely_persistent: rms_fgdepar=15.6877, expected range: 3.8656 19.1928
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 51656 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-13.3786, expected range: -22.8094 16.7441
Severe: rms_fgdepar=13.3786, expected range: 0.0000 16.6487
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-13.4702, expected range: -9.7015 -4.5936
Severe: rms_fgdepar=13.5226, expected range: 4.5849 9.8784
METAR 2M TEMPERATURE (K) KBFM : out of range
Severe: rms_fgdepar=11.7172, expected range: 0.0994 4.3018
BUFR LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-13.5315, expected range: -9.7957 -4.6702
Severe: rms_fgdepar=13.5805, expected range: 4.6669 9.9571
BUFR LAND SYNOP 2M TEMPERATURE (K) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=52479.0000, expected range: 136678.9188 141644.1400
Slight: obs_number=7711.0000, expected range: 11473.7295 12910.6234
rh2m
BUFR LAND SYNOP RH2M (%) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=42910.0000, expected range: 90865.9785 98285.4333
Slight: obs_number=5946.0000, expected range: 7485.0248 9732.7399