Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-05-30 00:00

amsua
METOP-B AMSUA RADIANCES (10 channels affected) : out of range
Considerable: obs_number=4257.0000, expected range: 9266.9272 18073.6978
iasi
METOP-B IASI RADIANCES (52 channels affected) : out of range
Considerable: obs_number=2359.0000, expected range: 1944.0272 2253.8552
saphir
All MEGHA-TROPIQUES SAPHIR ALLSKY ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 933.42 21625.07
ssmis
DMSP-18 SSMIS RADIANCES CHANNEL 9 : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=15526.0000, expected range: 16622.2873 19293.5877
DMSP-18 SSMIS RADIANCES CHANNEL 10 : out of range
Considerable: obs_number=19397.0000, expected range: 20601.4947 24560.7553
DMSP-18 SSMIS RADIANCES CHANNEL 11 : out of range
Considerable: obs_number=19412.0000, expected range: 20586.8327 24604.0423
gpsro
All FY-3C GNOS RISING ALL HEIGHTS Global : all data missing
Severe: obs_number=0, expected range: 467.59 2312.99
All COSMIC2-E5 GPSRO RISING ALL HEIGHTS Global : all data missing
Severe: obs_number=0, expected range: 648.69 3411.47
All COSMIC2-E6 GPSRO RISING ALL HEIGHTS Global : all data missing
Severe: obs_number=0, expected range: 1037.43 2512.57
COSMIC2-E3 GPSRO SETTING (24 impact heights affected) : out of range
Considerable: obs_number=278.0000, expected range: 1120.9219 2971.5235
Atmospheric Motion Vector
NPP VIIRS AMV IR WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=663.0000, expected range: 0.0000 493.8388
HIMAWARI-8 AMV IR1 WIND VECTOR DIFF (M/S) PRESSURE LAYER 900-1200 (HPA : out of range
Considerable: obs_number=685.0000, expected range: 120.4004 552.9416
NOAA20 VIIRS-AMV IR WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
3 times in the last 10 days for at least one item
Considerable: obs_number=684.0000, expected range: 0.0000 475.1834
Radiosondes
LAND TEMP TEMPERATURE (K) 31510 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=8.2405, expected range: 0.0000 4.0295
Severe: avg_pge=0.8850, expected range: -0.1957 0.3887
LAND TEMP WIND VECTOR DIFF (M/S) 96147 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.4664, expected range: 3.5164 10.1235
LAND TEMP Q (G/KG) 72403 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=4.9023, expected range: 0.0000 2.0260
HIGH RESO LAND TEMP Q (G/KG) 27707 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.0262, expected range: 0.0000 0.8680
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 600-900 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=1.5075, expected range: 0.0000 0.8178
Considerable: obs_number=596.0000, expected range: 638.3068 699.1932
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 0-300 (HPA) : missing
1 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 57.4465 69.9821
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 48 : all data missing
Severe: obs_number=0, expected range: 139.78 176.72
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=87.0000, expected range: 162.6888 186.2001
HIGH RESO LAND TEMP Q (G/KG) (4 pressure layers affected) : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=65.0000, expected range: 107.7222 139.3889
Considerable: obs_number=132.0000, expected range: 191.3356 205.4144
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) 0MR0CMBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_pge=0.8169, expected range: -0.7896 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) DIJX1DJA PRESSURE LAYER 0-300 (HPA) : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=21.3034, expected range: -14.2471 25.9430
Severe: rms_fgdepar=21.3807, expected range: 0.0000 28.0307
Severe: avg_pge=0.8543, expected range: -1.3522 0.7500
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: obs_number=694.0000, expected range: 998.0224 1265.9776
Considerable: obs_number=694.0000, expected range: 998.0224 1265.9776
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 42971 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=17.5068, expected range: 0.2869 3.9729
synop
MANUAL LAND SYNOP RH2M (%) 76775 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9766, expected range: -1.0628 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 81982 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-1078.7053, expected range: -251.1924 41.5750
Severely_persistent: rms_fgdepar=1078.8868, expected range: 0.0000 252.1713
Severely_persistent: avg_pge=0.9614, expected range: -0.0865 0.7468
AUTOMATIC LAND SYNOP RH2M (%) 68513 : out of range
Severe: avg_fgdepar=54.7023, expected range: -53.4590 67.5111
Severe: rms_fgdepar=54.7023, expected range: 0.0000 50.6938
Severe: avg_pge=0.9894, expected range: -0.0198 0.0297
AUTOMATIC LAND SYNOP RH2M (%) 68408 : out of range
Severe: avg_fgdepar=58.9296, expected range: -27.2038 36.5048
Severe: rms_fgdepar=58.9296, expected range: 0.0000 26.5852
Severe: avg_pge=0.9958, expected range: -0.0025 0.0095
MANUAL LAND SYNOP RH2M (%) 38911 : out of range
Severe: avg_pge=0.9215, expected range: -0.8076 0.7500
MANUAL LAND SYNOP RH2M (%) 44373 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=30.3588, expected range: 0.0000 16.7941
MANUAL LAND SYNOP RH2M (%) 42874 : out of range
Severe: rms_fgdepar=38.7659, expected range: 0.0000 22.1006
MANUAL LAND SYNOP RH2M (%) 42056 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=32.8302, expected range: 0.0000 16.4719
MANUAL LAND SYNOP RH2M (%) 60557 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=43.2013, expected range: 0.0000 12.4756
Severe: rms_fgdepar=39.9335, expected range: 0.0000 15.0618
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43041 : out of range
Severe: rms_fgdepar=400.5337, expected range: 0.0000 170.5290
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42872 : out of range
Severe: rms_fgdepar=381.6342, expected range: 0.0000 149.4860
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40664 : out of range
Severe: rms_fgdepar=619.3860, expected range: 0.0000 109.3224
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43359 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8468, expected range: -0.7974 0.7500
BUFR LAND SYNOP RH2M (%) 70361 : out of range
Severe: rms_fgdepar=34.8156, expected range: 0.0000 17.9619
BUFR LAND SYNOP RH2M (%) 71834 : out of range
Severe: rms_fgdepar=32.7950, expected range: 0.0000 18.2792
BUFR LAND SYNOP RH2M (%) 53646 : out of range
Severe: rms_fgdepar=43.2348, expected range: 0.0000 14.0394
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72570 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8192, expected range: -1.6308 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33515 : out of range
Severe: rms_fgdepar=568.3157, expected range: 0.0000 97.0509
BUFR LAND SYNOP SURFACE PRESSURE (PA) 29456 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-571.6724, expected range: -304.9033 468.6492
Severe: rms_fgdepar=573.8957, expected range: 0.0000 444.0743
Severe: avg_pge=0.9000, expected range: -1.1696 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71419 : out of range
Severe: rms_fgdepar=311.4649, expected range: 0.0000 88.1861
Severe: avg_pge=0.8512, expected range: -0.2437 0.3168
BUFR LAND SYNOP SURFACE PRESSURE (PA) 27329 : out of range
Severe: rms_fgdepar=338.1744, expected range: 0.0000 90.8816
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) CFL24 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=24.7046, expected range: -8.9236 27.3077
Severely_persistent: rms_fgdepar=27.5037, expected range: 0.0000 30.0115
Severely_persistent: avg_pge=0.8773, expected range: -0.2555 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 9V2734 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8318, expected range: 0.1378 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRQK3 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-666.2821, expected range: -750.6763 -407.6108
Severely_persistent: rms_fgdepar=666.7368, expected range: 388.7307 782.4560
Severely_persistent: avg_pge=0.8670, expected range: 0.7688 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V9375 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=693.9278, expected range: -190.3937 1098.3086
Severely_persistent: rms_fgdepar=699.9970, expected range: 0.0000 990.8224
Severely_persistent: avg_pge=0.8359, expected range: -0.0847 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) UCQX : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1090.1276, expected range: -323.6207 1964.9068
Severely_persistent: rms_fgdepar=1090.3502, expected range: 0.0000 1961.7801
Severely_persistent: avg_pge=0.9027, expected range: 0.5588 0.7500
SHIP SURFACE PRESSURE (PA) A8JR6 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-561.9450, expected range: -847.3448 -235.9495
Severe: rms_fgdepar=561.9450, expected range: 235.9495 847.3448
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) C6DQ5 : out of range
Severe: rms_fgdepar=26.4019, expected range: 0.0000 11.2917
Severe: avg_pge=0.8487, expected range: -0.4778 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) S6DU5 : out of range
Severe: avg_pge=0.8765, expected range: -0.7203 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) PCHF : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=25.1141, expected range: -10.4971 26.4691
Severe: rms_fgdepar=25.1141, expected range: 0.0000 26.3267
Severe: avg_pge=0.9353, expected range: -0.1568 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V9404 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=839.2987, expected range: -796.3006 1323.1555
Severe: rms_fgdepar=930.4959, expected range: 0.0000 1768.0221
BUFR SHIP SYNOP SURFACE PRESSURE (PA) TBWUK34 : out of range
Severe: avg_fgdepar=552.0001, expected range: -107.7195 57.0494
Severe: rms_fgdepar=552.0001, expected range: 0.0000 113.8063
Severe: avg_pge=0.8051, expected range: -0.6501 0.7490
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V7954 : out of range
Severe: avg_fgdepar=790.2237, expected range: -216.6258 741.8464
Severe: rms_fgdepar=790.2237, expected range: 0.0000 741.8464
Severe: avg_pge=0.8624, expected range: -0.5414 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRTD6 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-537.6127, expected range: -765.8582 -417.6468
Severe: rms_fgdepar=537.6127, expected range: 411.2454 748.3216
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WZZF : out of range
Severe: avg_fgdepar=657.9999, expected range: 162.4223 555.0703
Severe: rms_fgdepar=657.9999, expected range: 162.2351 556.5423
Severe: avg_pge=0.8454, expected range: 0.3847 0.7500
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 6100198 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8556, expected range: -0.6754 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601700 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=620.4079, expected range: -1212.7722 1214.0388
Severely_persistent: rms_fgdepar=624.0487, expected range: 0.0000 1143.5200
Severely_persistent: avg_pge=0.8887, expected range: -1.3698 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6203641 : out of range
Severe: rms_fgdepar=392.2800, expected range: 0.0000 134.2164
Severe: avg_pge=0.8048, expected range: -0.8308 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6301676 : out of range
Severe: rms_fgdepar=458.0421, expected range: 0.0000 206.9421
Severe: avg_pge=0.8637, expected range: -0.3151 0.4765
metar
METAR SURFACE PRESSURE (PA) FNSA : out of range
Severe: avg_fgdepar=584.9116, expected range: -996.5482 812.6020
Severe: rms_fgdepar=584.9116, expected range: 0.0000 862.2438
METAR SURFACE PRESSURE (PA) VEJH : out of range
Severe: rms_fgdepar=306.2829, expected range: 0.0000 162.1048
METAR SURFACE PRESSURE (PA) VERP : out of range
Severe: rms_fgdepar=309.1317, expected range: 0.0000 133.9368
snow
AUTOMATIC LAND SYNOP SNOW (CM) 01132 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=68.0000, expected range: 69.0709 76.0041
Severely_persistent: rms_fgdepar=68.0000, expected range: 69.0709 76.0041
MANUAL LAND SYNOP SNOW (CM) 11138 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=73.3532, expected range: 58.9175 100.7586
Severely_persistent: rms_fgdepar=73.3532, expected range: 58.9175 100.7586
BUFR LAND SYNOP SNOW (CM) 01361 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=108.7289, expected range: 96.5074 112.4913
Severely_persistent: rms_fgdepar=108.7290, expected range: 96.5108 112.4918
BUFR LAND SYNOP SNOW (CM) 01132 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=69.0000, expected range: 69.6901 76.1234
Severely_persistent: rms_fgdepar=69.0072, expected range: 69.6913 76.1243
BUFR LAND SYNOP SNOW (CM) 01435 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=107.1783, expected range: 97.7674 117.1693
Severely_persistent: rms_fgdepar=107.1802, expected range: 97.7752 117.1678
BUFR LAND SYNOP SNOW (CM) 01008 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-52.2561, expected range: -127.8459 -53.2481
Severely_persistent: rms_fgdepar=52.2566, expected range: 53.2524 127.8434
BUFR LAND SYNOP SNOW (CM) 11138 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=74.0855, expected range: 60.8297 101.7950
Severely_persistent: rms_fgdepar=74.0855, expected range: 60.8297 101.7950
t2m
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.2338, expected range: -18.7758 2.1370
Severely_persistent: rms_fgdepar=13.2867, expected range: 0.0000 19.3211
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
3 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8139, expected range: 0.4028 1.0112
METAR 2M TEMPERATURE (K) KSKF : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=11.3093, expected range: 0.6160 3.7346
METAR 2M TEMPERATURE (K) KMYR : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-13.9878, expected range: -1.1434 3.4560
Severe: rms_fgdepar=13.9878, expected range: 0.0000 4.9764
BUFR LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
3 times in the last 10 days for at least one item
Severe: avg_est_pge=0.8144, expected range: 0.4013 1.0065
BUFR LAND SYNOP 2M TEMPERATURE (K) 89507 : out of range
Severe: avg_est_pge=0.8061, expected range: -0.0959 1.0076
rh2m
AUTOMATIC LAND SYNOP RH2M (%) 47420 : out of range
Severe: rms_fgdepar=30.9219, expected range: 0.0000 17.6384
MANUAL LAND SYNOP RH2M (%) 84088 : out of range
Severe: rms_fgdepar=38.5695, expected range: 0.0000 20.3144