Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-08-08 00:00

amsua
METOP-A AMSUA RADIANCES CHANNEL 5 : out of range
Considerable: obs_number=3398.0000, expected range: 3968.0209 5908.6041
cris
NPP CRIS RADIANCES CHANNEL 109 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1615, expected range: 0.1406 0.1515
NPP CRIS RADIANCES CHANNEL 106 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2408, expected range: 0.2068 0.2195
NPP CRIS RADIANCES CHANNEL 107 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1850, expected range: 0.1518 0.1561
NPP CRIS RADIANCES CHANNEL 108 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1432, expected range: 0.1143 0.1190
NPP CRIS RADIANCES CHANNEL 119 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1872, expected range: 0.1506 0.1678
NOAA20 CRIS RADIANCES CHANNEL 991 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2687, expected range: 0.3005 0.3266
NOAA20 CRIS RADIANCES CHANNEL 993 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1828, expected range: 0.2157 0.2469
NOAA20 CRIS RADIANCES CHANNEL 107 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2097, expected range: 0.1825 0.1852
NOAA20 CRIS RADIANCES CHANNEL 108 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1740, expected range: 0.1469 0.1599
NOAA20 CRIS RADIANCES CHANNEL 119 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1744, expected range: 0.1484 0.1564
NOAA20 CRIS RADIANCES (148 channels affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=5929.0000, expected range: 19449.9686 26291.0213
airs
AQUA AIRS RADIANCES CHANNEL 1948 : missing
6 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 1874.6669 4164.1665
AQUA AIRS RADIANCES CHANNEL 2164 : missing
7 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 632.0227 1959.3960
AQUA AIRS RADIANCES CHANNEL 1048 : out of range
Slight: avg_fgdepar=0.0121, expected range: -0.0551 -0.0037
AQUA AIRS RADIANCES CHANNEL 1079 : out of range
Slight: avg_fgdepar=0.0142, expected range: -0.0569 -0.0046
AQUA AIRS RADIANCES CHANNEL 1082 : out of range
Slight: avg_fgdepar=0.0067, expected range: -0.0559 -0.0114
AQUA AIRS RADIANCES CHANNEL 1083 : out of range
Slight: avg_fgdepar=0.0051, expected range: -0.0582 -0.0091
AQUA AIRS RADIANCES CHANNEL 1092 : out of range
Slight: avg_fgdepar=0.0046, expected range: -0.0623 -0.0107
AQUA AIRS RADIANCES CHANNEL 1111 : out of range
Slight: avg_fgdepar=0.0125, expected range: -0.0530 -0.0064
atms
NOAA20 ATMS RADIANCES CHANNEL 13 : out of range
Severe: avg_biascorr=-0.0819, expected range: -0.0652 -0.0489
gpsro
All COSMIC2-E5 GPSRO RISING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 268.24 3255.42
COSMIC2-E2 GPSRO RISING HEIGHT 38-40 KM : out of range
Considerable: stdev_norm_fgdepar=0.5961, expected range: 0.6573 0.7638
Atmospheric Motion Vector
HIMAWARI-8 AMV VIS1 WIND VECTOR DIFF (M/S) PRESSURE LAYER 900-1200 (HP : out of range
Considerable: avg_fgdepar=1.9262, expected range: 1.6315 1.7977
Radiosondes
LAND TEMP TEMPERATURE (K) 61660 PRESSURE LAYER 0-300 (HPA) : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-16.6619, expected range: -27.4011 -0.7357
Severely_persistent: rms_fgdepar=22.4479, expected range: 11.1420 30.3376
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 0-300 (HPA) : missing
4 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 48.3982 71.2018
Severe: obs_number=0.0000, expected range: 61.0220 312.8295
LAND TEMP TEMPERATURE (K) 78970 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=7.8545, expected range: 0.3928 2.3963
LAND TEMP TEMPERATURE (K) 41923 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=8.5113, expected range: 0.0000 4.5262
LAND TEMP TEMPERATURE (K) 42369 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=20.3184, expected range: -3.1430 2.3886
Severe: rms_fgdepar=20.3184, expected range: 0.1940 3.5379
Severe: avg_pge=0.9142, expected range: -0.2200 0.3583
LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=3.1152, expected range: 1.2360 2.3092
Severe: rms_fgdepar=3.8642, expected range: 0.8264 2.3051
LAND TEMP WIND VECTOR DIFF (M/S) 36096 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=25.7281, expected range: 0.4404 4.9032
Severe: rms_fgdepar=25.7281, expected range: 0.8221 5.4068
Severe: avg_pge=0.8764, expected range: -0.0763 0.1533
LAND TEMP WIND VECTOR DIFF (M/S) 72201 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=15.6884, expected range: 0.0000 7.6836
LAND TEMP WIND VECTOR DIFF (M/S) 74794 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=16.2721, expected range: 0.0000 7.8079
LAND TEMP Q (G/KG) 41217 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=6.6186, expected range: -6.2719 5.1854
Severe: rms_fgdepar=7.8455, expected range: 0.0000 10.7991
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : missing
2 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 14.4443 395.4841
Severe: obs_number=0.0000, expected range: 0.0000 554.8576
HIGH RESO LAND TEMP Q (G/KG) 51431 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=2.0090, expected range: 0.0000 1.0067
HIGH RESO LAND TEMP Q (G/KG) 51839 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=4.6700, expected range: 0.0000 1.6533
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: avg_fgdepar=1.1362, expected range: -0.4029 0.5768
amdar
AMDAR TEMPERATURE (K) CNFKQP PRESSURE LAYER 600-900 (HPA) : out of range
19 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=10.2637, expected range: 0.0000 23.4573
AMDAR WIND VECTOR DIFF (M/S) BR853092 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=23.7079, expected range: 2.2238 31.6196
Severe: rms_fgdepar=23.8172, expected range: 6.6080 30.5330
AMDAR WIND VECTOR DIFF (M/S) BR853092 (2 pressure layers affected) : out of range
Severe: avg_pge=0.8685, expected range: -0.1534 0.7500
AMDAR WIND VECTOR DIFF (M/S) BR549285 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=21.8287, expected range: -3.3894 43.5939
Severe: rms_fgdepar=21.9399, expected range: 3.8982 38.8522
AMDAR WIND VECTOR DIFF (M/S) BR722437 PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=21.0738, expected range: -12.9862 35.9059
Severe: rms_fgdepar=21.6161, expected range: 0.0000 36.7845
Severe: avg_pge=0.8406, expected range: -0.5003 0.7500
AMDAR WIND VECTOR DIFF (M/S) CNFKQP PRESSURE LAYER 300-600 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=18.6051, expected range: 0.0000 9.6827
Severe: avg_pge=0.8403, expected range: -0.8497 0.7500
WIGOS AMDAR Q (G/KG) GRBWUUZA PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=-7.2910, expected range: -7.0886 0.4239
Severe: rms_fgdepar=7.3127, expected range: 0.2199 8.5441
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 97260 PRESSURE LAYER 900-1200 (HPA) : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8277, expected range: -0.1695 0.7500
LAND PILOT WIND VECTOR DIFF (M/S) 43063 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=15.4241, expected range: 0.0000 7.4598
Severe: avg_pge=0.8411, expected range: -0.3115 0.4440
LAND PILOT WIND VECTOR DIFF (M/S) 96207 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_pge=0.8003, expected range: 0.0656 0.7500
synop
MANUAL LAND SYNOP RH2M (%) 76040 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8411, expected range: -0.6292 0.7500
MANUAL LAND SYNOP RH2M (%) 38933 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9340, expected range: -0.4785 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42441 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-720.3746, expected range: -891.3742 1137.3745
Severely_persistent: rms_fgdepar=720.3746, expected range: -726.7780 1042.0530
Severely_persistent: avg_pge=0.9165, expected range: -1.3743 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42834 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8071, expected range: -1.9342 0.7500
BUFR LAND SYNOP RH2M (%) 94215 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9776, expected range: -1.3299 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 91682 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-502.6287, expected range: -998.6521 838.0600
Severely_persistent: rms_fgdepar=502.6287, expected range: 0.0000 859.0646
Severely_persistent: avg_pge=0.9163, expected range: -0.7433 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72494 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8517, expected range: 0.7258 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72327 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8727, expected range: 0.8503 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 68840 : out of range
Severe: avg_fgdepar=55.9033, expected range: -47.4912 71.7322
Severe: rms_fgdepar=55.9033, expected range: 0.0000 65.4232
Severe: avg_pge=0.9844, expected range: -0.0435 0.0628
AUTOMATIC LAND SYNOP RH2M (%) 68839 : out of range
Severe: avg_pge=0.8310, expected range: -1.1722 0.7500
MANUAL LAND SYNOP RH2M (%) 41710 : out of range
Severe: rms_fgdepar=32.2293, expected range: 0.0000 12.4655
Severe: rms_fgdepar=31.0700, expected range: 0.0000 14.0078
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42654 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-548.0007, expected range: -358.4286 306.6504
Severe: rms_fgdepar=548.0007, expected range: 0.0000 341.9989
Severe: avg_pge=0.8917, expected range: -1.3881 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 67215 : out of range
Severe: rms_fgdepar=522.7897, expected range: 55.9293 148.5575
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 76519 : out of range
Severe: avg_fgdepar=882.3381, expected range: -1898.4275 1334.4032
Severe: rms_fgdepar=882.3381, expected range: -1334.4032 1898.4275
Severe: avg_pge=0.9146, expected range: -1.4119 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 91339 : out of range
Severe: rms_fgdepar=315.1236, expected range: 0.0000 172.7485
Severe: avg_pge=0.8195, expected range: -0.4121 0.4853
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43359 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-540.3414, expected range: -298.9766 116.2227
Severe: rms_fgdepar=540.3414, expected range: 0.0000 276.0281
Severe: avg_pge=0.8877, expected range: -1.1261 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 38099 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8219, expected range: -1.1511 0.7500
BUFR LAND SYNOP Z (M) 56172 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9992, expected range: -1.5154 0.7500
BUFR LAND SYNOP RH2M (%) 15450 : out of range
Severe: rms_fgdepar=42.2128, expected range: 0.0000 16.4847
BUFR LAND SYNOP RH2M (%) 94311 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9184, expected range: -1.6103 0.7500
BUFR LAND SYNOP RH2M (%) 15491 : out of range
Severe: rms_fgdepar=35.1728, expected range: 0.0000 17.7242
BUFR LAND SYNOP RH2M (%) 72764 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=33.5106, expected range: 0.0000 14.2018
BUFR LAND SYNOP SURFACE PRESSURE (PA) 94861 : out of range
Severe: avg_fgdepar=649.5207, expected range: -153.0020 121.2529
Severe: rms_fgdepar=649.5207, expected range: 0.0000 127.9821
Severe: avg_pge=0.9208, expected range: 0.0000 0.0000
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24894 : out of range
Severe: rms_fgdepar=468.5574, expected range: 0.0000 373.0510
Severe: avg_pge=0.8647, expected range: -1.1954 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 94866 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=344.3479, expected range: 0.0000 84.7779
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48938 : out of range
Severe: rms_fgdepar=386.1373, expected range: 0.0000 214.9663
BUFR LAND SYNOP SURFACE PRESSURE (PA) 23179 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=509.1862, expected range: 0.0000 109.5515
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7BN6 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-868.4315, expected range: -1042.3685 504.8298
Severely_persistent: rms_fgdepar=868.4315, expected range: 0.0000 1111.1147
Severely_persistent: avg_pge=0.8950, expected range: -0.9526 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) ASES01 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8084, expected range: -0.3062 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 2IYH2 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8290, expected range: 0.2923 0.7500
SHIP SURFACE PRESSURE (PA) 9HA4883 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8438, expected range: 0.3404 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V8896 : out of range
Severe: avg_fgdepar=743.3047, expected range: -174.2793 239.6467
Severe: rms_fgdepar=743.3047, expected range: 0.0000 212.5403
Severe: avg_pge=0.8582, expected range: -1.1804 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) LF3N : out of range
Severe: avg_fgdepar=550.0811, expected range: -193.3858 189.3991
Severe: rms_fgdepar=558.3028, expected range: 0.0000 175.4208
Severe: avg_pge=0.8620, expected range: -0.7648 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRMD3 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8905, expected range: -0.9242 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) D7UR : out of range
Severe: avg_fgdepar=20.5538, expected range: -9.4847 29.5405
Severe: rms_fgdepar=20.9388, expected range: 0.0000 32.3794
Severe: avg_pge=0.8977, expected range: -0.2712 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 5601521 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=517.7672, expected range: -312.2099 442.8222
Severely_persistent: avg_pge=0.8829, expected range: -0.4170 0.4987
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601531 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8451, expected range: 0.0558 0.7500
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89799 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8019, expected range: -0.0844 1.3590
MANUAL LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8172, expected range: 0.6443 0.9392
BUFR LAND SYNOP 2M TEMPERATURE (K) 85504 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=13.8295, expected range: -1.3281 4.0577
Severely_persistent: rms_fgdepar=13.9962, expected range: 0.5495 5.3205
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.4079, expected range: -21.0169 -12.2029
Severely_persistent: rms_fgdepar=17.5887, expected range: 12.8193 21.1499
BUFR LAND SYNOP 2M TEMPERATURE (K) 89507 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8078, expected range: 0.5435 0.8522
BUFR LAND SYNOP 2M TEMPERATURE (K) 35183 : out of range
Severe: rms_fgdepar=12.7624, expected range: 1.4031 5.5532