Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-08-09 00:00

iasi
METOP-A IASI RADIANCES (214 channels affected) : out of range
Severe: obs_number=14705.0000, expected range: 21681.4202 22201.9548
METOP-A IASI RADIANCES CHANNEL 3105 : out of range
1 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.1930, expected range: 0.1284 0.1698
METOP-B IASI RADIANCES CHANNEL 3105 : out of range
Considerable: obs_number=2753.0000, expected range: 2995.5172 3586.2328
METOP-B IASI RADIANCES CHANNEL 3107 : out of range
Considerable: obs_number=2509.0000, expected range: 2702.7454 3365.1296
METOP-B IASI RADIANCES CHANNEL 3160 : out of range
Considerable: obs_number=2624.0000, expected range: 2866.5584 3446.3166
cris
NPP CRIS RADIANCES CHANNEL 185 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1328, expected range: -0.1240 -0.1157
NPP CRIS RADIANCES CHANNEL 109 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1636, expected range: 0.1414 0.1515
NPP CRIS RADIANCES CHANNEL 106 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2386, expected range: 0.2084 0.2195
NPP CRIS RADIANCES CHANNEL 108 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1457, expected range: 0.1174 0.1190
Considerable: obs_number=1759.0000, expected range: 1933.8801 2541.8699
NPP CRIS RADIANCES CHANNEL 119 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1857, expected range: 0.1566 0.1678
NOAA20 CRIS RADIANCES CHANNEL 963 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0965, expected range: -0.0574 -0.0254
NOAA20 CRIS RADIANCES CHANNEL 991 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2601, expected range: 0.3005 0.3282
NOAA20 CRIS RADIANCES CHANNEL 993 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1825, expected range: 0.2157 0.2509
NOAA20 CRIS RADIANCES CHANNEL 108 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1766, expected range: 0.1517 0.1599
NOAA20 CRIS RADIANCES CHANNEL 119 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1743, expected range: 0.1526 0.1564
NOAA20 CRIS RADIANCES CHANNEL 124 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1320, expected range: 0.1136 0.1230
NOAA20 CRIS RADIANCES (148 channels affected) : out of range
3 times in the last 10 days for at least one item
Severe: obs_number=4557.0000, expected range: 19449.9686 26291.0213
NPP CRIS RADIANCES CHANNEL 177 : out of range
3 times in the last 10 days for at least one item
Considerable: avg_biascorr=-0.0869, expected range: -0.0816 -0.0725
NPP CRIS RADIANCES CHANNEL 96 : out of range
Considerable: obs_number=2978.0000, expected range: 3156.3460 3750.4040
NPP CRIS RADIANCES CHANNEL 97 : out of range
Considerable: obs_number=2794.0000, expected range: 2985.8118 3537.4382
NPP CRIS RADIANCES CHANNEL 99 : out of range
Considerable: obs_number=2525.0000, expected range: 2752.0745 3225.3005
NPP CRIS RADIANCES CHANNEL 101 : out of range
Considerable: obs_number=2054.0000, expected range: 2258.6135 2844.7615
NPP CRIS RADIANCES CHANNEL 105 : out of range
Considerable: obs_number=1812.0000, expected range: 1979.3876 2596.9874
NPP CRIS RADIANCES CHANNEL 110 : out of range
Considerable: obs_number=1921.0000, expected range: 2132.1240 2691.2510
NPP CRIS RADIANCES CHANNEL 115 : out of range
Considerable: obs_number=1937.0000, expected range: 2127.0187 2749.1063
NPP CRIS RADIANCES CHANNEL 147 : out of range
Considerable: obs_number=2209.0000, expected range: 2430.5420 2951.0830
airs
AQUA AIRS RADIANCES CHANNEL 169 : out of range
Slight: avg_fgdepar=-0.0225, expected range: -0.0131 0.0188
atms
NOAA20 ATMS RADIANCES CHANNEL 13 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.0916, expected range: -0.0652 -0.0438
gpsro
All COSMIC2-E5 GPSRO RISING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 373.24 3184.42
Atmospheric Motion Vector
AQUA MODIS CLOUDY WV WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HP : out of range
Considerable: stdev_fgdepar=2.7515, expected range: 1.9192 2.3232
METOP-B AMV IR WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: obs_number=657.0000, expected range: 779.0318 994.9682
Radiosondes
LAND TEMP TEMPERATURE (K) 61660 PRESSURE LAYER 0-300 (HPA) : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.1610, expected range: -26.1428 -0.6447
Severely_persistent: rms_fgdepar=21.0321, expected range: 11.2875 29.2435
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 0-300 (HPA) : missing
4 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 48.4355 72.0645
Severe: obs_number=0.0000, expected range: 4.0846 542.5186
LAND TEMP TEMPERATURE (K) 25123 PRESSURE LAYER 300-600 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9033, expected range: -1.2646 0.7500
LAND TEMP TEMPERATURE (K) 24688 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=6.7914, expected range: 0.0000 1.2767
Severe: avg_pge=0.8684, expected range: -0.1251 0.1875
LAND TEMP Q (G/KG) 31004 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.4130, expected range: 0.0000 1.9239
LAND TEMP Q (G/KG) 37259 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.1063, expected range: 0.0000 8.4821
HIGH RESO LAND TEMP TEMPERATURE (K) 72662 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.3687, expected range: 0.1382 1.8538
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : missing
2 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 646.4546
Severe: obs_number=0.0000, expected range: 0.0000 755.3068
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (3 pressure layers affected : missing
Severe: obs_number=0.0000, expected range: 0.0000 698.8147
HIGH RESO LAND TEMP Q (G/KG) 72649 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=4.9296, expected range: 0.3158 1.6782
HIGH RESO LAND TEMP Q (G/KG) 72649 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=-6.1137, expected range: -2.9006 2.2415
HIGH RESO LAND TEMP Q (G/KG) 72659 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=4.8228, expected range: 0.0000 2.2854
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=132.0000, expected range: 195.3274 200.6726
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 900-1200 (HPA) : missing
3 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 28.1148 315.7023
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 37 : all data missing
Severe: obs_number=0, expected range: 81.40 104.20
LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=75.0000, expected range: 24.8055 55.9445
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) BTSX1DZA PRESSURE LAYER 0-300 (HPA) : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8172, expected range: -1.7518 0.7500
AMDAR WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : missing
Severe: obs_number=0.0000, expected range: 0.0000 365.8350
Severe: obs_number=0.0000, expected range: 0.0000 681.6388
WIGOS AMDAR WIND VECTOR DIFF (M/S) VSRINERA PRESSURE LAYER 600-900 (HP : out of range
Severe: rms_fgdepar=16.4436, expected range: 0.0000 8.3929
Severe: avg_pge=0.8343, expected range: -0.6571 0.7500
WIGOS AMDAR Q (G/KG) C2SXQWJA PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=5.8120, expected range: 0.0000 3.2766
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 97260 PRESSURE LAYER 900-1200 (HPA) : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8152, expected range: -0.1155 0.7500
LAND PILOT WIND VECTOR DIFF (M/S) 48480 PRESSURE LAYER 0-300 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=20.6876, expected range: 2.2903 28.8384
synop
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42441 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-501.2392, expected range: -891.3742 1137.3745
Severely_persistent: rms_fgdepar=501.2392, expected range: -726.7780 1042.0530
Severely_persistent: avg_pge=0.8800, expected range: -1.3743 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43359 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-650.2074, expected range: -1013.2426 724.1968
Severely_persistent: rms_fgdepar=650.2074, expected range: -710.2743 1005.1104
Severely_persistent: avg_pge=0.9078, expected range: -1.3807 0.7500
BUFR LAND SYNOP RH2M (%) 94215 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9971, expected range: -1.1446 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 91682 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=623.0063, expected range: -1020.4106 868.4903
Severely_persistent: rms_fgdepar=625.3781, expected range: 0.0000 1264.4443
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72327 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8777, expected range: 0.8506 0.7500
MANUAL LAND SYNOP RH2M (%) 38613 : out of range
Severe: rms_fgdepar=34.3629, expected range: 0.0000 14.5017
MANUAL LAND SYNOP RH2M (%) 43335 : out of range
Severe: rms_fgdepar=38.2568, expected range: 0.0000 10.7152
Severe: avg_pge=0.9969, expected range: 0.0021 0.0031
Severe: rms_fgdepar=38.7014, expected range: 0.0000 10.4072
MANUAL LAND SYNOP RH2M (%) 67335 : out of range
Severe: rms_fgdepar=36.1641, expected range: 0.0000 26.4805
Severe: avg_pge=0.8908, expected range: -0.0033 0.0109
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 17380 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=396.8924, expected range: 0.0000 127.9349
Severe: avg_pge=0.8417, expected range: -0.2115 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40675 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-846.9128, expected range: -113.1393 76.9445
Severe: rms_fgdepar=847.0062, expected range: 0.0000 83.5690
Severe: avg_pge=0.9322, expected range: 0.0000 0.0000
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 67796 : out of range
Severe: avg_fgdepar=-636.6324, expected range: -1334.1626 -49.9368
Severe: rms_fgdepar=636.6324, expected range: 49.9368 1334.1626
Severe: avg_pge=0.9031, expected range: 0.8560 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 87648 : out of range
Severe: rms_fgdepar=406.6720, expected range: 0.0000 214.8645
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 37609 : out of range
Severe: avg_pge=0.8107, expected range: -0.8595 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 36729 : out of range
Severe: rms_fgdepar=627.0907, expected range: 0.0000 177.1207
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 24449 : out of range
Severe: rms_fgdepar=437.9382, expected range: 0.0000 120.2902
BUFR LAND SYNOP RH2M (%) 08140 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=47.6184, expected range: 0.0000 31.9084
Severe: avg_pge=0.8169, expected range: -0.0059 0.0140
BUFR LAND SYNOP RH2M (%) 15490 : out of range
Severe: rms_fgdepar=41.0311, expected range: 0.0000 15.2265
BUFR LAND SYNOP RH2M (%) 94311 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.9954, expected range: -1.5052 0.7500
BUFR LAND SYNOP RH2M (%) 07002 : out of range
Severe: rms_fgdepar=31.5453, expected range: 0.0000 14.8220
BUFR LAND SYNOP RH2M (%) 08072 : out of range
Severe: rms_fgdepar=39.2314, expected range: 0.0000 19.7977
BUFR LAND SYNOP RH2M (%) 15465 : out of range
Severe: rms_fgdepar=37.1725, expected range: 0.0000 20.9085
BUFR LAND SYNOP RH2M (%) 72658 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=34.0046, expected range: 0.0000 17.7065
BUFR LAND SYNOP RH2M (%) 15498 : out of range
Severe: rms_fgdepar=34.4948, expected range: 0.0000 16.9413
BUFR LAND SYNOP RH2M (%) 01439 : out of range
Severe: rms_fgdepar=30.4332, expected range: 0.0000 15.5527
BUFR LAND SYNOP RH2M (%) 16459 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8061, expected range: -1.4273 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 36729 : out of range
Severe: rms_fgdepar=627.0907, expected range: 0.0000 177.1207
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24449 : out of range
Severe: avg_fgdepar=617.7767, expected range: -95.0150 147.4390
Severe: rms_fgdepar=617.7767, expected range: 0.0000 120.2902
Severe: avg_pge=0.9010, expected range: 0.0000 0.0000
BUFR LAND SYNOP SURFACE PRESSURE (PA) : out of range
Considerable: obs_number=166.0000, expected range: 185.4407 200.5593
ship
SHIP SURFACE PRESSURE (PA) 9V8405 : out of range
Severe: avg_fgdepar=-1129.8718, expected range: -182.6643 79.1421
Severe: rms_fgdepar=1129.8718, expected range: 0.0000 182.6643
SHIP SURFACE PRESSURE (PA) WGAH : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=549.6728, expected range: -327.1053 217.4708
Severe: rms_fgdepar=551.1153, expected range: 0.0000 299.7069
SHIP SURFACE PRESSURE (PA) HPOR : out of range
Severe: avg_fgdepar=-1329.4467, expected range: -183.2633 285.0492
Severe: rms_fgdepar=1329.4467, expected range: 0.0000 266.9132
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OYID2 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=639.3334, expected range: -591.5708 1793.3919
Severe: rms_fgdepar=639.3334, expected range: 0.0000 1793.5074
Severe: avg_pge=0.8401, expected range: -1.2164 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V8405 : out of range
Severe: avg_fgdepar=-1129.8718, expected range: -182.6643 79.1421
Severe: rms_fgdepar=1129.8718, expected range: 0.0000 182.6643
Severe: avg_pge=0.9199, expected range: -0.4229 0.5761
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WGAH : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=549.6728, expected range: -326.8963 213.3370
Severe: rms_fgdepar=551.1153, expected range: 0.0000 300.3547
Severe: avg_pge=0.8123, expected range: -0.8597 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WDDI : out of range
Severe: rms_fgdepar=617.0328, expected range: 0.0000 170.3435
BUFR SHIP SYNOP SURFACE PRESSURE (PA) HPOR : out of range
Severe: avg_fgdepar=-1329.4467, expected range: -177.1330 275.3682
Severe: rms_fgdepar=1329.4467, expected range: 0.0000 315.2362
Severe: avg_pge=0.9306, expected range: -0.6985 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRMD3 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8933, expected range: -0.8889 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) V7LN4 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8829, expected range: -1.2695 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) AVBC : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8869, expected range: -1.4607 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 1501748 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=632.9877, expected range: -1515.0484 1401.2996
Severely_persistent: rms_fgdepar=646.0869, expected range: 0.0000 963.1275
Severely_persistent: avg_pge=0.9068, expected range: 0.0182 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6203703 : out of range
Severe: avg_pge=0.8272, expected range: -0.6925 0.7500
metar
METAR SURFACE PRESSURE (PA) PAHO : out of range
Severe: rms_fgdepar=459.4965, expected range: 0.0000 253.1735
t2m
MANUAL LAND SYNOP 2M TEMPERATURE (K) 89009 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8048, expected range: 0.1420 1.1675
METAR 2M TEMPERATURE (K) UGMS : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=13.0232, expected range: 4.6977 14.9503
Severely_persistent: rms_fgdepar=13.0328, expected range: 5.1814 14.8488
Severely_persistent: avg_est_pge=0.8043, expected range: 0.5654 0.8854
BUFR LAND SYNOP 2M TEMPERATURE (K) 85504 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=14.6024, expected range: -11.0061 17.4677
Severely_persistent: rms_fgdepar=14.7034, expected range: 0.0000 17.2833
Severely_persistent: avg_est_pge=0.8091, expected range: -0.4727 0.9546
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.9698, expected range: -20.5994 -13.2458
Severely_persistent: rms_fgdepar=18.0249, expected range: 13.4021 20.6045
MANUAL LAND SYNOP 2M TEMPERATURE (K) 86285 : out of range
Severe: rms_fgdepar=10.1798, expected range: 0.0000 4.5024
METAR 2M TEMPERATURE (K) MHLC : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=13.6031, expected range: 0.0000 11.0630
METAR 2M TEMPERATURE (K) KMYR : out of range
Severe: avg_fgdepar=-17.0239, expected range: -3.2844 4.2385
Severe: rms_fgdepar=17.0239, expected range: 0.0000 6.6036
BUFR LAND SYNOP 2M TEMPERATURE (K) 89811 : out of range
Severe: rms_fgdepar=10.5412, expected range: 0.0000 3.4950
BUFR LAND SYNOP 2M TEMPERATURE (K) 26456 : out of range
Severe: avg_fgdepar=-17.3670, expected range: -3.6516 1.8985
Severe: rms_fgdepar=17.3670, expected range: 0.0000 4.0433
rh2m
MANUAL LAND SYNOP RH2M (%) 94625 : out of range
Severe: rms_fgdepar=34.5216, expected range: 0.0000 16.4642
All BUFR LAND SYNOP WMO BLOCK 76 : all data missing
Severe: obs_number=0, expected range: 72.92 305.24