^^

MadALwx's Forecast Accuracy Report on Temperatures vice NWS

National Weather Service (NW), Actual Observed (Act), MadAL WxSim Generated (WS)
I'm running 5 different comparison routines throughout the day to determine the accuracy timeframe of a forecast. Day+"x" are extended forecasts.
I run forecast models at 6am, 9am, 12pm, 3pm, and 6pm.
NWSs forecast for this area is w/in Forecast Goal     MadALwx's forecast is w/in Forecast Goal
Morning Comparison (this forecast period is 4 days, 6AM today through Day +3)
Updated: 11-20-09 at 6:27 am
Goal Forecast Day Day +1 Day +2 Day +3
± 2.0° F High Low High Low High Low High Low
Date NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS
11-20-09 65   63 44   37 58   57 50   46 58   57 50   51 62   62 47   41
11-19-09 59 60.4 66 38 34.6 32 64   62 44   42 62   55 48   47 58   65 44   39
11-18-09 55 48.2 59 37 42.7 28 61 60.4 58 36 34.6 29 61   61 43   38 59   62 47   52
11-17-09 59 58.6 57 39 43.3 36 55 48.2 57 38 42.7 34 61 60.4 59 39 34.6 34 61   59 44   40
11-16-09 71 69.8 70 51 48.9 56 57 58.6 58 36 43.3 40 58 48.2 57 35 42.7 34 61 60.4 58 41 34.6 36
11-15-09 73 73.3 73 44 39.3 40 73 69.8 70 48 48.9 58 59 58.6 68 45 43.3 50 60 48.2 65 44 42.7 45
11-14-09 73 69.7 72 40 38.0 41 73 73.3 72 48 39.3 40 73 69.8 73 51 48.9 47 66 58.6 74 50 43.3 57
11-13-09 69 70.9 71 43 38.2 37 74 69.7 73 46 38.0 39 75 73.3 73 49 39.3 40 74 69.8 72 51 48.9 50
11-12-09 63 62.3 64 39 39.3 33 69 70.9 68 41 38.2 37 73 69.7 72 45 38.0 37 74 73.3 72 51 39.3 42
11-11-09 61 64.1 69 43 41.3 41 64 62.3 65 39 39.3 36 70 70.9 71 46 38.2 47 73 69.7 72 50 38.0 37
11-10-09 63 60.8 58 48 53.9 53 64 64.1 64 44 41.3 42 65 62.3 62 43 39.3 35 70 70.9 66 45 38.2 44
11-09-09 71 70.2 78 53 57.7 53 65 60.8 59 47 53.9 49 64 64.1 64 39 41.3 41 64 62.3 63 41 39.3 37
11-08-09 77 73.5 78 48 51.6 50 70 70.2 79 53 57.7 58 64 60.8 64 47 53.9 48 64 64.1 65 40 41.3 40
11-07-09 72 73.9 77 42 42.0 44 74 73.5 80 49 51.6 52 71 70.2 78 54 57.7 61 66 60.8 70 46 53.9 52
11-06-09 71 68.2 68 40 38.7 35 72 73.9 73 43 42.0 39 74 73.5 76 50 51.6 49 69 70.2 79 54 57.7 62
11-05-09 64 65.5 65 35 33.6 34 68 68.2 67 39 38.7 36 71 73.9 71 44 42.0 36 73 73.5 74 51 51.6 51
11-04-09 65 71.0 66 45 39.2 40 65 65.5 64 35 33.6 37 65 68.2 67 45 38.7 40 45 73.9 71 45 42.0 43
11-03-09 65 66.8 66 37 36.5 38 67 71.0 67 41 39.2 41 64 65.5 66 39 33.6 38 67 68.2 66 40 38.7 42
11-02-09 65 69.1 68 45 41.3 40 65 66.8 63 35 36.5 38 65 71.0 65 45 39.2 39   60   34
11-01-09 65 61.3 60 35 40.5 33 65 69.1 65 45 41.3 39 65 66.8 63 35 36.5 37 65 71.0 63 40 39.2 38
10-31-09 60 59.0 59 40 38.3 36 65 61.3 60 35 40.5 36 65 69.1 65 45 41.3 38 65 66.8 59 40 36.5 35
Results NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS
# Succ 11 11 8 10 12 9 8 8 9 7 4 8 9 4 6 9
% Succ 55.0   55.0 40.0   50.0 63.2   47.4 42.1   42.1 50.0   38.9 22.2   44.4 56.3   25.0 37.5   56.3
Ave Error 2.4   2.7 3.2   3.5 2.2   3.0 3.5   3.1 2.6   3.2 4.6   3.4 4.7   5.4 4.4   2.8
Net Error 0.2   1.4 0.2   -1.9 0.4   0.2 -0.1   -1.1 0.3   1.0 2.0   -0.5 -0.4   1.7 2.7   1.6
Std Dev 1.8   2.8 2.0   3.6 1.9   2.7 2.8   2.7 2.4   3.1 3.0   2.9 4.0   5.5 4.1   3.3

Afternoon1 Comparison (this forecast period is 4 days, 9AM today through Day +3)
Updated: 11-20-09 at 9:26 am
Goal Forecast Day Day +1 Day +2 Day +3
± 2.0° F High Low High Low High Low High Low
Date NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS
11-20-09 65   68 44   42 58   58 50   50 58   56 50   45 62   64 47   39
11-19-09 59 60.4 61 38 34.6 29 64   62 44   36 62   59 48   48 58   60 44   51
11-18-09 55 48.2 58 37 41.2 28 61 60.4 59 36 34.6 28 61   60 43   37 59   58 47   46
11-17-09 51 58.6 55 39 43.2 32 55 48.2 57 38 41.2 31 61 60.4 58 39 34.6 33 61   60 44   39
11-16-09 71 69.8 79 51 44.6 59 57 58.6 63 36 43.2 43 58 48.2 63 35 41.2 41 61 60.4 64 41 34.6 40
11-15-09 73 73.3 77 44 39.3 46 73 69.8 73 48 44.6 60 59 58.6 68 45 43.2 47 60 48.2 63 44 41.2 42
11-14-09 73 69.7 77 40 37.9 46 73 73.3 75 48 39.3 44 73 69.8 74 51 44.6 54 66 58.6 72 50 43.2 64
11-13-09 69 70.9 75 43 38.2 40 74 69.7 75 46 37.9 43 75 73.3 75 49 39.3 45 74 69.8 72 51 44.6 55
11-12-09 63 62.3 68 39 39.3 34 69 70.9 69 41 38.2 37 73 69.7 73 45 37.9 39 74 73.3 72 51 39.3 43
11-11-09 61 64.1 69 43 41.3 39 64 62.3 63 39 39.3 36 70 70.9 67 46 38.2 40 73 69.7 73 50 37.9 39
11-10-09 63 60.8 58 48 52.5 49 64 64.1 64 44 41.3 42 65 62.3 66 43 39.3 37 70 70.9 68 45 38.2 49
11-09-09 71 70.2 81 53 56.6 55 65 60.8 60 47 52.5 53 64 64.1 67 39 41.3 42 64 62.3 64 41 39.3 41
11-08-09 77 73.5 83 48 51.6 59 70 70.2 79 53 56.6 60 64 60.8 67 47 52.5 50 64 64.1 61 40 41.3 39
11-07-09 72 73.9 84 42 42.0 49 74 73.5 83 49 51.6 53 71 70.2 79 54 56.6 60 66 60.8 73 46 52.5 46
11-06-09 71 68.2 74 40 38.7 41 72 73.9 75 43 42.0 42 74 73.5 77 50 51.6 49 69 70.2 72 54 56.6 56
11-05-09 64 65.5 70 35 33.6 39 68 68.2 70 39 38.7 38 71 73.9 74 44 42.0 39 73 73.5 75 51 51.6 50
11-04-09 65 71.0 74 45 39.0 44 65 65.5 68 35 33.6 39 65 68.2 69 45 38.7 42 45 73.9 72 45 42.0 44
11-03-09 65 66.8 65 37 36.5 40 67 71.0 70 41 39.0 43 64 65.5 67 39 33.6 39 67 68.2 68 40 38.7 42
11-02-09 68 69.1 73 45 41.4 44 66 66.8 66 37 36.5 40 66 71.0 67 41 39.0 40 65 65.5 61 38 33.6 37
11-01-09 61 61.3 64 37 40.5 36 68 69.1 65 45 41.4 38 67 66.8 59 35 36.5 37 66 71.0 63 41 39.0 35
10-31-09 59 59.0 61 39 38.3 39 63 61.3 60 37 40.5 36 67 69.1 65 43 41.4 38 63 66.8 58 41 36.5 37
Results NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS
# Succ 12 3 7 3 14 11 7 7 9 4 6 7 9 6 5 7
% Succ 60.0   15.0 35.0   15.0 73.7   57.9 36.8   36.8 50.0   22.2 33.3   38.9 52.9   35.3 29.4   41.2
Ave Error 2.4   5.3 3.0   5.6 1.9   3.1 3.3   3.9 2.3   4.6 4.3   2.9 4.5   5.0 4.8   4.6
Net Error -0.3   4.5 0.6   0.9 0.5   1.9 0.5   0.7 0.6   2.2 2.1   1.1 -0.4   1.4 3.5   2.9
Std Dev 2.1   3.2 1.9   3.8 1.9   3.0 2.7   3.9 2.3   3.9 2.8   2.4 7.0   4.8 3.9   5.4

Afternoon2 Comparison (this forecast period is 4 days, 12PM today through Day +3)
Updated: 11-20-09 at 12:26 pm
Goal Forecast Day Day +1 Day +2 Day +3
± 2.0° F High Low High Low High Low High Low
Date NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS
11-20-09 65   64 44   43 58   54 50   47 58   55 50   43 62   64 47   37
11-19-09 59 60.4 60 38 34.6 29 64   60 44   35 62   58 48   47 58   59 44   50
11-18-09 54 48.2 54 37 41.2 26 61 60.4 59 36 34.6 28 61   61 43   38 59   59 47   46
11-17-09 49 58.6 49 39 43.2 30 55 48.2 56 38 41.2 32 61 60.4 57 39 34.6 32 61   59 44   38
11-16-09 71 69.8 72 51 44.6 54 57 58.6 58 36 43.2 39 58 48.2 57 35 41.2 35 61 60.4 62 41 34.6 35
11-15-09 73 73.3 74 44 39.3 41 73 69.8 69 48 44.6 59 59 58.6 67 45 43.2 45 60 48.2 62 44 41.2 41
11-14-09 72 69.7 73 40 37.9 43 73 73.3 73 48 39.3 39 73 69.8 71 51 44.6 48 66 58.6 64 50 43.2 56
11-13-09 69 70.9 72 43 38.2 38 74 69.7 73 46 37.9 42 75 73.3 73 49 39.3 44 74 69.8 72 51 44.6 54
11-12-09 63 62.3 63 39 39.3 31 69 70.9 67 41 38.2 36 73 69.7 72 45 37.9 37 74 73.3 73 51 39.3 39
11-11-09 62 64.1 63 43 41.3 36 64 62.3 60 39 39.3 33 70 70.9 67 46 38.2 39 71 69.7 73 50 37.9 38
11-10-09 63 60.8 58 48 52.5 48 64 64.1 64 44 41.3 41 65 62.3 65 43 39.3 36 70 70.9 68 45 38.2 47
11-09-09 70 70.2 76 53 56.7 54 65 60.8 58 47 52.5 51 64 64.1 65 39 41.3 39 64 62.3 64 41 39.3 39
11-08-09 75 73.5 78 48 51.6 52 70 70.2 77 53 56.7 57 64 60.8 63 47 52.5 51 64 64.1 63 40 41.3 41
11-07-09 73 73.9 71 42 42.1 37 74 73.5 81 49 51.6 50 71 70.2 82 54 56.7 61 66 60.8 72 46 52.5 51
11-06-09 71 68.2 70 40 38.7 38 72 73.9 74 43 42.1 43 74 73.5 78 50 51.6 50 69 70.2 75 54 56.7 56
11-05-09 64 65.5 65 35 33.6 30 68 68.2 66 39 38.7 36 71 73.9 73 44 42.1 37 73 73.5 75 51 51.6 49
11-04-09 69 71.0 71 41 39.0 44 62 65.5 66 36 33.6 39 68 68.2 69 40 38.7 39 72 73.9 72 42 42.1 39
11-03-09 65 66.8 66 37 36.5 36 67 71.0 66 41 39.0 40 64 65.5 66 39 33.6 37 67 68.2 66 40 38.7 40
11-02-09 68 69.1 69 45 41.4 40 66 66.8 63 37 36.5 38 66 71.0 67 41 39.0 39 65 65.5 61 38 33.6 36
11-01-09 61 61.3 63 37 40.5 37 68 69.1 66 45 41.4 40 67 66.8 60 35 36.5 36 66 71.0 63 41 39.0 36
10-31-09 59 59.0 62 39 38.3 39 63 61.3 62 37 40.5 37 67 69.1 66 43 41.4 37 63 66.8 57 41 36.5 34
Results NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS
# Succ 14 11 8 7 13 8 6 9 10 6 7 8 11 6 6 9
% Succ 70.0   55.0 40.0   35.0 68.4   42.1 31.6   47.4 55.6   33.3 38.9   44.4 64.7   35.3 35.3   52.9
Ave Error 2.0   2.4 2.8   4.6 2.0   2.8 3.3   3.5 2.2   3.7 4.1   2.6 2.8   4.5 4.6   2.9
Net Error -0.3   0.6 0.4   -2.4 0.4   0.0 0.6   -0.6 0.8   1.2 1.9   -0.5 1.0   0.9 3.3   1.2
Std Dev 2.1   2.4 1.8   4.1 1.9   2.5 2.6   3.7 2.3   3.4 2.9   1.9 3.2   4.1 4.0   3.9

Evening Comparison (this forecast period is 4 days, 3PM today through Day +3)
Updated: 11-20-09 at 3:26 pm
Goal Forecast Day Day +1 Day +2 Day +3
± 2.0° F High Low High Low High Low High Low
Date NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS
11-20-09 66   64 43   40 59   62 48   48 58   54 47   40 64   65 45   38
11-19-09 61 60.4 61 37 34.6 30 65   59 40   35 61   59 48   50 59   60 44   53
11-18-09 54 48.2 54 35 41.2 26 61 60.4 59 36 34.6 28 64   62 42   38 62   59 44   46
11-17-09 49 58.6 50 39 43.2 29 55 48.2 56 38 41.2 27 61 60.4 58 39 34.6 29 61   59 44   38
11-16-09 71 69.8 70 51 44.6 52 57 58.6 55 36 43.2 36 58 48.2 59 35 41.2 34 61 60.4 61 41 34.6 40
11-15-09 73 73.3 73 41 39.3 40 70 69.8 74 49 44.6 58 58 58.6 60 39 43.2 40 59 48.2 58 39 41.2 35
11-14-09 72 69.7 69 44 37.9 42 71 73.3 73 44 39.3 40 71 69.8 71 50 44.6 57 59 58.6 63 43 43.2 42
11-13-09 69 70.9 73 42 38.2 38 73 69.7 73 46 37.9 41 74 73.3 74 49 39.3 43 73 69.8 72 51 44.6 54
11-12-09 63 62.3 62 38 39.3 34 68 70.9 67 40 38.2 35 73 69.7 72 44 37.9 39 74 73.3 73 47 39.3 40
11-11-09 62 64.1 64 41 41.3 36 64 62.3 60 38 39.3 32 69 70.9 68 45 38.2 38 71 69.7 72 50 37.9 37
11-10-09 63 60.8 57 48 52.5 48 64 64.1 64 44 41.3 42 65 62.3 67 43 39.3 37 70 70.9 68 45 38.2 46
11-09-09 70 70.2 71 54 56.7 54 67 60.8 57 50 52.5 49 65 64.1 68 44 41.3 41 66 62.3 66 41 39.3 41
11-08-09 75 73.5 74 50 51.6 48 71 70.2 73 53 56.7 55 63 60.8 58 47 52.5 51 64 64.1 60 40 41.3 37
11-07-09 74 73.9 74 43 42.1 40 75 73.5 79 50 51.6 51 71 70.2 80 52 56.7 58 66 60.8 67 47 52.5 52
11-06-09 71 68.2 68 41 38.7 41 72 73.9 75 44 42.1 41 74 73.5 76 50 51.6 47 70 70.2 73 54 56.7 53
11-05-09 35 65.5 65 65 33.6 32 45 68.2 67 75 38.7 36 45 73.9 71 75 42.1 38 55 73.5 76 65 51.6 54
11-04-09 69 71.0 71 41 39.0 43 64 65.5 67 37 33.6 38 68 68.2 67 42 38.7 42 71 73.9 73 45 42.1 45
11-03-09 65 66.8 67 37 36.5 35 68 71.0 67 41 39.0 41 63 65.5 65 38 33.6 37 67 68.2 66 40 38.7 38
11-02-09 68 69.1 69 44 41.4 38 64 66.8 64 37 36.5 37 67 71.0 65 43 39.0 40 64 65.5 60 39 33.6 35
11-01-09 61 61.3 62 36 40.5 37 68 69.1 66 44 41.4 39 67 66.8 67 37 36.5 40 66 71.0 67 41 39.0 42
10-31-09 59 59.0 59 43 38.3 42 62 61.3 64 40 40.5 38 68 69.1 67 43 41.4 41 63 66.8 62 41 36.5 35
Results NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS
# Succ 13 16 7 4 11 6 8 7 11 6 3 7 9 3 5 8
% Succ 65.0   80.0 35.0   20.0 57.9   31.6 42.1   36.8 61.1   33.3 16.7   38.9 52.9   17.6 29.4   47.1
Ave Error 3.4   1.3 4.5   4.5 3.3   2.9 4.7   4.1 3.5   3.2 6.0   3.3 3.5   3.5 4.9   3.2
Net Error -1.6   -0.2 2.0   -2.3 -1.0   0.1 2.6   -1.5 -0.9   0.9 3.5   0.0 -0.5   0.6 3.5   0.9
Std Dev 6.6   2.2 6.5   3.9 5.1   2.0 7.8   4.1 6.6   3.0 7.1   3.1 4.8   2.7 4.2   2.9

Night Comparison (this forecast period is 4 days, 6PM today through Day +3)
Updated: 11-20-09 at 6:26 pm
Goal Forecast Day Day +1 Day +2 Day +3
± 2.0° F Low High Low High Low High Low High
Date NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS
11-20-09 43   40 59   62 48   48 58   54 47   41 64   64 45   38 61   65
11-19-09 37 34.6 29 65 60.4 57 40   34 61   59 48   50 59   60 44   53 62   65
11-18-09 35 41.2 28 61 48.2 58 36 34.6 29 64 60.4 60 42   37 62   60 44   40 60   65
11-17-09 39 43.2 30 55 58.6 57 38 41.2 28 61 48.2 59 39 34.6 30 61 60.4 59 44   38 65   60
11-16-09 52 44.6 51 55 69.8 55 39 43.2 36 56 58.6 58 39 41.2 34 62 48.2 61 39 34.6 40 63 60.4 66
11-15-09 41 39.3 38 70 73.3 65 49 44.6 55 58 69.8 56 39 43.2 39 59 58.6 56 39 41.2 34 64 48.2 60
11-14-09 44 37.9 43 71 69.7 69 44 39.3 43 71 73.3 68 50 44.6 51 59 69.8 55 43 43.2 36 58 58.6 56
11-13-09 42 38.2 37 73 70.9 67 46 37.9 40 74 69.7 71 49 39.3 43 73 73.3 71 51 44.6 47 63 69.8 70
11-12-09 38 39.4 36 68 62.3 69 40 38.2 36 73 70.9 72 44 37.9 40 74 69.7 72 47 39.3 40 72 73.3 73
11-11-09 41 41.3 37 64 64.1 60 38 39.4 34 69 62.3 68 45 38.2 39 71 70.9 72 50 37.9 38 73 69.7 73
11-10-09 49 52.5 47 62 60.8 64 40 41.3 39 65 64.1 67 44 39.4 36 70 62.3 68 45 38.2 46 74 70.9 74
11-09-09 54 56.7 54 67 70.2 57 50 52.5 49 65 60.8 68 44 41.3 41 66 64.1 65 41 39.4 41 71 62.3 57
11-08-09 50 51.6 45 71 73.5 70 53 56.7 56 63 70.2 60 47 52.5 52 64 60.8 61 40 41.3 41 65 64.1 60
11-07-09 43 42.1 39 75 73.9 76 50 51.6 45 71 73.5 73 52 56.7 54 66 70.2 63 47 52.5 48 64 60.8 62
11-06-09 41 38.7 39 72 68.2 74 44 42.1 42 74 73.9 76 50 51.6 51 70 73.5 75 54 56.7 58 66 70.2 72
11-05-09 35 33.6 29 69 65.5 66 41 38.7 36 71 68.2 73 44 42.1 39 72 73.9 76 51 51.6 51 68 73.5 66
11-04-09 41 39.0 41 64 71.0 65 37 33.6 37 68 65.5 66 42 38.7 41 71 68.2 72 45 42.1 44 73 73.9 73
11-03-09 37 36.5 32 68 66.8 65 41 39.0 39 63 71.0 64 38 33.6 37 67 65.5 65 40 38.7 38 72 68.2 69
11-02-09 45 41.4 38 65 69.1 62 35 36.5 36 65 66.8 64 45 39.0 39 67 71.0 59 42 33.6 35   62
11-01-09 36 40.5 32 68 61.3 64 44 41.4 33 67 69.1 63 37 36.5 37 66 66.8 65 41 39.0 41 66 71.0 59
10-31-09 43 38.3 40 62 59.0 63 40 40.5 38 68 61.3 66 43 41.4 40 63 69.1 61 41 36.5 35 66 66.8 64
Results NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS NW Act WS
# Succ 8 5 5 4 9 4 3 6 4 7 8 7 6 11 5 6
% Succ 40.0   25.0 25.0   20.0 47.4   21.1 15.8   31.6 22.2   38.9 44.4   38.9 35.3   64.7 31.3   37.5
Ave Error 3.1   4.8 4.3   5.2 2.8   4.2 4.5   4.6 4.2   2.6 3.8   4.5 4.2   2.7 4.2   4.0
Net Error 0.6   -3.3 0.4   -1.7 0.7   -2.2 0.4   -0.3 2.2   -0.5 0.3   -1.1 2.7   0.2 1.0   -0.5
Std Dev 2.0   3.5 3.8   4.0 1.9   3.6 3.6   4.1 2.5   2.1 3.9   4.4 3.5   2.8 4.1   3.4

The forecast software I use, WXSIM, has the ability to apply a 'learned bias'. As more forecast models are run, WXSIM will apply this bias, which will then improve forecast accuracy. I run the bias routine once a week.
This will in turn, point to a particular model runtime for the most accurate 4-Day Forecast time to use.
I'm mainly concerned with forecast accuracy of the current timeframe up to Day +2.

The graph depicts how my forecasts compare relative to normal.

Old
Departure from Forecasts
Current
Departure from Forecasts