Poll Performances: Crazy October
David Moore | December 1, 2008
The final presidential contest predictions of the major media polls all came pretty close to the actual results, predicting Obama to win by anywhere from 5 to 11 percentage points (he actually won by 6.7 points).
However, the polls showed a great deal of variability even during the last four weeks of October leading into the election, raising questions about how to measure poll "accuracy" during the election campaign itself.
Shown below is a graph of the results of 10 polls that publicized results for at least the final three weeks of October.
An examination of the daily tracking polls provides no better picture of poll accuracy.
The differences in the overall trends are quite substantial, as are individual points.
On October 12, IBD/TIPP shows an Obama lead of two points, while DailyKos says it's 12. The next day, IBD/TIPP produces a 3-point lead, while GWU has a 13-point lead. On October 25, GWU's lead is just three points, while DailyKos has it at 12 points. Even right before the election, IBD/TIPP shows just a 2-point lead, while ABC/WP says the lead is 11 points.
More important are the many different pictures of the dynamics of the race. If we single out, say, DailyKos from GWU, one would never know they are measuring the same contest - except that they both converge in their final predictions. Another example: Rasmussen shows only a little variability in the race, between an Obama lead of 3 to 8 points, ending at 6, while GWU goes from 13 points down to 1, finally ending at 5. Likewise, Zogby's description of the campaign dynamics shows a relatively stable race for the first half of the month, followed by a major surge, a big decline, and then a last minute surge. DailyKos usually had the most optimistic Obama leads, mostly double digits, except for the middle of the month, and then at the end when the lead declined to just five points.
What can we say about poll performances when there are such different stories about the October dynamics? The notion that the polls were mostly "accurate" must be modified to reflect how divergent they were during the campaign.
By David Moore | December 1, 2008 2:05 PM | Permalink | Comments (3) | TrackBacks (0)
Comments
There is a simple explanation for all this. Go take a look at the national polling chart on this site (http://www.pollster.com/polls/us/08-us-pres-ge-mvo.php ). Set the date range as from 10/01/08 to 11/04/08. Turn the sensitivity to low.
That's the real picture. There was almost no change in the race in the last month. Your charts show how much variation you can get just by repeating samples of the same distribution.
David Moore wrote: "predicting Obama to win by anywhere from 5 to 11 percentage points (he actually won by 6.7 points)" This so-called "actual" result is noticeably inaccurate because it is based on incomplete vote totals. (As of Dec. 4, some states still aren't done counting their absentee and provisional ballots.)
According to the still-incomplete numbers posted on Wikipedia today, the popular vote percentages are:
Obama 52.92%
McCain 45.71%
other 1.37%
margin(Obama-McCain)=7.21%
Mr David Moore :
Thanks for interesting graphs and information.
The striking news in polling is the steep rise of Obama in favorability during November.
Gallup Poll gives this interesting information and graphs :
Obama Favorability increases 10% since Election Day - The unfavorability drops 14%
http://www.gallup.com/poll/111772/Gallup-Daily-Obama-Favorability.aspx
I am trying to study the impact of Youngsters on Politics :
Milenials.com
Vicente Duque
Posted on December 1, 2008 6:54 PM