January 13, 2008
Likely Voter Screens and the Clinton Surprise in New Hampshire
(Editor's note: Today's Guest Pollster contribution comes from Professors Robert S. Erikson of Columbia University and Christopher Wlezien of Temple University).
Does the world need one more explanation for the historic failure of the polls to predict Hillary Clinton's victory in the New Hampshire primary? We offer another possible account. Ours does not require unusual last-minute voter shifts in preference, voters lying to pollsters, or any disconnect between the campaign story line in the media and voter decision-making voters.
We suggest as the possible culprit the way pollsters' employ their likely voter screens. Pollsters may have been tricked not by voters shifting their candidate preferences but by a rapid shift in enthusiasm by Clinton supporters at the last minute. It may be that significant numbers of Clinton supporters were uninclined to vote at the time when the pollsters were doing their final interviews but then regained their interest just in time to vote. In short, the surge to Clinton could have been simply due to uncounted Clinton supporters who the pollsters dismissed as unlikely voters regaining their interest in voting.
According to most accounts, the late Clinton gains stemmed from sympathy for Hillary after her rough treatment in the media, Hillary's response to the questioning of her likeability in the final debate, and her tears on election eve. But how did this response come about? Was it due to truly undecided voters with their blank slates turning overwhelmingly to Hillary? Exit polls show no evidence of this. And it is unlikely that voters tuning in late would see the flow of the news moving in Hillary's direction. It is the idea that late-deciders could have done so that is so jarring to media watchers.
If late-deciders did not split for Hillary, maybe it was Obama supporters changing their minds? But it is even more implausible that voters who followed the campaign and settled on Obama as their choice would follow the late news and see a reason to vote for Hillary. Once people "make up their minds" in a campaign they rarely change and then only for seemingly good reasons. Did Obama supporters have reason to shift? Would the internal dialog of massive numbers of voters be: "I support Obama because he is such an exciting candidate...No wait, Hillary just shed a tear so I'll vote for her instead"?
Rather than voters deciding late for Hillary or shifting late to Hillary, we posit that her proportion of eligible voters in the New Hampshire primary was fairly steady in the final weeks. What changed was the enthusiasm of her supporters. It may be that Hillary supporters followed the news and became disillusioned by her decline in Iowa, her loss of momentum, and the general negative arc of her campaign. They were watching and they were responding to the media's storyline. Their response was not to shift to another candidate but to become dispirited. If interviewed by pollsters, their lessening enthusiasm placed them disproportionately in the "unlikely voter" column. Then, after the pollsters stopped calling, Hillary's supporters gained the enthusiasm necessary to motivate them to vote. This may be because Hillary showed her more human side late in the campaign or because it was her campaign was on the brink or for other less obvious reasons. The point is that the preferences of these voters were undercounted by pollsters. No unusual number of previously undecided voters or former Obama supporters is necessary to account for her late surge in the polls.**
Is our story true? We know that shifts in net enthusiasm from one candidate's supporters to the other's are more volatile than shifts in net preference. We also know that pollsters can be very sensitive to these shifts in enthusiasm when identifying likely voters. (See our paper from 2004 on "Likely Voters and the Assessment of Campaign Dynamics" in the Public Opinion Quarterly). Was it simply a very late shift in enthusiasm that caused the New Hampshire polls to go wrong?
Pollsters hold in their data banks the evidence that would tell if our conjecture is right or wrong. Our suspicion is that voter preferences among potential Democratic primary voters were more stable over the campaign's final weeks than generally realized. This shifting dynamic evident in the polls, we suggest, was exaggerated by daily shifts in enthusiasm that caused shifts in the composition of who gets counted as "likely voters." If likely voters first shifted against Hillary and then for, the shifting membership of the "unlikely voters" may have "surged" back and forth in the opposite way. It would be interesting to see if this was the case.
**Of course the pattern also could be explained by changes in enthusiasm among Obama supporters that mirrored what we have posited for Clinton supporter, flowing after the big victory in Iowa and then ebbing after the pollsters left the field.
-- Guest Pollster
January 13, 2008 in New Hampshire 2008
TrackBack
TrackBack URL for this entry:
http://www.pollster.com/cgi-bin/mt/mt-tb.fcgi/4612.
Listed below are links to weblogs that reference Likely Voter Screens and the Clinton Surprise in New Hampshire:
Comments
Dave Vanness:
This is consistent with stories making their way on the Democratic blogs (like this one at Daily Kos) that Hillary had an incredible ground game -- particularly focusing on turning out young female supporters. This would also be consistent with the observed switch in female vote patterns away from Obama toward Clinton.
Posted on January 13, 2008 4:51 PM
MSS:
Is this hypothesis consistent with Obama's final numbers being so close to his polling? That is, if the denominator grew significantly (due to Clinton-leaning"unlikely" voters turning out after all), how did Obama's support not slip relative to the poll estimates?
Posted on January 13, 2008 4:54 PM
OPandora:
To borrow from Huckabee may be God had a hand in Clinton's win in NH...
Posted on January 13, 2008 5:32 PM
Partha:
Thank you! Surely there is a way to estimate the sensitivity of pollsters' predictions to the likely voter screens used, and disclose an uncertainty that takes this effect into account. The error bars would be unflattering but much more accurate.
Posted on January 13, 2008 6:16 PM
Jake R:
NH's same day registration is a factor that has been completely overlooked.
If HRCs campaign used modeling to target liklely supporters (even if they were not registered to vote) and drove them to the polls with an aggressive GOTV program, this may further explain how polling results failed to predict the results.
Posted on January 13, 2008 8:09 PM
Charlie Hall:
Has anyone considered the possibility that telephone polling no longer accurately represents the electorate? Consider the possibility that working women who support Clinton might be less likely to be at home during polling hours and also less likely to pick up the phone even if they are home. It is also possible that they are more likely to use cell phones rather than land lines.
Posted on January 13, 2008 10:55 PM
Henry:
I personally think it is unlikely we have much voter fraud to blame for the difference between the polls and the final count, but we can thank Dennis Kucinich for making sure:
Kucinich has made the request and paid the $2000 fee to get a hand recount of machine counted ballots, after the numbers have shown a substantial difference in the results between hand counted ballots and machine counted ones (machine ones went more for Clinton). See:
http://www.counterpunch.com/lindorff01112008.html
Will be interesting to find out what the final count is, to hopefully put this possible issue to rest.
On another note, it seem to me that a relatively easy way to get some idea if there really was a discrepancy would be to have a post-voting poll done. Just ask people if they voted and for who. 500 or so polled should be enough to see if the results are close enough in line with the "actual" results.
Peace
Henry
Posted on January 14, 2008 1:43 AM
Jeff:
My understanding is that the exit polls were also wrong by roughly similar margins to the pre-vote polls. If this hypothesis is correct, shouldn't the exit polls have reflected this surge of suddenly more enthusiastic Hillary voters?
Posted on January 14, 2008 2:09 AM
kenmore:
The only poll that is really correct is USASURVEY, they acually said it on the eve of NHP that clinton is on the lead but people were too carried away by OBAMA'S preaching that they did not believe usasuvey .
for the latest go to usasurvey
Posted on February 4, 2008 8:03 PM
Post a comment
08 STATEWIDE PRIMARIES
US
Dem,
Rep
Upcoming
Kentucky (5/20)
Oregon (5/20)
Puerto Rico (6/1)
Montana (6/3)
South Dakota (6/3)
2008 POLL DATA
Pres General Election:
McCain vs
US: Clinton, Obama
AL: Clinton, Obama
AK: Clinton, Obama
AZ: Clinton, Obama
AR: Clinton, Obama
CA: Clinton, Obama
CO: Clinton, Obama
CT: Clinton, Obama
DE: Clinton, Obama
FL: Clinton, Obama
GA: Clinton, Obama
HI: Clinton, Obama
ID: Clinton, Obama
IL: Clinton, Obama
IN: Clinton, Obama
IA: Clinton, Obama
KS: Clinton, Obama
KY: Clinton, Obama
LA: Clinton, Obama
ME: Clinton, Obama
MD: Clinton, Obama
MA: Clinton, Obama
MI: Clinton, Obama
MN: Clinton, Obama
MS: Clinton, Obama
MO: Clinton, Obama
MT: Clinton, Obama
NE: Clinton, Obama
NV: Clinton, Obama
NH: Clinton, Obama
NJ: Clinton, Obama
NM: Clinton, Obama
NY: Clinton, Obama
NC: Clinton, Obama
ND: Clinton, Obama
OH: Clinton, Obama
OK: Clinton, Obama
OR: Clinton, Obama
PA: Clinton, Obama
RI: Clinton, Obama
SC: Clinton, Obama
SD: Clinton, Obama
TN: Clinton, Obama
TX: Clinton, Obama
UT: Clinton, Obama
VT: Clinton, Obama
VA: Clinton, Obama
WA: Clinton, Obama
WV: Clinton, Obama
WI: Clinton, Obama
WY: Clinton, Obama
Sen General Election:
Alaska
Colorado
Louisiana
Maine
Minnesota
New Hampshire
New Mexico (Pearce)
New Mexico (Wilson)
North Carolina
Texas
Virginia
PUBLIC POLLSTERS
ABC News
AP-IPSOS
CBS News
Democracy Corps (D)
Diageo/Hotline Poll
Economist/YouGov
EPIC/MRA
The Field Poll
FOX News
GWU/Battleground
Gallup
Harris Interactive
IBD/TIPP
ICR - International Communications Research
LA Times/Bloomberg
Mason Dixon Polling and Research
Marist Poll
Market Shares Corporation
Mitchell Interactive
NBC/Wall Street Journal
New York Times
Opinion Research Corporation
Pew Research Center
Polimetrix
Princeton Survey Research Associates International
Public Agenda
Public Policy Polling
Quinnipiac University Poll
Rasmussen Reports
Selzer & Company
Suffolk University Political Research Center
Survey USA
Time/SRBI
Washington Post
World Public Opinion
Zogby International
POLL BLOGS AND SITES
Political Arithmetik
Crosstabs.org
The Polling Report
Electoral-Vote.com
R. Chung's Graphics
Prof. Wang's State Poll Meta-Analysis
Prof. Pollkatz Pool of Polls
Slate: Election Scorecard
Public Opinion Pros
Frank Newport: Gallup Guru
Carl Bialik: The Numbers Guy
Poll Positions: Kathy Frankovic
The Numbers: Gary Langer
Washington Post: Behind the Numbers
SURVEY RESEARCH ORGANIZATIONS
American Association for Public Opinion Research (AAPOR)
The National Council on Public Polls (NCPP)
Council of American Survey Research Organizations (CASRO)
The World Association for Public Opinion Research (WAPOR)
The Council for Marketing and Opinion Research (CMOR)
Marketing Research Association
ARCHIVES
May 11, 2008 - May 17, 2008
May 4, 2008 - May 10, 2008
April 27, 2008 - May 3, 2008
April 20, 2008 - April 26, 2008
April 13, 2008 - April 19, 2008
April 6, 2008 - April 12, 2008
March 30, 2008 - April 5, 2008
March 23, 2008 - March 29, 2008
March 16, 2008 - March 22, 2008
March 9, 2008 - March 15, 2008
All pollster.com archives
MysteryPollster.com archives






CalD:
It was also an incredibly beautiful day in New England on the 8th. I would not rule out that some significant number of people who fell out of likely voter tests by saying (on a cold day) that they were not all that likely to vote, might have turned out anyway just to get out of the house/office.
Posted on January 13, 2008 4:12 PM