Pollster.com

Dispatches

 

46 "Outliers"


Kaiser's Drew Altman identifies a key health reform polling number to watch; Ezra Klein, Kevin Drum and Andrew Sullivan ponder it further.

David Weigel takes a long and skeptical look at Rasmussen Reports, joined by Josh Marshall and Matt Yglesias.

Gary Langer says Barack Obama's initial job ratings are strong, average for a new president, and as partisan as other recent new presidents.

Frank Newport finds that forty-somethings worry more about money.

Jennifer Agiesta looks at support for DC voting rights.

David Hill offers Obama advice and explains how pollsters evaluate political viability.

Tom Jensen wonders why IVR polls seem to produce different job approval numbers.

Wilson Research assesses the political environment.

John Sides says Stan Greenberg was right; finds "nothing particularly useful" in Gallup speech reaction poll.

Stan Greenberg booked on this Sunday's This Week with George Stephanopolous.

Paul Bedard ponders whether Frank Luntz is a uniter or a traitor.

Frank Luntz wants your thoughts.

Michael Link and colleagues explain "address based sampling" as means of reaching cell phone only households.

Congratulations to occasional poll parser and proud new papa Chris Cillizza.

The headline? A clue in this link.


Gould: Greenberg versus Penn, Continued


[This Guest Pollster contribution comes from Philip Gould, who served as a polling and strategy adviser to the British Labour Party for general elections held from 1987 until 2005.

Editor's note: Gould was a central figure in the dispute between pollsters Stan Greenberg and Mark Penn that we have covered this week, as he was responsible for managing the services that each provided to the Labour Party. He submitted his comments to Pollster.com in an effort to help clarify and resolve some of the issues raised here this week.

Since I emphasized the question of whether Penn delivered complete marginals and cross-tabulations, I want to promote the following paragraphs that come toward then end of Gould's memo:

After a poll Stan normally presented a filled in questionnaire, a full banner book containing complete cross tabs.

Mark had a different approach. Following a poll he quickly made available a full and extensive polling report. This went immediate to the whole campaign. This was not an inconsiderable document. I have one in front of me now: it is 18 pages long; it contains historic voting and favourability data; it closely examines 12 targeting groups ranging from rural lower class Conservatives to union households; it uses seven different batteries to examine campaign issues. It analyses responses to the news and key policy areas. And of course it contains numerous message batteries: in all well over 100 questions were asked and recorded. All of these were analysed by voting preferences, and sometimes by demographic categories.

These reports were extensive and useful documents, far in excess of a normal filled in campaign questionnaire. They did not constitute a full banner book and did not contain 'full marginal's' in the manner favoured by Stan Greenberg, but what Penn did supply was both exhaustive and useful, and certainly met the regular needs of the campaign. As one senior campaign official with responsibility for polling in 2005 has said: 'Mark Penn 'could quite fairly argue that the memos were intended for an audience that had no time or interest in delving into every corner of the data. I don't think that in any way illegitimises the findings or his advice'. On a personal note Mark Penn invariably supplied any additional cross tab or targeting data that I required, and I presume the same is true of others. Two pollsters, two approaches.

Gould's piece covers far more ground than this narrow excerpt.  It is well worth reading in full. 

-- Mark Blumenthal]


I am aware that intercession in the Greenberg/Penn polling war can precipitate what has probably never happened before: uniting Stan and Mark in the face of a common enemy (i.e. me). But with all the risks it entails I will press on. From the start I must declare an interest- I suspect I am one of the very few people around who can claim that they like and respect both Greenberg and Penn (I can already feel them starting to unite against me!). I worked with Stan for well over ten years and believe him to be an outstanding pollster and strategist. I worked with Mark for a much shorter time, and came to greatly appreciate his skills too, different from Stan's certainly, but considerable for all that. It is in that spirit that I write this piece.

There are so many issues here, of methodology, strategy, personality and of course memory that getting to the truth of what actually happened in the UK election campaign of 2005 is probably impossible, but I will try at least to clear away some of the fog. Not by focusing on the smaller, although I accept crucial disagreements between the two pollsters, but by trying to paint a bigger picture, and using where possible contemporary sources, notes written at the time, my rather sketchy diary, and in particular a lecture I made to the LSE on the campaign in 2006 which pretty accurately sums up what I believe about the campaign.

[Continue reading after the jump]

Continue reading "Gould: Greenberg versus Penn, Continued"


Smith Reports on the Greenberg-Penn Feud


Over at Politico, Ben Smith picks up the story of the Greenberg-Penn feud:

Greenberg’s new book ups the stakes. He argues that Penn played dirty inside the Blair campaign, tweaking the questions and introductions in his polls to produce results that favored his “mindless, fixed theory.” Through “biased wording,” Greenberg writes, “the tests were rigged.”

Penn fired back Monday on a polling website and in an interview with Politico, calling Greenberg’s charges of rigging “ludicrous,” his strategic theories “unsubstantiated,” and his attack the product of “sour grapes.”

The spat between the two men comes, perhaps not coincidentally, as Greenberg is selling his new book, Dispatches from the War Room. Their dispute offers a behind the scenes glimpse into the big-ego, big-bucks world of top-shelf political consulting, where franchises and reputations are made being the kingpin in a presidential campaign.

The small fraternity of top Democratic pollsters watched the fracas with amazement and amusement Monday, and sniped from the sidelines.

“This is ridiculous – this isn’t about polling and strategy,” said one, describing it as “a pissing match” that will, incidentally, “sell books.”

On a somewhat related and personal note, we will be back to other topics soon. I'm still depleted from a 24-hour viral bug that hit me yesterday, so apologies for less productivity than usual over the last two days.


A Tuppence Worth


A reader, a European politico who "witnessed the working of the Labour war rooms in both 2001 and 2005," emails to share his "tuppence worth" on the Greenberg-Penn exchange:

In terms of the atmosphere of the campaigns - 2001 was one large open-plan office where even [then Chancellor of the Exchequer Gordon] Brown sat. It was an upbeat room where there was a constant interchange between people. Greenberg was deeply embedded within everything. 'Loops' were large and delivered a brilliantly effective campaign.

2005 was factionalised, with people working in separate (large) rooms and with lousy communication. It was a very unhappy place. Penn's operation had a much larger physical presence than Greenberg's had had - reflecting a tendency to be self-contained in analysis versus Greenberg's more collegial approach (in 2001 I overheard him go to some Brits with "these are just in what do you think?"). Alistair Campbell is credited with going to Blair and saying 'enough' and things got back on track.

I have never worked with Greenberg, and he wouldn't know me, but I have observed his work closely in a couple countries and his approach is clearly to be a partner of the client - essential to recognising the limits of US experience when applied to international campaigns. This is why his is the only US firm which has had a long-term presence in Europe. Penn is building his business in Europe, but we'll have to wait a few years before we see if it's sustainable.


Dispatches: Penn's Rejoinder to Greenberg


Mark Penn has emailed a second response to Greenberg, which I have reproduced in full below.

One aspect of this back-and-forth is still not quite resolved. In his book, Greenberg writes that "Penn's firm provided none of the information normally delivered by a professional research organization." In his rejoinder posted earlier today, Greenberg expands on that claim:

Pollsters as a rule share the results for all their questions and hypotheses, even the ones that didn't pan out. In the Blair campaign, Penn provided a memo with large tables including only the questions he wanted to report; he did not provide a standard book of demographic cross-tabulations. Read Penn's words carefully, "The campaign received all of the agendas, marginals, as requested without reservation." In short, he provided breakouts only when asked, in effect keeping his own client and campaign team "out of the loop."

Penn's latest response does not directly answer Greenberg's charge:

The questions in the polls went through a team vetting process and it was up to Labour not me to determine what Stan got and what Stan did not get. I have plenty of letters of transmittal of questionnaires, marginals and crosstabs to the party - they chose what Stan did and did not get - and there were very sensitive questions for small group use only that they decided not to give him.

So Penn's firm transmitted "plenty" of questionnaires, marginals and crosstabs, but when and how often? If these documents were only shared on request, and then only after strategy meetings or conference calls in which Penn presented results (as was reportedly the case in Hillary Clinton's campaign), then Greenberg has a point. The standard procedure of every pollster I've worked with is to share these documents with the campaign as soon as they are ready -- by email or (in the good old days) by fax -- so that campaign decision makers can examine the data and be in a position to question the pollster's strategic recommendations. Perhaps this is a question that Phillip Gould can help resolve.

Penn's latest response follows after the jump.

Continue reading "Dispatches: Penn's Rejoinder to Greenberg"


Dispatches: Greenberg's Rejoinder to Penn


This guest pollster contribution from Stan Greenberg is part of Pollster.com's week-long series on his new book, Dispatches from the War Room and responds to comments from Mark Penn in Mark Blumenthal's post earlier today.  Greenberg is chairman and CEO of Greenberg Quinlan Rosner.

To avoid this discussion descending into an ugly mud-wrestling match between two squabbling pollsters, I will only take up issues where the "facts" are indisputable and where we learn something about Tony Blair and political leadership and about differing approaches to polling and strategy.

What this exchange reveals even more clearly than the book itself are the limits of building a strategy from a coterie of target groups, rather than from the leader's vision or party's mission for the times. It underscores the need for frankness about what is holding voters back and the need to challenge leaders with blunt truths. It underscores the need for transparency and methodological rigor.

Penn's basic argument is straightforward. He took over the campaign's polling in July 2004 about nine months before the election when Blair was at a low point, working under Philip Gould, Blair's long time advisor for research and media. Greenberg was pushed out and was in no position to judge the character of Penn's work, as he was "not in the loop." Seems straightforward enough.

When I first learned in December of Penn's involvement and in January of our dividing the polling, I was convinced that Gould had played just such a role and I wrote about it. I was wrong. Philip was hurt by the accusation that he had concealed Penn's involvement and wrote me with detailed diary entrees that show he only learned of it in September and resisted Penn's involvement until the end of the year, when he decided to "make the best of it."

Penn's premature rush to anoint himself as Blair's pollster obscures Blair's effort to examine competing solutions to the problems he faced. In May, Blair had reached a low point in the polls, dragged down by Iraq, the "hyping" of pre-war intelligence and Abu Ghraib. He was very despondent, seriously considering not running again and consulted widely, including with President Clinton and Senator Clinton who urged him to run and to use Penn.

Penn offered his own path back for Blair, aided by huge surveys and "clustering work" that coughed up "school gate mums" as a key target. Because Labour got its highest marks on the economy, his message started there, but Penn's emphasis was on policies that appeal to the groups that can grow Blair's coalition. Penn's imprint was immediately evident in Blair's September conference speech when he spoke of the stresses of the need for "more choice for mums at home and at work." Blair's policy offer was grounded in this clustering and coalition building.

At the very same time, we were commissioned by Phillip to do a special research project and I reported in July with a very different approach to the problem - centered on New Labour's central mission. For the first time in a long time, respondents shifted to Labour on hearing of Blair's commitment to "a better life for hardworking families," though only when Blair expressed his own frustration with the state of public service reform and offered some learning by showing independence from Bush on climate change. Iraq was the elephant in the room. Finding a way to acknowledge it, even indirectly, allowed people to come back to Blair's project.

In the September party conference speech, Blair was eloquent about "hardworking families," but just could not get himself to be reflective on Iraq - perhaps with Penn's support. That was the learning voters needed if they were to come back.

I respect Blair for rejecting my advice and deciding to go with Penn who did not push him to address the Iraq question and who offered a way to make electoral gains. The mistake was not firing me and leaving both of us in the campaign.

In fact, I have all of Penn's memos - about a two-inch pile on my desk at the moment, available for inspection by Mr. Blumenthal. Philip's note to me confirms he shared all of them during the course of the campaign, as did many of my friends "in the loop."

The whole concept of "in the loop" betrays a lack of transparency and openness in Penn's approach to campaigns - painfully evident in the Blair campaign, perhaps a precursor to Hillary Clinton's presidential run two years later.

Pollsters as a rule share the results for all their questions and hypotheses, even the ones that didn't pan out. In the Blair campaign, Penn provided a memo with large tables including only the questions he wanted to report; he did not provide a standard book of demographic cross-tabulations. Read Penn's words carefully, "The campaign received all of the agendas, marginals, as requested without reservation." In short, he provided breakouts only when asked, in effect keeping his own client and campaign team "out of the loop."

The surveys were methodologically sloppy and included biased tests, though it is important to underscore here that Philip Gould came to value Penn's research and rejects my characterization of it in the book.

Specifically:

1) Penn failed to incorporate professional learning from Britain. Penn national polling - not some errant tracking program - showed Labour with landslide leads of 8 or 9 points for the entire six weeks prior to the election being called. Penn discovered just 27 days before the election what every pollster in Britain has knows: you have to weight to offset the "shy Tories" - Conservatives reluctant to be interviewed. In an instant, the Tories gained 6 points in Penn's polls.

2) Penn's fixed targeting let real targets slip away. With Penn focused on "mums," the campaign regularly rolled out initiatives on breast cancer screening and childhood obesity. But voters in the key marginal seats were older and among those most likely to return to Labour, two-thirds had no children at home and found this campaign irrelevant.

3) Penn exaggerated the reliability of findings. Penn conducted a valuable weekly open-ended Internet panel of undecided voters. When the sample dropped to 100, so did the reporting of sample size that produced a testy email exchange that restored it. Still, Penn reported this as a "Survey of Undecided Swing Voters" and reported the full percentage results over 18 pages, including results for men and women, with about 50 cases each.

4) Penn created biased tests. Two weeks before the election, Penn declared that "our policy approach remains stronger than the Tories," but the Labour statement was more than twice as long, with more rhetorical flourishes and covering a much broader range of policies with greater specificity (which I'm happy to share). Even with this biased test, the Conservative's statement ran 6 points ahead of its vote. An unbiased test might have revealed potential Tory gains.

To inform the decision of whether to close positively or negatively, Penn constructed a sensible experiment where half the respondents were read positive statements about Labour's progress and half read attacks on the Conservatives' record and plans, and then respondents were asked to vote again. But this was not meant to be a fair test. The negative statements were 50 percent longer by word count and helped foreclose an uplifting close.

Penn describes the 2005 third-term as "historic" but in the campaign everyone was disappointed with the result, what the media called Labour's "drastically reduced majority," produced by a disengaged electorate and historically low turnout. Many factors contributed to the result, but among them were Penn's research, not to mention having two polling teams with different theories on how to win.


Dispatches: Greenberg vs. Penn


Of the many stories in Democratic pollster Stan Greenberg's new book, Dispatches from the War Room, the most newsworthy may be his slashing condemnation of Mark Penn, the pollster that displaced him within the inner circles of both President Bill Clinton and British Prime Minister Tony Blair.

Greenberg, reacting to what he saw of Penn's polling when both worked on Blair's 2005 re-election, describes Penn's methods as "errant," his tests of messages as "biased" and "rigged" and his documentation lacking "transparency" and "the information normally delivered by a professional research organization."

Penn, in response to my query, defends his surveys for the Labor Party as "extremely accurate," says Greenberg was excluded from information because he was "not in the loop," and describes Greenberg's attacks as inaccurate and "unsubstantiated."

This exchange brings out into the open a particular critique of Penn that until now came mostly from speculation or the reports of anonymous sources. Some aspects of their stories are in conflict, if nothing else the undisputed facts illustrate the contrast between the Carville/Greenberg "War Room" model of campaigns and the style of consulting that Penn practices.

[This post is part of Pollster.com's series on Dispatches from the War Room].

* * * *

For those just joining this conversation, Greenberg's new book chronicles his work for five national leaders, including Clinton and Blair. The story starts with the 1992 campaign that put Clinton in the White House and made the "War Room" famous. After the 1994 elections that swept Republicans into control of both the House and Senate, however, Clinton started taking advice from Dick Morris and brought in pollster Mark Penn to replace Greenberg and conduct polling for the 1996 reelection campaign.

In the midst of the first Clinton term, Greenberg also went to work for Britain's Labour Party, helping to create another political "War Room" that helped Blair and Labour win landslide victories in 1997 and 2001. Following the terrorist attacks of September 11, 2001, Blair emerged as one of the closest allies of the U.S. and President George Bush in both the response to the attacks and the Iraq War. As Greenberg relates in the book, he personally opposed the Iraq war and felt uncomfortable with Blair's embrace of Bush and military action in Iraq. Nevertheless, he remained an advisor since he "did not question Blair's motivation" nor his commitment to the larger "political project" that "transcended this war."

Ultimately, however, the war took a toll on both Blair's popularity and his relationship with Greenberg. In this period, Greenberg recounts several examples of Blair rejecting his counsel as he struggled with how to win back public support and whether to seek reelection. In November 2004, after Blair decided to seek a third term, the Labour Party informed Greenberg that they had retained Mark Penn and that Blair wanted "the polling program split between the two of you."

Greenberg soon learned that during periods of Blair's doubts, "President Clinton and Hillary, too, called repeatedly to urge Blair to run again...They also pushed for Blair to use Mark Penn to help find a way out." Penn had conducted polls kept secret from Blair's inner circle, even from Phillip Gould, the polling and strategy advisor. Friends also told him that the plan had been to "fire" him, yet "somehow nobody did it." So he continued to conduct polls on behalf of Labour in marginal districts and, as such, remained present in the campaign,

watching it all from a dysfunctional new war room. The Penn people were grouped at one set of long tables and my people at another, a touch further away from the cluster of tables at the center. It was a daily humiliating experience, but I decided I had too much invested in "New Labour" to walk away.

Greenberg's criticism of Penn stems from what he observed during the period including, by his account, both the shift in message and the results of Penn's polling. He recounts an episode in March 2005 in which Penn's polls showed Labour "with landslide leads," while Greenberg's surveys in marginal districts were closer and his review of public polls showed Labour leading by only four percentage points. A memo from Greenberg to Blair about these numbers "led Philip [Gould] to erupt in the war room," shouting at Greenberg's staffer to "tell Stan these emails to Tony are wrong and very destructive." In the end, Labour won by just three percentage points and a significantly reduced majority.

After the election Greenberg wrote three memos to Blair and then Chancellor Gordon Brown that interpreted the results and "put on paper in an inescapable way my outrage at the polling and the banal strategy that followed from it that put Blair and Labour at risk." He describes the overall "research program" (which included work by Penn and by others) as "unprofessional and lacking in methodological rigor...biased, self-deluding and overly optimistic."

The memoranda, as recounted in the book, include these specific references to Penn's work:

Penn's errant polling methods had produced landslide predictions all along, giving way in the last week to a roller coaster: first Labour crashed, then it surged back. One could only divine the cause because Penn's firm provided none of the information normally delivered by a professional research organization," I wrote. The lack of transparency allowed findings to be "packaged in scientific surety that should never have been reported with anything but the greatest qualifications."

The biggest problem was that the campaign fixated on winning over some Americanized target group. Without any evidence, Penn touted that "soccer moms" were the key swing group in the 2004 U.S. elections. In Britain that group became "married mums." The problem was that three quarters of the "lapsed Labour voters" in the marginal seats did not have kids at home. Penn set the campaign on a course that missed most of its key targets and would not adapt. So, "during the campaign, we successfully raised Labour's support with women with children at home" but "that came at a price" among older voters and pensioners and men under forty-five who were not stirred by yet one more initiative on breast cancer screening and childhood obesity. "It was as if creating an American-style gender gap was something to emulate, when Democrats in the U.S. have had so much difficulty winning nationally." I concluded that this mindless, fixed theory had "consequences": "a reduced Labour vote share and a reduced parliamentary majority."

After some criticism of focus groups by the campaign (but not by Penn's firm), Greenberg concludes, again quoting from his own memorandum:

[T]o keep the campaign on its predetermined course, "the national survey's were riddled with questions whose biased wording seemed to get the reports to a preferred conclusion." In short, the tests were rigged.

What makes these accusations unique is that they are from an on-the-record, first person account. Similar accusations -- such as not not sharing  "filled in" questionnaires (also known as "marginals") and crosstabs or cherry picking results to support a favored position -- have bubbled up in the past, but Greenberg is the first I can recall willing to make such accusations out in the open.

I emailed Mark Penn for comment and he sent a response that characterizes Greenberg's charges "unfortunate" and "unsubstantiated," defends his firms' data and its contribution to Labour's 2005 campaign. "We did in fact change the course of the campaign, developed a new message, a new set of targets, were extremely accurate, and received extensive written and personal praise from the prime minister." He denies as "ludicrous" the accusation that his polls showed Labour winning by landslide margins: "We never predicted a landslide. Most of our polls showed Labour and Tories within 4-5 pts. It was Stan's predictions of a loss that proved inaccurate."

Penn's complete response appears after the jump, but the following paragraphs are most relevant:

First and perhaps most disturbing is the idea that he did not receive any standard market research information - of course HE didn't. The campaign received all of the agendas, marginals and crosstabs as requested without reservation. But Stan didn't because he was not in the loop as 1) many of the polls contained highly sensitive questions and 2) he was seen as highly adversarial looking only to undermine the team and their effort - which is rather borne out by his book. The memo he quotes in his book actually sealed his fate and was seen as highly unprofessional and mocking of an effort led by a hard-working team of smart professionals including Philip and Alistair Campbell. Blair specifically praised the professionalism, quality and creativity of the work.

Penn may have had a different memo in mind, but to be clear, the internal memos that Greenberg quotes in the passages above were written two weeks after the 2005 elections. Penn continues:

Again, Stan was excluded from the strategy sessions and all meetings with the prime minister and provided with only limited information at the specific instructions of the client. How could he have understood what was going on when wasn't there for the high-level discussions? This is rather well illustrated by his saying he learned of us in December and that Philip Gould did not know of our work. In fact, we started many months earlier in the summer when the most in-depth positioning and clustering work was done and Philip was at every presentation and supervised us. Of course he did not tell Stan that he was working with us long before or that he had all of the information on the polls for reasons that are quite obvious.

And on top of all this Stan has confused daily tracking in the last month that was done by another firm (not Penn and Schoen) that Philip had arranged to have shared with the campaign. This daily polling did tend to shift around and we did not have much information on it - it was not used for much of anything. We did not do daily tracking - we did the message and strategy polling, and we supplied the questions, the answers, the sample sizes, and the logic behind each and every conclusion or suggestion.

We worked almost a year on this campaign asking hundreds of questions of all types and nothing was "rigged." Philip had input to all of the questionnaires without reservation as did members of the team and he ran extensive independent almost daily focus groups alongside us.

There are clearly some facts in dispute in this exchange, and resolving the conflicting stories is beyond the scope of this post. Other issues, such as whether question wording is slanted or "rigged," will inevitably involve subjective judgments. I assume that he will have more to say in response, and we look forward to trying to dig deeper into this controversy.

Timing is important in all of this. If "the campaign received all of the agendas, marginals and crosstabs as requested without reservation," when exactly were they requested and received? The complaint I heard from within Hillary Clinton's campaign was that Penn only shared filled-in questionnaires with the campaign's senior staff after the meetings or conference calls at which results were presented and decisions made, and only shared cross-tabs reluctantly on the condition they be locked up in the campaign manager's office.

But if we set aside the conflicting aspects of the two pollsters' accounts, we can still see a clear contrast in the way they approach campaigns and a vivid illustration of the Carville/Greenberg "War Room" philosophy. As Greenberg writes, James Carville's vision was to "house...all the key campaign people [in a single room], the opposition researchers, policy people, and news monitors." Yes, as most of us know, all of it was "geared toward fast analysis and instant response," but speed alone was not what made the concept unique.

What really distinguished a Carville War Room was the absence of doors, the way information flowed freely among the staff that worked inside. Instead of limiting access to "sensitive" polling information to the half-dozen or so in the campaign's "inner circle," Carville opened access to everyone working in the War Room, including relatively junior staff. "The idea was that information was widely shared among the campaign people," Carville himself told me when when I spoke to him on Friday. Even though he routinely shared sensitive strategic information with hundred or so staffers in the Clinton campaign "we never had leaks" (though to be clear: Carville was not involved in the 2005 Labour campaign).

In Penn's conception, polling information should be shared only with a select few with the candidate's ear, those "in the loop." Carville and Greenberg's "war room thinking" trusts everyone in that room with the details of strategy and polling so they can be, as Greenberg puts it, "sensitive to all kinds of information, and anxious to jump on any sign of strategy going awry."

Trust your staff with the data that drives the strategy and they are more likely to understand it and react accordingly. Limit "the loop" to just a small handful in a presidential campaign and expect infighting, dysfunction and poor execution to follow.

[Past relationship disclosed: I worked in Stan Greenberg's company, then known as Greenberg-Lake: The Analysis Group, in 1990 and 1991].

UpdateGreenberg responds to Penn, Penn responds to Greenberg.

Greenberg's full passage from Dispatches on this subject and Penn's response follow after the jump.

Continue reading "Dispatches: Greenberg vs. Penn"


Dispatches: Greenberg's Reponse to Schaffner and Moore


This guest pollster contribution from Stan Greenberg is part of Pollster.com's week-long series on his new book, Dispatches from the War Room. Greenberg is chairman and CEO of Greenberg Quinlan Rosner.

Brian Schaffner focuses on the role of pollsters in identifying groups and thus empowering them -- making their opinions relevant to political leaders. I am very conscious of the role and as you correctly point out, I put the spotlight on Macomb County's "Reagan Democrats" and after this election, moved the spotlight next door to upscale suburban Oakland County.

What groups "matter" in my work is not some blind search of the data to find interesting and distinctive groups.

Dispatches.jpg

In the period when the wall between my academic and political lives was starting to crumble, I was very taken by E. E. Schattshneider's argument that whomever decides what the fights about likely wins. Successful political leaders and campaigns control the subject, define the choice and choose the fight. Drawing that line decides what issues are important and critically, who gets engaged and who loses interest. In 1992 Clinton made the election about change and the economy stupid and President Bush failed to make it about trust and experience. This year, Obama made it about change and Hillary Clinton tried unsuccessfully to make it about experience, but when she shifted to the economy and the middle class, she put the spotlight on white working class voters who rallied to her.

"Reagan Democrats" derived from the political project that tried to put the middle class back at the center of a renewed Democratic Party -- but the groups emerged from the project. In the book, I argue for the strength of these five leaders because they made politics purposeful.

Related to this point is David Moore's important discussion of "intensity" of beliefs and and the ability of leaders to get people to change their views on an issue and follow them. Whether a leader touches people, understands the times and poses a choice that impacts their lives impacts both which issues get highlighted and how intense are reactions.

I fully agree that mapping intensity will give you a much better view of public thinking and how issues are likely to break. But what is interesting about my Jerusalem example is that people held intense views (which I measured and monitored closely) when they rejected the idea of dividing Jerusalem, but shifted their views nonetheless once the public debate forced them to think about all the possibilities. This is a life and death and emotional issue and voters followed it very closely but Ehud Barak, like earlier Israeli leaders, was able to move the deliberation to a longer-term framework for preserving a Jewish state.

Focusing on intensity will help pollsters know which opinions really matter and difficult to move, and I did a lot of simulation in my polls to see how dynamic are opinions. But I'm still in awe of how much opinions shifted on such a central issue in such a short period and still learning from the fact.


Dispatches: Greenberg's Response to Franklin (Part 2)


This guest pollster contribution from Stan Greenberg is part of Pollster.com's week-long series on his new book, Dispatches from the War Room. Greenberg is chairman and CEO of Greenberg Quinlan Rosner.

Charles Franklin rightly begins his comments by putting up my quote on page 58 that "the endgame in presidential campaigns brings out all sorts of irrationalities, starting with the media polls. Many are criminally bad." One of the problems in writing a book and a memoir is living with your words and thoughts, particularly when as unnuanced as those.

Dispatches.jpg

In retrospect, I might have been more nuanced. First, I made the comment in the context of the Clinton presidential campaign when the statement was clearly true, as described in the book. Second, it reflects my experience during the final weeks in campaigns in Britain and Israel and in Latin America, even very recently. But because of sites like Pollster.com, there is more transparency and exposure of shoddy methods, and despite strong budget pressures, the national media organizations in the US produced very credible polling programs in this last election. But as recently as 2004, there were stark examples of volatile polls without political weighting conducted by Gallup and aired on CNN, along with commentary on how fickle were the voters. The challenge will be what happens with media polls, as there is more upheaval in the industry and need for more costly multi-modal methodologies and greater use of IVR.

This is a very different matter when one goes down to the state and congressional level and when you are in lower turnout elections and primaries. The media polls, as well as polls conducted by universities and institutes, are often out of line with the campaign surveys, as they are less likely to screen or filter for likely voters, factor-in historic turnout patterns and consider use of exit polls, as well as CPS. That one in four state polls in 2008 were conducted one day suggests we are dealing with a genuine issue.

I Amen, Franklin's Amen. The biggest problem is the reporting, not the polls themselves. It is the "outlier" poll -- not the boring average that gets headlines. But it is even worse in the war rooms I'm writing about that are poised to explode in the closing week of the campaign. It is the errant poll, not the average, that sets off the sparks in the war room and gets the attention of the candidate.


Dispatches: Greenberg's Response to Charles Franklin (Part 1)


This guest pollster contribution from Stan Greenberg is part of Pollster.com's week-long series on his new book, Dispatches from the War Room. Greenberg is chairman and CEO of Greenberg Quinlan Rosner.

I want to come back in my next post to the first half of Charles Franklin's piece where he raises legitimate issues about my characterization of media polls. But before that I want to develop a point he makes -- about order of questions -- because I actually have some new information on the subject and it is hard to find anyone interested in such issues.

When it comes to the vote, I have spent a lot of time assessing how to get people most comfortable with answering and to minimize the number of false undecided. In my experience, the closer the question to the start of the survey, the larger the undecided. There is a price in possible bias in introducing prior questions but if those questions reflect the broad political context in which the vote choice is being made, you can risk that. So, we will usually have a right direction/wrong track question, most important problem (either open-end or closed), a favorability or thermometer battery on political leaders, parties and organizations -- broadly distributed and balanced. Each election is a test of whether that structure produces unbiased estimates.

Our national presidential results for Democracy Corps or by Greenberg Quinlan Rosner closely resemble the national media polls, with a somewhat smaller undecided (though I haven't done the comparison on this issue).

Presidential approval is different. People are comfortable answering the question and at presidential level, not a lot of undecided once in office for a period. When I polled in the White House for President Clinton, we started by asking the job approval after the thermometer/favorability battery and right before the vote. With President Clinton, I discovered that asked at that point, his approval rating was higher than reported by other organizations. So, we conducted an experiment where half the respondents heard the job approval at the front of the survey and half heard it right after the favorability battery about Clinton and other political leaders. The implicit comparison led people to rate Clinton higher. Since job approval was the indicator most important to us, we moved up to the front in the survey.

We continued that practice during Bush's term and Democracy Corps' approval for Bush was higher than the norm -- and often cited by the White House. Bush's job approval, unlike Clinton's, likely fell if considered alongside other leaders or if the survey dealt with Iraq, the economy, health care or any other topic where is approval was probably even lower. I know this is obvious, but order really matters.

I agree that openness is the best route to sorting these issues -- including publishing the full surveys wherever possible.


Dispatches: Greenberg's Response to Kristen Soltis


This guest pollster contribution from Stan Greenberg is part of Pollster.com's week-long series on his new book, Dispatches from the War Room. Greenberg is chairman and CEO of Greenberg Quinlan Rosner.

Kristen starts with a key piece of the role of pollster -- keeping elites and elected officials "in-touch" with people; a reality check. Lost in all the talk about politicians with their fingers to the wind is how hard it is for the voter to get heard amidst the lobbyists, experts, bureaucrats, donors and more. If there is a problem to solve, that's not a bad one to address.

I really share Kristen's frustration with the search for the "silver bullet" -- particularly a word or phrase -- when the "silver bullet" is really have a theory of the race, knowing why you are running, defining the choice in a way that really impacts people's lives. Look what happened when Obama's "change" encountered Clinton's "experience" and coalition of small groups. Clinton lost ground because Obama had the force of what was happening in society and the economy with him. Understanding your times and having a mission puts you in a more powerful electoral position.

I agree that voters not voters not grounded in the current ideological polarization. That's why it hasn't worked to label Clinton a "liberal" in 1996 or Obama in 2008. But that has led to some to say that voters aren't moved by big ideas and political political forces and alignments and they have rushed to advance a bunch of small policies. I think 2008 showed that America is a country moved by big currents and open to big ideas about how to address our problems. I think Obama and McCain debated big philosophical issues and those mattered in how people became engaged and voted.


Dispatches: Trusting What People Say in Polls


This post is part of Pollster.com's week-long series on Stan Greenberg's new book, Dispatches from the War Room.

Dispatches.jpg

I'm pleased to join this conversation and to have received Stan Greenberg's book, which is a fascinating insider's look at the way polls were used in five major situations. It's great history by itself, and I would strongly recommend the book to any one at all interested in current events and/or the role of polling consultants in public policy.

 

I have several comments I would like to make at some point, but this one will focus on one issue raised by Mark Blumenthal and subsequently addressed by Greenberg himself.

 

Mark pointed to Greenberg's query at one point in the book, where the author asked how much he could trust his own polls on public policy matters. To make it easier for the reader to follow this conversation, I will reproduce what Mark wrote:

 

...the most candid observation from the book concerns Greenberg's admission that his focus groups and polls misled him on the question of whether Israeli voters would ever accept a division of Jerusalem. At first, two-thirds of voters in his surveys said "it was unacceptable to have a Palestinian state with its capital in East Jerusalem." When Greenberg "saw no movement" when he presented arguments for the division in surveys, and voters "nearly cried" in focus groups, insisting that dividing Jerusalem would be "like taking away your beloved child," Greenberg advised his client that such a policy was a "dead end." [emphasis added]

 

Yet four weeks after Ehud Barak put that option on the bargaining table at Camp David, despite a negative approval rating and strong opposition in parliament, a majority of Israelis were ready to "go with him" on Jerusalem in Greenberg's polling. Thus Greenberg raises a critical question:

 

If I cannot believe what people tell me is unacceptable in my surveys on Jerusalem, then what of my findings on other subjects? Why can't a determined leader change these too?

 

Greenberg's question about the changeability of public opinion is an important one, because much of what polls present to us today are measures of public opinions that appear to be firm - when in fact we know that for many people, polls measure only the most ephemeral of views. What's lacking in most polls are any measures of intensity.

 

My question to Greenberg would be how intensely did the poll respondents feel about the "unacceptable" response they gave to the interviewers? Greenberg gives no indication that he measured it, though he did get an idea of intensity in the focus groups when participants "nearly cried" about the proposed division of Jerusalem.

 

Still, as we know, focus groups are poor indicators of general public opinion. The people who are willing to participate are no doubt more engaged in issues than people who can't be bothered (or paid) to participate, and the focus group experience itself can be intense - making the participants completely unrepresentative of the general population.

 

Greenberg is, of course, quite aware of such limits, readily acknowledging them in his book. Still, as we all know, it's very difficult to ignore numbers and visceral experiences even when we know they are technically unrepresentative of the larger population. The high emotion of the focus group participants could well have made it seem impossible that voters at large could change their minds.

 

In a series of experiments that Jeff Jones and I designed while I was at Gallup,[1] we discovered that on any given issue about 40 percent to 60 percent of the public had a "permissive" opinion. Though many people may have initially expressed a preference for a policy (saying that they either favored or opposed it), those with a "permissive" opinion then admitted (in response to a follow-up question) that they would not be "upset" if the government did the opposite of what they had just said. This does not mean that later on, once a policy has been implemented, those same people will not hold the leaders accountable if it doesn't work. But it does mean that political leaders have tremendous leeway in what they initially decide to do.

 

And it also means that on most public policy issues, leaders can probably do pretty much what they want to without being held accountable.

 

Greenberg refers to that phenomenon when he talks about the importance of public opinion to legislators (p. 395). "The fundamental lesson is that people matter because elections matter. You could only think otherwise if you haven't spent any time close to elected officials or candidates for office...The antics of the Republicans in Washington over the past decade seemed to challenge that presumption when they ignored overwhelming public sentiment on Clinton's impeachment, taxes, and the Iraq war, and escaped accountability at the polls."

 

What I'm suggesting here is that the "overwhelming public sentiment" described by Greenberg was not, in fact, overwhelming. The polls are misleading us. Such sentiments as Greenberg mentions may be widespread, but thinly anchored. And whether we like it or not, from a democratic point of view, it means that politicians can often get away with ignoring what appears to be a public consensus.

 

The Iraq War is a good example, though on the opposite side of the issue from what Greenberg is discussing. Did Americans "overwhelmingly" support the war before President Bush launched it? The polls all said yes, by about two-to-one margins or greater. And it would appear that most Democratic Senators, who might have been expected to oppose the war, were influenced by these polls to support the war resolution. But Jeff Jones and I discovered that after measuring intensity on that issue, in fact the public was evenly divided - three in ten strongly supporting the war, three in ten strongly opposed, and a plurality - four in ten - with a "permissive" opinion (not upset either if the United States went to war or didn't go to war). How different the political climate in Washington might have been had this picture of public opinion prevailed, instead of the erroneous depiction of a public hankering for war.

 

While Gallup has not measured intensity on this issue recently (nor have other pollsters), I suspect that even when it comes to withdrawing troops - which Bush refused to do - the public is more divided than unified. The point is that the public is much more in the middle of an issue, and thus willing to defer to its leaders, than the polls tell us, because most polls ignore the intensity with which people hold their poll-expressed views.

 

In the conclusion to his book, Greenberg writes that despite his ability, post hoc, to explain why his poll results about Jerusalem might have misled him (p. 422),

 

...it does not change the question I now must face whenever I see a survey result that sets such dramatic limits on what is possible. How do you know that people will not rethink their starting points? How do you know they will not be moved by a deliberative process that thinks about the problem in new ways?...How do you know you won't discourage a less fearless leader from chancing to be bold?

 

I do not have an answer to this question, other than to constantly remind myself that opinion is changeable, that I must always simulate changing circumstances, and that I should be wary of telling a leader the public will not join him or her in this.

 

Like Greenberg, I think there is a much larger portion of the public in the middle of any given issue than might be at first assumed - and that we find reflected in most current polls. It's a point that Kristen Soltis makes in a different way when she praises Morris Fiorina's Culture War?: The Myth of a Polarized Electorate.

 

In a follow-up commentary about Greenberg's book, Blumenthal  wrote that "public opinion will ultimately limit or control the extent to which policy makers can affect change and achieve their goals, and a wise wonk will want to study public opinion -- both as it exists now and where political leaders can move it in the future."

 

But political leaders need realistic measures of such opinion. Crucial to that goal is measuring not only the direction of the public's preference, but the intensity with which people hold their views - and thus their potential willingness to be influenced by their political leaders.

 

Greenberg's Dispatches is a testament to the importance of this dimension of public opinion so often ignored by our major media polls.

 

 



[1] David W. Moore and Jeffrey M. Jones, "Permissive Consensus: Toward A New Paradigm for Policy Attitude Research," revision of a paper presented at the annual meeting of the American Association for Public Opinion Research, May 16-19, 2002.

 


Dispatches: Are Media Polls Criminally Bad?


This post is part of Pollster.com's week-long series on Stan Greenberg's new book, Dispatches from the War Room.

Dispatches.jpg

Stan Greenberg's book is a "good read" from both a political and a polling perspective and I know fellow junkies will find it rewarding. But I want to start a conversation over a strong claim Greenberg makes on page 58 about the quality of polling. I'll quote the full paragraph, but interspersing my comments as we go.

The endgame in presidential campaigns brings out all sorts of irrationalities, starting with the media polls. Many are criminally bad.

Ok, that's provocative and got my attention. How so?

Some are done in one night with no time for callbacks and thus over-represent people who are easily reached by phone, often seniors.

In principle this is a problem but in practice not so much. Of 543 national polls in Pollster.com's data for 2008, only 6 have a one day field period, with another 76 having two days of interviewing. That's 15% which isn't trivial but certainly isn't representative of most polling. The most common field period in our data was 3 days, with 230 polls, and another 115 that did 4 days on interviewing. That's 64% of polls. At the state level there is more single day polling, a lot of it done by IVR (or "Robo-polls") which are still controversial in the polling profession. Of 1791 state polls in our data, 472 were done in a single day, or 26%. Another 204 were done in two days, for a combined share of 38%. So the complaint here is fairly well justified for state polls but not so much for national polling.

Greenberg continues:

They are not carefully weighted and, as a result, show wide swings in voter preference that the media interpret wrongly as voter fickleness.

I'd be curious what constitutes careless weighting. Almost all pollsters weight the data to demographic distributions derived from the Current Population Survey (a huge monthly government survey with over 90% response rate and therefore considered particularly reliable.) Pollsters might differ on some technical issues here but it is hard to believe that media polls are that different from Greenberg's own methods. None of the weighting techniques are in any way secret-- just buy a textbook on survey sampling or read the journals or attend panels at AAPOR (the pollsters conference) and the variety of options are all right there in the public domain. So there is little reason to think that variation in weighting practice is due to either secret knowledge that Greenberg and colleagues have that is unavailable to others, or that "media pollsters" systematically choose to be reckless by using poor weighting schemes. The one controversial area of weighting is whether to weight the data to some specific party identification distribution, derived either from past polling or from exit polls (which are themselves suspect on this, but I digress.) I don't know what Greenberg's position is on this, or if that is what he is referring to in this paragraph.

I would, however, strongly agree with the implication of the end of the sentence, that media interpretations of polling variation is far too quick to present random sampling noise as "real change" and to let that noise drive the narrative. I might disagree that this is a function of weighting, but I think this point is certainty right.

Continuing in the paragraph:

And they usually ask the respondent only for whom they will vote without any prior questions that build trust. With people reluctant to tell a stranger for whom they will vote without being warmed up, many of the media polls report an inflated number of undecided voters.

I think a review of the major network and newspaper polls will show that the vote question appears early in the survey, but very rarely as the first question and never the only question. This does however raise a valuable point of legitimate disagreement among pollsters: Is it better to remind a voter of a variety of issues and considerations about the candidates through your survey before asking the vote question, or is it better to get the vote response early before you have "primed" the respondent to be thinking of particular issues. For example, at Wisconsin an ongoing survey in the 1990s asked about the state of the economy as the warmup items, then asked presidential approval. We switched that to ask initial questions about interest in politics and attention to news as the warmups to avoid priming the respondents to think of the economy before they thought about presidential approval. Now some, perhaps Greenberg, would argue that asking a series of questions about current politics before the approval question (or vote in an election survey) is actually a good thing because those are the considerations voters are likely to carry with them to the polls. Others would point to evidence that the questions you prime will have greater influence over approval or vote response than questions that might matter to voters but which you happen not to bring up. I'd be interested in hearing more from Greenberg about his view of this debate.

Finally the paragraph concludes:

Worst of all, a poll that shows a result sharply different from all the others gets media attention because the difference is "news" when it is likely the result of normal sampling fluctuations or careless polling practices.

Amen! Our efforts to detect polling outliers and label them as such is an attempt to reduce the attention paid to these fluctuations. But outliers happen to every polling organization. If they don't then the pollsters are fiddling with the data in suspect ways, since sampling theory says you will produce a statistical outlier 5% of the time. If you don't then you are cheating, not being "better". The problem for journalists and public interpreters of polls is not to get rid of outliers or suppress their publication, but to recognize them as such and give an appropriate interpretation.

My bottom line is that polling techniques and methodology are "open source." Take classes in grad school and you can learn all the theory. Work in a polling firm and you'll also learn a lot of practical wisdom. Survey professionals all have access to this. Greenberg may well think that his polls are superior to those conducted by others, but I'd disagree that this has anything to do with secret knowledge or methods. I'd also question the implicit claim that campaign pollsters are better at conducting polls than are media pollsters. I am more sympathetic to a claim that campaign pollsters or advisors on policy as Greenberg's book illustrates, may be able to craft surveys that get at the ability of politicians to shape public response through how they talk about issues. Media (and academic) polls are seldom focused on this, and in that way are arguably more limited. That is a very interesting discussion that perhaps we can move on to.


Dispatches: Thoughts From A Young Pollster


This post is part of Pollster.com's week-long series on Stan Greenberg's new book, Dispatches from the War Room.

Perhaps the two most appropriate topics for the young Republican pollster participating in this discussion are 1)the idea that younger consultants are more tactics-focused and that 2)the role of ideology hand in hand with opinion research that guides the creation of a public agenda. I'll attempt to give my thoughts on each.

First, I truly appreciate Greenberg's defense of the role of the pollster in advising leaders and participating in the cultivation of public support for policy goals. The Bush Administration was not the first political operation to proudly declare they aren't looking to polls to set their agenda, nor will they be the last. But Greenberg is spot on in noting that in a democratic society, gaining the trust and support of the people is essential to effective governance.

When I explain "what pollsters do" to acquaintances and family members who are not closely familiar with what pollsters do (besides call them during dinner time), I like to say that we are the "reality check".

In the case of pollsters, we are a special group of intermediaries between Americans and their leaders. Constituent mail, phone calls...these things show what the most activated pieces of the public are thinking. Democratic elections may be the purest expressions of public opinion between a public and its leaders. But it is the job of a pollster to provide an accurate and representative picture of what the electorate is thinking in the mean time. We provide the reality check. There's a lot of talk about "inside the Beltway thinking" - as a pollster, we get to be the antidote. If my work as a pollster enhances a leader's connection to the electorate and helps those in Washington maintain a focus on the important priorities of the people who elected them, I can feel good about what I've done.

A disturbing trend I've noticed however is a trend toward finding the "silver bullet", the very tactical focus that Greenberg references in particular relation to younger consultants. There is an idea that has been made popular by some pollsters that all you need are the right words...that an idea, regardless of that idea's merit, can gain traction with the public and can become the Next Big Thing if only the right alliterative device is used to name and define the problem. The right words and rhetorical gimmicks will win over the public, regardless of the merits of the policy.

This isn't just in the polling/messaging/strategy realm. I've seen the belief that the right piece of opposition research or the right witty negative ad is all that is needed for victory. And so these tactics are the focus, because they are exciting, they provide the "thrill" of the game that Greenberg mentions. I'm heartened to read that Greenberg identifies the importance of a bigger vision, the importance of issues and sound policy, and his reference to V.O. Key's quote that "voters are not fools". Today, that belief still remains unorthodox in too many places in the world of the political consultancy.

What is missing all too often is the idea that polling can help cultivate public support by focusing on those big ideas. Another way I like to think of a good pollster is like a debate coach. So you as a leader have decided to pursue a specific policy goal. What are the best arguments to use to build support? Note, I'm using the term "arguments". Not words. Not to diminish the importance of framing, but I believe a pollster is far more effective when helping to craft arguments that are sound and intelligent. There's a big difference between good positioning and gimmicks. Pollsters should be in the business of the former, not the latter.

Where I'll disagree with Greenberg slightly is in his criticism of some other contemporary pollsters. He cites another pollster's belief in "the not-so-silent majority of Americans who reject ideological soundness in favor of the sound center" and goes on to discuss the problem of pollsters who try to craft tactics (and maybe strategy) without any endgame greater than...well, put simply, winning. Fair enough. But I don't think that a belief that most Americans are not strongly ideological or in search of ideological purity diminishes the role of ideas. I'm an enormous fan of Dr. Morris Fiorina's work in Culture War?: The Myth of a Polarized Electorate where he explores just how large the Big Middle is. And from what I've seen in research I've been a part of, Americans rarely see ideology as the endgame. Americans want outcomes.

My mentor in survey research, David Winston, often says that ideology itself is like a screwdriver. By itself, it's just a screwdriver. Its worth comes from what it can be used for, what outcomes it can create (building a swing set, etc.). I'd venture that the electorate is full of more Americans who are looking for outcomes than processes. And thus the existence of a "big middle" doesn't necessarily mean polling should become focused on the little tactics or the dumbing down of politics. Quite the opposite.

I'd be interested in the comments of the other participants in this forum on the question - to what extent does the size of the "big middle" in American politics help or hinder the ability for politicians to pursue the big ideas?


Dispatches: Greenberg's Response to Lombardo


This guest pollster contribution from Stan Greenberg is part of Pollster.com's week-long series on his new book, Dispatches from the War Room. Greenberg is chairman and CEO of Greenberg Quinlan Rosner.

I think Steve Lombardo makes an important point.  Some elections and some periods invite big choices and political projects, while many do not.  When I raised the issue, I was not so much suggesting what is the best choice in a particular campaign.  Obviously, you will do what works and use the opportunity of the moment to win.  But I was making a self-reflective judgment about my work over a number of decades, and the parallel emergence of polling that was self-consciously tactical, some ideologically centered and some post-ideological.  There is evidence cited in the book that more recent generations of political consultants (p. 423) give greater weight to the thrill of the contest rather than partisan or ideological goals, compared to earlier generations.  I don't think that was just a consequence of diminishing issues in the late 1990s -- as many of them advanced this approach earlier -- e.g., the 1996 Clinton campaign -- and later.

I do think any campaign -- even ones in less tumultuous times and a lower place in the ticket -- will seek to pose a choice that draws on the issue and partisan environment, the candidate's goals and project, and that poses a defining choice with the opponent.  That is strategic and possibly purposeful, regardless of how small bore.  But collectively, pollsters and political consultants elevate the political discourse in the country as they are part of that process.  But where they are opportunistically jumping on tactics or "swing groups" detached from that kind of process, they may well be diminishing the quality of political discourse.


Dispatches: Can Pollsters Influence Policy by Determining Whose Voices Are Heard?


This post is part of Pollster.com's week-long series on Stan Greenberg's new book, Dispatches from the War Room.

I've enjoyed reading through Greenberg's thought-provoking book over the last several days. The exercise has led me to think not just about the relationship between pollsters and their clients, but also about the role of pollsters and political consultants in our democratic system. Greenberg makes an interesting case that pollsters play an integral role in helping to link elected officials to those they govern, and his argument is convincing.

Dispatches.jpg

In his lead-off post on Tuesday, Mark referred to V.O. Key's famous definition of public opinion. The quote was familiar for me (and many others, I'm sure) as I use it as a point of departure for my PhD course on political behavior. Key described public opinion as "those opinions held by private citizens which governments find it prudent to heed." I've added the emphasis to the second part of the sentence because I think it is crucial. For Key, "opinions held by private citizens" do not, on their own, rise to the level of public opinion. Rather, only those opinions that capture the attention of political elites can be classified as public opinion. But which attitudes are these? Or, perhaps more to the point, whose attitudes are these?

Greenberg points out in his book that he initially gained notoriety by reporting on his study of white union members in Michigan (p. 19-20). The report caused a "storm" and led to a lot of focus in Democratic circles about how to win back the so-called "Reagan Democrats." The DLC hired Greenberg to gain more insight into how to win over this group and much of Clinton's appeal was his ability to speak to these working class whites. "Reagan Democrats" were suddenly exercising significant influence over how Democrats would campaign and, ultimately, how they would govern.

But time and resources are finite and politics is a zero-sum game. When pollsters draw politicians' attention to groups like "Reagan Democrats," other groups will necessarily get less attention and, therefore, may be less represented in government. Consider this quote from a story by Politico's Avi Zenilman just after the verdict in our most recent election:

"Unions, Hispanic groups, the Netroots, progressive organizing coalitions, single women, working women, youth, the religious left -- to name just a few -- all claim to have played a vital role in electing Barack Obama. And each says he owes them for that role."

These groups are actively lobbying for elected officials to notice their importance in the last election because they understand that being viewed in that light will lead to more influence over government. But it strikes me that pollsters may have a special role in telling their clients which of these groups have the most valid claims and should be paid special attention to.

This brings me back to how influential the role of a pollster can be during the time between elections. At the end of the book, Greenberg notes that he was always careful to limit his role to reporting on public opinion and avoided devising policy prescriptions (as Clinton himself said, "he wouldn't tell me what to do"). This suggests a relatively innocuous role for a pollster--one that is merely informational. However, if pollsters play a key role in identifying particular groups--"swing voters" or otherwise--that politicians should be particularly concerned with, then doesn't their role become far more influential? After all, the voters that politicians think they need to appeal to will likely have a major influence on the types of policies those politicians promote. By choosing to shine the spotlight on some groups, don't pollsters (and ultimately their clients) leave other groups in the dark?

So I'm interested in hearing the extent to which Greenberg thinks that his role as a pollster was influential simply by identifying some groups as "swing voters" but not others. There are so many different ways to slice and dice the public to identify the next influential group (whether it be "Reagan Democrats" or "married mums"); does Greenberg see any groups who were largely overlooked by government because they never rose to "swing voter" status? And if he was going to go back out into the country now, as he did after the 1984 election, and focus attention on a particular group of citizens, which group does he think would be most deserving of his attention?


Dispatches: "Politics of Purpose" vs. "Tactics?"


This post is part of Pollster.com's week-long series on Stan Greenberg's new book, Dispatches from the War Room.

I find the whole debate between the "politics of purpose" versus "tactics" to be a pretty silly one. There are several strategic factors that will drive a campaign to be about either big or small things, including the overall mood of the public, the ideological perspective of the candidate (or lack thereof), the distinctions between the two parities on key issues (or lack thereof) and the political skills of the candidate. Ideally, you want to have an election over big philosophical differences in which you can highlight your candidate in a favorable light. I applaud Stan for wanting to be involved with politicians and campaigns that are about watershed issues and seminal ideas but the reality is that most are not.

The fact that pollsters like Dick Morris (and many, many others) moved to tactics during a time when there were few big issues is not only unsurprising but probably the right thing to do. During much of the 1990s there were few perceptible ideological or issue differences between the two parties and pollsters had to look "micro." This, of course, changed around 2005 and had become a chasm by 2008, and just about everyone--with the possible exception of Mark Penn--realized it.

Update: Greenberg responds here. Follow the complete series here.


Dispatches: Warning Signs for Obama?


[This post is part of Pollster.com's week-long series on Stan Greenberg's new book, Dispatches from the War Room].

First, a quick status report: At least two and possibly three of my colleagues here at Pollster are working up posts on the Greenberg book today, but as they do have day jobs it looks like most will not post until sometime this evening (East Coast time).   

Second, I want to add one thought to my introductory post yesterday in response to the comment from reader "Moderate2008." I am not arguing that a pollster's job is to "make public policy." My point is that public opinion will ultimately limit or control the extent to which policy makers can affect change and achieve their goals, and a wise wonk will want to study public opinion -- both as it exists now and where political leaders can move it in the future. In that sense I agree with Moderate2008 that a pollster's primary job is to analyze the data "with competence and without bias," leaving policy makers in a better position to achieve their goals. I  will let Greenberg speak for himself on this, but my sense from from Dispatches is that he agrees.

Dispatches.jpg

Third, since I still have the floor, let me throw another question Stan's way (on a subject that at least one of my Pollster colleagues may probe more specifically later tonight):

One of the lessons Stan reports from his experience electing Clinton, Mandela, Blair, Barak and Sanchez de Lozada is that the "sense of triumph on election day almost always obscured political weakness." Examples include Clinton winning with only 43% of the vote, Sanchez de Lozada with only 23%, Barak having to cobble together a majority government that "failed to provide a working majority for any part of his agenda," Blair's Labor government taking the reigns with "no experience running anything," and so on.

Question is, looking forward, do you have any warnings for Democrats about any political weakness obscured by the headiness of Barack Obama's victory?'

PS: Yesterday I neglected to remind readers of my prior relationship with the author. I worked from 1990 to 1991 at Stan Greenberg's company -- then known Greenberg-Lake: The Analysis Group -- as a senior analyst to his then partner Celinda Lake. By chance, I left the company on the very day he announced that he would be working for Bill Clinton in 1992. In other words, I left just as the heart of the story told in Dispatches begins.



Dispatches: Greenberg's Response to Blumenthal


Today's guest pollster contribution comes from Stan Greenberg, chairman and CEO of Greenberg Quinlan Rosner. He will be discussing his new book, Dispatches from the War Room all week on Pollster.com.

I very much appreciate Pollster.com hosting this discussion of the book and Mark's introductory note that raises central issues.

Let me underline one point that is at the heart of the book and then address the two key questions raised by Mark.

I started the book with columnist Joe Klein's assertion that the polling-media industrial complex diminishes politics, leaders; it makes them less bold and more risk averse. I wasn't sure he wasn't right, if you can excuse the double negative.

And as you can see, I'm pretty critical of trends in polling and critical of some of my own choices, which we can discuss.

But, I come out of this believing that strong political leaders build a special bond with people, rather than flying in the face of it. Strong leadership is not defying the public, but engaging with it -- using support to get things done; mobilizing the public, educating the public on challenges and goals and working to shift opinion. I look at the example of Lincoln and Franklin Roosevelt who were both intensely solicitous of public opinion. Engaging with the public was a precondition for boldness. That contrasts with Bush and Cheney who thought they were strong because they pursued bold policies, never guided by polls and focus groups, but I think we can look now at the consequences. President Obama's special bond with people is part of his leadership but he will struggle like these leaders to keep people with him and enhance his chances of success. That makes for stronger and more democratic leadership and produce greater civic engagement. I'm not making a partisan point -- only the case for strong leadership that is solicitous of public opinion.

Mark raised two issues.

First was tactics. Yes, all campaigns are tactical but divorced from a political project, it becomes just a game and our techniques risk diminishing politics, as Klein suggested.

Example. Reassurance. Bill Clinton reassured voters by his commitment to "end welfare as we know it," support for death penalty, and commitment to cut middle class taxes. That is tactical. But with voters more comfortable about Clinton's values and how he would use government, they now were much more supportive of his bigger agenda for investing to create sustainable growth, investing in people and education, and allowing all to have health insurance. The reassurance built support for the main project, thus a strategy.

Tony Blair reassured by promising not to raise taxes and to not increase the budget over the next two years -- and that allowed voters to support him so that would invest in public services, particularly health care and education.

But when Dick Morris advised President Clinton, he relished "stealing" the Republicans' issues -- like welfare reform -- to make the Republicans irrelevant, not to advance Clinton's larger vision. Here it becomes a game and diminishes politics.

And then there is Jerusalem. My conclusion from that is that pollsters need to be unbelievably careful about assuming current attitudes are static or can't be changed. Political pollsters should not be focused on depicting current thinking, but instead, on searching for the underlying dynamism. Even strongly, deeply emotional positions can give way -- if leaders with authority in certain areas are committed their educative roles.

Remember, we also said in Bolivia that proceeding with the export of natural gas would lead to violent opposition and that voter opinions could not be moved on this deeply emotional issue. The president there was determined to make this bold move and ultimately was forced from office, as violence grew in the country.

So, Jerusalem is a lesson but so is La Paz.

[Follow the complete series here]
.


Greenberg's Dispatches from the War Room


About a week ago, Armando Lorens took me to task, in part, for looking at how the ongoing economic stimulus debate might affect Barack Obama's job approval rating. The time for a "polling argument," he wrote, is not now but "as elections approach, when results [of policy] are evaluated." Too many people like me, he added "can not see past the day to day gyrations of the polling trees and miss the policy (and eventually, political) forest."

Dispatches.jpg

His argument is one of the more popular critiques of public opinion polling. Polls are interesting just before elections, but should stay far away from policy. Leaders should make policy without regard to the whims of public opinion, or so the argument goes, crafting the best policy, ignoring and polls and letting the results speak for themselves at the next election. "Good policy is good politics."

The problem with the argument is that elected officials, like the rest of us, tend to be self-interested. They want to win the next election. Moreover, in constitutional governments, leaders must win support from legislatures or hold together parliamentary majorities. So whether we like it or not, public opinion -- or perhaps more accurately, the way leaders perceive public opinion -- ultimately acts as a control on policy options. Consider the way V.O. Key, one of the most influential political scientists of the last century, defined the term "public opinion," in his 1961 book, Public Opinion and American Democracy (as cited by Donald R. Kinder in The Handbook of Social Psychology , p. 780):

[T]hose opinions held by private citizens which governments find it prudent to heed. Governments may be compelled toward action or inaction by such opinion; in other instances they may ignore it, perhaps at their peril; they may attempt to alter it, or they may divert and pacify it.

That conflict is in many ways the central theme of Stan Greenberg's new memoir Dispatches from the War Room, which serves as an extended history of how five leaders -- Bill Clinton, Nelson Mandela, Tony Blair, Ehud Barak and Gonzalo "Goni" Sanchez de Lozado -- navigated the waters of public opinion in their campaigns and in government.

Dispatches is different from typical pollster books, which tend toward analyses of their data, prescriptions for how "our side can win," thinly veiled efforts to market their services, or some combination of these. Dispatches is most memorable for Greenberg's effort to convey the human side of his role: What it was like, for example, to attain the pinnacle of professional success in helping Bill Clinton win the White House in 1992 only to be fired two years later, replaced by Dick Morris and Mark Penn. What was it like to play a similar role to Tony Blair in 1997 and 2001, only to be shunted aside (again for Penn at the urging, he says, of Bill and Hillary Clinton) in 2005?

The new book will be our focus this week as Greenberg himself joins in for an extended dialogue that will include the other contributors to this site and, of course, your comments. It should be interesting.

To kick it off, I want to start with Greenberg's thesis that all five leaders pursued a "politics of purpose" for which public support was essential. Each of these leaders, he writes, "deserve our respect precisely because they are consumed with people and popular support." Each had a political "project," a mission beyond their own electoral success, and close attention to public opinion was critical to the success at that project.

Each used polling to determine if the people were with them, increasing the prospects for actually doing what they set out to do. And as they drove forward on the mission, they used polling to look back over their shoulder to see of the populace was following, if the battalions were marching with them. They were consumed with keeping or building support for the mission, particularly at the time of key legislative or parliamentary battles and as they faced the looming judgement of the voters in reelection (p. 403).

In addition to this defense of the work that pollsters do, Greenberg's lessons include some tough critiques. I want to ask about two of them.

First, he wonders whether the "politics of purpose" is giving way to "mere tactics...a focus on the game, the tactics and winning outside of the idea of a political, partisan, or ideological project." He provides as examples, the work of political consultants like Frank Luntz and Dick Morris, whose "whole premise" is "the 'end of ideology' -- the end of big political projects, big issues, or strong party affinities -- as the new reality."

My question: Isn't the politics of "mere tactics" always part of the process at some level? My experience is that all politicians are a mix of ambitions to accomplish something and be something. In some, however, the desire to hold and maintain public office is paramount, and they are often the most likely to chase any tactic or policy that serves that end. Those actors are always present -- in campaigns, legislatures and executive offices -- and to the extent that they hold power, their motives must be considered by nobler colleagues chasing bigger accomplishments. Moreover, as Greenberg explains, even the heros of this book sometimes resort to "mere tactics" to secure reelection. After all, both Clinton and Blair turned to Penn, whose pursuit of "soccer moms" and "married mums" (respectively) define the sort of tactical politics that Greenberg condemns.

Second, the most candid observation from the book concerns Greenberg's admission that his focus groups and polls mislead him on the question of whether Israeli voters would ever accept a division of Jerusalem. At first, two-thirds of voters in his surveys said "it was unacceptable to have a Palestinian state with its capital in East Jerusalem." When Greenberg "saw no movement" when he presented arguments for the division in surveys, and voters "nearly cried" in focus groups, insisting that dividing Jerusalem would be "like taking away your beloved child." Greenberg advised his client that such a policy was a "dead end."

Yet four weeks after Ehud Barak put that option on the bargaining table at Camp David, despite a negative approval rating and strong opposition in parliament, a majority of Israelis were ready to "go with him" on Jerusalem in Greenberg's polling. Thus Greenberg raises a critical question:

If I cannot believe what people tell me is unacceptable in my surveys on Jerusalem, then what of my findings on other subjects? Why can't a determined leader change these too?

Perhaps the lesson is that pollsters should never say never. We learn that lesson with regard to "statistical significance" and sampling error (which is always about probabilities). Why not extend that idea to the more complex issues of measurement and interpretation: ,We are never absolutely certain of anything. The best we can do is sort out the relative difficulties of persuasion. On some issues, voters are open and easily moved. On other issues, only leaders with exceptional "bully pulpits" acting in truly extraordinary circumstances will change minds. Barak knew that his choice involved enormous risks, but he made it anyway. Obviously, Greenberg regrets his "dead end" advice, but otherwise, he advised Barak correctly that a divided Jerusalem would be the biggest obstacle to public acceptance of an accord in Israel. Isn't that what Barak was paying him for?

This last issue is in many ways the most important question raised by Greenberg's new book. What is your answer?

Update: Greenberg responds here. Follow the complete series here. Also, interest disclosed: I worked from 1990 to 1991 at Stan Greenberg's company -- then known Greenberg-Lake: The Analysis Group -- as a senior analyst to his then partner Celinda Lake.  By chance, my last day at the company was the same day he announced he would be working for Bill Clinton in 1992.


 

MAP - US, AL, AK, AZ, AR, CA, CO, CT, DE, FL, GA, HI, ID, IL, IN, IA, KS, KY, LA, ME, MD, MA, MI, MN, MS, MO, MT, NE, NV, NH, NJ, NM, NY, NC, ND, OH, OK, OR, PA, RI, SC, SD, TN, TX, UT, VT, VA, WA, WV, WI, WY, PR