By Dan Kennedy • The press, politics, technology, culture and other passions

Tag: Nate Silver

Say it again: Bad data, not bad reporting, is what led to media failures in 2016

Photo (cc) 2005 by stu_spivack

This drives me crazy. In a New York Times review of Katy Tur’s new memoir, “Rough Draft,” Joanna Coles writes about Tur’s coverage of the 2016 presidential campaign:

Tur, then in her early 30s, spent 510 exhausting days on the road for NBC News pursuing Trump and quickly realized — contrary to the opinion of her newsroom and the assumptions of the mainstream media — that he absolutely could win.

I’m sorry, but the idea that the media failed because they were hermetically sealed in their blue bicoastal bubbles — and that intrepid reporters like Tur were more in touch with what was happening — is perniciously wrong. It’s a myth that’s led to hundreds if not thousands of stories about Donald Trump voters in diners (do yourself a favor and read this), grounded in the false belief that if only journalists had been listening to working-class white voters in swing states they wouldn’t have been quite so secure in their belief that Hillary Clinton was going to win.

In fact, those predictions that Clinton would easily beat Trump were based not on smug assumptions or a lack of reporting. They were based on data. Poll after poll, conducted by smart, experienced pollsters, showed that Trump had no chance. The polls were off, but not by as much as we think. After all, Clinton did win the popular vote by nearly 3 million. In percentage terms, Trump (46.1%) didn’t even do as well as Mitt Romney (47.2%) four years earlier. It’s just that Clinton piled up her margin in the wrong states, allowing Trump to eke out a tiny Electoral College victory. It’s a problem that’s only going to get worse unless we make some long-overdue changes to the Constitution, as I wrote recently.

My point is not to relitigate the 2016 election. Rather, it’s to remind us of why the media got it wrong. This is a big country. For every enthusiastic Trump rally, there were others with scores of empty seats. For every flat Clinton appearance, there were those where she and the crowd were energized. Anecdotal evidence, no matter how much of it you accumulate, is of limited value. The media didn’t blow it because they weren’t listening to Trumpers. They blew it because they believed the data. Ask yourself this: If those Nate Silver-style projections showed Trump, rather than Clinton, with a 70% chance of victory, do you think the press would have ignored that? Of course not.

Then again, why is media failure defined by getting predictions wrong? Democracy would have been better served if the press had spent more time simply covering the campaign and less time trying to figure out who was going to win.

By the way, Tur sounds like a pretty amazing person as well as a fine reporter.

No surprises, really. So why do the early election returns feel like a punch to the gut?

Photo (cc) 2008 by H2Woah!

Previously published at GBH News.

Four years ago I was watching CNN as John King poked and prodded an interactive map of Florida while Wolf Blitzer looked on. King was explaining why the state was likely to go for Hillary Clinton. And then it happened — the map flipped red. Donald Trump was on his way to victory in Florida and to a narrow Electoral College win nationwide.

So it was with a deep sense of foreboding Tuesday night as I watched King and Blitzer pore over the same map. The early lead Joe Biden had built up over President Trump in that state was beginning to fade. And sure enough, Trump moved ahead in Florida while the two were talking, just as he had in 2016.

But this is not 2016. As I write this, in the early-morning hours on Wednesday following a sleepless night, the race has not yet been decided. The headline on The New York Times home page reads “Election Turns Into Nail-Biter That May Extend for Days.” Moments after I crawled out of bed and turned on the TV, a lead that Trump had maintained in Wisconsin all night suddenly went Biden’s way. The election could go in either direction, and Biden is still very much in the running.

Among those of us who are appalled by Trump, the sickening feeling we experienced last night was based entirely on Biden’s inability to break through in solidly red states that had seemed to be within his grasp. Texas was never ridin’ with Biden. Nor was Florida — not quite an all-red state, but one that has been trending increasingly Republican in recent years, a trend that has been boosted by voter suppression. Nor was Georgia (or so I thought; at the moment it’s actually trending toward Biden).

In fact, if you strip away the fantasies of a Biden landslide, the map looks very much like what we had expected, with the race coming down to the industrial states of Pennsylvania, Michigan and Wisconsin.

Last night it struck me that the only real surprise was there hadn’t been any surprises. So I was reassured to see Boston College History Professor Heather Cox Richardson confirm that judgment. In her daily newsletter, “Letters from an American,” she wrote, “Tonight, we wait, as returns from this year’s election are about what we expected. … This is the scenario we all foresaw.”

As Cox and others have pointed out, the reason that the mail-in votes are taking so long to tally in Pennsylvania, Michigan and Wisconsin is that Republicans fought tooth and nail to prevent them from being counted before the polls closed. As the liberal economist Dean Baker put it, Republican complaints about the slow pace “is pretty thick hypocrisy even for Republicans.”

This is also the moment when Trump, cornered and desperate, will be at his most dangerous. Trump is attempting to capitalize, railing against the media in a middle-of-the-night speech and — as we all knew he would — falsely claiming that he’s won and threatening to take the election to the Supreme Court on some unspecified grounds.

“This is an extremely flammable situation, and the president just threw a match into it,” Fox News Anchor Chris Wallace told viewers.

In the hours and days ahead, the media must exercise all the discipline it can muster and keep reminding viewers, listeners and readers that the election isn’t over until all the ballots have been counted. We all know what happened this year — about 100 million ballots were cast early, many by mail, because of the COVID pandemic, and that has created delays and confusion. Republican leaders need to speak up for a fair election as well, but I’ve pretty much given up any hope that they’ll do the right thing.

A couple of other points.

First, Democrats must be shocked to see Hispanic voters shifting toward the Republicans. As The Texas Tribune reported, “Even as Biden performed well in large suburban counties that used to be reliably Republican, he failed to notch wide margins of victory in some critical Democratic strongholds, massively underperforming Hillary Clinton in the mostly Hispanic Rio Grande Valley. For example, Trump was leading in unofficial results in Zapata County — where Clinton won with 66% of the vote in 2016.”

Noting there were also signs that Black voters were not as monolithically with Biden as had been expected, the conservative pundit Byron York said on Fox News: “This is something the Republican Party has been trying to do for a long time.”

And yet Trump has shown in word and deed that he’s a racist, going all the way back to his earliest days as a real-estate developer. As the Black Lives Matter activist DeRay Mckesson tweeted, “No matter what happens tonight, we will have to reckon with the millions of people who chose Trump after seeing his racism, bigotry, and xenophobia over the past 4 years.” Democrats have some serious soul-searching to do as to why that’s the case.

Second, although it’s too early to pass judgment given that millions of mail-in ballots have not yet been counted, it may be that the long-predicted polling apocalypse is upon us. A lot of observers said that four years ago, too, but the polls then really weren’t that bad. Clinton’s victory in the popular vote was within the margin of error, and Trump barely squeaked by in the Electoral College.

This time, though, it feels different — although, if you look at the final RealClearPolitics polls of battleground states, it may turn out that the numbers aren’t that far off. Even so, it wasn’t supposed to be this hard, and hopes that the Democrats would take back the Senate appear to be hanging by a thread. The wildly optimistic forecasts published by polling analysts like Nate Silver of FiveThirtyEight (see this and this) are a separate problem, and too complex to be dealt with at the moment.

For those of us who believe that Trump is a would-be authoritarian who poses a threat to American democracy, the results so far have been shocking. But we need to get out of our bubble. It looks like Biden may have just barely accomplished what he needed to do to win, which was all we could have realistically expected. He’ll win the popular vote by a lot. The Electoral College, on the other hand, is increasingly becoming a bulwark of Republican minority rule. A huge Biden win was probably never in the cards.

In the hours and days ahead, it’s important that all of us — not just Biden supporters, but Trump supporters as well — stay calm and wait for the final result to become clear.

Talk about this post on Facebook.

Ezra Klein and the problem with top-down control

Ezra Klein

Ezra Klein

This commentary was published earlier at the Nieman Journalism Lab.

What should a 21st-century news organization look like? A single entity, run from the top, with a common set of values? Or a loose network of related projects, sharing a brand and to some extent a mission but operating semi-independently?

With the likely departure of Ezra Klein from The Washington Post, the management of one of our last great newspapers might be showing signs of preferring the former approach. Klein, who founded and runs the widely read Wonkblog at washingtonpost.com, is reportedly leaving for a new venture, as yet undefined. According to Ravi Somaiya in The New York Times, Klein sought an eight-figure Post investment in the new project. Klein already has his own Wonkblog staff, but clearly he has something much bigger in mind — perhaps an all-purpose independent news organization along the lines of Talking Points Memo. (Although it wouldn’t be called Wonkblog — the Post owns the name and will be keeping it, writes The Huffington Post’s Michael Calderone, who broke the news about Klein’s proposal last month.)

We can’t know everything that went into the decision. Maybe it came down to money. But Wonkblog generates a hefty amount of Web traffic — more than 4 million page views a month, according to a profile of Klein in The New Republic last February. “It’s ‘fuck you traffic,’” a Post source told TNR’s Julia Ioffe. “He’s always had enough traffic to end any argument with the senior editors.” Apparently, that’s no longer the case.

Significantly, the Times reports that new Post owner Jeff Bezos was involved in the decision to let Klein leave. Last September, shortly after announcing his intention to buy the Post for $250 million, the Amazon.com founder lauded the “daily ritual” of reading the morning paper — which led to some chiding by one of the Post’s own journalists, Timothy B. Lee. Despite Bezos’ well-earned reputation as a clear-eyed digital visionary, he appears to have some romantic notions about the business he’s bought into. And allowing entrepreneurs such as the twentysomething Klein run his own shop inside the Post might not fit with that vision.

What makes the likely Klein departure even more significant is that in 2006 the Post, under the ownership of the Graham family, allowed John Harris and Jim VandeHei to walk out the door and start Politico. Now, I have a lot of problems with Politico’s gossipy “drive the day” approach. But as Times columnist Ross Douthat has observed, much of the media conversation about Washington politics has shifted from the Post to Politico, threatening one of the Post’s franchises. It would have been enormously beneficial to the Post if Politico had been launched under its own umbrella. And Politico itself might be better.

So if the Post is reluctant to loosen the reins, are there any other news organizations that are taking a different approach? Walt Mossberg and Kara Swisher walked away from their AllThingsD site at The Wall Street Journal and set up a new project called Re/code in partnership with NBC. Perhaps the most famous example is Nate Silver, who brought his FiveThirtyEight poll-analysis site to The New York Times a few years ago and then moved it lock, stock and barrel to ESPN. In that regard, I suppose you could say NBC and ESPN have embraced the network approach. To some extent you might say also that of The Huffington Post, as it combines professional journalists, unpaid bloggers (I’m one) and a dizzying array content — from Calderone’s excellent media coverage to the notorious Sideboob vertical.

Jeff Jarvis recently argued that Patch — AOL’s incredibly shrinking hyperlocal news project — might have stood a chance if AOL chief executive Tim Armstrong had taken a network approach. Rather than running cookie-cutter community sites from the top down, Jarvis asked, what if Patch had offered advertising and support services to a network of independent or semi-independent sites?

The problem with such scenarios is that media executives — and business leaders in general — are not accustomed to the idea of giving up control. Calderone reports that some Post staffers have long grumbled at what they see as “preferential treatment” for Klein, which suggests the depth of the problem. But entrepreneurial journalists like Harris and VandeHei, like Mossberg and Swisher, and like Silver and Klein have a proven track record.

Legacy news organizations need to find a way to tap into that success outside the old models of ownership and not worry about obsolete notions of employer-employee relationships. Reach and influence are what matter. And they are proving to be incompatible with the ambitions of young journalists like Ezra Klein.

More: After this piece was published at Nieman, Mathew Ingram responded at Gigaom with his own smart take.

Tierney, Tisei and a defense of party-line voting

John Tierney

We all live in Nate Silver’s world, so there were no real surprises on Election Day. Except one: Republican congressional candidate Richard Tisei’s failure to topple U.S. Rep. John Tierney, a Salem Democrat who was up to his neck in family trouble.

I was stunned that Tierney had prevailed. So, apparently, was Tisei, who was confident enough of victory to run a non-ad ad toward the end of the campaign showing nothing but a tranquil seascape. “That was lovely, but ultimately a waste of money,” writes Marjorie Arons-Barron. “Better he told voters why in a Republican-held Congress he could do more for them.”

Maybe better he didn’t.

As for whether Libertarian Party candidate Dan Fishman cost Tisei the election, I agree with Arons-Barron that Fishman probably drew a lot of support from Democrats who were turned off by the ethics cloud enveloping Tierney and who otherwise would have blanked it.

So what happened? Clearly Tierney benefitted from a party-line vote. You will find a lot of people who think that’s mindless. I think it’s pretty smart.

The culture on Capitol Hill these days does not encourage independence. Tisei, whom I first met in the 1980s when I was a reporter for The Daily Times Chronicle of Woburn, is a great guy and a true moderate, despite Democratic efforts to tag him as a tea party ally. But if he’d been elected, his first act would have been to vote for John Boehner as speaker. And you can be sure he would have voted with the Republican House majority most of the time on the issues that really matter — principally taxes and spending.

Tierney, who lacks Tisei’s personal warmth, has nevertheless been a reliable ally of the Democratic House minority. He voted for the Affordable Care Act, which Tisei said he opposed, even though as a state senator he supported Gov. Mitt Romney’s nearly identical Massachusetts version. And Tierney is a traditional Democrat when it comes to taxing the wealthy and preserving the social safety net. Those are values that voters in Massachusetts and across the country upheld this week.

It should also not go unmentioned that Tierney himself has not been credibly tied to his in-laws’ illegal gambling activities, even though his wife, Patrice Tierney, served a month in prison for her role. (I think the tale of Tierney and his in-laws is sufficiently convoluted to warrant the triple negative.)

People should vote their values and their interests. In the case of Tierney and Tisei, that’s what they did this week.

Photo (cc) by the Center for American Progress and republished under a Creative Commons license. Some rights reserved.

Not fat, not a lady, but Nate Silver is singing

This may be the last polling analysis of the Massachusetts Senate race worth paying attention to before the voting starts tomorrow. According to Nate Silver, Republican candidate Scott Brown now has a 74 percent chance of winning. As recently as last night, Silver very tentatively gave Democrat Martha Coakley a 58 percent chance.

What happened? A series of polls throughout today that just got worse and worse for Coakley. Silver explains:

Coakley’s odds are substantially worse than they appeared to be 24 hours ago, when there were fewer credible polls to evaluate and there appeared to be some chance that her numbers were bottoming out and perhaps reversing. However, the ARG and Research 2000 polls both show clear and recent trends against her. Indeed the model, which was optimized for regular rather than special elections, may be too slow to incorporate new information and may understate the magnitude of the trend toward Brown.

What I like about Silver is that he’s not a pollster — rather, he’s someone who looks at a wide range of polls and makes sense of them. His record in the presidential campaign was outstanding.

This is very bad news for the Coakley campaign.

All politics is (still) local

As the late Tip O’Neill was fond of saying, all politics is local. The idea that Republican victories in New Jersey and Virginia amount to some sort of repudiation of President Obama is just as silly as the notion that Obama’s endorsement was a key to Democratic victory in a congressional race in upstate New York.

Yet your media are going to spin it as a referendum on Obama. And, mostly, they’re going to ignore New York so they can advance a simplistic — and wrong — script. Indeed, the lead headline on the Web site of the rapidly deteriorating Washington Post this morning proclaims, “A warning to Democrats: It’s not 2008 anymore.” (The actual analysis, by Dan Balz, is more nuanced than that.)

Polling analyst extraordinaire Nate Silver explains all. But his take on Democratic Gov. Jon Corzine’s defeat in New Jersey, I think, is especially worth noting:

Obama approval was actually pretty strong in New Jersey, at 57 percent, but 27 percent of those who approved of Obama nevertheless voted for someone other than Corzine. This one really does appear to be mostly about Corzine being an unappealing candidate, as the Democrats look like they’ll lose just one or two seats in the state legislature in Trenton.

Keep in mind that we’re going to be dealing with the same situation in Massachusetts next year. Democratic Gov. Deval Patrick is unpopular at the moment, and if his numbers remain low, it’s possible that he won’t be re-elected.

If Patrick loses, the national media will dutifully explain that we repudiated Obama. But those of us who live in Massachusetts will know better.

Powered by WordPress & Theme by Anders Norén