# Why we’re happy we got one prediction wrong on Super Tuesday

On Super Tuesday, the Signal got 9 out of 10 election predictions correct, following up on an Oscar night where we got 3 of 4 award picks right. Not bad, but we really wish we didn't have those two annoying blemishes, right?

In fact, we're delighted! When the markets are functioning properly, we expect to get a certain percentage wrong every time. (The exact amount depends on how certain the probabilities are for each election on a given day; on Oscar and election nights we actutally expected to get about one wrong each.) If we had swept all 14 predictions, it would have meant our confidence was too low, or what statisticians call "miscalibrated." It sounds strange, but it's actually possible to get too many predictions right.

Think of it like rolling a six-sided Monopoly die and predicting the odds that you'll roll a one, two, three, four or five. On any given roll, you can say with high confidence—83 percent—that you will succeed. But do it 100 times, and you would expect to roll a six about 17 times. If you got your one-through-five all 100 times, there's probably something wrong with your dice.

At the Signal, we don't call up-and-down outcomes. Like a weatherperson, we assign it a likelihood or a percentage chance of happening. Our predictions range from high confidence—we felt Mitt Romney had a 98.7 percent chance to win the Virginia primary, for example—to more up-in-the-air estimates—we thought Viola Davis had a 58.1 percent chance of taking home the Best Actress Oscar. (Meryl Streep won instead, whom we had given a 39.9 percent chance.)

Over time, we should get about half of our 50-percent predictions right, three-quarters of our 75-percent predictions right, and so forth. This is an important difference in what we're trying to do at the Signal compared to the usual practice of picking outcomes outright. The only way to judge us is over time, measured over the course of several predictions. For any single prediction by itself, you can't actually say that it was right or wrong.

Perhaps this sounds defensive—"if we're wrong, it's because of the system!"—but that's the way probability works. At the same time, you absolutely should judge us over the course of weeks and months as our record of predictions grows, and we'll be sure to publish that track record for all to see.

For an example, let's look at our Super Tuesday predictions. This table shows what we were projecting as of 2:52 p.m. ET on Monday, March 5.

 Virginia: Romney 98.7% Massachusetts: Romney 99.6% Vermont: Romney 97.5% Idaho: Romney 95.7% Georgia: Gingrich 98.0% Ohio: Romney 82.6% Oklahoma: Santorum 88.6% North Dakota: Romney 72.1% Alaska: Romney 82.6% Tennessee: Santorum 57.1% total 872.5% expected number correct 8.725

To compute how many predictions we expected to get right, just add up all the percentages and then divide by 100 to convert from a percentage to a number. In this case, we expected to get 8.725 out of 10 correct.

David Pennock is a Principal Research Scientist at Yahoo! Research. Follow him on twitter @pennockd.

More popular Yahoo! News stories:

Want more? Visit The Signal blog, connect with us on Facebook, and follow us on Twitter. Handy with a camera? Join the Yahoo! News Election 2012 Flickr group to submit your photos of the campaign in action.

Sorry you didn't like this comment. Please provide a reason below.

Are you sure?
Rating failed. Try again.
Request failed. Try again.
We will promote constructive and witty comments to the top, so everyone sees them!

## Recommended for You

• ### Trump slapped with federal lawsuit in New York

A group of American lawyers on Monday filed a federal lawsuit in New York against Donald Trump, accusing the US president of violating a constitutional ban on accepting payments from foreign governments. The Citizens for Responsibility and Ethics in Washington (CREW) is pursuing Trump over his vast business holdings, from which the billionaire has refused to divest fully, saying that as president he can have no conflict of interest. CREW says Trump's business properties abroad operate based partly on goodwill from foreign governments and regulators, but that under the US Constitution no federal official can receive a gift or "emolument" from a foreign government.

AFP
• ### Wawrinka wins grudge match at Australian Open as Venus shines

Stan Wawrinka won a bad-tempered clash with Jo-Wilfried Tsonga to reach the Australian Open semi-finals as Venus Williams' late-career surge sent her soaring into the last four on Tuesday. Wawrinka and France's Tsonga, who have been at odds in the past, argued heatedly at the first-set changeover and there was no love lost as the Swiss charged to a 7-6 (7/2), 6-4, 6-3 win. It puts 2014 champion Wawrinka, 31, into his third Melbourne semi-final where he will play the ever-popular Roger Federer, his Swiss compatriot, or Mischa Zverev.

AFP
• ### What's in the Box? Social Media Goes Wild Over Tiffany's Gift Melania Trump Gave Michelle Obama

It led to an awkward exchange after Michelle Obama was unsure what to do with the gift.

Inside Edition
• ### Supreme Court sets stage for Trump switch on voter IDs

The Supreme Court on Monday morning cleared the way for the new Trump Administration to switch the government’s position – if it wishes to do so – to allow states to enforce strict photo ID requirements for America’s voters.

National Constitution Center
• ### Man convicted of 3 murders as teen kills himself in prison

CAMP HILL, Pa. (AP) — A man who broke into a classmate's home in 2007 and stabbed the teenager and his parents to death has killed himself in prison, authorities said Monday.

Associated Press
• ### Firebrand Iraq cleric warns US on Israel embassy move

Moving the US embassy in Israel from Tel Aviv to Jerusalem would be a declaration of war on Islam, influential Iraqi cleric Moqtada al-Sadr said Tuesday. "Transferring the US embassy to Jerusalem would be a public and more-explicit-than-ever declaration of war against Islam," he said in a statement. In a break with previous administrations, new US President Donald Trump has pledged to recognise Jerusalem as Israel's capital and relocate the US embassy there from Tel Aviv.

AFP
• ### Royals' Ventura killed in car crash in Dominican Republic

KANSAS CITY, Mo. (AP) — Yordano Ventura quit school as a teenager so he could begin working a construction job to help his family make ends meet, laboring day after day in the hot sun of the Dominican Republic.

Associated Press
• ### 'SNL' Writer Suspended for Controversial Tweet About Barron Trump

"The View" co-hosts discuss the boundaries involving children of presidents.

ABC News Videos
• ### Gun rights activists sue Massachusetts over assault weapons ban

Gun rights advocates have sued Massachusetts over the state's ban on assault weapons, saying that a crackdown begun last year on "copycat" assault rifles is a vague and unconstitutional violation of gun ownership rights. The group of gun owners, dealers and the state's Gun Owners Action League, who have the backing of the National Rifle Association, said the July decision by Attorney General Maura Healey banned guns that had been purchased legally in the state over the past two decades and infringed on the right to bear arms protected by the Second Amendment of the U.S. Constitution. "Massachusetts prohibits firearms it pejoratively defines as 'assault weapons,' which is a non-technical, entirely fabricated, and political term of uncertain definition and scope," the 33-page lawsuit contends.

Reuters
• ### Chelsea Clinton shuts down trolls who targeted Barron Trump

Former First Daughter Chelsea Clinton has spoken out in defence of Barron Trump, the US president's youngest son, after trolls targeted him with cruel memes online during the inauguration.  In a Facebook post Chelsea, who spent much of her teenage years in the spotlight while her dad Bill Clinton was president, said the 10-year-old "deserves the chance every child does-to be a kid".  But she also turned political: "Standing up for every kid also means opposing POTUS policies that hurt kids". Criticism of Barron's facial expressions and posture during the inauguration was widespread on social media, with people mocking him and calling him out for looking bored.  A Saturday Night Live writer even tweeted: "Barron will be this country's first homeschool shooter". The tweet was later deleted.  People on Facebook praised Chelsea for defending Barron while also expressing her political ideas:  BONUS: Donald Trump's inauguration address included a Bane quote ›

Mashable
• ### The Sig P320 is the U.S. Army's New Sidearm

The new pistol replaces the 80s vintage M9 handgun.

Popular Mechanics
• ### Severe storms hit the South (32 photos)

A powerful storm system plowed up the U.S. Eastern seaboard with torrential showers and high winds on Monday, hindering airline and rail travel, after killing at least 21 people in the South, many in mobile homes demolished by tornadoes. The storm, which unleashed deadly twisters in Mississippi and Georgia over the weekend, turned cooler as it advanced on the Northeast, where residents faced potential flooding, downed power lines and high surf late on Monday and early Tuesday, said Tim Morrin, the National Weather Service’s New York observation program leader.. Thunderstorms and tornadoes spawned by the same weather system killed 16 people on Sunday in Georgia, according to a tally by the Storm Prediction Center in Oklahoma. Four of those fatalities were confirmed, and a toddler was reported missing, in Dougherty County after a twister left a path of destruction up to a half mile wide. A trailer park was especially hard hit, and local authorities said they expected the death toll to rise. “It literally looks like God took half of the mobile home park and threw it across the street into the woods,” Dougherty County Commission Chair Chris Cohilas said at a news conference. Cohilas expressed frustration at the pace of the federal government in furnishing emergency help, calling it “disgraceful.” “I would ask President Trump to take some significant steps to cut through the red tape and get us some people on the damned ground,” he said at a news conference on Monday. Governor Nathan Deal, announcing that he extended a state emergency declaration to 16 Georgia counties, said Trump had called him on Sunday and promised he would be “ready and willing to respond” to an expected request for federal disaster relief. A tornado killed four people, three of them in mobile homes, in the southern Mississippi town of Hattiesburg on Saturday, and one person was reported killed in northern Florida when a tree toppled onto a house during a severe thunderstorm, authorities said. (Reuters) See more news-related photo galleries and follow us on Yahoo News Photo Tumblr .

Yahoo News Photo Staff
• ### Minnesota Gov. Dayton, 69, collapses during speech

ST. PAUL, Minn. (AP) — Gov. Mark Dayton collapsed while delivering his State of the State speech on Monday, striking his head on a lectern. The 69-year-old Democrat appeared to be conscious as he was helped into a back room several minutes later, and a top staffer said he walked out of the Capitol under his own power.

Associated Press
• ### Gambia's Jammeh 'allowed to keep' luxury car collection

Gambian ex-president Yahya Jammeh will be allowed to keep his collection of 13 luxury cars and fly them out to his exiled home in Equatorial Guinea, a spokesman for new president Adama Barrow said Tuesday. Barrow's spokesman confirmed to AFP an agreement had been struck to facilitate Jammeh's exit on Saturday in order to end a weeks-long impasse caused by the ex-leader's refusal to recognise Barrow's election victory. "What is very clear is that arrangements were made and the government was fully prepared and supportive of ex-president Jammeh to leave and as a result they found it is better to leave with all his properties instead of coming down and checking properties," spokesman Halifa Sallah told AFP.

AFP
• ### White House denies Trump filled front rows with supporters during CIA HQ visit

White House press secretary Sean Spicer on Monday rejected reports that President Trump’s visit to CIA headquarters during the weekend hurt his already troubled relationship with the U.S. intelligence community. On Saturday, Trump gave a freewheeling speech at the CIA while standing before a wall memorializing fallen officers. Among other comments, he ripped the media for downplaying the size of the crowd at his inauguration and boasted that most of the people in the room had voted for him.

Yahoo News
• ### 12 bodies found in Mexican tourist town: officials

A dozen bodies -- including seven that were headless and mutilated -- were discovered over the weekend in western Mexico's seaside resort of Manzanillo, apparent victims of the country's epidemic of drug violence, local officials said. It was a shocking turn of events for an area popular with American and other foreign tourists, which until now had largely been spared from the bloody drug wars wracking other parts of Mexico. Seven bodies were found early Saturday in an abandoned taxi on the road from Manzanillo to the town of Cihuatlan.

AFP
• ### 2018 BMW M4: Light Updates

This year's evolution of the M4.

Car and Driver
• ### Samsung: ‘A better, safer, and very innovative’ Galaxy Note 8 is coming

Samsung completed its Galaxy Note 7 investigation and shared the results with the world on Monday. The company also unveiled a new 8-point quality assurance plan meant to prevent battery accidents from occurring on future Galaxy phones — and one of the phones that will benefit from the new safety policies is going to be the Galaxy Note 8. Yes, Samsung confirmed that it’s making “a better, safer and very innovative Note 8” just a few days ahead of its press conference on Monday. Samsung mobile boss DJ Koh spoke to CNET on Thursday about the Galaxy Note 7 fires. But Koh also let it slip that the Galaxy Note 7 won’t be the last phablet in the Note series. "I will bring back a better, safer and very innovative Note 8," Koh actually said, which a clear confirmation that a Galaxy Note 8 is indeed in the works. Samsung may have elaborated on the “safer” part during its press event on Monday, but it’s unclear at this time what “better” and “very innovative” mean. The Galaxy Note was the first big-screen smartphone that people flocked to, making Samsung the godfather of the phablet. The phone has plenty of fans, and Samsung says that Note fans are very devoted. In fact, 4% of the potentially faulty Galaxy Note 7 units that were sold are still in use out there — though most of them can’t even be used as phones anymore thanks to software limitations that have been put in place. "We found through the investigative process, we knew there are lots and lots of loyal Note customers," Koh said. Note fans are Samsung's most loyal base of clients across all of its products, the company said. According to Samsung’s Tim Baxter, president of the company's US division, more than 10,000 Note customers signed up to stay connected to Samsung for more updates. On top of that, there’s a large base of Galaxy Note 4 and Note 5 users who want an upgrade. "They made it clear, they want a Note," Baxter said. The Galaxy Note 8 likely won't launch until sometime this fall, but in the meantime, at least we all know for certain that the phone is coming.

BGR News
• ### Trump admin backs off pledge of immediate immigration change

WASHINGTON (AP) — President Donald Trump will focus immigration enforcement efforts first on criminal immigrants in the country illegally, his administration said on Monday, offering hope to more than three-quarters of a million young immigrants protected from deportation under the Obama administration.

Associated Press
• ### Hugo Barra leaves Xiaomi, says China has ‘taken a huge toll on my life’

Smartphone startup Xiaomi began life as a peculiar beast. From within the safety of China, the company did all it could to copy every last detail of Apple's devices and marketing strategy, knowing there was precious little Apple could do to stop it. When Apple's portfolio was exhausted, Xiaomi moved on to Samsung, copying a large portion of its device lineup as well. But then, the company realized that it could only go so far selling phones in China and a handful of other markets. As growth was on track to slow substantially, Xiaomi knew that it had to work its way into other top-tier markets around the world. And so Xiaomi Global was born. The Xiaomi subsidiary has hit a few rough patches over the course of the past three-plus years, but today may be its roughest to date. On Monday, Xiaomi Global VP Hugo Barra announced that he is leaving the company. In a post on Facebook, Barra confirmed that he is leaving the company and moving back to Silicon Valley. "When Lei Jun and Bin Lin came to me nearly four years ago with the opportunity to help turn a young rockstar startup into a global player, I embarked on what has been the greatest and most challenging adventure of my life," Barra wrote . "I moved to Beijing, 6,500 miles out of my comfort zone in Silicon Valley, to build from scratch a startup team within a bigger startup. This journey has been nothing short of spectacular in every way, and I can proudly say that Xiaomi Global is the first baby I helped bring into the world." Then, his post took a curious turn. "But what I've realized is that the last few years of living in such a singular environment have taken a huge toll on my life and started affecting my health," Barra said. "My friends, what I consider to be my home, and my life are back in Silicon Valley, which is also much closer to my family. Seeing how much I've left behind these past few years, it is clear to me that the time has come to return." It's unclear exactly what Barra means when he says that working at Xiaomi in Beijing has "taken a huge toll" on his life and affected his health, but he goes on to run down some of the things Xiaomi Global has accomplished since he joined the company. Most notably, the company has expanded sales into Russia, Mexico, Malaysia and more than 20 additional markets. Of note, Barra will still play a role at Xiaomi moving forward. Mi president and cofounder Bin Lin confirmed in a post on Facebook that Barra will be an advisor to the company following his departure. "When Hugo joined us 3.5 years ago, we started an amazing adventure to turn Xiaomi into a global player," Lin wrote . "We have come a long way since, and I couldn’t thank him enough for contributing so much to Xiaomi’s journey. As much as we would love to have Hugo stay with us in Beijing for a much longer time, we understand his personal challenges and wish him all the best in his future endeavors. I’m also looking forward to working closely with him in his new role as advisor to Xiaomi."

BGR News