« How Things Change | Main | The Calm After The Storm »

February 26, 2009

Oscar Prediction Sausage

NP: John Cage, 4'33"

Nate Silver does a post-mortem on his Academy Award predictions. If you're into data analysis, this is by far my favorite bit:

Whenever we make an incorrect prediction, we are probably better off asking questions along these lines:

What, if anything, did the incorrect prediction reveal to us about the model's flaws? Was the model wrong for the wrong reasons? Or was it wrong for the right reasons? What, if any, improvements should we make to the model given these results?

Real modeling isn't entirely about being right or wrong, although that's certainly a big part of it. It's also about improving your understanding of what it is you're modeling. I think the political punditry (one of Silver's two bread-and-butter domains, along with baseball) gets really hung up on the first thing to the point where they're not attuned at all to the second.

Comments

Post a comment
Name:


Email Address:


URL:


Comments:


Remember info?



about notabbott.com

what is it?

notabbott.com is not spamming you -- please read

however, if you'd like e-mails about upcoming shows and whatnot, click here

recent entries in MAIN

A Win Is A Win
November 3, 2011

How We Got Here
October 30, 2011

The Media Vacuum, Defined
October 30, 2011

Pre-writing History
September 16, 2011

Finishing The Sentence
September 7, 2011

archives by month

credits

Creative Commons License
All content on this website (including text, photographs, audio files, and any other original works), unless otherwise noted, is licensed under a Creative Commons License.