Math you do as a Republican to make yourself feel better

The headline right there was my favorite quote of the whole election cycle.

I got a special request from a coworker of my father’s who suggested to him that I should wade in to the murky water of the gerrymandering controversy.  There’s a lot of data being thrown around*, but here’s the gist:
Some Democrats are claiming that the Obama victory and the victory in the Senate have given the Dems a mandate….basically claiming that the country agrees with their policies and they should push forward with them no matter how much resistance from the other side.  Resistance is considered irrelevant, because the people didn’t vote their opposition in.  Some Republicans on the other hand point to their victory in the House to say that actually they have the mandate, or at the very least that Obama/Dems do not have any sort of consensus.  The Dems counterpoint is that the Republicans only kept the house because of clever gerrymandering (redistricting) they orchestrated in 2010.  Thus, the Democrat mandate is even stronger than it appears because the Republicans cheated to get theirs.  
So, was it all chicanery?  How do we assess election and gerrymandering data?
Well, the first step is to look at the popular vote.  I couldn’t find any updates, but as of Nov 9th, the Democrats got more votes for their house candidates than the Republicans did (by a very small margin).  
However, this may or may not mean much.  
State politics are a funny thing.  In many states, people run unopposed, or with only token opposition.   It’s hard to count popular vote when many races are foregone conclusions.  Additionally, on the state level I’d wager people are more likely to vote for incumbents, if only for the extra power they believe it gives them to have more senior congressional members representing them.  Adding to the difficulty of interpreting the numbers is California’s new system of doing run off races….so we can’t presume that all house seats were decided in Rep vs Dem contests.  
Alright, so where does that leave us?  
Ultimately, we have to cut through the mess and ask ourselves what a fairer system would be, and what the results would have been under said fairer system would have been.  This blog post over at ballotlines does that quite nicely.  The short version is this: even if the House seats were broken down based on popular vote by state, the Republicans would have kept the majority, though not by as wide a margin.  
Another interesting take is here at the Monkey Cage blog, which revisits the 2008 district map, and shows the Republicans still winning the house, though again by a smaller margin.
So Dad, you were right, gerrymandering likely does NOT explain the house win, though it does seem to explain the magnitude.  That’s just math you do as a Democrat to make yourself feel better**.  
*Along with data being thrown around, there’s also some FANTASTIC conspiracy theories.  The two best I’ve read in comments sections so far are:  (Republican) “Polls clearly show almost twice as many people self identify as conservative vs liberal.  For Obama to win raises some serious questions.  Given that Silicone Valley is in California, and Californians are liberal, I think we should check how the voting machines were programmed.  I believe Mitt Romney won 60% to 40% and the computer programmers changed millions of votes.” (Democrat) “I understand that Romney does better among married women than single women.  Does anyone else think that’s because so many conservative men are abusive and probably force their wives to vote Republican? At my polling place I saw people enter the voting booth together, my guess is it was men making sure their wives voted the way they wanted”.  Actually, that first one is mostly just kind of tinfoil hat paranoid, the second one I found pretty disgusting.  Believing that many conservative men are capable of domestic violence is a kind of chilling way to view the world.

**All of the analysis here of course sidesteps the issue of how voter turnout would change if a new system were implemented.  We live in a country where (at last count) 42% of eligible voters didn’t vote.  Since we can only guess at what those voters would have done, we can’t know for sure how any new or different system would effect any of this.

Wednesday Brain Teaser – Driving down the highway

If the probability of observing a car in 30 minutes on a highway is 0.95, what is the probability of observing a car in 10 minutes (assuming constant default probability)?

 Answer will be posted in the comment section sometime on Friday.

Why you can’t always rely on the experts….

In research criticism, it is not an uncommon event for someone to suggest that if something was really wrong with the research, the peer review process would have picked it up.

This is an understandable sentiment, but clearly not true.  Peer review is a good system of course, and peer reviewed papers are much more likely to be reliable than those not subject to it.  However, to imply that no one not on the review committee can or should point out errors in papers is silly.
I bring this up because there’s a great article at Retraction Watch right now about a guy who was doing a little reading in the journal “Water Research” when he came across a paper that addressed one of his pet interests.  He was excited when he started reading it to find the authors seemed to share many of his opinions, and thought it was cool that they even used a lot of the same wording he would have……and then he realized the paper was his PhD thesis, with at least half of it copied word for word and attributed to another author.
Oops.
The paper ultimately got retracted, and it looks like the journal handled it well. However, it’s a great example of how peer review is not a fool proof system.  
The world always needs people who keep their eyes peeled for error.  

Weekend moment of zen 11-10-12

My father in law is reading Nate Silver’s book.  He said he was getting bogged down in the description of Bayesian statistics.

I sent him this XKCD comics to help explain it to him:

I’m not sure it helped him, but it certainly made me giggle.

Electoral map fun

I was psyched to see a friend post this link to electoral map fun on Facebook today.  Mark Newman, a professor at the University of Michigan has done a series on different representations of the electoral map.  You should look at the whole thing, but here’s a sample.

It’s always been interesting to me how misleading the regular red/blue electoral map is:

This always makes it look like the red should easily have outnumbered the blue.  The link shows different breakdowns to account for population by state:
He includes breakdowns by county, and some with shades of purple to represent splits.  Interesting stuff.

Signs signs everywhere signs

Well, it appears that either there was no systematic bias against Republicans in the polls, or Nov 6th just happened to be the wrong time of the month for the Republicans.

My mother was with me on election night, and she mentioned being quite surprised that New Hampshire wasn’t a closer race (52-46 for Obama), and even more surprised that Maggie Hassan beat Ovide Lamontagne by as wide a margin as she did (55-42).  Apparently the polls had showed a closer race, and many people she knew were convinced that bias meant the Republicans were actually leading.

I ended up driving back to New Hampshire with her, and I started to see where some of the problem had come up.  At least on the route I take, the roads were COVERED in Romney/Ryan and Lamontagne signs.  They outnumbered Obama/Biden and Hassan signs by quite a bit.

I was reflecting that I’ve heard that’s the point of signs….to give the impression that there is a majority for one candidate, and that you are going against all of your neighbors if you vote otherwise.  I wondered how many people saw those signs and had at least some of that influence there opinions of the polls.  There can’t be that many people voting for the other guy….I see hundreds of signs every morning that say otherwise.

This is yet another example of where proxy markers can fail.  Political signs along major routes reflect the dedication of a few, not necessarily the opinion of the many.

Election Eve and Polling Bias

Well it’s election eve and Nate Silver is still predicting an Obama win….with the caveat that it is possible that if Romney wins it will mean nearly all state polling might be biased against Republicans.

I don’t think he was saying this to be glib, or ruling the possibility out.  He actually goes quite in depth as to where he thinks error could occur.

To me though, this brought up an interesting point…..what do we do if it’s true?  If nearly all swing state polls are saying Obama, and they break Republican, we will have to do quite a bit of reworking of our polling system.  But that’s not what this post is about.

This post is actually about a rather entertaining comment I saw in a discussion about this.  Why haven’t there been more concentrated efforts to skew polls?  Essentially, if you live in a swing state and hate political advertising, why not start a movement to get people in your state to all answer the same candidate to obscure the fact that it was a battleground state and reduce the number of dollars spent there?

This sounds wacky, but how many people would really have to buy in to this to make a difference?

Let’s take my home state of New Hampshire.  As of January, there were about 770,000 registered voters.  As of today, polls show they are tied for Obama and Romney.  From what I can find, even the best polls only have a 10% response rate, and many are at 2 to 5%.  The UNH Granite State Poll is widely reported and only surveys 500 people.  It seems it would not take many people making an effort to answer their phones and state they are for a particular candidate to start to skew things.  Even if word got out, it would introduce enough uncertainty in to the polls to confuse the heck out of the political consultants and the media…and wouldn’t that at least be entertaining for the rest of us?

It’s not like this is unprecedented….it was tried with Sanjaya on American Idol and there were rumors about Bristol Palin on Dancing With the Stars.  Those efforts took far more people than it would take to skew the polls in a small state like New Hampshire.  With 58% of adults using Facebook to get political information, it shouldn’t be too hard to mobilize people….just like Twitter was used to start chants at the Boston Garden during the playoffs last year.

This is the danger of big data.  While data driven decision making is awesome, it’s also hackable.  I’m just curious what the back up plan is if polls don’t work any more.

Friday Fun links 11-2-12

A history of film, in one graph.

With election day coming, should you make sure you’re voting for the candidate whose positions you most agree with?  It’s a good quiz, with both yes/no options or more nuanced opinions…also lets you rank how important certain issues are.  I was happy to see that I’m in 97% agreement with my candidate of choice for president, and my Senate choice aligned with my beliefs too, though not as strongly.

Heard about this on Tim Ferriss’s blog….they’re billing it the “Manhattan Project to End Fad Diets“.  I’ll be following this.

A new study shows an increasing danger for men in our time….Tie Retraction Syndrome.

Science Ink….a compilation of geeky tattoos.

Data visualization…the beauty of simplicity

With the rise of creative data visualization, I’ve heard some commentary lately regarding the tendency of some of these creations to be high on the visuals but low on the data.  While intense data visuals may look amazing, they can give the impression that complex charts are the only effective ones.

While watching a TED talk this morning, I saw a chart that reminded me this is not so.  It was a talk by an ICU doctor, Peter Saul, and the charts showed the four ways people die.  Excuse the poor resolution, it’s a screenshot of the video:

If it’s tough to read, it essentially graphs function (of the patient as a whole) vs time.  The four ways he tracks are (clockwise from upper left):
  1. Sudden Death
  2. Terminal Illness
  3. Organ Failure
  4. Frailty
I thought these graphs were extremely effective at illustrating a (for most people) unfamiliar concept quickly.  
Definitely a “picture’s worth a thousand words” type of graph.