Technical Clarification

I was feeling a bit ranty in my last post about the women/hormones study, but I decided it needs a slightly more academic treatment.  Despite CNN yanking the story, I managed to find the original study and read the whole thing.

A few points:

  1. All the participants were paid via Mechanical Turk for their participation.  This gave me pause.  Depending on how this was set up, I was curious how they verified that people didn’t give some of their answers just to qualify to get paid.  
  2. The study did not follow individual women and show them to be fluctuating.  The study compared groups of women at high and low fertility times and reported their differences.
  3. The measured political attitudes excluded all fiscal views (because those didn’t change much) and focused only on social views.  
  4. The single women assessed for political affiliation had a median income of $15000-25000/year, whereas the married women had incomes of $35000-$50000/year.  Interestingly, in the discussion section, this difference is considered relatively small and inconsequential.
  5. While the study (and articles) mention that they surveyed 275 women for the first experiment, they later clarify that they tossed out nearly half of them because they couldn’t reasonably determine where they were in their cycle.  The second study started at around 500 and got whittled down the 300.  This means the groups being compared were about 75 people each in the first study and 150 each in the second.  
  6. The groups were not controlled for anything.  Those income ranges are so big you could drive a truck through them, and nothing was said about what states people came from. 
  7. No woman under 44 was counted, nor were any of them asked if they planned on voting. 
Overall, I was less weirded out by this study when I saw the authors.  They are all pretty hard core evolutionary psych folks, and pretty much believe everything people do is hooked to mating opportunity (interesting, this includes religion.  Apparently women become religious to either stop themselves from cheating or to attempt to impose a social order on others that will keep their mates faithful).  Take a look at Kristina Durante’s publishing history and you’ll see why they never even looked at how any other variables might influence anything.  Truthfully, they saw a link where they had already decided there was a link.  
With sample sizes as small as they were from a very specific group (people seeking out paid work on the internet), a control for region or income would have been helpful.  Additionally, the group studied (18-44) is the least likely group to vote.  Even beyond their reproductive years, women still tend to vote Democrat…so there’s that.  I also thought it interesting that there was no control for historic voting behavior…if women who voted for Obama in 2008 were more likely to change their vote in conjunction with specific times of month, it might have been more interesting.  As is though, we have no idea if there’s a real shift in individuals or if it’s just the groups they picked (a interesting number of their p values did not reach the level of statistical significance, the results were reported in the article without this caveat).  

Data so bad even CNN took it down

After living in New Hampshire for my entire upbringing, moving to Massachusetts when I was 18 was a bit of a surprise.  Why you ask?  Because my goodness are election years more peaceful here.

For those readers who aren’t from New England, New Hampshire residents are some of the most harassed people in the nation when it comes to presidential elections.  Between the first in the nation primary and swing state status, the amount of effort people put in to trying to find out what New Hampshirites are going to do on election day is staggering.  Massachusetts on the other hand is reliably blue, so everyone pretty much leaves us alone (Exception: the Scott Brown/Elizabeth Warren face off is really harshing my mellow this year).

Anyway, as a woman who both strongly believes it’s her civic duty to vote and who puts a lot of thought in to her vote every 4 years, I was a bit surprised to see a story on CNN yesterday about how women voted with their hormones.  The link actually goes to Jezebel there because the “science” was so bad that CNN actually took the story down. 

Essentially, the research claimed that during “that time of the month” women felt sexier.  This led single women to want more social services (because they apparently were worried they wouldn’t be able to help but get pregnant with a random partner).  Married women on the other hand apparently overcompensated and wanted to vote Republican because they….I don’t know.  I really couldn’t follow the convoluted reasoning of how feeling sexy or not influenced your vote.

To note, this was an internet survey done by a marketing research person.  It also apparently found that women’s level of religiousness varied based on monthly cycle.

The sheer weirdness of saying political party and religious affiliation, two of the deepest and most profound beliefs people have, is based on a few fluctuating hormones (of course only in women….I mean, have you ever heard of testosterone influencing men?  I don’t think so) is just so reductionist it’s bizarre.

It also of course leaves out post menopausal women, women who are on hormone regulating birth control, and ignores better research that shows women in committed relationships are already more likely to be conservative.  Oh, and it totally leaves out anyone voting for a third party candidate.

I bring this up not just because it was a bad story and because it actually got taken down, but also because it’s part of a larger phenomena of journalists inflating the effect of small differences to write a better story.  I am really stunned how many times in the past week I’ve seen stories about “why Obama/Romney isn’t getting as much support as he should”.  The author then goes on to talk about some line of reasoning that supposedly explains why their candidate would be creaming the other guy if it weren’t for the influence of the small factor that they and only they are acknowledging.

News flash to the media:  most people not voting for your candidate are voting the way they are because they don’t agree with him, or your party, or because they like the other candidate or party better.  Stop belittling large portions of the population while trying to prove otherwise.

*Gets off soapbox*
Thank you for your time.