With the Hugo voting continuing I thought it was important to consider more carefully what my voting strategy should be, Specifically in what circumstances should I vote for No Award above a nominated work?
El Sandifer has recommended voting No Award on everything and there is much merit in her argument. However, it would only be effective if most non-Puppies did the same and it is not a viable strategy in the long term. Specific puppy-free voting guides have been produced e.g. by Deidre Saoirse Moen.
However a few things have made me reconsider automatically voting No Award for Puppy nominees:
Continue reading “Hugo voting strategy: High-bar no award”
Part 1, 2, 3, 4, 5, 6, 7 and 8
Dave Freer’s argument does not show what he thinks it shows. The flaws in the argument are:
- His description of a left wing category of authors is probably faulty as it relies on key issues that enjoy more popular support in the US public than some conservatives realize.
- Consequently his estimate of 15%, while accurate for genuinely “solid liberal” people, is too low when considering Hugo eligible authors. The likelihoods he needed to model may have an upper range beyond 50%.
- The model he uses in his analogy has some flaws but is not unreasonable and the flaws don’t severely undermine his argument
- Using his model an expected proportion of 45% for what he calls “red” nominees would produce results that are not highly improbable and which match his analysis of past Hugo nominees for best novel.
- His choice of years to analyze may be distorted by avoiding 2004 and by including WorldCon years held in countries other than the US, but his analysis would still hold if his assumption of 15% for reds was correct.
- There is some plausible evidence of statistical bias against very conservative authors but overall the evidence of bias is slim
- Dave’s argument even if it was sound does not address multiple sources of bias – some of which may be beyond WorldCon (or Puppy) influence
In truth there is no good reason why we should expect the Hugo awards to reflect the political spectrum of the USA. Neither authors, reader or fans are a random sample of the US population. Ideology in the United States has geographic, socioeconomic, ethnic and cultural dimensions. While none of those are deterministic, there is no reason to assume that group defined by common cultural interests would coincidentally be a decent random sample of the US population when it comes to ideology.
The shortest, simplest objection to Dave’s argument is this: any person knowledgeable about statistics would not use science-fiction/fantasy readers as a way of generating a representative cross-section of US politics. Yet the core premise of his argument relies on that being the case – otherwise in what sense is their a discrepancy?
Worse yet the 2015 Year of the Puppy has revealed a very narrow set of nominees, with conservative works being represented by a small number of authors.
In part 7 I found some evidence of bias – specifically a plausible bias against Hugo eligible authors who might fit into the Pew typology (covered in previous posts) of “steadfast conservatives“. Dave Freer’s argument had looked at this from the other direction – considering whether there was a bias in favor of “red” authors.
Overall I don’t think the numbers do suggest an active political bias in the Hugo voting for people who are particularly left wing. However, there may be a bias against people on the right of the spectrum. [NOTE: I shan’t say ‘far right” because that is a whole other argument. The Pew typology I’ve used is looking at mainstream beliefs on mainstream issues. There are fringe views beyond these that will behave quite differently]
This takes me back to Part 1 and Part 2 of this discussion. If you recall I’d discussed the fact that discovering a statistical bias is not the same as discovering some active discrimination, prejudice, vote rigging or nefarious acts against a given group. The bias can come from many directions. Here are a few: Continue reading “On petunias and whales: part 8”
In part 6 I wandered off topic to nit-pick on issues that do not add much to the overall argument.
So far I think I have shown that we can’t, based on Dave Freer’s red/white/black classification of Hugo nominees conclude political bias towards the left in the Hugos. the central feature of that argument has been simply that he the author’s aren’t as left as he might think they are – but the case isn’t closed yet and I’ve made challengable assumptions and broad estimates.
In the next two posts I’m going to do a couple of things. Firstly the checks for bias aren’t quite finished and secondly I need to return to an earlier point – the potential sources and characteristics of bias in the Hugos.
Note that all I’ve shown so far is that we can’t really reject the “unbiased” hypothesis. That is not same as actually showing there isn’t bias – it just shows that using the methods we employed (Dave Freer’s methodology) I couldn’t detect it.
What about the steadfast conservatives?
Dave’s account of past Hugo results was intended to show two things that pertain to bias and I’ve only looked at one of them “too many reds”. The other thing we have not considered is the flip-side “not enough blacks” i.e. not enough outspoken conservatives. Continue reading “On petunias and whales: part 7”
Part 5 was the number crunching post. I promised pedantry and I delivered 🙂
This post is about some nit-picks, caveats and other stuff that are worth pointing out partly because it is important to get the maths right as best we can and partly because they don’t matter that much in terms of the broad sweep of Dave Freer’s argument. Put another way: all models are simplifications and imperfect representations. When critiquing an argument based on a model, figuring out what is a deep flaw and what is a minor departure from reality is important.
Dave uses for his analogy a person pulling colored balls from the bag. When he calculates the probability of several of the same color in each row he uses the same probability each time e.g. ” ½ x ½ x ½ = 1/8″. This is not quite correct. Continue reading “On petunias and whales: part 6”
In part 4 I started trying to get a better handle on Dave’s 15% estimate. I explained why category he thinks of “left wing” maybe much larger than he imagines when considering authors as a population.
In this post I’ll try and look at how Dave Freer then models the actual results from various Hugos and what results we might have expected.
Dave starts with 2005 – unfortunately that breaks the model straight away. I assume he picked 2005 to avoid Dan Simmons’s nomination for Ilium in 2004. In fact 2005 is an excellent year to consider bias because it was a year in which the best novel nominations show an indisputable bias! Continue reading “On petunias and whales: part 5”
In a bit of a marathon, Part 3 looked at some of the political markers raised by Dave Freer post and looked at those markers compared with survey data in the US. I also discussed why caution had to be applied when thinking about authors as reflecting the US population as a whole. The short version is: US SF/F authors are not a random sample of the US population.
Dave listed a range of issue and his choices were apt in the sense that they do show marked difference between the 15% of Americans the Pew typology calls “Solid Liberal” and the 12% of Americans the Pew typology calls “Steadfast Conservatives”. What should be clear on the data, though is that only on some issues is there a smooth left-right transition. Indeed the only issue on which there was a neat match was gun rights. On same-sex marriage and affirmative action positive “left wing” views on the issue could be found in significant numbers to the right of the US center. Continue reading “On petunias and whales: part 4”
Read Part 1 and Part 2
I’ve outlined some of the issues and looked at one core issues with Dave’s argument. To move on I’ll need to quote some more of Dave’s post:
What is the chance that a novel/short/novella etc will come from someone who is politically outspoken, who loudly champions causes dear to the Left wing (for example, Gay marriage, affirmative action, abortion, militant feminism, pro-Socialism) or Right wing (for example Anti-abortion, the right to concealed carry, equality of opportunity not outcome, pro-death penalty)? Defining the open left/right thing is difficult, because what do you call someone who admits he is communist or a republican but pointedly avoids pontificating on it? That’s why I left proportions at a generous 0.15.
To Dave’s credit, he tells us a lot about his underlying assumptions. This is key to considering what his argument tells us. There are two issues here:
- How best to characterize those positions so we can get some good estimates from general population data?
- In what ways, relevant to Dave’s argument, are authors different from the general population?
I’ll deal with point 2 first as I reject the tyranny of mere numbers. Continue reading “On petunias and whales: part 3”
Read Part 1 first. A discussion of “A very surprised looking sperm whale and a bowl of petunias” by Dave Freer.
Previously I’d listed the various ways Dave’s argument could go wrong and I claimed (without support) that it had gone wrong in each of them.
Firstly I’ll pick on the easy one. If we assume Dave had shown statistically that the Hugo results show bias (he hadn’t but let’s go with it) then what he had not done is shown the source of the bias. Wikipedia has a page entitled “List of Jewish Nobel laureates“. The page notes that Jewish people have won a disproportionate number of awards when compared to the world’s population. Even accepting a European bias in the awards, the numbers are disproportionate compared with the historical size of the Jewish population in Europe. It takes only a moment’s reflection (assuming you aren’t a raving anti-Semite) to see that this statistical “bias” is not a bias in the judges of the Nobel prize or the mechanism by which the prize has been awarded. Indeed given the levels of antisemitism in 20th century Europe, we know that if anything Jewish people would have faced at least some degree of institutionalized prejudice when being considered for the award. Continue reading “On petunias and whales: part 2”
Several posts in and I’ve finally got to the blog comment that was getting way, way to long to be a blog comment.
The story so far: The Hugo Awards have been dominated by Sad/Rabid Puppies who have claimed left-wing cliques of ruining the awards. A rag tag team and/or an unruly mob and/or revolutionary cadres (delete according to preferred narrative) of anti-puppies have reacted in various ways and Puppies have reacted back etc. My post is dealing with a relatively early pre-2015 nomination argument from puppy supporter Dave Freer. Dave Freer is an author based in Australia who posts on the Mad Genius Club blog among other places. The Mad genius Club is one of three main pro-puppy blogs (the other two being Brad Torgersen and Monster Hunter Nation )
Dave takes an approach I like – which isn’t to say his argument holds water (it doesn’t) but it is an argument that attempts something other than vague accusations. Continue reading “On petunias and whales: Part 1”