Friday, September 7, 2012
Refining a tournament: Painting Scores
No matter what organizers will claim, every paint judge has a bias on what makes an army look good. Some judges abhor the use of airbrushes and have given lower scores if they know the army is airbrushed. Other judges put more weight on conversions and will score an army higher on that. This is based on personal knowledge, and talking to judges who scored GTs and local tournaments. For some players those bias and preferences can change the outcome of an award or overall standing.
Time for a painting score game-change
One possible solution is to adopt a policy that was used in the London 2012 Olympics. Any army that is fully painted recieves 10 points. An army that is based recieves another 5 points and finally if the models are fully WYSIWYG then add in 5 points. This gives 20 points to the player and is easily attainable for simply painting and basing your army and making it fully represented. This also cuts down the need to go through 5-10 min of reviewing a scoring rhubric for judges and allows speed of judging.
Next, have 4-5 judges score painting on a scale of 1-10 on how they think the army looks in their own opinion. Once they are finished scoring, have the top score and the bottom score discarded. This leaves the middle scores and they can then be combined. The plus side to this idea is that you can discard the scores of judges who are generous with their painting scores or judges who may harbor some prejudice towards a painting style.
Another idea can be utilized if there are less than 4 judges and have the scores averaged. If there are some decimal points after the averaging, just round up to the nearest whole number. This may require a bit of math on the organizing side.
This solution does not eliminate subjectivity but helps migate an excessive high or low score due to that subjectivity and with painting scores it is in they eye of the beholder. Note that this idea works best in a GT environment and does not translate well in the RTT environment. I will be writing about my ideas for an RTT environment in future installments.