While watching coverage of the 2008 Olympic games this summer, I have noticed a trend in the reporting of medal counts. When the reporters speak about individuals who are competing in the Olympics, a lot of weight is given to the fact that they are earning gold medals and not just silver or bronze.
Take the Michael Phelps story, for example.
On Sunday morning, Phelps swam the butterfly leg on the 4×100-meter U.S. medley relay that held off Australia in a world record-setting victory, giving Phelps his eighth gold medal of these Games and his 14th overĀ all.
He had previously come close to the record, but as far as the count of Olympic medals go, this would not have been quite as impressive had he not won all 8 gold medals. Don’t get me wrong. I am not playing down his accomplishment. Rather I am setting a basis for my argument that follows.
Below is a table of the medal count for the Olympics1 as of this afternoon.
Medal Count
| Rank | Country | Total | |||
| 1 | United States | 22 | 24 | 26 | 72 |
| 2 | China | 39 | 14 | 14 | 67 |
| 3 | Russia | 8 | 13 | 15 | 36 |
| 4 | Australia | 11 | 10 | 12 | 33 |
| 5 | France | 4 | 11 | 13 | 28 |
| 6 | Britain | 12 | 7 | 8 | 27 |
| 7 | Germany | 9 | 7 | 7 | 23 |
| 8 | South Korea | 8 | 9 | 6 | 23 |
| 9 | Japan | 8 | 5 | 7 | 20 |
| 10 | Italy | 6 | 6 | 6 | 18 |
This table is the one that is shown daily with updates. One of the things that jumped out at me when I first saw it reported was that the country in second place (China) had more gold medals than the country in first (United States). This bothered me because it goes against my logic of ranking.
If one athlete wins three bronze medals and another wins one gold medal, the athlete with the bronze medals is not placed on the top platform for any of the award ceremonies. Three bronzes indicate third best in the world in each of those events. The athlete with only one gold medal is the best athlete in the world in that one event.
Gymnastics and Diving Scores
Both gymnastics and diving take a similar approach in their scoring systems. Each routine or dive is given a difficulty rating which serves as an adjuster to the scores awarded by the judges. Gymnastics adopted this more recently, but it was deemed a necessary change as competitors who performed less difficult routines could often come away winning gold medals.
Putting a difficulty rating on the routines gives a starting score advantage to those athletes who try more challenging feats. Rightfully so. This is the Olympics, after all, and we’re supposed to be seeing the best the world has to offer, not the easiest routine that will score a perfect 102.
So the divers and the gymnasts step up their game. Shawn Johnson from the United States was expected to win a gold medal in the individual floor exercise at this Olympic games. She performed an exquisite routine and a technically difficult one as well. However, in the end, she had to accept the silver medal.
On the individual level, these medal metals are meaningful. Gold is better than silver is better than bronze is better than the rest. Even so, good sportsmanship pervades the games, and athletes are proud to even compete in the Olympics, let alone win a medal. This is as it should be. When we look at the countries overall and the medals they have earned, we are given another picture, though.
Weight. What?
I am an American. I would love to see the United States rank first in the Olympic games in many events. On the other hand, I would like to see a fair ranking of the achievements. I do not think that total medal count alone is indicative of a country’s overall performance. Looking at just the United States and China, you can see that China has won a commanding number of gold medals, and is not terribly far behind in earning the other medals.
What I propose is that a weight be assigned to the medals for a more accurate portrayal of which countries have the best athletes in the world. For illustrative purposes, let’s just assign a simple arbitrary weight of 3, 2, and 1, respectively to gold, silver, and bronze. Doing this paints a very different picture of the rankings. Take a look at the table below.
Weighted Medal Count
| Prev | Rank | Country | Total | |||
| 2 | 1 | China | 117 | 28 | 14 | 159 |
| 1 | 2 | United States | 66 | 48 | 26 | 140 |
| 4 | 3 | Australia | 33 | 20 | 12 | 65 |
| 3 | 4 | Russia | 24 | 26 | 15 | 65 |
| 6 | 5 | Britain | 36 | 14 | 8 | 58 |
| 7 | 6 | Germany | 27 | 14 | 7 | 48 |
| 8 | 7 | South Korea | 24 | 18 | 6 | 48 |
| 5 | 8 | France | 12 | 22 | 13 | 47 |
| 9 | 9 | Japan | 24 | 10 | 7 | 41 |
| 10 | 10 | Italy | 18 | 12 | 6 | 36 |
I have left the previous ranks — the “Prev” column — for comparison. Notice, there is quite a bit of difference when the weights are applied. France drops from 5th place down to a 8th. China moves up to first displacing the United States. While Australia and Russia are tied in this scenario, Australia moves to third place by virtue of having won more overall gold medals.
I believe this is a more accurate representation of how the countries are performing in the Olympics. Remember that this chart is only the top ten. Some countries just below the top ten could possibly move up as well. Using this method of weighting, gold and silver medals would have more meaning on a national level again.
I believe this, or a similar method, is what we should use when ranking countries in the Olympic games. I am not a statistician, and what little I know of statistics is probably grossly misused here, so I welcome any comments/criticisms/feedback.
Is quality over quantity a better metric in this case?
Update (08/19/2008)
I am not the only one who believes that weighting is the more accurate measure. Wesley N. Colley keeps a regularly updating medal count that includes raw count and a weighting methodology, ranking nations by weighted score.
The weighting factors are as follows.
- Gold — 6
- Silver — 3
- Bronze — 2
Wesley provides an explanation for this weighting selection.
Gold medals are weighted by a factor of 6, silver medals by a factor of 3, bronze medals by a factor of 2.
The reasoning is simple. One person has won a gold medal. Two people have won at least silver, and three people have won at least bronze. The weightings simply reflect these factors.
Note that this weighting system is consistent with many golf tournament payouts, in which the 2nd place finisher receives half the prize money of the champion and the 3rd place finisher receives a third as much as the champion.
See, I knew someone out there had a better methodology, but damned if I wasn’t close.
Footnotes
- via New York Times ↩
- Not that I am even 1/10 capable of doing any of the routines, so all of them are impressive to me. ↩


{ 4 comments }
Ian, I agree heavily with your suggestion to weight the overall standings, just the same way gymnastics and diving have done. Being a former gymnast and diver, I would get very frustrated when I attempted harder routines or dives and still lost while someone who could do a simple dive won the gold.
This just goes to show that the media will move data around to make it what they want so they have a story. I bet in China they are all talking up a storm that they have won more gold medals than the USA. Besides, who determines the rankings? I bet since the USA is in first place, it is an American standard if you will.
I like your suggestion.
Watching the Olympics, I can’t help but think how COMPLICATED the entire system is.
I completely agree with you. It should be a point value system that is assigned to each medal that determines which country is in first.
Nice work here.
@Sal: Exactly. The media of any given nation will always have a propensity to bias the coverage in some way or another. I think NBC is glaringly guilty of this during the Olympic games this year.
@Vered: Some of the scoring systems are rather complicated, I agree. I’m not so sure that I like the new gymnastics scoring because I have found myself caring less about the scores since without the pre-announced difficulty rating, it is hard to have a rough idea of what the athlete will get just by watching. Not to mention the need to do some quick mental math each time.
@Jonathan Mead: Thank you for the compliment. As I said, I am no statistician, so I am sure someone could come up with something a bit more elegant and less biased.
Something I apparently missed was the controversy over the scoring of some vaults.
(the entire article can be read at http://sportsillustrated.cnn.com/2008/olympics/2008/writers/em_swift/08/18/judging.controversy/index.html)
Some analysts have argued that the rule that prohibits a judge from a country from scoring their own athletes is also a rule that may have caused the vault scoring deviance. The analysts further suggest that judges with less experience will not deduct proper penalties and may lack the experience to even see the errors in a routine in the first place.
Overall, it looks like the gymnastics scoring system is going to get another overhaul or at least some finer tuning as time goes on and definitely before the next Olympic games.
Comments on this entry are closed.