WINETASTER ON 12/18/98 WITH 9 JUDGES AND 9 WINES BASED ON RANKS, IDENT=N Copyright (c) 1995-98 Richard E. Quandt


FLIGHT 1: Number of Judges = 9 Number of Wines = 9
Identification of the Wine: The judges' overall ranking:
Wine A is Ch. de Marsannay 93 ........ 5th place Wine B is WG Thuengersheimer Johannisberg Kabinet 94 ........ 9th place Wine C is Knipser,Laumersch Kirschgarten Spaetlese 94 ........ 6th place Wine D is Perrot-Minot Chambolle Musigny 1er Cru 94 ........ 4th place Wine E is Chevillon, Nuit-St.Georges 94 ........ 7th place Wine F is Lavirotte,Santenay Clos des Mouches 94 ........ 8th place Wine G is Michelot,Nuit-St.Georges Les Poret 94 ........ 3rd place Wine H is Bichot,Les Echezeaux Grand Cru 94 ........ 1st place Wine I is Coli, Corton-Renardes Gran Cru 93 ........ 2nd place
The Judges's Rankings
Judge Wine -> A B C D E F G H I Andre 5. 9. 2. 6. 8. 7. 4. 3. 1. Amo 4. 8. 7. 6. 5. 9. 2. 1. 3. Heike 1. 9. 4. 5. 6. 7. 8. 3. 2. Kai 3. 9. 8. 2. 5. 4. 6. 1. 7. Karl 7. 9. 3. 4. 8. 6. 5. 2. 1. Michael 6. 8. 7. 3. 5. 9. 2. 1. 4. Pit 6. 7. 5. 2. 4. 3. 1. 9. 8. Roland 6. 9. 4. 5. 8. 7. 2. 3. 1. Wolfgang 3. 8. 5. 2. 9. 7. 4. 1. 6.
Table of Votes Against Wine -> A B C D E F G H I
Group Ranking -> 5 9 6 4 7 8 3 1 2 Votes Against -> 41 76 45 35 58 59 34 24 33
( 9 is the best possible, 81 is the worst)

Here is a measure of the correlation in the preferences of the judges which ranges between 1.0 (perfect correlation) and 0.0 (no correlation):
W = 0.4420

The probability that random chance could be responsible for this correlation is quite small, 0.0001. Most analysts would say that unless this probability is less than 0.1, the judges' preferences are not strongly related. We now analyze how each taster's preferences are correlated with the group preference. A correlation of 1.0 means that the taster's preferences are a perfect predictor of the group's preferences. A 0.0 means no correlation, while a -1.0 means that the taster has the reverse ranking of the group. This is measured by the correlation R.
Correlation Between the Ranks of Each Person With the Average Ranking of Others
Name of Person Correlation R Michael 0.8117 Roland 0.7615 Wolfgang 0.7333 Amo 0.7000 Karl 0.6833 Andre 0.6000 Heike 0.4100 Kai 0.3667 Pit -0.2427

The wines were preferred by the judges in the following order. When the preferences of the judges are strong enough to permit meaningful differentiation among the wines, they are separated by -------------------- and are judged to be significantly different.
1. ........ 1st place Wine H is Bichot,Les Echezeaux Grand Cru 94 --------------------------------------------------- 2. ........ 2nd place Wine I is Coli, Corton-Renardes Gran Cru 93 3. ........ 3rd place Wine G is Michelot,Nuit-St.Georges Les Poret 94 4. ........ 4th place Wine D is Perrot-Minot Chambolle Musigny 1er 94 5. ........ 5th place Wine A is Ch. de Marsannay 93 6. ........ 6th place Wine C is Knipser,Laumersch Kirschgarten Spaetlese 94 7. ........ 7th place Wine E is Chevillon, Nuit-St.Georges 94 --------------------------------------------------- 8. ........ 8th place Wine F is Lavirotte,Santenay Clos des Mouches 94 9. ........ 9th place Wine B is WG Thuengersheimer Johannisberg Kabinet 94 We now test whether the ranksums AS A WHOLE provide a significant ordering. The Friedman Chi-square value is 31.8222. The probability that this could happen by chance is 0.0001 We now undertake a more detailed examination of the pair-wise rank correla- tions that exist between pairs of judges. First, we present a table in which you can find the correlation for any pair of judges, by finding one of the names in the left hand margin and the other name on top of a column. A second table arranges these correlations in descending order and marks which is significantly positive significantly negative, or not significant. This may allow you to find clusters of judges whose rankings were particularly similar or particularly dissimilar. Pairwise Rank Correlations Correlations must exceed in absolute value 0.70 for significance at the 0.05 level and must exceed 0.60 for significance at the 0.1 level Andre Amo Heike Andre 1.000 0.567 0.650 Amo 0.567 1.000 0.450 Heike 0.650 0.450 1.000 Kai 0.017 0.367 0.400 Karl 0.900 0.483 0.550 Michael 0.450 0.883 0.267 Pit -0.300 -0.267 -0.500 Roland 0.917 0.700 0.450 Wolfgang 0.500 0.550 0.500 Kai Karl Michael Andre 0.017 0.900 0.450 Amo 0.367 0.483 0.883 Heike 0.400 0.550 0.267 Kai 1.000 0.200 0.483 Karl 0.200 1.000 0.533 Michael 0.483 0.533 1.000 Pit 0.050 -0.267 -0.033 Roland 0.100 0.883 0.667 Wolfgang 0.667 0.550 0.650 Pit Roland Wolfgang Andre -0.300 0.917 0.500 Amo -0.267 0.700 0.550 Heike -0.500 0.450 0.500 Kai 0.050 0.100 0.667 Karl -0.267 0.883 0.550 Michael -0.033 0.667 0.650 Pit 1.000 -0.100 -0.067 Roland -0.100 1.000 0.550 Wolfgang -0.067 0.550 1.000 Pairwise correlations in descending order 0.917 Andre and Roland Significantly positive 0.900 Andre and Karl Significantly positive 0.883 Amo and Michael Significantly positive 0.883 Karl and Roland Significantly positive 0.700 Amo and Roland Significantly positive 0.667 Michael and Roland Significantly positive 0.667 Kai and Wolfgang Significantly positive 0.650 Andre and Heike Significantly positive 0.650 Michael and Wolfgang Significantly positive 0.567 Andre and Amo Not significant 0.550 Roland and Wolfgang Not significant 0.550 Karl and Wolfgang Not significant 0.550 Heike and Karl Not significant 0.550 Amo and Wolfgang Not significant 0.533 Karl and Michael Not significant 0.500 Andre and Wolfgang Not significant 0.500 Heike and Wolfgang Not significant 0.483 Amo and Karl Not significant 0.483 Kai and Michael Not significant 0.450 Andre and Michael Not significant 0.450 Heike and Roland Not significant 0.450 Amo and Heike Not significant 0.400 Heike and Kai Not significant 0.367 Amo and Kai Not significant 0.267 Heike and Michael Not significant 0.200 Kai and Karl Not significant 0.100 Kai and Roland Not significant 0.050 Kai and Pit Not significant 0.017 Andre and Kai Not significant -0.033 Michael and Pit Not significant -0.067 Pit and Wolfgang Not significant -0.100 Pit and Roland Not significant -0.267 Karl and Pit Not significant -0.267 Amo and Pit Not significant -0.300 Andre and Pit Not significant -0.500 Heike and Pit Not significant
Return to previous page