WINETASTER ON 02/01/10 WITH 7 JUDGES AND 8 WINES BASED ON RANKS, IDENT=N Copyright (c) 1995-2010 Richard E. Quandt, V. 1.65


FLIGHT 1: Number of Judges = 7 Number of Wines = 8
Identification of the Wine: The judges' overall ranking:
Wine A is Twomey Merlot 2002 ........ 6th place Wine B is Freemark Abbey 1997 ........ 8th place Wine C is Silver Oak Napa 2003 ........ 3rd place Wine D is Opus One 2002 ........ 1st place Wine E is Phelps Insignia 2005 ........ 4th place Wine F is Silver Oak Alexander Valley 2003 ........ 2nd place Wine G is Penfolds Grange 1997 ........ 5th place Wine H is Dominus 2006 ........ 7th place
The Judges's Rankings
Judge Wine -> A B C D E F G H John 2. 8. 5. 3. 1. 4. 7. 6. Ed 7. 8. 4. 6. 3. 1. 2. 5. Mike 8. 6. 3. 4. 5. 7. 2. 1. Burt 5. 6. 2. 1. 4. 7. 3. 8. Roman 6. 8. 1. 3. 7. 2. 4. 5. Paul 2. 6. 8. 1. 7. 3. 5. 4. Dick 5. 2. 6. 4. 3. 1. 8. 7.
Table of Votes Against Wine -> A B C D E F G H
Group Ranking -> 6 8 3 1 4 2 5 7 Votes Against -> 35 44 29 22 30 25 31 36
( 7 is the best possible, 56 is the worst)

Here is a measure of the correlation in the preferences of the judges which ranges between 1.0 (perfect correlation) and 0.0 (no correlation):
W = 0.1603

The probability that random chance could be responsible for this correlation is rather large, 0.3454. Most analysts would say that unless this probability is less than 0.1, the judges' preferences are not strongly related. We now analyze how each taster's preferences are correlated with the group preference. A correlation of 1.0 means that the taster's preferences are a perfect predictor of the group's preferences. A 0.0 means no correlation, while a -1.0 means that the taster has the reverse ranking of the group. This is measured by the correlation R.
Correlation Between the Ranks of Each Person With the Average Ranking of Others
Name of Person Correlation R Roman 0.4671 Ed 0.3810 Burt 0.2515 John 0.2395 Paul -0.0120 Dick -0.2635 Mike -0.2755

The wines were preferred by the judges in the following order. When the preferences of the judges are strong enough to permit meaningful differentiation among the wines, they are separated by -------------------- and are judged to be significantly different.
1. ........ 1st place Wine D is Opus One 2002 2. ........ 2nd place Wine F is Silver Oak Alexander Vall. 2003 3. ........ 3rd place Wine C is Silver Oak Napa 2003 4. ........ 4th place Wine E is Phelps Insignia 2005 5. ........ 5th place Wine G is Penfolds Grange 1997 6. ........ 6th place Wine A is Twomey Merlot 2002 7. ........ 7th place Wine H is Dominus 2006 --------------------------------------------------- 8. ........ 8th place Wine B is Freemark Abbey 1997 We now test whether the ranksums AS A WHOLE provide a significant ordering. The Friedman Chi-square value is 7.8571. The probability that this could happen by chance is 0.3454 We now undertake a more detailed examination of the pair-wise rank correla- tions that exist between pairs of judges. First, we present a table in which you can find the correlation for any pair of judges, by finding one of the names in the left hand margin and the other name on top of a column. A second table arranges these correlations in descending order and marks which is significantly positive significantly negative, or not significant. This may allow you to find clusters of judges whose rankings were particularly similar or particularly dissimilar. Pairwise Rank Correlations Correlations must exceed in absolute value 0.74 for significance at the 0.05 level and must exceed 0.64 for significance at the 0.1 level John Ed Mike John 1.000 0.119 -0.429 Ed 0.119 1.000 0.214 Mike -0.429 0.214 1.000 Burt 0.238 0.000 0.167 Roman 0.024 0.524 0.262 Paul 0.262 -0.190 -0.286 Dick 0.262 -0.048 -0.738 Burt Roman Paul John 0.238 0.024 0.262 Ed 0.000 0.524 -0.190 Mike 0.167 0.262 -0.286 Burt 1.000 0.357 -0.071 Roman 0.357 1.000 0.095 Paul -0.071 0.095 1.000 Dick -0.238 -0.190 0.095 Dick John 0.262 Ed -0.048 Mike -0.738 Burt -0.238 Roman -0.190 Paul 0.095 Dick 1.000 Pairwise correlations in descending order 0.524 Ed and Roman Not significant 0.357 Burt and Roman Not significant 0.262 Mike and Roman Not significant 0.262 John and Dick Not significant 0.262 John and Paul Not significant 0.238 John and Burt Not significant 0.214 Ed and Mike Not significant 0.167 Mike and Burt Not significant 0.119 John and Ed Not significant 0.095 Paul and Dick Not significant 0.095 Roman and Paul Not significant 0.024 John and Roman Not significant 0.000 Ed and Burt Not significant -0.048 Ed and Dick Not significant -0.071 Burt and Paul Not significant -0.190 Ed and Paul Not significant -0.190 Roman and Dick Not significant -0.238 Burt and Dick Not significant -0.286 Mike and Paul Not significant -0.429 John and Mike Not significant -0.738 Mike and Dick Significantly negative




COMMENT: At our last tasting of cabernets, including French and California wines, Opus One had the lowest votes against. It is interesting that in this tasting with different California cabernets and including an Australian Grange Hermitage, Opus One also won the tasting, although by not as big a margin. Interestingly also, the Grange was difficult for the group to identify as distinct from the California cabernets and ultimately ranked in the middle of the pack. One taster says that he hates California cabernets; wine B is the quintessence of that. But these wines were superb, particularly the Silver Oak Napa.
Return to previous page