Log in or Sign up
Coin Talk
Home
Forums
>
Coin Forums
>
Coin Chat
>
Serious Question (about grading)
>
Reply to Thread
Message:
<p>[QUOTE="calcol, post: 2453013, member: 77639"]As numerous folks have pointed out, grading is subjective, so accuracy can't be measured. The only possibilities are statistical measures of consistency within services, among services, and with time. Statistical measures can be used because the results are expressed numerically (1 to 70) and sometimes with a secondary categorical classification (for example, BN, RB, RD). </p><p><br /></p><p>Good luck on getting data about variation among graders within a service. Curiously, back in the days of ANACS photo-certificates, the opinion of four graders for obverse and reverse were listed on the certificate. The closest we can do today is to send the same coins repeatedly to a service a number of times in a short span and measure the variation in grades. However, for all we'll know, the same grader may have graded it each time. So we couldn't know if we were measuring variation among graders or variation within a single grader. </p><p><br /></p><p>Comparison among services would be straightforward. Send the same group of coins to each service in turn and compare the results. All should be done within a short time span.</p><p><br /></p><p>Establishing variation over time can be done in several ways. The one way would be comparison with one time period with another; the first ten years of grading versus the last ten years of grading, for example. The other way is trend analysis, which evaluates whether there is a significant trend over a time span.</p><p><br /></p><p>There would have to be separate studies of each coin type and well-thought-out statistical plans. The major grading services have probably performed some of these studies, but aren't likely to release the results. They could hardly be called unbiased investigators in any case. Perhaps a collector or organization with sufficient resources may fund the studies.</p><p><br /></p><p>The results and conclusions have to be used correctly and cautiously. For a particular coin type, one service may grade higher than another on average, but variation has to be considered. Typically variation gets expressed as to whether the averages differ significantly at some probability level. Typically, this is 95% in most scientific studies. But, for a collector, knowing that there is a 51% probability that one service grades higher than another might be good enough.</p><p><br /></p><p>The results wouldn't necessarily provide a clear guide as to whether one service is better than another for a collector submitting a single coin. For example, suppose service A grades Morgan dollars significantly higher than service B, but the variation within service A is greater than service B. You have one dollar to send in. If you were sending 100 Morgans, service A would be the choice, but for your one dollar, service B, which is more consistent, might be the way to go.</p><p><br /></p><p>Finally, for many folks, market value is really important, and a statistical study of market valuation of grades of different services is completely different from one that looks only at grading variation.</p><p><br /></p><p>Cal[/QUOTE]</p><p><br /></p>
[QUOTE="calcol, post: 2453013, member: 77639"]As numerous folks have pointed out, grading is subjective, so accuracy can't be measured. The only possibilities are statistical measures of consistency within services, among services, and with time. Statistical measures can be used because the results are expressed numerically (1 to 70) and sometimes with a secondary categorical classification (for example, BN, RB, RD). Good luck on getting data about variation among graders within a service. Curiously, back in the days of ANACS photo-certificates, the opinion of four graders for obverse and reverse were listed on the certificate. The closest we can do today is to send the same coins repeatedly to a service a number of times in a short span and measure the variation in grades. However, for all we'll know, the same grader may have graded it each time. So we couldn't know if we were measuring variation among graders or variation within a single grader. Comparison among services would be straightforward. Send the same group of coins to each service in turn and compare the results. All should be done within a short time span. Establishing variation over time can be done in several ways. The one way would be comparison with one time period with another; the first ten years of grading versus the last ten years of grading, for example. The other way is trend analysis, which evaluates whether there is a significant trend over a time span. There would have to be separate studies of each coin type and well-thought-out statistical plans. The major grading services have probably performed some of these studies, but aren't likely to release the results. They could hardly be called unbiased investigators in any case. Perhaps a collector or organization with sufficient resources may fund the studies. The results and conclusions have to be used correctly and cautiously. For a particular coin type, one service may grade higher than another on average, but variation has to be considered. Typically variation gets expressed as to whether the averages differ significantly at some probability level. Typically, this is 95% in most scientific studies. But, for a collector, knowing that there is a 51% probability that one service grades higher than another might be good enough. The results wouldn't necessarily provide a clear guide as to whether one service is better than another for a collector submitting a single coin. For example, suppose service A grades Morgan dollars significantly higher than service B, but the variation within service A is greater than service B. You have one dollar to send in. If you were sending 100 Morgans, service A would be the choice, but for your one dollar, service B, which is more consistent, might be the way to go. Finally, for many folks, market value is really important, and a statistical study of market valuation of grades of different services is completely different from one that looks only at grading variation. Cal[/QUOTE]
Your name or email address:
Do you already have an account?
No, create an account now.
Yes, my password is:
Forgot your password?
Stay logged in
Coin Talk
Home
Forums
>
Coin Forums
>
Coin Chat
>
Serious Question (about grading)
>
Home
Home
Quick Links
Search Forums
Recent Activity
Recent Posts
Forums
Forums
Quick Links
Search Forums
Recent Posts
Competitions
Competitions
Quick Links
Competition Index
Rules, Terms & Conditions
Gallery
Gallery
Quick Links
Search Media
New Media
Showcase
Showcase
Quick Links
Search Items
Most Active Members
New Items
Directory
Directory
Quick Links
Directory Home
New Listings
Members
Members
Quick Links
Notable Members
Current Visitors
Recent Activity
New Profile Posts
Sponsors
Menu
Search
Search titles only
Posted by Member:
Separate names with a comma.
Newer Than:
Search this thread only
Search this forum only
Display results as threads
Useful Searches
Recent Posts
More...