Log in or Sign up
Coin Talk
Home
Forums
>
Coin Forums
>
Coin Chat
>
Serious Question (about grading)
>
Reply to Thread
Message:
<p>[QUOTE="Burton Strauss III, post: 2452987, member: 59677"]How high is up?</p><p><br /></p><p>Seriously, in order to measure an error rate you actually need to know the value of what you are measuring. And the accuracy of your measurement procedure.</p><p><br /></p><p>Since you rarely know the exact value, you typically make multiple measurements (each of which has an error interval), take the average and compute the statistical confidence interval around the average of those measurements. This allows you to report that the value is X +/- Y with a 95%CI.</p><p><br /></p><p>That is frequently (erroneously) interpreted as saying the actual value is between X-Y and X+Y 95% of the time (and the other 5% the true value is actually outside the X +/- Y interval. That’s actually bunk.</p><p><br /></p><p>/1/ This assumes a bell curve (normal distribution), which is not always true.</p><p>/2/ The error interval, Y is actually related to the measurement PROCEDURE and is established a priori (before the measurements are taken).</p><p><br /></p><p>To figure out the error interval, you need to understand your tools - for example, let's measure a meter stick in inches. I know the actual value, its 39.37".</p><p>If I make my measurements using an yard stick (36") with typical 1/16th marks, the correct answer is 39 5.92/16ths. But I have to admit that my measurement procedure sucks (I have to move the yard stick and that introduces uncertainty of at least a 1/16nd). And then there is the 1/16th accuracy of both the 36" and 3.37" measurement. So my error interval is 3/16ths (these add as that's the worst case).</p><p><br /></p><p>If I take 10 measurements I would <i>EXPECT </i>that they should average to just under 39 6/16ths (but +/- 3/16 as averaging doesn’t reduce the error).</p><p><br /></p><p>This looks horrible (so a meter is somewhere between 39 3/16 and 39 9/16? That's useless - which is why most people use statistics to define a 'better' looking result).</p><p><br /></p><p><br /></p><p>Now if I make my measurements using a 4 foot stick, I don't have the reposition error and I only have a single error related to the marked intervals on the stick.</p><p>With that 1/16" stick some measurements will be 39 5/16 and some 39 6/16. My error interval is +/- 1/16nd, so my result of 39 6/16 +/- 1/16" looks a lot better, like I did a better job. Don't fool yourself, it's just better, more appropriate tools.</p><p><br /></p><p>With good tools, e.g. an electronic multimeter, the error interval is actually part of the specifications, either +/- 0.0005 or +/- one count in the last digit, etc.</p><p><br /></p><p><br /></p><p>In situations where you don't know the actual value, sometimes you fall back on repeatability and the math also works the other way: if I know the exact value and have a number of measurements, I can calculate the error interval (but this is typically where people throw it into a stats program and calculate the statistical confidence interval and present THAT as the measurement accuracy).</p><p><br /></p><p><br /></p><p>So to bring this back to the coin grading realm, you would need to establish the actual grade of a particular coin and then conduct multiple measurements (submissions to a TPG). You would need to do this with enough different coins (series, date, strike, etc.) to be a truly representative sample and against several TPGs.</p><p><br /></p><p>This doesn’t happen because /a/ nobody agrees on the actual grade and /b/ not enough money to perform the tests and /c/ the more time that elapses in conducting the tests, the more likely something changes (e.g. new grader) that makes the results invalid anyway…</p><p><br /></p><p>At best for time & money reasons, people submit a coin to a couple TPGs and say “X” sucks because they were different from “Y” who’s answer I like.[/QUOTE]</p><p><br /></p>
[QUOTE="Burton Strauss III, post: 2452987, member: 59677"]How high is up? Seriously, in order to measure an error rate you actually need to know the value of what you are measuring. And the accuracy of your measurement procedure. Since you rarely know the exact value, you typically make multiple measurements (each of which has an error interval), take the average and compute the statistical confidence interval around the average of those measurements. This allows you to report that the value is X +/- Y with a 95%CI. That is frequently (erroneously) interpreted as saying the actual value is between X-Y and X+Y 95% of the time (and the other 5% the true value is actually outside the X +/- Y interval. That’s actually bunk. /1/ This assumes a bell curve (normal distribution), which is not always true. /2/ The error interval, Y is actually related to the measurement PROCEDURE and is established a priori (before the measurements are taken). To figure out the error interval, you need to understand your tools - for example, let's measure a meter stick in inches. I know the actual value, its 39.37". If I make my measurements using an yard stick (36") with typical 1/16th marks, the correct answer is 39 5.92/16ths. But I have to admit that my measurement procedure sucks (I have to move the yard stick and that introduces uncertainty of at least a 1/16nd). And then there is the 1/16th accuracy of both the 36" and 3.37" measurement. So my error interval is 3/16ths (these add as that's the worst case). If I take 10 measurements I would [I]EXPECT [/I]that they should average to just under 39 6/16ths (but +/- 3/16 as averaging doesn’t reduce the error). This looks horrible (so a meter is somewhere between 39 3/16 and 39 9/16? That's useless - which is why most people use statistics to define a 'better' looking result). Now if I make my measurements using a 4 foot stick, I don't have the reposition error and I only have a single error related to the marked intervals on the stick. With that 1/16" stick some measurements will be 39 5/16 and some 39 6/16. My error interval is +/- 1/16nd, so my result of 39 6/16 +/- 1/16" looks a lot better, like I did a better job. Don't fool yourself, it's just better, more appropriate tools. With good tools, e.g. an electronic multimeter, the error interval is actually part of the specifications, either +/- 0.0005 or +/- one count in the last digit, etc. In situations where you don't know the actual value, sometimes you fall back on repeatability and the math also works the other way: if I know the exact value and have a number of measurements, I can calculate the error interval (but this is typically where people throw it into a stats program and calculate the statistical confidence interval and present THAT as the measurement accuracy). So to bring this back to the coin grading realm, you would need to establish the actual grade of a particular coin and then conduct multiple measurements (submissions to a TPG). You would need to do this with enough different coins (series, date, strike, etc.) to be a truly representative sample and against several TPGs. This doesn’t happen because /a/ nobody agrees on the actual grade and /b/ not enough money to perform the tests and /c/ the more time that elapses in conducting the tests, the more likely something changes (e.g. new grader) that makes the results invalid anyway… At best for time & money reasons, people submit a coin to a couple TPGs and say “X” sucks because they were different from “Y” who’s answer I like.[/QUOTE]
Your name or email address:
Do you already have an account?
No, create an account now.
Yes, my password is:
Forgot your password?
Stay logged in
Coin Talk
Home
Forums
>
Coin Forums
>
Coin Chat
>
Serious Question (about grading)
>
Home
Home
Quick Links
Search Forums
Recent Activity
Recent Posts
Forums
Forums
Quick Links
Search Forums
Recent Posts
Competitions
Competitions
Quick Links
Competition Index
Rules, Terms & Conditions
Gallery
Gallery
Quick Links
Search Media
New Media
Showcase
Showcase
Quick Links
Search Items
Most Active Members
New Items
Directory
Directory
Quick Links
Directory Home
New Listings
Members
Members
Quick Links
Notable Members
Current Visitors
Recent Activity
New Profile Posts
Sponsors
Menu
Search
Search titles only
Posted by Member:
Separate names with a comma.
Newer Than:
Search this thread only
Search this forum only
Display results as threads
Useful Searches
Recent Posts
More...