Talk to Matt about getting rid of those spots. Without the spots, from that picture I think you have a good shot. @LostDutchman
I would be concerned that attempting to remove the spots would alter the color of the reverse. You'd hate to loose the matched yellowish color on both sides. The other concern would be - even if you remove the black spot, now you'll have a negative spot (an untoned spot in an otherwise toned coin). This is preferrable to having a spot that can cause damage long term, but it is something to consider.
My guess is that the graders were just being punitive for the spots on the reverse. On coins like this, you tend to see more variation than for pieces without spotting as the degree of how detracting they are (and hence the reduction in grade) can vary tremendously among graders. I am still suggesting the NCS or PCGS Conservation route. It is a nice coin, that could look even better without the spots. I have seen pieces that I did not believe could be conserved successfully conserved by NCS. Whether you submit to PCGS or NCS (or either), you could always solicit opinions from NCS on the NGC Forums under the "Ask NGC" forum. They could give you some ideas of how they have handled similar coins in the past, although they will be reserved in what they will tell you based on the photos alone.