I don't know much about Civil War tokens, but over the years I've managed to pick up a few. This particular one always intrigued me. I was never sure what was under the 3. It may be nothing more than a bad morning after.
The die is chipping or spalling. If the die blank was not properly annealed before the punching was done therecan be chipping around the edges. These could have been removed by lapping the die after the punching was done but that apparently was not done.