I wouldn't use xylene just because it leaves trace residue on the surface of whatever you're using it on. 100% acetone will fully evaporate leaving the surface unspoiled and free of residue which would cause issues in a few months/ years down the road.
Agree, but sometimes acetone will not dissolve substances that xylene will. Whatever you use, you should make sure the surface is free from all contamination.