I know... I factor those in. Sold my last one for a small profit after all fees. Not much, but enough to move on to an upgrade and do it again.
Fair enough. I know of a collector, just a newspaper man, who was improving his collection just like you. He was really knowledgeable by experience and visited all the small shops and fairs. It took thirty years, but then he had The Best Of The Best.
I doubt I get anywhere near the best of the best, but I try to find coins I like. If someone likes it more than me, and is willing to let me make a small profit on it, then I use that as my opportunity to find a nicer one.