If there are divots that can’t be leveled-out, it’s refret time. Unless it’s somebody else’s divot on the 1st fret from playing the g# on an E maj chord and you never play in E maj.If the current fret condition diminishes your playing experience, you owe it to yourself and the instrument to have it professionally re-fretted. But keep in mind, not all professional luthiers are adept or willing to refret a maple neck. Ask the luthier for examples of his work and/or referrals by previous clients.
BUT, don't underestimate the improvements you can get from a simple level/crown/polish. Even if divots are left behind, often playability can still be much improved.
Collectors of high-end vintage instruments are often not players, and can afford to ignore worn-out frets or neck resets on acoustics because their buyers usually won't care. They are not necessarily musicians or players, but deal in collectibility.