When you have finished a project and the finish feels rough, use a piece of brown paper bag as you would sand paper.  It will remove the roughness, smooth things out and not remove any varnish or paint.  Works for me!

Shop Keeper - Dixie