Dip an old toothbrush or cotton swab in vinegar or lemon juice so it's soaking wet, and dab it on over the baking soda. Let it fizz for a couple of minutes, then scrub the corrosion away and rinse with clean, water-soaked cotton swabs. Let the compartment dry completely before you put new batteries in.