You really don't have to worry about it unless you are immediately putting flower in there that is receptive to pollen. When 'exposed' the pollen only lives a couple weeks, if that.
wiping down with water will be effective. Pollen 'germinates'. Once it germinates after being exposed to water, it can no longer pollinate a plant. You can google to verify this is not a figment of my imagination nor some vage 'water makes it inactive' statement...
Wipe it down any which way and you'll be safe.