I've had good results using a hairdryer on a low heat setting. All I would be concerned about is not heating up your component any more than it's normal operating temp.
I would suggest an air compressor and blowgun for only connections between wires.
If used on, say the controller, you may actually drive water into it! I would think the F-R switch would be fine to blow out as long as it has no circuit board attached to it.
I don't think you damaged anything, but I would put your " run - tow " switch ( if so equipped ) in tow and disconnect the battery pack while waiting on the drying process.