Yes, it likely is an irrational thing, just like halflings... cuz of this one guy who used to play Kender ALL THE TIME, and did so horribly... Anyways... I could always just role as a WF Wizard, cuz, that's like good offense and self healing... If I can stomach playing a WF that is.
Sorc might be better though...
How much UMD is necessary for a drow sorc to use healing scrolls and wands?