It sounds to me like wizard, sorc, or bard are not for you. If you can not keep haste on the melee you probably could not keep any buffs on the melee. Let's be honest here if you do not like casting one single buff on the melee then you do not like casting any. Casting buffs is a part of what wizards, sorcs, and bards do. If you do not enjoy casting buffs then just solo your wizard or play other classes.