As someone who likes to use hirelings, summon, and charm, I actually think its pretty nifty to have a past life that improves these abilities. IMHO. FWIW. YMMV.