What concentration is needed end game to use scrolls/cast spells in combat?

I am trying to figure out if I should put concentration into my build or just not worry about it as a melee character.