The problem with that was the auto level up system of destinies. It would be easily possible for a leader to make a group that conforms to an elite bravery bonus only to lose this bonus when the optional exp pushes character x to the next destiny level.
Had they made a system similar to leveling where you can only advance by talking to the fatespinner then t would have been a great system for regulating exp penalties.