Well, one could design it intelligently so that you can turn off that alert if you don't like it, so the party leader would get nothing but automatic "your vote rejected" messages.
Does Battlefield have a "party leader" position?
They could also simply have an activity time-out for quests--if you go 10 minutes without any in-game activity, you auto-recall.