Here's a handy new feature that should come out.
It's called the PVP enhancement.
You basically have to just ignore that person to prevent him from attacking you. However, you also can't attack him.
If you want to attack him again, you just un-ignore him and wait 24H for the effect to wear off.