Half the time in quests like the shroud where I need no instruction, I just hit the mute key. It seems to always be the one guy with the loudest mic that talks the most.
That said, I did enjoy some of the A&O conversations before their raids disappeared off the face of the earth. Keep it interesting and a bit dirty and I may avoid muting.