They can actually be quite fun. I always hit "Decline" the first time, but if they do it again I hit "Accept".
The last time I got a double-blind-invite, though, the party leader was a dud. It's more fun when the group heads into the quest without double-checking where their "healer" is