It only works if you have the time to do so : see comment above about what 'rushing through a random dongeon' can be, following your left hand won't get you far in those cases.
On a side note, the pirate event used a bit of randomness already (following your left hand was a very bad idea there)