When you finish the Baudry Cartaman low level quests in the harbor, the icon on the map of the Wayward Lobster blinks to inform the player to return there to speak with him even though he was moved sometime ago to be standing outside closer to the water.