I had trouble interacting with objects in the beta. When I press E (interact) I would swing away or do nothing at all with something selected in the focus orb. Two examples of this: The key in the pool in Giants Vault and the Lever to release the captives at the end of the Demon Web "bridge quest"

In both cases I ended up using the focus orb "use" feature to pick up the key and operate the lever.